Jul 23 00:17:59.350235 ip-10-0-141-176 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 23 00:17:59.350242 ip-10-0-141-176 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 23 00:17:59.350252 ip-10-0-141-176 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 23 00:17:59.350565 ip-10-0-141-176 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 23 00:18:09.413410 ip-10-0-141-176 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 23 00:18:09.413425 ip-10-0-141-176 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 4e3319400e3b4cbfad67b38b8643ead9 --
Jul 23 00:20:10.161136 ip-10-0-141-176 systemd[1]: Starting Kubernetes Kubelet...
Jul 23 00:20:10.560964 ip-10-0-141-176 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 00:20:10.560964 ip-10-0-141-176 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 23 00:20:10.560964 ip-10-0-141-176 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 00:20:10.560964 ip-10-0-141-176 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 23 00:20:10.560964 ip-10-0-141-176 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 00:20:10.561944 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.561858    2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 23 00:20:10.569341 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569309    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 00:20:10.569341 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569332    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 00:20:10.569341 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569336    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 00:20:10.569341 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569339    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 00:20:10.569341 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569342    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 00:20:10.569341 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569345    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 00:20:10.569341 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569348    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 00:20:10.569341 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569351    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 00:20:10.569341 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569354    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 00:20:10.569646 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569357    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 00:20:10.569646 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569359    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 00:20:10.569646 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569362    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 00:20:10.569646 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569365    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 00:20:10.569646 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569367    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 00:20:10.569646 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569370    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 00:20:10.569646 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569373    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 00:20:10.569646 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569375    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 00:20:10.569646 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569378    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 00:20:10.569646 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569380    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 00:20:10.569646 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569383    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 00:20:10.569646 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569385    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 00:20:10.569646 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569388    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 00:20:10.569646 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569392    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 00:20:10.569646 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569396    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 00:20:10.569646 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569399    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 00:20:10.569646 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569402    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 00:20:10.569646 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569404    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 00:20:10.569646 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569407    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 00:20:10.570131 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569409    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 00:20:10.570131 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569412    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 00:20:10.570131 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569414    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 00:20:10.570131 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569417    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 00:20:10.570131 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569419    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 00:20:10.570131 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569422    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 00:20:10.570131 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569425    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 00:20:10.570131 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569427    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 00:20:10.570131 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569430    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 00:20:10.570131 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569432    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 00:20:10.570131 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569435    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 00:20:10.570131 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569438    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 00:20:10.570131 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569440    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 00:20:10.570131 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569442    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 00:20:10.570131 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569446    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 00:20:10.570131 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569449    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 00:20:10.570131 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569451    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 00:20:10.570131 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569454    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 00:20:10.570131 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569457    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 00:20:10.570131 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569461    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 00:20:10.570626 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569464    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 00:20:10.570626 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569467    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 00:20:10.570626 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569470    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 00:20:10.570626 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569472    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 00:20:10.570626 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569475    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 00:20:10.570626 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569478    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 00:20:10.570626 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569480    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 00:20:10.570626 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569483    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 00:20:10.570626 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569485    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 00:20:10.570626 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569488    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 00:20:10.570626 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569490    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 00:20:10.570626 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569492    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 00:20:10.570626 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569495    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 00:20:10.570626 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569497    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 00:20:10.570626 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569499    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 00:20:10.570626 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569502    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 00:20:10.570626 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569504    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 00:20:10.570626 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569507    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 00:20:10.570626 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569509    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 00:20:10.570626 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569512    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 00:20:10.571136 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569514    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 00:20:10.571136 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569517    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 00:20:10.571136 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569519    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 00:20:10.571136 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569521    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 00:20:10.571136 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569524    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 00:20:10.571136 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569527    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 00:20:10.571136 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569530    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 00:20:10.571136 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569532    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 00:20:10.571136 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569535    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 00:20:10.571136 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569537    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 00:20:10.571136 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569540    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 00:20:10.571136 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569542    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 00:20:10.571136 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569545    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 00:20:10.571136 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569547    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 00:20:10.571136 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569550    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 00:20:10.571136 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569553    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 00:20:10.571136 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569558    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 00:20:10.571136 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569562    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 00:20:10.571136 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569565    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 00:20:10.571591 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569568    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 00:20:10.571591 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569570    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 00:20:10.571591 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569573    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 00:20:10.571591 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569576    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 00:20:10.571591 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569578    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 00:20:10.571591 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569581    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 00:20:10.571591 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569583    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 00:20:10.571591 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569586    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 00:20:10.571591 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569588    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 00:20:10.571591 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569590    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 00:20:10.571591 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569593    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 00:20:10.571591 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.569596    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 00:20:10.571591 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570341    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 00:20:10.571591 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570349    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 00:20:10.571591 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570351    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 00:20:10.571591 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570354    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 00:20:10.571591 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570356    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 00:20:10.571591 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570359    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 00:20:10.571591 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570362    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 00:20:10.571591 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570365    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 00:20:10.572124 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570368    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 00:20:10.572124 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570370    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 00:20:10.572124 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570373    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 00:20:10.572124 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570376    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 00:20:10.572124 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570378    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 00:20:10.572124 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570381    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 00:20:10.572124 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570385    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 00:20:10.572124 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570387    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 00:20:10.572124 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570390    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 00:20:10.572124 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570393    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 00:20:10.572124 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570396    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 00:20:10.572124 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570398    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 00:20:10.572124 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570400    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 00:20:10.572124 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570403    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 00:20:10.572124 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570405    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 00:20:10.572124 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570408    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 00:20:10.572124 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570410    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 00:20:10.572124 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570413    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 00:20:10.572124 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570415    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 00:20:10.572124 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570418    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 00:20:10.572621 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570420    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 00:20:10.572621 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570423    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 00:20:10.572621 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570425    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 00:20:10.572621 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570427    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 00:20:10.572621 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570430    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 00:20:10.572621 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570432    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 00:20:10.572621 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570435    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 00:20:10.572621 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570437    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 00:20:10.572621 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570440    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 00:20:10.572621 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570443    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 00:20:10.572621 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570446    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 00:20:10.572621 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570450    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 00:20:10.572621 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570453    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 00:20:10.572621 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570455    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 00:20:10.572621 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570457    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 00:20:10.572621 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570460    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 00:20:10.572621 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570462    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 00:20:10.572621 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570464    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 00:20:10.572621 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570467    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 00:20:10.572621 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570469    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 00:20:10.573135 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570472    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 00:20:10.573135 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570476    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 00:20:10.573135 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570480    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 00:20:10.573135 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570483    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 00:20:10.573135 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570486    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 00:20:10.573135 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570489    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 00:20:10.573135 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570491    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 00:20:10.573135 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570494    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 00:20:10.573135 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570497    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 00:20:10.573135 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570500    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 00:20:10.573135 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570502    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 00:20:10.573135 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570505    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 00:20:10.573135 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570508    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 00:20:10.573135 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570512    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 00:20:10.573135 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570515    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 00:20:10.573135 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570517    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 00:20:10.573135 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570520    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 00:20:10.573135 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570522    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 00:20:10.573135 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570525    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 00:20:10.573135 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570527    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 00:20:10.573625 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570530    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 00:20:10.573625 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570533    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 00:20:10.573625 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570536    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 00:20:10.573625 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570538    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 00:20:10.573625 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570540    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 00:20:10.573625 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570544    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 00:20:10.573625 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570547    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 00:20:10.573625 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570549    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 00:20:10.573625 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570551    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 00:20:10.573625 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570554    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 00:20:10.573625 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570556    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 00:20:10.573625 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570559    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 00:20:10.573625 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570561    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 00:20:10.573625 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570564    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 00:20:10.573625 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570566    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 00:20:10.573625 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570570    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 00:20:10.573625 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570573    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 00:20:10.573625 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570575    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 00:20:10.573625 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570577    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 00:20:10.573625 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570580    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 00:20:10.574125 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570583    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 00:20:10.574125 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570585    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 00:20:10.574125 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570589    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 00:20:10.574125 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570593    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 00:20:10.574125 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570595    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 00:20:10.574125 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570598    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 00:20:10.574125 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570601    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 00:20:10.574125 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570603    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 00:20:10.574125 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570606    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 00:20:10.574125 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570608    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 00:20:10.574125 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.570611    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 00:20:10.574125 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571042    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 00:20:10.574125 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571048    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 00:20:10.574125 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571050    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 00:20:10.574125 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571053    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 00:20:10.574125 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571056    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 00:20:10.574125 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571058    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 00:20:10.574125 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571061    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 00:20:10.574125 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571064    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 00:20:10.574671 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571066    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 00:20:10.574671 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571069    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 00:20:10.574671 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571071    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 00:20:10.574671 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571074    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 00:20:10.574671 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571077    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 00:20:10.574671 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571079    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 00:20:10.574671 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571082    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 00:20:10.574671 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571084    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 00:20:10.574671 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571092    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 00:20:10.574671 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571095    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 00:20:10.574671 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571097    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 00:20:10.574671 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571100    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 00:20:10.574671 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571104    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 00:20:10.574671 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571109    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 00:20:10.574671 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571112    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 00:20:10.574671 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571115    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 00:20:10.574671 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571117    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 00:20:10.574671 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571120    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 00:20:10.574671 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571122    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 00:20:10.575158 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571125    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 00:20:10.575158 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571127    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 00:20:10.575158 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571130    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 00:20:10.575158 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571132    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 00:20:10.575158 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571135    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 00:20:10.575158 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571137    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 00:20:10.575158 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571140    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 00:20:10.575158 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571143    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 00:20:10.575158 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571146    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 00:20:10.575158 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571148    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 00:20:10.575158 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571152    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 00:20:10.575158 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571155    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 00:20:10.575158 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571157    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 00:20:10.575158 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571160    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 00:20:10.575158 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571162    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 00:20:10.575158 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571165    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 00:20:10.575158 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571167    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 00:20:10.575158 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571169    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 00:20:10.575158 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571172    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 00:20:10.575158 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571174    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 00:20:10.575633 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571177    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 00:20:10.575633 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571179    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 00:20:10.575633 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571182    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 00:20:10.575633 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571184    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 00:20:10.575633 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571187    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 00:20:10.575633 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571190    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 00:20:10.575633 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571194    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 00:20:10.575633 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571197    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 00:20:10.575633 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571201    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 00:20:10.575633 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571206    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 00:20:10.575633 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571208    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 00:20:10.575633 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571211    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 00:20:10.575633 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571214    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 00:20:10.575633 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571216    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 00:20:10.575633 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571219    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 00:20:10.575633 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571222    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 00:20:10.575633 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571225    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 00:20:10.575633 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571227    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 00:20:10.575633 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571229    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 00:20:10.576147 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571232    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 00:20:10.576147 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571235    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 00:20:10.576147 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571237    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 00:20:10.576147 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571239    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 00:20:10.576147 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571242    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 00:20:10.576147 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571244    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 00:20:10.576147 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571247    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 00:20:10.576147 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571249    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 00:20:10.576147 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571251    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 00:20:10.576147 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571254    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 00:20:10.576147 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571256    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 00:20:10.576147 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571259    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 00:20:10.576147 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571261    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 00:20:10.576147 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571263    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 00:20:10.576147 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571266    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 00:20:10.576147 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571268    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 00:20:10.576147 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571271    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 00:20:10.576147 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571274    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 00:20:10.576147 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571276    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 00:20:10.576147 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571279    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 00:20:10.576654 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571281    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 00:20:10.576654 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571284    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 00:20:10.576654 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571286    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 00:20:10.576654 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571289    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 00:20:10.576654 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571291    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 00:20:10.576654 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571293    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 00:20:10.576654 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571295    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 00:20:10.576654 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571298    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 00:20:10.576654 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571300    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 00:20:10.576654 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571302    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 00:20:10.576654 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571305    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 00:20:10.576654 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571307    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 00:20:10.576654 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.571310    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 00:20:10.576654 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571414    2575 flags.go:64] FLAG: --address="0.0.0.0"
Jul 23 00:20:10.576654 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571424    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 23 00:20:10.576654 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571443    2575 flags.go:64] FLAG: --anonymous-auth="true"
Jul 23 00:20:10.576654 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571450    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 23 00:20:10.576654 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571456    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 23 00:20:10.576654 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571461    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 23 00:20:10.576654 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571467    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 23 00:20:10.576654 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571474    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 23 00:20:10.577181 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571477    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 23 00:20:10.577181 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571480    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 23 00:20:10.577181 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571484    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 23 00:20:10.577181 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571487    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 23 00:20:10.577181 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571490    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 23 00:20:10.577181 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571493    2575 flags.go:64] FLAG: --cgroup-root=""
Jul 23 00:20:10.577181 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571495    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 23 00:20:10.577181 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571498    2575 flags.go:64] FLAG: --client-ca-file=""
Jul 23 00:20:10.577181 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571502    2575 flags.go:64] FLAG: --cloud-provider="external"
Jul 23 00:20:10.577181 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571505    2575 flags.go:64] FLAG: --cluster-dns="[]"
Jul 23 00:20:10.577181 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571510    2575 flags.go:64] FLAG: --cluster-domain=""
Jul 23 00:20:10.577181 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571512    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 23 00:20:10.577181 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571515    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 23 00:20:10.577181 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571519    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 23 00:20:10.577181 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571522    2575 flags.go:64] FLAG: --container-log-max-files="5"
Jul 23 00:20:10.577181 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571526    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 23 00:20:10.577181 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571529    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 23 00:20:10.577181 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571532    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 23 00:20:10.577181 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571535    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 23 00:20:10.577181 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571540    2575 flags.go:64] FLAG: --contention-profiling="false"
Jul 23 00:20:10.577181 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571543    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 23 00:20:10.577181 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571546    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 23 00:20:10.577181 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571549    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 23 00:20:10.577181 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571552    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 23 00:20:10.577752 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571556    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 23 00:20:10.577752 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571559    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 23 00:20:10.577752 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571562    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 23 00:20:10.577752 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571565    2575 flags.go:64] FLAG: --enable-load-reader="false"
Jul 23 00:20:10.577752 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571568    2575 flags.go:64] FLAG: --enable-server="true"
Jul 23 00:20:10.577752 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571571    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 23 00:20:10.577752 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571575    2575 flags.go:64] FLAG: --event-burst="100"
Jul 23 00:20:10.577752 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571580    2575 flags.go:64] FLAG: --event-qps="50"
Jul 23 00:20:10.577752 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571582    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 23 00:20:10.577752 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571585    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 23 00:20:10.577752 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571588    2575 flags.go:64] FLAG: --eviction-hard=""
Jul 23 00:20:10.577752 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571592    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 23 00:20:10.577752 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571595    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 23 00:20:10.577752 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571598    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 23 00:20:10.577752 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571601    2575 flags.go:64] FLAG: --eviction-soft=""
Jul 23 00:20:10.577752 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571605    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 23 00:20:10.577752 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571608    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 23 00:20:10.577752 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571617    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 23 00:20:10.577752 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571620    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 23 00:20:10.577752 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571623    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 23 00:20:10.577752 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571626    2575 flags.go:64] FLAG: --fail-swap-on="true"
Jul 23 00:20:10.577752 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571628    2575 flags.go:64] FLAG: --feature-gates=""
Jul 23 00:20:10.577752 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571632    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 23 00:20:10.577752 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571635    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 23 00:20:10.577752 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571638    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 23 00:20:10.578397 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571641    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 23 00:20:10.578397 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571644    2575 flags.go:64] FLAG: --healthz-port="10248"
Jul 23 00:20:10.578397 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571650    2575 flags.go:64] FLAG: --help="false"
Jul 23 00:20:10.578397 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571653    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-141-176.ec2.internal"
Jul 23 00:20:10.578397 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571656    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 23 00:20:10.578397 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571659    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 23 00:20:10.578397 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571662    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 23 00:20:10.578397 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571665    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 23 00:20:10.578397 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571668    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 23 00:20:10.578397 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571671    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 23 00:20:10.578397 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571674    2575 flags.go:64] FLAG: --image-service-endpoint=""
Jul 23 00:20:10.578397 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571676    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 23 00:20:10.578397 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571679    2575 flags.go:64] FLAG: --kube-api-burst="100"
Jul 23 00:20:10.578397 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571682    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 23 00:20:10.578397 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571686    2575 flags.go:64] FLAG: --kube-api-qps="50"
Jul 23 00:20:10.578397 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571689    2575 flags.go:64] FLAG: --kube-reserved=""
Jul 23 00:20:10.578397 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571692    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 23 00:20:10.578397 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571695    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 23 00:20:10.578397 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571698    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 23 00:20:10.578397 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571701    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 23 00:20:10.578397 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571703    2575 flags.go:64] FLAG: --lock-file=""
Jul 23 00:20:10.578397 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571706    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 23 00:20:10.578397 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571709    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 23 00:20:10.578397 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571712    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 23 00:20:10.579001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571717    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 23 00:20:10.579001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571720    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 23 00:20:10.579001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571723    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 23 00:20:10.579001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571726    2575 flags.go:64] FLAG: --logging-format="text"
Jul 23 00:20:10.579001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571728    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 23 00:20:10.579001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571732    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 23 00:20:10.579001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571734    2575 flags.go:64] FLAG: --manifest-url=""
Jul 23 00:20:10.579001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571737    2575 flags.go:64] FLAG: --manifest-url-header=""
Jul 23 00:20:10.579001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571741    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 23 00:20:10.579001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571744    2575 flags.go:64] FLAG: --max-open-files="1000000"
Jul 23 00:20:10.579001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571751    2575 flags.go:64] FLAG: --max-pods="110"
Jul 23 00:20:10.579001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571753    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 23 00:20:10.579001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571756    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 23 00:20:10.579001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571759    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 23 00:20:10.579001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571762    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 23 00:20:10.579001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571765    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 23 00:20:10.579001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571768    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 23 00:20:10.579001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571771    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 23 00:20:10.579001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571779    2575 flags.go:64] FLAG: --node-status-max-images="50"
Jul 23 00:20:10.579001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571782    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 23 00:20:10.579001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571785    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 23 00:20:10.579001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571787    2575 flags.go:64] FLAG: --pod-cidr=""
Jul 23 00:20:10.579001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571791    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 23 00:20:10.579550 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571798    2575 flags.go:64] FLAG: --pod-manifest-path=""
Jul 23 00:20:10.579550 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571801    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 23 00:20:10.579550 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571804    2575 flags.go:64] FLAG: --pods-per-core="0"
Jul 23 00:20:10.579550 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571806    2575 flags.go:64] FLAG: --port="10250"
Jul 23 00:20:10.579550 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571809    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 23 00:20:10.579550 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571827    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e404726d8bfe5cb3"
Jul 23 00:20:10.579550 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571832    2575 flags.go:64] FLAG: --qos-reserved=""
Jul 23 00:20:10.579550 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571834    2575 flags.go:64] FLAG: --read-only-port="10255"
Jul 23 00:20:10.579550 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571837    2575 flags.go:64] FLAG: --register-node="true"
Jul 23 00:20:10.579550 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571840    2575 flags.go:64] FLAG: --register-with-taints=""
Jul 23 00:20:10.579550 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571844    2575 flags.go:64] FLAG: --registry-burst="10"
Jul 23 00:20:10.579550 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571848    2575 flags.go:64] FLAG: --registry-qps="5"
Jul 23 00:20:10.579550 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571851    2575 flags.go:64] FLAG: --reserved-cpus=""
Jul 23 00:20:10.579550 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571855    2575 flags.go:64] FLAG: --reserved-memory=""
Jul 23 00:20:10.579550 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571858    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 23 00:20:10.579550 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571861    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 23 00:20:10.579550 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571864    2575 flags.go:64] FLAG: --rotate-certificates="false"
Jul 23 00:20:10.579550 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571867    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 23 00:20:10.579550 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571870    2575 flags.go:64] FLAG: --runonce="false"
Jul 23 00:20:10.579550 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571873    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 23 00:20:10.579550 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571877    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 23 00:20:10.579550 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571880    2575 flags.go:64] FLAG: --seccomp-default="false"
Jul 23 00:20:10.579550 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571883    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 23 00:20:10.579550 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571886    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 23 00:20:10.579550 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571888    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 23 00:20:10.579550 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571891    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 23 00:20:10.580237 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571894    2575 flags.go:64] FLAG: --storage-driver-password="root"
Jul 23 00:20:10.580237 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571897    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 23 00:20:10.580237 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571900    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 23 00:20:10.580237 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571903    2575 flags.go:64] FLAG: --storage-driver-user="root"
Jul 23 00:20:10.580237 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571906    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 23 00:20:10.580237 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571910    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 23 00:20:10.580237 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571913    2575 flags.go:64] FLAG: --system-cgroups=""
Jul 23 00:20:10.580237 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571916    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 23 00:20:10.580237 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571921    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 23 00:20:10.580237 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571924    2575 flags.go:64] FLAG: --tls-cert-file=""
Jul 23 00:20:10.580237 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571926    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 23 00:20:10.580237 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571934    2575 flags.go:64] FLAG: --tls-min-version=""
Jul 23 00:20:10.580237 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571937    2575 flags.go:64] FLAG: --tls-private-key-file=""
Jul 23 00:20:10.580237 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571939    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 23 00:20:10.580237 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571942    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 23 00:20:10.580237 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571945    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 23 00:20:10.580237 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571948    2575 flags.go:64] FLAG: --v="2"
Jul 23 00:20:10.580237 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571954    2575 flags.go:64] FLAG: --version="false"
Jul 23 00:20:10.580237 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571958    2575 flags.go:64] FLAG: --vmodule=""
Jul 23 00:20:10.580237 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571962    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 23 00:20:10.580237 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.571965    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 23 00:20:10.580237 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572096    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 00:20:10.580237 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572100    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 00:20:10.580237 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572103    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 00:20:10.580868 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572106    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 00:20:10.580868 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572109    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 00:20:10.580868 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572114    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 00:20:10.580868 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572117    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 00:20:10.580868 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572119    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 00:20:10.580868 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572122    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 00:20:10.580868 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572125    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 00:20:10.580868 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572128    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 00:20:10.580868 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572131    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 00:20:10.580868 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572134    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 00:20:10.580868 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572137    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 00:20:10.580868 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572139    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 00:20:10.580868 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572142    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 00:20:10.580868 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572146    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 00:20:10.580868 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572149    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 00:20:10.580868 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572152    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 00:20:10.580868 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572154    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 00:20:10.580868 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572157    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 00:20:10.580868 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572159    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 00:20:10.580868 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572162    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 00:20:10.581368 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572164    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 00:20:10.581368 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572167    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 00:20:10.581368 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572169    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 00:20:10.581368 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572172    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 00:20:10.581368 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572174    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 00:20:10.581368 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572178    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 00:20:10.581368 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572182    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 00:20:10.581368 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572186    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 00:20:10.581368 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572190    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 00:20:10.581368 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572194    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 00:20:10.581368 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572197    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 00:20:10.581368 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572200    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 00:20:10.581368 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572202    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 00:20:10.581368 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572205    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 00:20:10.581368 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572209    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 00:20:10.581368 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572212    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 00:20:10.581368 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572214    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 00:20:10.581368 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572217    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 00:20:10.581368 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572219    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 00:20:10.581830 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572222    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 00:20:10.581830 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572224    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 00:20:10.581830 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572227    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 00:20:10.581830 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572230    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 00:20:10.581830 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572232    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 00:20:10.581830 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572235    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 00:20:10.581830 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572239    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 00:20:10.581830 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572242    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 00:20:10.581830 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572244    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 00:20:10.581830 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572247    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 00:20:10.581830 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572249    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 00:20:10.581830 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572252    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 00:20:10.581830 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572255    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 00:20:10.581830 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572257    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 00:20:10.581830 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572259    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 00:20:10.581830 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572262    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 00:20:10.581830 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572264    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 00:20:10.581830 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572267    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 00:20:10.581830 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572270    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 00:20:10.581830 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572272    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 00:20:10.582325 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572274    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 00:20:10.582325 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572278    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 00:20:10.582325 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572280    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 00:20:10.582325 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572283    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 00:20:10.582325 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572287    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 00:20:10.582325 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572290    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 00:20:10.582325 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572293    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 00:20:10.582325 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572297    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 00:20:10.582325 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572300    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 00:20:10.582325 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572303    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 00:20:10.582325 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572306    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 00:20:10.582325 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572309    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 00:20:10.582325 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572312    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 00:20:10.582325 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572314    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 00:20:10.582325 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572317    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 00:20:10.582325 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572320    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 00:20:10.582325 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572323    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 00:20:10.582325 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572325    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 00:20:10.582325 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572329    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 00:20:10.582779 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572332    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 00:20:10.582779 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572335    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 00:20:10.582779 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572337    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 00:20:10.582779 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572340    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 00:20:10.582779 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572343    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 00:20:10.582779 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572345    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 00:20:10.582779 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572348    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 00:20:10.582779 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572350    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 00:20:10.582779 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572353    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 00:20:10.582779 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572355    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 00:20:10.582779 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572358    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 00:20:10.582779 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572360    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 00:20:10.582779 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572363    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 00:20:10.582779 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572365    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 00:20:10.582779 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572368    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 00:20:10.582779 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572371    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 00:20:10.582779 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572374    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 00:20:10.582779 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.572376    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 00:20:10.583221 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.572912    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 00:20:10.583221 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.579877    2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 23 00:20:10.583221 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.579899    2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 23 00:20:10.583221 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.580692    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 23 00:20:10.583221 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.580700    2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 23 00:20:10.583221 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580761    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 00:20:10.583221 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580766    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 00:20:10.583221 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580769    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 00:20:10.583221 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580773    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 00:20:10.583221 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580775    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 00:20:10.583221 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580779    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 00:20:10.583221 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580781    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 00:20:10.583221 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580784    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 00:20:10.583221 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580787    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 00:20:10.583221 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580789    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 00:20:10.583593 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580792    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 00:20:10.583593 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580794    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 00:20:10.583593 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580799    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 00:20:10.583593 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580802    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 00:20:10.583593 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580805    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 00:20:10.583593 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580808    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 00:20:10.583593 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580811    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 00:20:10.583593 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580827    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 00:20:10.583593 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580829    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 00:20:10.583593 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580832    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 00:20:10.583593 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580834    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 00:20:10.583593 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580837    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 00:20:10.583593 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580839    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 00:20:10.583593 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580842    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 00:20:10.583593 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580844    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 00:20:10.583593 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580847    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 00:20:10.583593 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580850    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 00:20:10.583593 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580852    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 00:20:10.583593 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580855    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 00:20:10.584077 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580859    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 00:20:10.584077 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580863    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 00:20:10.584077 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580865    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 00:20:10.584077 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580868    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 00:20:10.584077 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580871    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 00:20:10.584077 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580873    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 00:20:10.584077 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580876    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 00:20:10.584077 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580879    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 00:20:10.584077 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580882    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 00:20:10.584077 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580884    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 00:20:10.584077 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580887    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 00:20:10.584077 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580889    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 00:20:10.584077 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580892    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 00:20:10.584077 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580894    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 00:20:10.584077 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580897    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 00:20:10.584077 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580899    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 00:20:10.584077 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580902    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 00:20:10.584077 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580906    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 00:20:10.584077 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580910    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 00:20:10.584077 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580913    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 00:20:10.584561 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580915    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 00:20:10.584561 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580918    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 00:20:10.584561 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580921    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 00:20:10.584561 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580923    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 00:20:10.584561 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580926    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 00:20:10.584561 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580930    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 00:20:10.584561 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580934    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 00:20:10.584561 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580937    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 00:20:10.584561 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580939    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 00:20:10.584561 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580942    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 00:20:10.584561 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580944    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 00:20:10.584561 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580947    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 00:20:10.584561 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580950    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 00:20:10.584561 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580954    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 00:20:10.584561 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580956    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 00:20:10.584561 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580959    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 00:20:10.584561 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580961    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 00:20:10.584561 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580964    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 00:20:10.584561 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580966    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 00:20:10.585070 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580969    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 00:20:10.585070 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580971    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 00:20:10.585070 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580974    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 00:20:10.585070 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580976    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 00:20:10.585070 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580979    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 00:20:10.585070 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580981    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 00:20:10.585070 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580984    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 00:20:10.585070 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580986    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 00:20:10.585070 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580989    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 00:20:10.585070 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580991    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 00:20:10.585070 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580994    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 00:20:10.585070 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580997    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 00:20:10.585070 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.580999    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 00:20:10.585070 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581002    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 00:20:10.585070 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581004    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 00:20:10.585070 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581006    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 00:20:10.585070 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581009    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 00:20:10.585070 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581011    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 00:20:10.585070 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581014    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 00:20:10.585070 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581016    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 00:20:10.585605 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581018    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 00:20:10.585605 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581021    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 00:20:10.585605 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581023    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 00:20:10.585605 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581025    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 00:20:10.585605 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581028    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 00:20:10.585605 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581031    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 00:20:10.585605 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581034    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 00:20:10.585605 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581037    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 00:20:10.585605 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581039    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 00:20:10.585605 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581042    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 00:20:10.585605 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581045    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 00:20:10.585605 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.581050    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 00:20:10.585605 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581165    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 00:20:10.585605 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581170    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 00:20:10.585605 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581173    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 00:20:10.586159 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581176    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 00:20:10.586159 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581178    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 00:20:10.586159 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581181    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 00:20:10.586159 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581183    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 00:20:10.586159 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581185    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 00:20:10.586159 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581188    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 00:20:10.586159 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581190    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 00:20:10.586159 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581193    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 00:20:10.586159 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581196    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 00:20:10.586159 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581198    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 00:20:10.586159 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581200    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 00:20:10.586159 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581203    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 00:20:10.586159 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581205    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 00:20:10.586159 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581208    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 00:20:10.586159 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581210    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 00:20:10.586159 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581213    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 00:20:10.586159 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581215    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 00:20:10.586159 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581219    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 00:20:10.586159 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581222    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 00:20:10.586159 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581225    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 00:20:10.586982 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581227    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 00:20:10.586982 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581230    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 00:20:10.586982 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581233    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 00:20:10.586982 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581235    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 00:20:10.586982 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581238    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 00:20:10.586982 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581241    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 00:20:10.586982 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581245    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 00:20:10.586982 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581248    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 00:20:10.586982 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581251    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 00:20:10.586982 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581253    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 00:20:10.586982 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581256    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 00:20:10.586982 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581259    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 00:20:10.586982 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581262    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 00:20:10.586982 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581264    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 00:20:10.586982 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581266    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 00:20:10.586982 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581269    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 00:20:10.586982 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581271    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 00:20:10.586982 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581274    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 00:20:10.586982 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581276    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 00:20:10.586982 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581279    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 00:20:10.587566 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581281    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 00:20:10.587566 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581284    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 00:20:10.587566 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581286    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 00:20:10.587566 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581289    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 00:20:10.587566 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581291    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 00:20:10.587566 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581294    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 00:20:10.587566 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581297    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 00:20:10.587566 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581299    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 00:20:10.587566 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581301    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 00:20:10.587566 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581304    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 00:20:10.587566 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581306    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 00:20:10.587566 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581310    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 00:20:10.587566 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581313    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 00:20:10.587566 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581316    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 00:20:10.587566 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581319    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 00:20:10.587566 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581321    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 00:20:10.587566 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581324    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 00:20:10.587566 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581332    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 00:20:10.587566 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581336    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 00:20:10.588114 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581339    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 00:20:10.588114 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581341    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 00:20:10.588114 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581343    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 00:20:10.588114 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581346    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 00:20:10.588114 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581348    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 00:20:10.588114 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581351    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 00:20:10.588114 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581354    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 00:20:10.588114 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581356    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 00:20:10.588114 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581359    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 00:20:10.588114 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581361    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 00:20:10.588114 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581364    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 00:20:10.588114 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581366    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 00:20:10.588114 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581369    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 00:20:10.588114 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581372    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 00:20:10.588114 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581374    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 00:20:10.588114 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581377    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 00:20:10.588114 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581380    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 00:20:10.588114 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581382    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 00:20:10.588114 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581385    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 00:20:10.588114 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581387    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 00:20:10.588770 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581390    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 00:20:10.588770 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581392    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 00:20:10.588770 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581395    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 00:20:10.588770 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581397    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 00:20:10.588770 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581400    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 00:20:10.588770 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581402    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 00:20:10.588770 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581405    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 00:20:10.588770 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581407    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 00:20:10.588770 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581410    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 00:20:10.588770 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581412    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 00:20:10.588770 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581415    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 00:20:10.588770 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581417    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 00:20:10.588770 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581420    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 00:20:10.588770 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581423    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 00:20:10.588770 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581425    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 00:20:10.588770 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581427    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 00:20:10.588770 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:10.581430    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 00:20:10.589363 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.581435    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 00:20:10.589363 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.581556    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 23 00:20:10.589363 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.583546    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 23 00:20:10.589363 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.584918    2575 server.go:1019] "Starting client certificate rotation"
Jul 23 00:20:10.589363 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.585044    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 00:20:10.589363 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.585094    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 00:20:10.589363 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.587333    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 00:20:10.592113 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.592090    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 00:20:10.604340 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.604320    2575 log.go:25] "Validated CRI v1 runtime API"
Jul 23 00:20:10.606980 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.606961    2575 log.go:25] "Validated CRI v1 image API"
Jul 23 00:20:10.607927 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.607910    2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 23 00:20:10.610807 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.610787    2575 fs.go:135] Filesystem UUIDs: map[75dbd3c5-cf70-421e-aa4c-3a993262bfef:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 87aff928-43fc-4707-b6dd-721d2ab8406b:/dev/nvme0n1p3]
Jul 23 00:20:10.610884 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.610807    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 23 00:20:10.613009 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.612989    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 00:20:10.616105 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.615993    2575 manager.go:216] Machine: {Timestamp:2026-07-23 00:20:10.614762583 +0000 UTC m=+0.328654812 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102291 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24a49d6c70bd1ef224035e39dc2e8d SystemUUID:ec24a49d-6c70-bd1e-f224-035e39dc2e8d BootID:4e331940-0e3b-4cbf-ad67-b38b8643ead9 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6c:82:77:75:3f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6c:82:77:75:3f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:c4:6e:6d:ef:9d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 23 00:20:10.616105 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.616100    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 23 00:20:10.616207 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.616183    2575 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 23 00:20:10.619629 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.619597    2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 23 00:20:10.619785 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.619633    2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-176.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 23 00:20:10.620420 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.620409    2575 topology_manager.go:138] "Creating topology manager with none policy"
Jul 23 00:20:10.620452 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.620422    2575 container_manager_linux.go:309] "Creating device plugin manager"
Jul 23 00:20:10.620452 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.620429    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 00:20:10.621142 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.621131    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 00:20:10.622223 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.622212    2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 23 00:20:10.624979 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.624966    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 00:20:10.625110 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.625100    2575 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 23 00:20:10.625139 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.625135    2575 kubelet.go:486] "Attempting to sync node with API server"
Jul 23 00:20:10.625166 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.625149    2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 23 00:20:10.625193 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.625182    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 23 00:20:10.625223 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.625195    2575 kubelet.go:398] "Adding apiserver pod source"
Jul 23 00:20:10.625223 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.625218    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 23 00:20:10.625676 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.625664    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 00:20:10.625711 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.625684    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 00:20:10.628051 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.628037    2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 23 00:20:10.629828 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.629798    2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 23 00:20:10.629880 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.629853    2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 23 00:20:10.630931 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.630919    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 23 00:20:10.630968 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.630935    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 23 00:20:10.630968 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.630942    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 23 00:20:10.630968 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.630947    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 23 00:20:10.630968 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.630956    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 23 00:20:10.630968 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.630961    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 23 00:20:10.630968 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.630969    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 23 00:20:10.631118 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.630975    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 23 00:20:10.631118 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.630982    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 23 00:20:10.631118 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.630987    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 23 00:20:10.631118 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.631000    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 23 00:20:10.631118 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.631008    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 23 00:20:10.632697 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.632684    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 23 00:20:10.632730 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.632699    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 23 00:20:10.636483 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:10.636137    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-176.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 23 00:20:10.636483 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:10.636293    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 23 00:20:10.636483 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.636390    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-176.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 23 00:20:10.636882 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.636857    2575 server.go:1268] "Started kubelet"
Jul 23 00:20:10.637028 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.636874    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 23 00:20:10.637028 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.636947    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 23 00:20:10.637126 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.637047    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 23 00:20:10.637925 ip-10-0-141-176 systemd[1]: Started Kubernetes Kubelet.
Jul 23 00:20:10.639527 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.639512    2575 server.go:310] "Adding debug handlers to kubelet server"
Jul 23 00:20:10.641416 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.641395    2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 23 00:20:10.643586 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:10.643569    2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 23 00:20:10.646592 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.646572    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 23 00:20:10.646678 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:10.646662    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-176.ec2.internal\" not found"
Jul 23 00:20:10.646744 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.646575    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 23 00:20:10.647769 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.647113    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 23 00:20:10.647769 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.647207    2575 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 23 00:20:10.647769 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.647343    2575 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 23 00:20:10.647769 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.647495    2575 reconstruct.go:97] "Volume reconstruction finished"
Jul 23 00:20:10.647769 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.647505    2575 reconciler.go:29] "Reconciler: start to sync state"
Jul 23 00:20:10.647769 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:10.646248    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-176.ec2.internal.18c4c33b07323a1e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-176.ec2.internal,UID:ip-10-0-141-176.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-176.ec2.internal,},FirstTimestamp:2026-07-23 00:20:10.636778014 +0000 UTC m=+0.350670242,LastTimestamp:2026-07-23 00:20:10.636778014 +0000 UTC m=+0.350670242,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-176.ec2.internal,}"
Jul 23 00:20:10.648220 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.648031    2575 factory.go:55] Registering systemd factory
Jul 23 00:20:10.648220 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.648047    2575 factory.go:223] Registration of the systemd container factory successfully
Jul 23 00:20:10.648660 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.648279    2575 factory.go:153] Registering CRI-O factory
Jul 23 00:20:10.648660 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.648294    2575 factory.go:223] Registration of the crio container factory successfully
Jul 23 00:20:10.648660 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.648344    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 23 00:20:10.648660 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.648363    2575 factory.go:103] Registering Raw factory
Jul 23 00:20:10.648660 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.648380    2575 manager.go:1196] Started watching for new ooms in manager
Jul 23 00:20:10.648939 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.648753    2575 manager.go:349] Starting recovery of all containers
Jul 23 00:20:10.653605 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:10.653570    2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-176.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 23 00:20:10.653796 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.653776    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vv7zq"
Jul 23 00:20:10.653918 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:10.653901    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 23 00:20:10.658256 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.658093    2575 manager.go:354] Recovery completed
Jul 23 00:20:10.659057 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.659036    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vv7zq"
Jul 23 00:20:10.660266 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:10.660231    2575 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 23 00:20:10.664141 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.664125    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 00:20:10.666628 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.666599    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-176.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 00:20:10.666715 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.666641    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-176.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 00:20:10.666715 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.666663    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-176.ec2.internal" event="NodeHasSufficientPID"
Jul 23 00:20:10.667476 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.667455    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 23 00:20:10.667476 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.667475    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 23 00:20:10.667601 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.667495    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 00:20:10.667782 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.667758    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 00:20:10.668728 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.668707    2575 policy_none.go:49] "None policy: Start"
Jul 23 00:20:10.668839 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.668733    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 23 00:20:10.668839 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.668750    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 23 00:20:10.668948 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:10.668856    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-176.ec2.internal.18c4c33b08f9b1d0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-176.ec2.internal,UID:ip-10-0-141-176.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-176.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-176.ec2.internal,},FirstTimestamp:2026-07-23 00:20:10.666627536 +0000 UTC m=+0.380519766,LastTimestamp:2026-07-23 00:20:10.666627536 +0000 UTC m=+0.380519766,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-176.ec2.internal,}"
Jul 23 00:20:10.669020 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.668969    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-176.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 00:20:10.669020 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.669002    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-176.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 00:20:10.669113 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.669017    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-176.ec2.internal" event="NodeHasSufficientPID"
Jul 23 00:20:10.669740 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.669729    2575 policy_none.go:47] "Start"
Jul 23 00:20:10.707462 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.707442    2575 manager.go:337] "Starting Device Plugin manager"
Jul 23 00:20:10.707579 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:10.707488    2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 23 00:20:10.707579 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.707501    2575 server.go:87] "Starting device plugin registration server"
Jul 23 00:20:10.707788 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.707775    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 23 00:20:10.707872 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.707791    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 23 00:20:10.707992 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.707946    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 23 00:20:10.708145 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.708058    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 23 00:20:10.708145 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.708068    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 23 00:20:10.708580 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:10.708560    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 23 00:20:10.708673 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:10.708606    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-176.ec2.internal\" not found"
Jul 23 00:20:10.808374 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.808327    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 00:20:10.809698 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.809279    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-176.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 00:20:10.809698 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.809307    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-176.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 00:20:10.809698 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.809319    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-176.ec2.internal" event="NodeHasSufficientPID"
Jul 23 00:20:10.809698 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.809351    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-176.ec2.internal"
Jul 23 00:20:10.810593 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.810567    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 23 00:20:10.812016 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.811971    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 23 00:20:10.812077 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.812019    2575 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 23 00:20:10.812077 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.812044    2575 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 23 00:20:10.812148 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:10.812082    2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 23 00:20:10.814018 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.814002    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 00:20:10.815695 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.815682    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-176.ec2.internal"
Jul 23 00:20:10.815747 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:10.815703    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-176.ec2.internal\": node \"ip-10-0-141-176.ec2.internal\" not found"
Jul 23 00:20:10.857836 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:10.857795    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-176.ec2.internal\" not found"
Jul 23 00:20:10.913179 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.913142    2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-176.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-176.ec2.internal"]
Jul 23 00:20:10.913362 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.913250    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 00:20:10.914867 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.914849    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-176.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 00:20:10.914979 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.914878    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-176.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 00:20:10.914979 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.914889    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-176.ec2.internal" event="NodeHasSufficientPID"
Jul 23 00:20:10.916181 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.916169    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 00:20:10.916311 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.916295    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-176.ec2.internal"
Jul 23 00:20:10.916348 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.916330    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 00:20:10.916908 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.916891    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-176.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 00:20:10.916983 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.916925    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-176.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 00:20:10.916983 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.916893    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-176.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 00:20:10.916983 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.916938    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-176.ec2.internal" event="NodeHasSufficientPID"
Jul 23 00:20:10.916983 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.916952    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-176.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 00:20:10.916983 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.916980    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-176.ec2.internal" event="NodeHasSufficientPID"
Jul 23 00:20:10.918465 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.918448    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-176.ec2.internal"
Jul 23 00:20:10.918515 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.918481    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 00:20:10.919151 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.919136    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-176.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 00:20:10.919229 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.919162    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-176.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 00:20:10.919229 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.919172    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-176.ec2.internal" event="NodeHasSufficientPID"
Jul 23 00:20:10.933377 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:10.933356    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-176.ec2.internal\" not found" node="ip-10-0-141-176.ec2.internal"
Jul 23 00:20:10.937100 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:10.937087    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-176.ec2.internal\" not found" node="ip-10-0-141-176.ec2.internal"
Jul 23 00:20:10.949132 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.949110    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cc7e38348870c33ddb5bc928a23b8d26-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-176.ec2.internal\" (UID: \"cc7e38348870c33ddb5bc928a23b8d26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-176.ec2.internal"
Jul 23 00:20:10.949251 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.949138    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc7e38348870c33ddb5bc928a23b8d26-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-176.ec2.internal\" (UID: \"cc7e38348870c33ddb5bc928a23b8d26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-176.ec2.internal"
Jul 23 00:20:10.949251 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:10.949160    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4a00a11760339a8d98a59b9745057c66-config\") pod \"kube-apiserver-proxy-ip-10-0-141-176.ec2.internal\" (UID: \"4a00a11760339a8d98a59b9745057c66\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-176.ec2.internal"
Jul 23 00:20:10.957892 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:10.957868    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-176.ec2.internal\" not found"
Jul 23 00:20:11.049782 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:11.049749    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc7e38348870c33ddb5bc928a23b8d26-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-176.ec2.internal\" (UID: \"cc7e38348870c33ddb5bc928a23b8d26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-176.ec2.internal"
Jul 23 00:20:11.049864 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:11.049787    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4a00a11760339a8d98a59b9745057c66-config\") pod \"kube-apiserver-proxy-ip-10-0-141-176.ec2.internal\" (UID: \"4a00a11760339a8d98a59b9745057c66\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-176.ec2.internal"
Jul 23 00:20:11.049864 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:11.049829    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cc7e38348870c33ddb5bc928a23b8d26-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-176.ec2.internal\" (UID: \"cc7e38348870c33ddb5bc928a23b8d26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-176.ec2.internal"
Jul 23 00:20:11.049944 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:11.049880    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cc7e38348870c33ddb5bc928a23b8d26-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-176.ec2.internal\" (UID: \"cc7e38348870c33ddb5bc928a23b8d26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-176.ec2.internal"
Jul 23 00:20:11.049944 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:11.049885    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4a00a11760339a8d98a59b9745057c66-config\") pod \"kube-apiserver-proxy-ip-10-0-141-176.ec2.internal\" (UID: \"4a00a11760339a8d98a59b9745057c66\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-176.ec2.internal"
Jul 23 00:20:11.049944 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:11.049880    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc7e38348870c33ddb5bc928a23b8d26-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-176.ec2.internal\" (UID: \"cc7e38348870c33ddb5bc928a23b8d26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-176.ec2.internal"
Jul 23 00:20:11.058849 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:11.058811    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-176.ec2.internal\" not found"
Jul 23 00:20:11.159688 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:11.159618    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-176.ec2.internal\" not found"
Jul 23 00:20:11.236870 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:11.236841    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-176.ec2.internal"
Jul 23 00:20:11.240638 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:11.240618    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-176.ec2.internal"
Jul 23 00:20:11.259957 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:11.259922    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-176.ec2.internal\" not found"
Jul 23 00:20:11.360550 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:11.360510    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-176.ec2.internal\" not found"
Jul 23 00:20:11.461095 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:11.461024    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-176.ec2.internal\" not found"
Jul 23 00:20:12.871782 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:12.871747    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-176.ec2.internal\" not found"
Jul 23 00:20:12.894940 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:12.894894    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 23 00:20:12.895091 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:12.895074    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 00:20:12.972034 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:12.972006    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-176.ec2.internal\" not found"
Jul 23 00:20:12.973096 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:12.973072    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 00:15:11 +0000 UTC" deadline="2028-02-03 08:06:04.168947552 +0000 UTC"
Jul 23 00:20:12.973144 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:12.973097    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13447h45m51.195853376s"
Jul 23 00:20:13.039036 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:13.038999    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc7e38348870c33ddb5bc928a23b8d26.slice/crio-0dd652c931bedf9b8ab8c2e52e5c202a8ddbcbe97615722110f097033643a86e WatchSource:0}: Error finding container 0dd652c931bedf9b8ab8c2e52e5c202a8ddbcbe97615722110f097033643a86e: Status 404 returned error can't find the container with id 0dd652c931bedf9b8ab8c2e52e5c202a8ddbcbe97615722110f097033643a86e
Jul 23 00:20:13.039423 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:13.039412    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a00a11760339a8d98a59b9745057c66.slice/crio-4b50f4e741c4d6443dcd2e4cdad3272af340846562e647b7eefb457c1a9a2244 WatchSource:0}: Error finding container 4b50f4e741c4d6443dcd2e4cdad3272af340846562e647b7eefb457c1a9a2244: Status 404 returned error can't find the container with id 4b50f4e741c4d6443dcd2e4cdad3272af340846562e647b7eefb457c1a9a2244
Jul 23 00:20:13.044428 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.044418    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 00:20:13.053237 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.053218    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 00:20:13.057531 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.057507    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-176.ec2.internal"
Jul 23 00:20:13.067303 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.067275    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 00:20:13.070472 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.070447    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-176.ec2.internal"
Jul 23 00:20:13.076031 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.076015    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 00:20:13.125348 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.125292    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-176.ec2.internal" event={"ID":"cc7e38348870c33ddb5bc928a23b8d26","Type":"ContainerStarted","Data":"0dd652c931bedf9b8ab8c2e52e5c202a8ddbcbe97615722110f097033643a86e"}
Jul 23 00:20:13.126316 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.126292    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-176.ec2.internal" event={"ID":"4a00a11760339a8d98a59b9745057c66","Type":"ContainerStarted","Data":"4b50f4e741c4d6443dcd2e4cdad3272af340846562e647b7eefb457c1a9a2244"}
Jul 23 00:20:13.161478 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.161449    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 00:20:13.531212 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.531178    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 00:20:13.936734 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.936669    2575 apiserver.go:52] "Watching apiserver"
Jul 23 00:20:13.941304 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.941280    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 23 00:20:13.942760 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.942730    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-sjjx7","kube-system/konnectivity-agent-fw9dw","kube-system/kube-apiserver-proxy-ip-10-0-141-176.ec2.internal","openshift-cluster-node-tuning-operator/tuned-7pgx5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-176.ec2.internal","openshift-multus/multus-8hpmj","openshift-network-operator/iptables-alerter-6wl7h","openshift-ovn-kubernetes/ovnkube-node-lhvxb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6vfps","openshift-dns/node-resolver-7wb6q","openshift-image-registry/node-ca-rstk9","openshift-multus/multus-additional-cni-plugins-45m4m","openshift-multus/network-metrics-daemon-5bdx2","openshift-network-diagnostics/network-check-target-9pnlz"]
Jul 23 00:20:13.944804 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.944773    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6wl7h"
Jul 23 00:20:13.946042 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.946021    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 00:20:13.946825 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.946807    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 23 00:20:13.947004 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.946991    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 23 00:20:13.947171 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.947151    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-x6dgg\""
Jul 23 00:20:13.947357 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.947344    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 23 00:20:13.948625 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.948018    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rstk9"
Jul 23 00:20:13.948625 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.948168    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:20:13.948625 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:13.948251    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pnlz" podUID="ae70da8b-d8aa-4b34-9780-3e53cb43fac9"
Jul 23 00:20:13.948833 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.948745    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:13.949831 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.949708    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:13.949987 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.949969    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 23 00:20:13.950439 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.950420    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 23 00:20:13.950611 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.950596    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 23 00:20:13.950821 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.950803    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nf2lf\""
Jul 23 00:20:13.951164 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.951146    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 23 00:20:13.951240 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.951167    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-krwrk\""
Jul 23 00:20:13.951673 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.951413    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:13.951673 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.951454    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 23 00:20:13.951673 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.951572    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 23 00:20:13.951835 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.951797    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vp6lw\""
Jul 23 00:20:13.952165 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.952121    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 23 00:20:13.952391 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.952179    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 23 00:20:13.952619 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.952603    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6vfps"
Jul 23 00:20:13.955558 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.953792    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 23 00:20:13.955558 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.954398    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 23 00:20:13.955558 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.954827    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 23 00:20:13.956112 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.955177    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f7lv7\""
Jul 23 00:20:13.956112 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.955220    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 23 00:20:13.956112 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.955412    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 23 00:20:13.956112 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.955668    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 23 00:20:13.956347 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.955732    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 23 00:20:13.956411 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.956348    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 23 00:20:13.956466 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.956420    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 23 00:20:13.956535 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.956517    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2kst5\""
Jul 23 00:20:13.957054 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.956685    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 23 00:20:13.957054 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.956766    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:13.957054 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:13.956871    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bdx2" podUID="a594d680-4ddd-4df4-9130-0a4e075dd19a"
Jul 23 00:20:13.957227 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.957082    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 23 00:20:13.958208 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.957879    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fw9dw"
Jul 23 00:20:13.960021 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.960000    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7wb6q"
Jul 23 00:20:13.961445 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.961008    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 23 00:20:13.961445 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.961031    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 23 00:20:13.961445 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.961299    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mrvtq\""
Jul 23 00:20:13.962192 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.961976    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 23 00:20:13.962693 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.962428    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 23 00:20:13.962693 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.962437    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dvbr9\""
Jul 23 00:20:13.964707 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.964487    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:13.964707 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:13.964553    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjjx7" podUID="18b6cfa7-6d8f-4934-b78c-789e54bdbac9"
Jul 23 00:20:13.967265 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.967080    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 00:20:13.967642 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.967626    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-45m4m"
Jul 23 00:20:13.969970 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968150    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-455s4\" (UniqueName: \"kubernetes.io/projected/ae70da8b-d8aa-4b34-9780-3e53cb43fac9-kube-api-access-455s4\") pod \"network-check-target-9pnlz\" (UID: \"ae70da8b-d8aa-4b34-9780-3e53cb43fac9\") " pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:20:13.969970 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968184    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-sys\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:13.969970 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968207    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-host\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:13.969970 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968230    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b4e3ecfb-d1fe-463f-9bb5-b35da3031d52-etc-selinux\") pod \"aws-ebs-csi-driver-node-6vfps\" (UID: \"b4e3ecfb-d1fe-463f-9bb5-b35da3031d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6vfps"
Jul 23 00:20:13.969970 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968264    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-log-socket\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:13.969970 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968287    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b4e3ecfb-d1fe-463f-9bb5-b35da3031d52-socket-dir\") pod \"aws-ebs-csi-driver-node-6vfps\" (UID: \"b4e3ecfb-d1fe-463f-9bb5-b35da3031d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6vfps"
Jul 23 00:20:13.969970 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968309    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkkgk\" (UniqueName: \"kubernetes.io/projected/9f541343-d56e-484e-9baf-7c16d3a507e3-kube-api-access-qkkgk\") pod \"iptables-alerter-6wl7h\" (UID: \"9f541343-d56e-484e-9baf-7c16d3a507e3\") " pod="openshift-network-operator/iptables-alerter-6wl7h"
Jul 23 00:20:13.969970 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968332    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jz9m\" (UniqueName: \"kubernetes.io/projected/3c56952e-6052-40d6-ac90-f998ec05586a-kube-api-access-4jz9m\") pod \"node-ca-rstk9\" (UID: \"3c56952e-6052-40d6-ac90-f998ec05586a\") " pod="openshift-image-registry/node-ca-rstk9"
Jul 23 00:20:13.969970 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968356    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-etc-sysctl-d\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:13.969970 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968396    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-run-systemd\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:13.969970 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968423    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-host-run-ovn-kubernetes\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:13.969970 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968447    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvg9s\" (UniqueName: \"kubernetes.io/projected/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-kube-api-access-vvg9s\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:13.969970 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968476    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b4e3ecfb-d1fe-463f-9bb5-b35da3031d52-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6vfps\" (UID: \"b4e3ecfb-d1fe-463f-9bb5-b35da3031d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6vfps"
Jul 23 00:20:13.969970 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968498    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-system-cni-dir\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:13.969970 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968522    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3c56952e-6052-40d6-ac90-f998ec05586a-serviceca\") pod \"node-ca-rstk9\" (UID: \"3c56952e-6052-40d6-ac90-f998ec05586a\") " pod="openshift-image-registry/node-ca-rstk9"
Jul 23 00:20:13.969970 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968551    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-systemd-units\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:13.970755 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968573    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-host-cni-netd\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:13.970755 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968601    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:13.970755 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968625    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-env-overrides\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:13.970755 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968650    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-ovnkube-script-lib\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:13.970755 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968674    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-multus-conf-dir\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:13.970755 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968695    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bceae902-761d-44c5-b35a-2e83f90ac653-etc-tuned\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:13.970755 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968728    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b4e3ecfb-d1fe-463f-9bb5-b35da3031d52-device-dir\") pod \"aws-ebs-csi-driver-node-6vfps\" (UID: \"b4e3ecfb-d1fe-463f-9bb5-b35da3031d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6vfps"
Jul 23 00:20:13.970755 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968750    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-host-run-k8s-cni-cncf-io\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:13.970755 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968775    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-host-run-multus-certs\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:13.970755 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968797    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b4e3ecfb-d1fe-463f-9bb5-b35da3031d52-registration-dir\") pod \"aws-ebs-csi-driver-node-6vfps\" (UID: \"b4e3ecfb-d1fe-463f-9bb5-b35da3031d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6vfps"
Jul 23 00:20:13.970755 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968822    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-etc-kubernetes\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:13.970755 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968853    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-host-slash\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:13.970755 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968887    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q5l8\" (UniqueName: \"kubernetes.io/projected/17093c98-5d84-4987-a1d7-d480d4f3bc29-kube-api-access-4q5l8\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:13.970755 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968960    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-node-log\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:13.970755 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.968986    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxlfv\" (UniqueName: \"kubernetes.io/projected/a594d680-4ddd-4df4-9130-0a4e075dd19a-kube-api-access-kxlfv\") pod \"network-metrics-daemon-5bdx2\" (UID: \"a594d680-4ddd-4df4-9130-0a4e075dd19a\") " pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:13.970755 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.969012    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e2d0a009-a5ef-4d0e-a294-3e1f34647c9a-konnectivity-ca\") pod \"konnectivity-agent-fw9dw\" (UID: \"e2d0a009-a5ef-4d0e-a294-3e1f34647c9a\") " pod="kube-system/konnectivity-agent-fw9dw"
Jul 23 00:20:13.971621 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.969034    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-etc-modprobe-d\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:13.971621 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.969056    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-etc-sysctl-conf\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:13.971621 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.969080    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-run\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:13.971621 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.969119    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-run-ovn\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:13.971621 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.969142    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-cnibin\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:13.971621 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.969168    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d20d0267-ce15-40ee-8f79-a24b8ef3016c-hosts-file\") pod \"node-resolver-7wb6q\" (UID: \"d20d0267-ce15-40ee-8f79-a24b8ef3016c\") " pod="openshift-dns/node-resolver-7wb6q"
Jul 23 00:20:13.971621 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.969211    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-ovnkube-config\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:13.971621 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.969360    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b4e3ecfb-d1fe-463f-9bb5-b35da3031d52-sys-fs\") pod \"aws-ebs-csi-driver-node-6vfps\" (UID: \"b4e3ecfb-d1fe-463f-9bb5-b35da3031d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6vfps"
Jul 23 00:20:13.971621 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.969387    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9f541343-d56e-484e-9baf-7c16d3a507e3-iptables-alerter-script\") pod \"iptables-alerter-6wl7h\" (UID: \"9f541343-d56e-484e-9baf-7c16d3a507e3\") " pod="openshift-network-operator/iptables-alerter-6wl7h"
Jul 23 00:20:13.971621 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.969411    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-host-var-lib-kubelet\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:13.971621 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.969434    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a594d680-4ddd-4df4-9130-0a4e075dd19a-metrics-certs\") pod \"network-metrics-daemon-5bdx2\" (UID: \"a594d680-4ddd-4df4-9130-0a4e075dd19a\") " pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:13.971621 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.969458    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-etc-sysconfig\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:13.971621 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.969482    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-lib-modules\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:13.971621 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.969507    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-run-openvswitch\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:13.971621 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.969530    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-hostroot\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:13.971621 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.969552    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d20d0267-ce15-40ee-8f79-a24b8ef3016c-tmp-dir\") pod \"node-resolver-7wb6q\" (UID: \"d20d0267-ce15-40ee-8f79-a24b8ef3016c\") " pod="openshift-dns/node-resolver-7wb6q"
Jul 23 00:20:13.971621 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.969581    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-multus-cni-dir\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:13.972448 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.969605    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17093c98-5d84-4987-a1d7-d480d4f3bc29-cni-binary-copy\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:13.972448 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.969642    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-host-run-netns\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:13.972448 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.969666    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/17093c98-5d84-4987-a1d7-d480d4f3bc29-multus-daemon-config\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:13.972448 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.969692    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwsvl\" (UniqueName: \"kubernetes.io/projected/b4e3ecfb-d1fe-463f-9bb5-b35da3031d52-kube-api-access-rwsvl\") pod \"aws-ebs-csi-driver-node-6vfps\" (UID: \"b4e3ecfb-d1fe-463f-9bb5-b35da3031d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6vfps"
Jul 23 00:20:13.972448 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.969715    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-os-release\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:13.972448 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.969738    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e2d0a009-a5ef-4d0e-a294-3e1f34647c9a-agent-certs\") pod \"konnectivity-agent-fw9dw\" (UID: \"e2d0a009-a5ef-4d0e-a294-3e1f34647c9a\") " pod="kube-system/konnectivity-agent-fw9dw"
Jul 23 00:20:13.972448 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.969762    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3c56952e-6052-40d6-ac90-f998ec05586a-host\") pod \"node-ca-rstk9\" (UID: \"3c56952e-6052-40d6-ac90-f998ec05586a\") " pod="openshift-image-registry/node-ca-rstk9"
Jul 23 00:20:13.972448 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.969797    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-host-var-lib-cni-bin\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:13.972448 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.969848    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-etc-kubernetes\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:13.972448 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.969891    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6c8v\" (UniqueName: \"kubernetes.io/projected/d20d0267-ce15-40ee-8f79-a24b8ef3016c-kube-api-access-g6c8v\") pod \"node-resolver-7wb6q\" (UID: \"d20d0267-ce15-40ee-8f79-a24b8ef3016c\") " pod="openshift-dns/node-resolver-7wb6q"
Jul 23 00:20:13.972448 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.969943    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-etc-systemd\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:13.972448 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.970017    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-var-lib-kubelet\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:13.972448 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.970042    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bceae902-761d-44c5-b35a-2e83f90ac653-tmp\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:13.972448 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.970068    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5qj7\" (UniqueName: \"kubernetes.io/projected/bceae902-761d-44c5-b35a-2e83f90ac653-kube-api-access-k5qj7\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:13.972448 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.970091    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-host-kubelet\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:13.972448 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.970116    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f541343-d56e-484e-9baf-7c16d3a507e3-host-slash\") pod \"iptables-alerter-6wl7h\" (UID: \"9f541343-d56e-484e-9baf-7c16d3a507e3\") " pod="openshift-network-operator/iptables-alerter-6wl7h"
Jul 23 00:20:13.972448 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.970142    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-host-run-netns\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:13.973185 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.970191    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-var-lib-openvswitch\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:13.973185 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.970218    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-multus-socket-dir-parent\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:13.973185 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.970243    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-host-var-lib-cni-multus\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:13.973185 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.970270    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-etc-openvswitch\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:13.973185 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.970294    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-host-cni-bin\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:13.973185 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.970327    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-ovn-node-metrics-cert\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:13.973185 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.970786    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 23 00:20:13.973185 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.971301    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-chzrv\""
Jul 23 00:20:13.973185 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.971314    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 23 00:20:13.986214 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.986193    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-df7h4"
Jul 23 00:20:13.993770 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:13.993745    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-df7h4"
Jul 23 00:20:14.058742 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.058712    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 23 00:20:14.074936 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.073537    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-node-log\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.074936 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.073606    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxlfv\" (UniqueName: \"kubernetes.io/projected/a594d680-4ddd-4df4-9130-0a4e075dd19a-kube-api-access-kxlfv\") pod \"network-metrics-daemon-5bdx2\" (UID: \"a594d680-4ddd-4df4-9130-0a4e075dd19a\") " pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:14.074936 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.073640    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e2d0a009-a5ef-4d0e-a294-3e1f34647c9a-konnectivity-ca\") pod \"konnectivity-agent-fw9dw\" (UID: \"e2d0a009-a5ef-4d0e-a294-3e1f34647c9a\") " pod="kube-system/konnectivity-agent-fw9dw"
Jul 23 00:20:14.074936 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.073671    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-etc-modprobe-d\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:14.074936 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.073749    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-etc-sysctl-conf\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:14.074936 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.073782    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-run\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:14.074936 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.073857    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-node-log\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.074936 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.073871    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-run-ovn\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.074936 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.074012    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-etc-modprobe-d\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:14.074936 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.074027    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-etc-sysctl-conf\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:14.074936 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.074050    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-run-ovn\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.074936 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.074094    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-cnibin\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.074936 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.074226    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-run\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:14.074936 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.074228    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-cnibin\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.074936 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.074258    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d20d0267-ce15-40ee-8f79-a24b8ef3016c-hosts-file\") pod \"node-resolver-7wb6q\" (UID: \"d20d0267-ce15-40ee-8f79-a24b8ef3016c\") " pod="openshift-dns/node-resolver-7wb6q"
Jul 23 00:20:14.074936 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.074340    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d20d0267-ce15-40ee-8f79-a24b8ef3016c-hosts-file\") pod \"node-resolver-7wb6q\" (UID: \"d20d0267-ce15-40ee-8f79-a24b8ef3016c\") " pod="openshift-dns/node-resolver-7wb6q"
Jul 23 00:20:14.074936 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.074400    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-ovnkube-config\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.074936 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.074438    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b4e3ecfb-d1fe-463f-9bb5-b35da3031d52-sys-fs\") pod \"aws-ebs-csi-driver-node-6vfps\" (UID: \"b4e3ecfb-d1fe-463f-9bb5-b35da3031d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6vfps"
Jul 23 00:20:14.075754 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.074473    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9f541343-d56e-484e-9baf-7c16d3a507e3-iptables-alerter-script\") pod \"iptables-alerter-6wl7h\" (UID: \"9f541343-d56e-484e-9baf-7c16d3a507e3\") " pod="openshift-network-operator/iptables-alerter-6wl7h"
Jul 23 00:20:14.075754 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.074506    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-host-var-lib-kubelet\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.075754 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.074542    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5354d283-a176-4db3-89b3-59b7d2081668-cnibin\") pod \"multus-additional-cni-plugins-45m4m\" (UID: \"5354d283-a176-4db3-89b3-59b7d2081668\") " pod="openshift-multus/multus-additional-cni-plugins-45m4m"
Jul 23 00:20:14.075754 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.074570    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5354d283-a176-4db3-89b3-59b7d2081668-cni-binary-copy\") pod \"multus-additional-cni-plugins-45m4m\" (UID: \"5354d283-a176-4db3-89b3-59b7d2081668\") " pod="openshift-multus/multus-additional-cni-plugins-45m4m"
Jul 23 00:20:14.075754 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.074581    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b4e3ecfb-d1fe-463f-9bb5-b35da3031d52-sys-fs\") pod \"aws-ebs-csi-driver-node-6vfps\" (UID: \"b4e3ecfb-d1fe-463f-9bb5-b35da3031d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6vfps"
Jul 23 00:20:14.075754 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.074604    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a594d680-4ddd-4df4-9130-0a4e075dd19a-metrics-certs\") pod \"network-metrics-daemon-5bdx2\" (UID: \"a594d680-4ddd-4df4-9130-0a4e075dd19a\") " pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:14.075754 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.074645    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e2d0a009-a5ef-4d0e-a294-3e1f34647c9a-konnectivity-ca\") pod \"konnectivity-agent-fw9dw\" (UID: \"e2d0a009-a5ef-4d0e-a294-3e1f34647c9a\") " pod="kube-system/konnectivity-agent-fw9dw"
Jul 23 00:20:14.075754 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.074665    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-etc-sysconfig\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:14.075754 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.074610    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-host-var-lib-kubelet\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.075754 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:14.074813    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 00:20:14.075754 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.074817    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-etc-sysconfig\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:14.075754 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:14.074934    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a594d680-4ddd-4df4-9130-0a4e075dd19a-metrics-certs podName:a594d680-4ddd-4df4-9130-0a4e075dd19a nodeName:}" failed. No retries permitted until 2026-07-23 00:20:14.574889595 +0000 UTC m=+2.978686109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a594d680-4ddd-4df4-9130-0a4e075dd19a-metrics-certs") pod "network-metrics-daemon-5bdx2" (UID: "a594d680-4ddd-4df4-9130-0a4e075dd19a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 00:20:14.075754 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.075224    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-lib-modules\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:14.075754 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.075261    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-run-openvswitch\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.075754 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.075295    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-hostroot\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.075754 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.075320    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d20d0267-ce15-40ee-8f79-a24b8ef3016c-tmp-dir\") pod \"node-resolver-7wb6q\" (UID: \"d20d0267-ce15-40ee-8f79-a24b8ef3016c\") " pod="openshift-dns/node-resolver-7wb6q"
Jul 23 00:20:14.075754 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.075351    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-multus-cni-dir\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.076613 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.075443    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-multus-cni-dir\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.076613 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.075578    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17093c98-5d84-4987-a1d7-d480d4f3bc29-cni-binary-copy\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.076613 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.075585    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-run-openvswitch\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.076613 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.075622    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-host-run-netns\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.076613 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.075659    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/17093c98-5d84-4987-a1d7-d480d4f3bc29-multus-daemon-config\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.076613 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.075694    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5354d283-a176-4db3-89b3-59b7d2081668-os-release\") pod \"multus-additional-cni-plugins-45m4m\" (UID: \"5354d283-a176-4db3-89b3-59b7d2081668\") " pod="openshift-multus/multus-additional-cni-plugins-45m4m"
Jul 23 00:20:14.076613 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.075765    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-hostroot\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.076613 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.076080    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d20d0267-ce15-40ee-8f79-a24b8ef3016c-tmp-dir\") pod \"node-resolver-7wb6q\" (UID: \"d20d0267-ce15-40ee-8f79-a24b8ef3016c\") " pod="openshift-dns/node-resolver-7wb6q"
Jul 23 00:20:14.076613 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.076102    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17093c98-5d84-4987-a1d7-d480d4f3bc29-cni-binary-copy\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.076613 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.076142    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9f541343-d56e-484e-9baf-7c16d3a507e3-iptables-alerter-script\") pod \"iptables-alerter-6wl7h\" (UID: \"9f541343-d56e-484e-9baf-7c16d3a507e3\") " pod="openshift-network-operator/iptables-alerter-6wl7h"
Jul 23 00:20:14.076613 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.076173    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-host-run-netns\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.076613 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.076181    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-lib-modules\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:14.076613 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.076239    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwsvl\" (UniqueName: \"kubernetes.io/projected/b4e3ecfb-d1fe-463f-9bb5-b35da3031d52-kube-api-access-rwsvl\") pod \"aws-ebs-csi-driver-node-6vfps\" (UID: \"b4e3ecfb-d1fe-463f-9bb5-b35da3031d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6vfps"
Jul 23 00:20:14.076613 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.076267    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-os-release\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.076613 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.076297    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e2d0a009-a5ef-4d0e-a294-3e1f34647c9a-agent-certs\") pod \"konnectivity-agent-fw9dw\" (UID: \"e2d0a009-a5ef-4d0e-a294-3e1f34647c9a\") " pod="kube-system/konnectivity-agent-fw9dw"
Jul 23 00:20:14.076613 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.076326    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3c56952e-6052-40d6-ac90-f998ec05586a-host\") pod \"node-ca-rstk9\" (UID: \"3c56952e-6052-40d6-ac90-f998ec05586a\") " pod="openshift-image-registry/node-ca-rstk9"
Jul 23 00:20:14.076613 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.076350    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-host-var-lib-cni-bin\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.076613 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.076420    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-etc-kubernetes\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.077425 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.076436    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-etc-kubernetes\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.077425 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.076479    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/18b6cfa7-6d8f-4934-b78c-789e54bdbac9-kubelet-config\") pod \"global-pull-secret-syncer-sjjx7\" (UID: \"18b6cfa7-6d8f-4934-b78c-789e54bdbac9\") " pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:14.077425 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.076521    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6c8v\" (UniqueName: \"kubernetes.io/projected/d20d0267-ce15-40ee-8f79-a24b8ef3016c-kube-api-access-g6c8v\") pod \"node-resolver-7wb6q\" (UID: \"d20d0267-ce15-40ee-8f79-a24b8ef3016c\") " pod="openshift-dns/node-resolver-7wb6q"
Jul 23 00:20:14.077425 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.076553    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-etc-systemd\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:14.077425 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.076629    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-os-release\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.077425 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.076669    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/17093c98-5d84-4987-a1d7-d480d4f3bc29-multus-daemon-config\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.077425 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.076685    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-etc-systemd\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:14.077425 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.076782    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-var-lib-kubelet\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:14.077425 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.076795    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3c56952e-6052-40d6-ac90-f998ec05586a-host\") pod \"node-ca-rstk9\" (UID: \"3c56952e-6052-40d6-ac90-f998ec05586a\") " pod="openshift-image-registry/node-ca-rstk9"
Jul 23 00:20:14.077425 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.076819    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bceae902-761d-44c5-b35a-2e83f90ac653-tmp\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:14.077425 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.076852    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5qj7\" (UniqueName: \"kubernetes.io/projected/bceae902-761d-44c5-b35a-2e83f90ac653-kube-api-access-k5qj7\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:14.077425 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.076885    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-host-kubelet\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.077425 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.076895    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-host-var-lib-cni-bin\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.077425 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.076934    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f541343-d56e-484e-9baf-7c16d3a507e3-host-slash\") pod \"iptables-alerter-6wl7h\" (UID: \"9f541343-d56e-484e-9baf-7c16d3a507e3\") " pod="openshift-network-operator/iptables-alerter-6wl7h"
Jul 23 00:20:14.077425 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.077105    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 23 00:20:14.077425 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.077151    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-host-run-netns\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.077425 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.077205    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-host-run-netns\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.077425 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.077241    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f541343-d56e-484e-9baf-7c16d3a507e3-host-slash\") pod \"iptables-alerter-6wl7h\" (UID: \"9f541343-d56e-484e-9baf-7c16d3a507e3\") " pod="openshift-network-operator/iptables-alerter-6wl7h"
Jul 23 00:20:14.078264 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.076855    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-var-lib-kubelet\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:14.078264 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.077526    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-host-kubelet\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.078264 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.077655    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-var-lib-openvswitch\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.078264 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.077694    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-multus-socket-dir-parent\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.078264 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.077725    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-host-var-lib-cni-multus\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.078264 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.077773    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-var-lib-openvswitch\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.078264 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.077792    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-multus-socket-dir-parent\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.078264 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.077823    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5354d283-a176-4db3-89b3-59b7d2081668-tuning-conf-dir\") pod \"multus-additional-cni-plugins-45m4m\" (UID: \"5354d283-a176-4db3-89b3-59b7d2081668\") " pod="openshift-multus/multus-additional-cni-plugins-45m4m"
Jul 23 00:20:14.078264 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.077850    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-host-var-lib-cni-multus\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.078264 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.077883    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5354d283-a176-4db3-89b3-59b7d2081668-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-45m4m\" (UID: \"5354d283-a176-4db3-89b3-59b7d2081668\") " pod="openshift-multus/multus-additional-cni-plugins-45m4m"
Jul 23 00:20:14.078264 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.077951    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-etc-openvswitch\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.078264 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.077987    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-host-cni-bin\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.078264 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.078018    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-ovn-node-metrics-cert\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.078264 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.078051    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-455s4\" (UniqueName: \"kubernetes.io/projected/ae70da8b-d8aa-4b34-9780-3e53cb43fac9-kube-api-access-455s4\") pod \"network-check-target-9pnlz\" (UID: \"ae70da8b-d8aa-4b34-9780-3e53cb43fac9\") " pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:20:14.078264 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.078087    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-sys\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:14.078264 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.078112    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-host\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:14.078264 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.078144    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b4e3ecfb-d1fe-463f-9bb5-b35da3031d52-etc-selinux\") pod \"aws-ebs-csi-driver-node-6vfps\" (UID: \"b4e3ecfb-d1fe-463f-9bb5-b35da3031d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6vfps"
Jul 23 00:20:14.079107 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.078169    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-log-socket\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.079107 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.078302    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b4e3ecfb-d1fe-463f-9bb5-b35da3031d52-socket-dir\") pod \"aws-ebs-csi-driver-node-6vfps\" (UID: \"b4e3ecfb-d1fe-463f-9bb5-b35da3031d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6vfps"
Jul 23 00:20:14.079107 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.078395    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-host-cni-bin\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.079107 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.078934    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-sys\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:14.079107 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.078950    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-etc-openvswitch\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.079107 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.078978    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b4e3ecfb-d1fe-463f-9bb5-b35da3031d52-socket-dir\") pod \"aws-ebs-csi-driver-node-6vfps\" (UID: \"b4e3ecfb-d1fe-463f-9bb5-b35da3031d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6vfps"
Jul 23 00:20:14.079107 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.079001    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-host\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:14.079107 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.079014    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkkgk\" (UniqueName: \"kubernetes.io/projected/9f541343-d56e-484e-9baf-7c16d3a507e3-kube-api-access-qkkgk\") pod \"iptables-alerter-6wl7h\" (UID: \"9f541343-d56e-484e-9baf-7c16d3a507e3\") " pod="openshift-network-operator/iptables-alerter-6wl7h"
Jul 23 00:20:14.079107 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.079093    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-log-socket\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.079500 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.079140    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/18b6cfa7-6d8f-4934-b78c-789e54bdbac9-dbus\") pod \"global-pull-secret-syncer-sjjx7\" (UID: \"18b6cfa7-6d8f-4934-b78c-789e54bdbac9\") " pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:14.079500 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.079138    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b4e3ecfb-d1fe-463f-9bb5-b35da3031d52-etc-selinux\") pod \"aws-ebs-csi-driver-node-6vfps\" (UID: \"b4e3ecfb-d1fe-463f-9bb5-b35da3031d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6vfps"
Jul 23 00:20:14.079500 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.079174    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jz9m\" (UniqueName: \"kubernetes.io/projected/3c56952e-6052-40d6-ac90-f998ec05586a-kube-api-access-4jz9m\") pod \"node-ca-rstk9\" (UID: \"3c56952e-6052-40d6-ac90-f998ec05586a\") " pod="openshift-image-registry/node-ca-rstk9"
Jul 23 00:20:14.079500 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.079209    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-etc-sysctl-d\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:14.079500 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.079481    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-etc-sysctl-d\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:14.079735 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.079537    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-run-systemd\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.079735 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.079605    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-run-systemd\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.079735 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.079616    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-host-run-ovn-kubernetes\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.079735 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.079656    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvg9s\" (UniqueName: \"kubernetes.io/projected/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-kube-api-access-vvg9s\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.079735 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.079687    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b4e3ecfb-d1fe-463f-9bb5-b35da3031d52-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6vfps\" (UID: \"b4e3ecfb-d1fe-463f-9bb5-b35da3031d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6vfps"
Jul 23 00:20:14.079992 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.079739    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-host-run-ovn-kubernetes\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.079992 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.079952    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-system-cni-dir\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.080086 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.080000    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-system-cni-dir\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.080086 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.080003    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3c56952e-6052-40d6-ac90-f998ec05586a-serviceca\") pod \"node-ca-rstk9\" (UID: \"3c56952e-6052-40d6-ac90-f998ec05586a\") " pod="openshift-image-registry/node-ca-rstk9"
Jul 23 00:20:14.080086 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.080048    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-systemd-units\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.080086 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.080080    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-host-cni-netd\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.080245 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.080157    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.080245 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.080212    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b4e3ecfb-d1fe-463f-9bb5-b35da3031d52-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6vfps\" (UID: \"b4e3ecfb-d1fe-463f-9bb5-b35da3031d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6vfps"
Jul 23 00:20:14.080331 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.080253    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-systemd-units\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.080331 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.080111    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.080331 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.080309    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-host-cni-netd\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.080331 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.080320    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-env-overrides\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.080526 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.080352    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-ovnkube-script-lib\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.080526 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.080395    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-multus-conf-dir\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.080526 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.080429    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bceae902-761d-44c5-b35a-2e83f90ac653-etc-tuned\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:14.080526 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.080501    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b4e3ecfb-d1fe-463f-9bb5-b35da3031d52-device-dir\") pod \"aws-ebs-csi-driver-node-6vfps\" (UID: \"b4e3ecfb-d1fe-463f-9bb5-b35da3031d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6vfps"
Jul 23 00:20:14.080786 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.080718    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-env-overrides\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.082201 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.081277    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-multus-conf-dir\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.082201 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.081359    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-ovnkube-config\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.082201 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.081507    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3c56952e-6052-40d6-ac90-f998ec05586a-serviceca\") pod \"node-ca-rstk9\" (UID: \"3c56952e-6052-40d6-ac90-f998ec05586a\") " pod="openshift-image-registry/node-ca-rstk9"
Jul 23 00:20:14.082201 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.081374    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b4e3ecfb-d1fe-463f-9bb5-b35da3031d52-device-dir\") pod \"aws-ebs-csi-driver-node-6vfps\" (UID: \"b4e3ecfb-d1fe-463f-9bb5-b35da3031d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6vfps"
Jul 23 00:20:14.082201 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.081605    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-host-run-k8s-cni-cncf-io\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.082201 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.081623    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-ovnkube-script-lib\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.082201 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.081632    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-host-run-multus-certs\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.082201 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.081662    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18b6cfa7-6d8f-4934-b78c-789e54bdbac9-original-pull-secret\") pod \"global-pull-secret-syncer-sjjx7\" (UID: \"18b6cfa7-6d8f-4934-b78c-789e54bdbac9\") " pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:14.082201 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.081672    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-host-run-multus-certs\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.082201 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.081687    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5354d283-a176-4db3-89b3-59b7d2081668-system-cni-dir\") pod \"multus-additional-cni-plugins-45m4m\" (UID: \"5354d283-a176-4db3-89b3-59b7d2081668\") " pod="openshift-multus/multus-additional-cni-plugins-45m4m"
Jul 23 00:20:14.082201 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.081710    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/17093c98-5d84-4987-a1d7-d480d4f3bc29-host-run-k8s-cni-cncf-io\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.082201 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.081737    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5354d283-a176-4db3-89b3-59b7d2081668-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-45m4m\" (UID: \"5354d283-a176-4db3-89b3-59b7d2081668\") " pod="openshift-multus/multus-additional-cni-plugins-45m4m"
Jul 23 00:20:14.082201 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.081758    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgbjk\" (UniqueName: \"kubernetes.io/projected/5354d283-a176-4db3-89b3-59b7d2081668-kube-api-access-rgbjk\") pod \"multus-additional-cni-plugins-45m4m\" (UID: \"5354d283-a176-4db3-89b3-59b7d2081668\") " pod="openshift-multus/multus-additional-cni-plugins-45m4m"
Jul 23 00:20:14.082201 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.081781    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b4e3ecfb-d1fe-463f-9bb5-b35da3031d52-registration-dir\") pod \"aws-ebs-csi-driver-node-6vfps\" (UID: \"b4e3ecfb-d1fe-463f-9bb5-b35da3031d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6vfps"
Jul 23 00:20:14.082201 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.081801    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-etc-kubernetes\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:14.082201 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.081816    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-host-slash\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.082201 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.081831    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q5l8\" (UniqueName: \"kubernetes.io/projected/17093c98-5d84-4987-a1d7-d480d4f3bc29-kube-api-access-4q5l8\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.083295 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.082086    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b4e3ecfb-d1fe-463f-9bb5-b35da3031d52-registration-dir\") pod \"aws-ebs-csi-driver-node-6vfps\" (UID: \"b4e3ecfb-d1fe-463f-9bb5-b35da3031d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6vfps"
Jul 23 00:20:14.083295 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.082134    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bceae902-761d-44c5-b35a-2e83f90ac653-etc-kubernetes\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:14.083295 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.082168    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-host-slash\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.083295 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.083117    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-ovn-node-metrics-cert\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.084540 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.084515    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bceae902-761d-44c5-b35a-2e83f90ac653-tmp\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:14.084802 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:14.084737    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 00:20:14.084802 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:14.084754    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 00:20:14.084802 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:14.084767    2575 projected.go:196] Error preparing data for projected volume kube-api-access-455s4 for pod openshift-network-diagnostics/network-check-target-9pnlz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 00:20:14.086166 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.085786    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwsvl\" (UniqueName: \"kubernetes.io/projected/b4e3ecfb-d1fe-463f-9bb5-b35da3031d52-kube-api-access-rwsvl\") pod \"aws-ebs-csi-driver-node-6vfps\" (UID: \"b4e3ecfb-d1fe-463f-9bb5-b35da3031d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6vfps"
Jul 23 00:20:14.086166 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:14.085877    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae70da8b-d8aa-4b34-9780-3e53cb43fac9-kube-api-access-455s4 podName:ae70da8b-d8aa-4b34-9780-3e53cb43fac9 nodeName:}" failed. No retries permitted until 2026-07-23 00:20:14.58585302 +0000 UTC m=+2.989649462 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-455s4" (UniqueName: "kubernetes.io/projected/ae70da8b-d8aa-4b34-9780-3e53cb43fac9-kube-api-access-455s4") pod "network-check-target-9pnlz" (UID: "ae70da8b-d8aa-4b34-9780-3e53cb43fac9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 00:20:14.086878 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.086850    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxlfv\" (UniqueName: \"kubernetes.io/projected/a594d680-4ddd-4df4-9130-0a4e075dd19a-kube-api-access-kxlfv\") pod \"network-metrics-daemon-5bdx2\" (UID: \"a594d680-4ddd-4df4-9130-0a4e075dd19a\") " pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:14.089344 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.089324    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e2d0a009-a5ef-4d0e-a294-3e1f34647c9a-agent-certs\") pod \"konnectivity-agent-fw9dw\" (UID: \"e2d0a009-a5ef-4d0e-a294-3e1f34647c9a\") " pod="kube-system/konnectivity-agent-fw9dw"
Jul 23 00:20:14.089662 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.089644    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bceae902-761d-44c5-b35a-2e83f90ac653-etc-tuned\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:14.089760 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.089738    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkkgk\" (UniqueName: \"kubernetes.io/projected/9f541343-d56e-484e-9baf-7c16d3a507e3-kube-api-access-qkkgk\") pod \"iptables-alerter-6wl7h\" (UID: \"9f541343-d56e-484e-9baf-7c16d3a507e3\") " pod="openshift-network-operator/iptables-alerter-6wl7h"
Jul 23 00:20:14.090200 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.090145    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6c8v\" (UniqueName: \"kubernetes.io/projected/d20d0267-ce15-40ee-8f79-a24b8ef3016c-kube-api-access-g6c8v\") pod \"node-resolver-7wb6q\" (UID: \"d20d0267-ce15-40ee-8f79-a24b8ef3016c\") " pod="openshift-dns/node-resolver-7wb6q"
Jul 23 00:20:14.090817 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.090791    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jz9m\" (UniqueName: \"kubernetes.io/projected/3c56952e-6052-40d6-ac90-f998ec05586a-kube-api-access-4jz9m\") pod \"node-ca-rstk9\" (UID: \"3c56952e-6052-40d6-ac90-f998ec05586a\") " pod="openshift-image-registry/node-ca-rstk9"
Jul 23 00:20:14.091339 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.091318    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5qj7\" (UniqueName: \"kubernetes.io/projected/bceae902-761d-44c5-b35a-2e83f90ac653-kube-api-access-k5qj7\") pod \"tuned-7pgx5\" (UID: \"bceae902-761d-44c5-b35a-2e83f90ac653\") " pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:14.091444 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.091424    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvg9s\" (UniqueName: \"kubernetes.io/projected/b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9-kube-api-access-vvg9s\") pod \"ovnkube-node-lhvxb\" (UID: \"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.092247 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.092214    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q5l8\" (UniqueName: \"kubernetes.io/projected/17093c98-5d84-4987-a1d7-d480d4f3bc29-kube-api-access-4q5l8\") pod \"multus-8hpmj\" (UID: \"17093c98-5d84-4987-a1d7-d480d4f3bc29\") " pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.183495 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.183458    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18b6cfa7-6d8f-4934-b78c-789e54bdbac9-original-pull-secret\") pod \"global-pull-secret-syncer-sjjx7\" (UID: \"18b6cfa7-6d8f-4934-b78c-789e54bdbac9\") " pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:14.183495 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.183500    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5354d283-a176-4db3-89b3-59b7d2081668-system-cni-dir\") pod \"multus-additional-cni-plugins-45m4m\" (UID: \"5354d283-a176-4db3-89b3-59b7d2081668\") " pod="openshift-multus/multus-additional-cni-plugins-45m4m"
Jul 23 00:20:14.183717 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.183521    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5354d283-a176-4db3-89b3-59b7d2081668-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-45m4m\" (UID: \"5354d283-a176-4db3-89b3-59b7d2081668\") " pod="openshift-multus/multus-additional-cni-plugins-45m4m"
Jul 23 00:20:14.183717 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.183566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgbjk\" (UniqueName: \"kubernetes.io/projected/5354d283-a176-4db3-89b3-59b7d2081668-kube-api-access-rgbjk\") pod \"multus-additional-cni-plugins-45m4m\" (UID: \"5354d283-a176-4db3-89b3-59b7d2081668\") " pod="openshift-multus/multus-additional-cni-plugins-45m4m"
Jul 23 00:20:14.183717 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.183594    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5354d283-a176-4db3-89b3-59b7d2081668-system-cni-dir\") pod \"multus-additional-cni-plugins-45m4m\" (UID: \"5354d283-a176-4db3-89b3-59b7d2081668\") " pod="openshift-multus/multus-additional-cni-plugins-45m4m"
Jul 23 00:20:14.183717 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.183608    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5354d283-a176-4db3-89b3-59b7d2081668-cnibin\") pod \"multus-additional-cni-plugins-45m4m\" (UID: \"5354d283-a176-4db3-89b3-59b7d2081668\") " pod="openshift-multus/multus-additional-cni-plugins-45m4m"
Jul 23 00:20:14.183717 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:14.183688    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 00:20:14.183894 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:14.183784    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18b6cfa7-6d8f-4934-b78c-789e54bdbac9-original-pull-secret podName:18b6cfa7-6d8f-4934-b78c-789e54bdbac9 nodeName:}" failed. No retries permitted until 2026-07-23 00:20:14.683765924 +0000 UTC m=+3.087562375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18b6cfa7-6d8f-4934-b78c-789e54bdbac9-original-pull-secret") pod "global-pull-secret-syncer-sjjx7" (UID: "18b6cfa7-6d8f-4934-b78c-789e54bdbac9") : object "kube-system"/"original-pull-secret" not registered
Jul 23 00:20:14.183894 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.183887    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5354d283-a176-4db3-89b3-59b7d2081668-cnibin\") pod \"multus-additional-cni-plugins-45m4m\" (UID: \"5354d283-a176-4db3-89b3-59b7d2081668\") " pod="openshift-multus/multus-additional-cni-plugins-45m4m"
Jul 23 00:20:14.184015 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.183943    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5354d283-a176-4db3-89b3-59b7d2081668-cni-binary-copy\") pod \"multus-additional-cni-plugins-45m4m\" (UID: \"5354d283-a176-4db3-89b3-59b7d2081668\") " pod="openshift-multus/multus-additional-cni-plugins-45m4m"
Jul 23 00:20:14.184015 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.183990    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5354d283-a176-4db3-89b3-59b7d2081668-os-release\") pod \"multus-additional-cni-plugins-45m4m\" (UID: \"5354d283-a176-4db3-89b3-59b7d2081668\") " pod="openshift-multus/multus-additional-cni-plugins-45m4m"
Jul 23 00:20:14.184084 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.184016    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/18b6cfa7-6d8f-4934-b78c-789e54bdbac9-kubelet-config\") pod \"global-pull-secret-syncer-sjjx7\" (UID: \"18b6cfa7-6d8f-4934-b78c-789e54bdbac9\") " pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:14.184084 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.184046    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5354d283-a176-4db3-89b3-59b7d2081668-tuning-conf-dir\") pod \"multus-additional-cni-plugins-45m4m\" (UID: \"5354d283-a176-4db3-89b3-59b7d2081668\") " pod="openshift-multus/multus-additional-cni-plugins-45m4m"
Jul 23 00:20:14.184084 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.184068    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5354d283-a176-4db3-89b3-59b7d2081668-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-45m4m\" (UID: \"5354d283-a176-4db3-89b3-59b7d2081668\") " pod="openshift-multus/multus-additional-cni-plugins-45m4m"
Jul 23 00:20:14.184189 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.184111    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/18b6cfa7-6d8f-4934-b78c-789e54bdbac9-dbus\") pod \"global-pull-secret-syncer-sjjx7\" (UID: \"18b6cfa7-6d8f-4934-b78c-789e54bdbac9\") " pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:14.184286 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.184265    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/18b6cfa7-6d8f-4934-b78c-789e54bdbac9-dbus\") pod \"global-pull-secret-syncer-sjjx7\" (UID: \"18b6cfa7-6d8f-4934-b78c-789e54bdbac9\") " pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:14.184514 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.184489    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5354d283-a176-4db3-89b3-59b7d2081668-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-45m4m\" (UID: \"5354d283-a176-4db3-89b3-59b7d2081668\") " pod="openshift-multus/multus-additional-cni-plugins-45m4m"
Jul 23 00:20:14.184601 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.184581    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/18b6cfa7-6d8f-4934-b78c-789e54bdbac9-kubelet-config\") pod \"global-pull-secret-syncer-sjjx7\" (UID: \"18b6cfa7-6d8f-4934-b78c-789e54bdbac9\") " pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:14.184656 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.184646    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5354d283-a176-4db3-89b3-59b7d2081668-os-release\") pod \"multus-additional-cni-plugins-45m4m\" (UID: \"5354d283-a176-4db3-89b3-59b7d2081668\") " pod="openshift-multus/multus-additional-cni-plugins-45m4m"
Jul 23 00:20:14.184719 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.184700    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5354d283-a176-4db3-89b3-59b7d2081668-cni-binary-copy\") pod \"multus-additional-cni-plugins-45m4m\" (UID: \"5354d283-a176-4db3-89b3-59b7d2081668\") " pod="openshift-multus/multus-additional-cni-plugins-45m4m"
Jul 23 00:20:14.184780 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.184770    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5354d283-a176-4db3-89b3-59b7d2081668-tuning-conf-dir\") pod \"multus-additional-cni-plugins-45m4m\" (UID: \"5354d283-a176-4db3-89b3-59b7d2081668\") " pod="openshift-multus/multus-additional-cni-plugins-45m4m"
Jul 23 00:20:14.185105 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.185084    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5354d283-a176-4db3-89b3-59b7d2081668-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-45m4m\" (UID: \"5354d283-a176-4db3-89b3-59b7d2081668\") " pod="openshift-multus/multus-additional-cni-plugins-45m4m"
Jul 23 00:20:14.192004 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.191948    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgbjk\" (UniqueName: \"kubernetes.io/projected/5354d283-a176-4db3-89b3-59b7d2081668-kube-api-access-rgbjk\") pod \"multus-additional-cni-plugins-45m4m\" (UID: \"5354d283-a176-4db3-89b3-59b7d2081668\") " pod="openshift-multus/multus-additional-cni-plugins-45m4m"
Jul 23 00:20:14.266218 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.266170    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6wl7h"
Jul 23 00:20:14.274456 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.274435    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rstk9"
Jul 23 00:20:14.283383 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.283361    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7pgx5"
Jul 23 00:20:14.289206 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.289191    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:14.297868 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.297852    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8hpmj"
Jul 23 00:20:14.306404 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.306378    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6vfps"
Jul 23 00:20:14.312907 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.312882    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fw9dw"
Jul 23 00:20:14.320383 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.320355    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7wb6q"
Jul 23 00:20:14.325847 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.325830    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-45m4m"
Jul 23 00:20:14.586718 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.586643    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-455s4\" (UniqueName: \"kubernetes.io/projected/ae70da8b-d8aa-4b34-9780-3e53cb43fac9-kube-api-access-455s4\") pod \"network-check-target-9pnlz\" (UID: \"ae70da8b-d8aa-4b34-9780-3e53cb43fac9\") " pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:20:14.586718 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.586702    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a594d680-4ddd-4df4-9130-0a4e075dd19a-metrics-certs\") pod \"network-metrics-daemon-5bdx2\" (UID: \"a594d680-4ddd-4df4-9130-0a4e075dd19a\") " pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:14.586876 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:14.586794    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 00:20:14.586876 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:14.586821    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 00:20:14.586876 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:14.586844    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 00:20:14.586876 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:14.586854    2575 projected.go:196] Error preparing data for projected volume kube-api-access-455s4 for pod openshift-network-diagnostics/network-check-target-9pnlz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 00:20:14.587015 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:14.586846    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a594d680-4ddd-4df4-9130-0a4e075dd19a-metrics-certs podName:a594d680-4ddd-4df4-9130-0a4e075dd19a nodeName:}" failed. No retries permitted until 2026-07-23 00:20:15.586833738 +0000 UTC m=+3.990630172 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a594d680-4ddd-4df4-9130-0a4e075dd19a-metrics-certs") pod "network-metrics-daemon-5bdx2" (UID: "a594d680-4ddd-4df4-9130-0a4e075dd19a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 00:20:14.587015 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:14.586926    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae70da8b-d8aa-4b34-9780-3e53cb43fac9-kube-api-access-455s4 podName:ae70da8b-d8aa-4b34-9780-3e53cb43fac9 nodeName:}" failed. No retries permitted until 2026-07-23 00:20:15.58689425 +0000 UTC m=+3.990690686 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-455s4" (UniqueName: "kubernetes.io/projected/ae70da8b-d8aa-4b34-9780-3e53cb43fac9-kube-api-access-455s4") pod "network-check-target-9pnlz" (UID: "ae70da8b-d8aa-4b34-9780-3e53cb43fac9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 00:20:14.687110 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.687071    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18b6cfa7-6d8f-4934-b78c-789e54bdbac9-original-pull-secret\") pod \"global-pull-secret-syncer-sjjx7\" (UID: \"18b6cfa7-6d8f-4934-b78c-789e54bdbac9\") " pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:14.687289 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:14.687205    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 00:20:14.687358 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:14.687290    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18b6cfa7-6d8f-4934-b78c-789e54bdbac9-original-pull-secret podName:18b6cfa7-6d8f-4934-b78c-789e54bdbac9 nodeName:}" failed. No retries permitted until 2026-07-23 00:20:15.687269149 +0000 UTC m=+4.091065593 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18b6cfa7-6d8f-4934-b78c-789e54bdbac9-original-pull-secret") pod "global-pull-secret-syncer-sjjx7" (UID: "18b6cfa7-6d8f-4934-b78c-789e54bdbac9") : object "kube-system"/"original-pull-secret" not registered
Jul 23 00:20:14.966070 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:14.966026    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c56952e_6052_40d6_ac90_f998ec05586a.slice/crio-4d26cb53c514ee2de6a37f6d00931689d7bb27a385b6fa3df9146b5f455178f9 WatchSource:0}: Error finding container 4d26cb53c514ee2de6a37f6d00931689d7bb27a385b6fa3df9146b5f455178f9: Status 404 returned error can't find the container with id 4d26cb53c514ee2de6a37f6d00931689d7bb27a385b6fa3df9146b5f455178f9
Jul 23 00:20:14.966658 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:14.966630    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5354d283_a176_4db3_89b3_59b7d2081668.slice/crio-9ee01ce0208990f12cb4196ed19c75db8c47298a1326843e5f947e0f11657782 WatchSource:0}: Error finding container 9ee01ce0208990f12cb4196ed19c75db8c47298a1326843e5f947e0f11657782: Status 404 returned error can't find the container with id 9ee01ce0208990f12cb4196ed19c75db8c47298a1326843e5f947e0f11657782
Jul 23 00:20:14.968491 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:14.968416    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f541343_d56e_484e_9baf_7c16d3a507e3.slice/crio-ddcd38b0b9976dff8e581c1201888671bec6cd2bfa4cd9e6d272f334bdf0b02b WatchSource:0}: Error finding container ddcd38b0b9976dff8e581c1201888671bec6cd2bfa4cd9e6d272f334bdf0b02b: Status 404 returned error can't find the container with id ddcd38b0b9976dff8e581c1201888671bec6cd2bfa4cd9e6d272f334bdf0b02b
Jul 23 00:20:14.981678 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:14.981652    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd20d0267_ce15_40ee_8f79_a24b8ef3016c.slice/crio-8bb28ea019e613fcd2c9ec769cb9f30477b958a54321250defc2141661608a38 WatchSource:0}: Error finding container 8bb28ea019e613fcd2c9ec769cb9f30477b958a54321250defc2141661608a38: Status 404 returned error can't find the container with id 8bb28ea019e613fcd2c9ec769cb9f30477b958a54321250defc2141661608a38
Jul 23 00:20:14.982164 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:14.982138    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17093c98_5d84_4987_a1d7_d480d4f3bc29.slice/crio-94d7aa748855b68cb2213a41c544886c0d70e135ba53d1378a9fdd732ecdfdb0 WatchSource:0}: Error finding container 94d7aa748855b68cb2213a41c544886c0d70e135ba53d1378a9fdd732ecdfdb0: Status 404 returned error can't find the container with id 94d7aa748855b68cb2213a41c544886c0d70e135ba53d1378a9fdd732ecdfdb0
Jul 23 00:20:14.983579 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:14.983553    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9cdd5cd_7fdd_42d6_ba29_3f0d5e1f5db9.slice/crio-29ed75105bd59f7575753cd71ae224ff2e086e9cfd6d7e63147ce7d843a692c3 WatchSource:0}: Error finding container 29ed75105bd59f7575753cd71ae224ff2e086e9cfd6d7e63147ce7d843a692c3: Status 404 returned error can't find the container with id 29ed75105bd59f7575753cd71ae224ff2e086e9cfd6d7e63147ce7d843a692c3
Jul 23 00:20:14.984991 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:14.984954    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2d0a009_a5ef_4d0e_a294_3e1f34647c9a.slice/crio-4d481c8fa33619e6d31bfe489b66496128c0f856c425703ef4f6c40c6a783dea WatchSource:0}: Error finding container 4d481c8fa33619e6d31bfe489b66496128c0f856c425703ef4f6c40c6a783dea: Status 404 returned error can't find the container with id 4d481c8fa33619e6d31bfe489b66496128c0f856c425703ef4f6c40c6a783dea
Jul 23 00:20:14.986274 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:14.985956    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbceae902_761d_44c5_b35a_2e83f90ac653.slice/crio-8c373b010745d342364089048b55a025cd929678d8a12d12b6e7f33d063e8b91 WatchSource:0}: Error finding container 8c373b010745d342364089048b55a025cd929678d8a12d12b6e7f33d063e8b91: Status 404 returned error can't find the container with id 8c373b010745d342364089048b55a025cd929678d8a12d12b6e7f33d063e8b91
Jul 23 00:20:14.987834 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:14.987644    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4e3ecfb_d1fe_463f_9bb5_b35da3031d52.slice/crio-11cf7973457d454689fa2f3e454841b53d9ade50aeaf0e5b25dce027dc221cff WatchSource:0}: Error finding container 11cf7973457d454689fa2f3e454841b53d9ade50aeaf0e5b25dce027dc221cff: Status 404 returned error can't find the container with id 11cf7973457d454689fa2f3e454841b53d9ade50aeaf0e5b25dce027dc221cff
Jul 23 00:20:14.995804 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.995757    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 00:15:13 +0000 UTC" deadline="2028-02-23 23:22:19.45111108 +0000 UTC"
Jul 23 00:20:14.996220 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:14.996163    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13943h2m4.455310266s"
Jul 23 00:20:15.122704 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:15.122516    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:20:15.122852 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:15.122784    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pnlz" podUID="ae70da8b-d8aa-4b34-9780-3e53cb43fac9"
Jul 23 00:20:15.130732 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:15.130700    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6vfps" event={"ID":"b4e3ecfb-d1fe-463f-9bb5-b35da3031d52","Type":"ContainerStarted","Data":"11cf7973457d454689fa2f3e454841b53d9ade50aeaf0e5b25dce027dc221cff"}
Jul 23 00:20:15.131819 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:15.131793    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7wb6q" event={"ID":"d20d0267-ce15-40ee-8f79-a24b8ef3016c","Type":"ContainerStarted","Data":"8bb28ea019e613fcd2c9ec769cb9f30477b958a54321250defc2141661608a38"}
Jul 23 00:20:15.132841 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:15.132821    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-45m4m" event={"ID":"5354d283-a176-4db3-89b3-59b7d2081668","Type":"ContainerStarted","Data":"9ee01ce0208990f12cb4196ed19c75db8c47298a1326843e5f947e0f11657782"}
Jul 23 00:20:15.133818 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:15.133794    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6wl7h" event={"ID":"9f541343-d56e-484e-9baf-7c16d3a507e3","Type":"ContainerStarted","Data":"ddcd38b0b9976dff8e581c1201888671bec6cd2bfa4cd9e6d272f334bdf0b02b"}
Jul 23 00:20:15.135801 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:15.135779    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7pgx5" event={"ID":"bceae902-761d-44c5-b35a-2e83f90ac653","Type":"ContainerStarted","Data":"8c373b010745d342364089048b55a025cd929678d8a12d12b6e7f33d063e8b91"}
Jul 23 00:20:15.136889 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:15.136870    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb" event={"ID":"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9","Type":"ContainerStarted","Data":"29ed75105bd59f7575753cd71ae224ff2e086e9cfd6d7e63147ce7d843a692c3"}
Jul 23 00:20:15.139528 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:15.139502    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fw9dw" event={"ID":"e2d0a009-a5ef-4d0e-a294-3e1f34647c9a","Type":"ContainerStarted","Data":"4d481c8fa33619e6d31bfe489b66496128c0f856c425703ef4f6c40c6a783dea"}
Jul 23 00:20:15.140566 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:15.140546    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8hpmj" event={"ID":"17093c98-5d84-4987-a1d7-d480d4f3bc29","Type":"ContainerStarted","Data":"94d7aa748855b68cb2213a41c544886c0d70e135ba53d1378a9fdd732ecdfdb0"}
Jul 23 00:20:15.141574 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:15.141556    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rstk9" event={"ID":"3c56952e-6052-40d6-ac90-f998ec05586a","Type":"ContainerStarted","Data":"4d26cb53c514ee2de6a37f6d00931689d7bb27a385b6fa3df9146b5f455178f9"}
Jul 23 00:20:15.143422 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:15.143377    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-176.ec2.internal" event={"ID":"4a00a11760339a8d98a59b9745057c66","Type":"ContainerStarted","Data":"ef65b33d8d2954e74e1df7cfd10c8d874c4799dcb32e2b0cc6b27c1c3a1125ef"}
Jul 23 00:20:15.156187 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:15.156150    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-176.ec2.internal" podStartSLOduration=2.156137687 podStartE2EDuration="2.156137687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:20:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:20:15.155358237 +0000 UTC m=+3.559154687" watchObservedRunningTime="2026-07-23 00:20:15.156137687 +0000 UTC m=+3.559934144"
Jul 23 00:20:15.593655 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:15.593561    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a594d680-4ddd-4df4-9130-0a4e075dd19a-metrics-certs\") pod \"network-metrics-daemon-5bdx2\" (UID: \"a594d680-4ddd-4df4-9130-0a4e075dd19a\") " pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:15.593655 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:15.593605    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-455s4\" (UniqueName: \"kubernetes.io/projected/ae70da8b-d8aa-4b34-9780-3e53cb43fac9-kube-api-access-455s4\") pod \"network-check-target-9pnlz\" (UID: \"ae70da8b-d8aa-4b34-9780-3e53cb43fac9\") " pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:20:15.593831 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:15.593716    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 00:20:15.593831 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:15.593731    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 00:20:15.593831 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:15.593740    2575 projected.go:196] Error preparing data for projected volume kube-api-access-455s4 for pod openshift-network-diagnostics/network-check-target-9pnlz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 00:20:15.593831 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:15.593785    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae70da8b-d8aa-4b34-9780-3e53cb43fac9-kube-api-access-455s4 podName:ae70da8b-d8aa-4b34-9780-3e53cb43fac9 nodeName:}" failed. No retries permitted until 2026-07-23 00:20:17.593772586 +0000 UTC m=+5.997569021 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-455s4" (UniqueName: "kubernetes.io/projected/ae70da8b-d8aa-4b34-9780-3e53cb43fac9-kube-api-access-455s4") pod "network-check-target-9pnlz" (UID: "ae70da8b-d8aa-4b34-9780-3e53cb43fac9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 00:20:15.594260 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:15.594238    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 00:20:15.594439 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:15.594298    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a594d680-4ddd-4df4-9130-0a4e075dd19a-metrics-certs podName:a594d680-4ddd-4df4-9130-0a4e075dd19a nodeName:}" failed. No retries permitted until 2026-07-23 00:20:17.594281453 +0000 UTC m=+5.998077894 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a594d680-4ddd-4df4-9130-0a4e075dd19a-metrics-certs") pod "network-metrics-daemon-5bdx2" (UID: "a594d680-4ddd-4df4-9130-0a4e075dd19a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 00:20:15.695307 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:15.694705    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18b6cfa7-6d8f-4934-b78c-789e54bdbac9-original-pull-secret\") pod \"global-pull-secret-syncer-sjjx7\" (UID: \"18b6cfa7-6d8f-4934-b78c-789e54bdbac9\") " pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:15.695307 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:15.694873    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 00:20:15.695307 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:15.694952    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18b6cfa7-6d8f-4934-b78c-789e54bdbac9-original-pull-secret podName:18b6cfa7-6d8f-4934-b78c-789e54bdbac9 nodeName:}" failed. No retries permitted until 2026-07-23 00:20:17.694933908 +0000 UTC m=+6.098730358 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18b6cfa7-6d8f-4934-b78c-789e54bdbac9-original-pull-secret") pod "global-pull-secret-syncer-sjjx7" (UID: "18b6cfa7-6d8f-4934-b78c-789e54bdbac9") : object "kube-system"/"original-pull-secret" not registered
Jul 23 00:20:15.997295 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:15.997202    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 00:15:13 +0000 UTC" deadline="2027-12-21 02:07:58.436998193 +0000 UTC"
Jul 23 00:20:15.997295 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:15.997247    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12385h47m42.439755345s"
Jul 23 00:20:16.125373 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:16.125342    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:16.125559 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:16.125484    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bdx2" podUID="a594d680-4ddd-4df4-9130-0a4e075dd19a"
Jul 23 00:20:16.125872 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:16.125854    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:16.125984 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:16.125965    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjjx7" podUID="18b6cfa7-6d8f-4934-b78c-789e54bdbac9"
Jul 23 00:20:16.163939 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:16.163728    2575 generic.go:356] "Generic (PLEG): container finished" podID="cc7e38348870c33ddb5bc928a23b8d26" containerID="723f922aa7066d88ea8bdfd539ed1d2645ff94670fd711f7e9debc93411ffcf3" exitCode=0
Jul 23 00:20:16.164585 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:16.164265    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-176.ec2.internal" event={"ID":"cc7e38348870c33ddb5bc928a23b8d26","Type":"ContainerDied","Data":"723f922aa7066d88ea8bdfd539ed1d2645ff94670fd711f7e9debc93411ffcf3"}
Jul 23 00:20:17.123653 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:17.123163    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:20:17.123653 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:17.123296    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pnlz" podUID="ae70da8b-d8aa-4b34-9780-3e53cb43fac9"
Jul 23 00:20:17.186945 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:17.186252    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-176.ec2.internal" event={"ID":"cc7e38348870c33ddb5bc928a23b8d26","Type":"ContainerStarted","Data":"ca18afcb23630b3814a699ae90a0e9ec090b9528b118585a09c1237c1b894f76"}
Jul 23 00:20:17.200865 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:17.200799    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-176.ec2.internal" podStartSLOduration=4.200777926 podStartE2EDuration="4.200777926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:20:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:20:17.200139059 +0000 UTC m=+5.603935509" watchObservedRunningTime="2026-07-23 00:20:17.200777926 +0000 UTC m=+5.604574384"
Jul 23 00:20:17.610190 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:17.609322    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-455s4\" (UniqueName: \"kubernetes.io/projected/ae70da8b-d8aa-4b34-9780-3e53cb43fac9-kube-api-access-455s4\") pod \"network-check-target-9pnlz\" (UID: \"ae70da8b-d8aa-4b34-9780-3e53cb43fac9\") " pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:20:17.610190 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:17.609410    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a594d680-4ddd-4df4-9130-0a4e075dd19a-metrics-certs\") pod \"network-metrics-daemon-5bdx2\" (UID: \"a594d680-4ddd-4df4-9130-0a4e075dd19a\") " pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:17.610190 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:17.609530    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 00:20:17.610190 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:17.609593    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a594d680-4ddd-4df4-9130-0a4e075dd19a-metrics-certs podName:a594d680-4ddd-4df4-9130-0a4e075dd19a nodeName:}" failed. No retries permitted until 2026-07-23 00:20:21.609574091 +0000 UTC m=+10.013370548 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a594d680-4ddd-4df4-9130-0a4e075dd19a-metrics-certs") pod "network-metrics-daemon-5bdx2" (UID: "a594d680-4ddd-4df4-9130-0a4e075dd19a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 00:20:17.610190 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:17.610030    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 00:20:17.610190 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:17.610049    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 00:20:17.610190 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:17.610061    2575 projected.go:196] Error preparing data for projected volume kube-api-access-455s4 for pod openshift-network-diagnostics/network-check-target-9pnlz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 00:20:17.610190 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:17.610106    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae70da8b-d8aa-4b34-9780-3e53cb43fac9-kube-api-access-455s4 podName:ae70da8b-d8aa-4b34-9780-3e53cb43fac9 nodeName:}" failed. No retries permitted until 2026-07-23 00:20:21.610090765 +0000 UTC m=+10.013887220 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-455s4" (UniqueName: "kubernetes.io/projected/ae70da8b-d8aa-4b34-9780-3e53cb43fac9-kube-api-access-455s4") pod "network-check-target-9pnlz" (UID: "ae70da8b-d8aa-4b34-9780-3e53cb43fac9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 00:20:17.710512 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:17.709923    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18b6cfa7-6d8f-4934-b78c-789e54bdbac9-original-pull-secret\") pod \"global-pull-secret-syncer-sjjx7\" (UID: \"18b6cfa7-6d8f-4934-b78c-789e54bdbac9\") " pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:17.710512 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:17.710095    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 00:20:17.710512 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:17.710156    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18b6cfa7-6d8f-4934-b78c-789e54bdbac9-original-pull-secret podName:18b6cfa7-6d8f-4934-b78c-789e54bdbac9 nodeName:}" failed. No retries permitted until 2026-07-23 00:20:21.710138779 +0000 UTC m=+10.113935230 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18b6cfa7-6d8f-4934-b78c-789e54bdbac9-original-pull-secret") pod "global-pull-secret-syncer-sjjx7" (UID: "18b6cfa7-6d8f-4934-b78c-789e54bdbac9") : object "kube-system"/"original-pull-secret" not registered
Jul 23 00:20:18.124061 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:18.124028    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:18.124528 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:18.124168    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjjx7" podUID="18b6cfa7-6d8f-4934-b78c-789e54bdbac9"
Jul 23 00:20:18.126524 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:18.126500    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:18.126643 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:18.126619    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bdx2" podUID="a594d680-4ddd-4df4-9130-0a4e075dd19a"
Jul 23 00:20:19.122770 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:19.122601    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:20:19.122984 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:19.122790    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pnlz" podUID="ae70da8b-d8aa-4b34-9780-3e53cb43fac9"
Jul 23 00:20:20.126957 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:20.126301    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:20.126957 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:20.126422    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjjx7" podUID="18b6cfa7-6d8f-4934-b78c-789e54bdbac9"
Jul 23 00:20:20.126957 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:20.126791    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:20.126957 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:20.126894    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bdx2" podUID="a594d680-4ddd-4df4-9130-0a4e075dd19a"
Jul 23 00:20:21.122988 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:21.122952    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:20:21.123177 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:21.123081    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pnlz" podUID="ae70da8b-d8aa-4b34-9780-3e53cb43fac9"
Jul 23 00:20:21.644619 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:21.643742    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-455s4\" (UniqueName: \"kubernetes.io/projected/ae70da8b-d8aa-4b34-9780-3e53cb43fac9-kube-api-access-455s4\") pod \"network-check-target-9pnlz\" (UID: \"ae70da8b-d8aa-4b34-9780-3e53cb43fac9\") " pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:20:21.644619 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:21.643833    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a594d680-4ddd-4df4-9130-0a4e075dd19a-metrics-certs\") pod \"network-metrics-daemon-5bdx2\" (UID: \"a594d680-4ddd-4df4-9130-0a4e075dd19a\") " pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:21.644619 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:21.643947    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 00:20:21.644619 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:21.644005    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a594d680-4ddd-4df4-9130-0a4e075dd19a-metrics-certs podName:a594d680-4ddd-4df4-9130-0a4e075dd19a nodeName:}" failed. No retries permitted until 2026-07-23 00:20:29.643987194 +0000 UTC m=+18.047783635 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a594d680-4ddd-4df4-9130-0a4e075dd19a-metrics-certs") pod "network-metrics-daemon-5bdx2" (UID: "a594d680-4ddd-4df4-9130-0a4e075dd19a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 00:20:21.644619 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:21.644389    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 00:20:21.644619 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:21.644420    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 00:20:21.644619 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:21.644433    2575 projected.go:196] Error preparing data for projected volume kube-api-access-455s4 for pod openshift-network-diagnostics/network-check-target-9pnlz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 00:20:21.644619 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:21.644477    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae70da8b-d8aa-4b34-9780-3e53cb43fac9-kube-api-access-455s4 podName:ae70da8b-d8aa-4b34-9780-3e53cb43fac9 nodeName:}" failed. No retries permitted until 2026-07-23 00:20:29.644463151 +0000 UTC m=+18.048259586 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-455s4" (UniqueName: "kubernetes.io/projected/ae70da8b-d8aa-4b34-9780-3e53cb43fac9-kube-api-access-455s4") pod "network-check-target-9pnlz" (UID: "ae70da8b-d8aa-4b34-9780-3e53cb43fac9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 00:20:21.744618 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:21.744579    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18b6cfa7-6d8f-4934-b78c-789e54bdbac9-original-pull-secret\") pod \"global-pull-secret-syncer-sjjx7\" (UID: \"18b6cfa7-6d8f-4934-b78c-789e54bdbac9\") " pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:21.744790 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:21.744730    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 00:20:21.744852 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:21.744798    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18b6cfa7-6d8f-4934-b78c-789e54bdbac9-original-pull-secret podName:18b6cfa7-6d8f-4934-b78c-789e54bdbac9 nodeName:}" failed. No retries permitted until 2026-07-23 00:20:29.744778413 +0000 UTC m=+18.148574867 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18b6cfa7-6d8f-4934-b78c-789e54bdbac9-original-pull-secret") pod "global-pull-secret-syncer-sjjx7" (UID: "18b6cfa7-6d8f-4934-b78c-789e54bdbac9") : object "kube-system"/"original-pull-secret" not registered
Jul 23 00:20:22.126053 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:22.125470    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:22.126053 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:22.125601    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bdx2" podUID="a594d680-4ddd-4df4-9130-0a4e075dd19a"
Jul 23 00:20:22.126053 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:22.126004    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:22.126309 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:22.126098    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjjx7" podUID="18b6cfa7-6d8f-4934-b78c-789e54bdbac9"
Jul 23 00:20:23.123421 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:23.122956    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:20:23.123421 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:23.123089    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pnlz" podUID="ae70da8b-d8aa-4b34-9780-3e53cb43fac9"
Jul 23 00:20:24.125169 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:24.124021    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:24.125169 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:24.124161    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjjx7" podUID="18b6cfa7-6d8f-4934-b78c-789e54bdbac9"
Jul 23 00:20:24.125169 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:24.124249    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:24.125169 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:24.124375    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bdx2" podUID="a594d680-4ddd-4df4-9130-0a4e075dd19a"
Jul 23 00:20:25.123300 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:25.123258    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:20:25.123495 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:25.123394    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pnlz" podUID="ae70da8b-d8aa-4b34-9780-3e53cb43fac9"
Jul 23 00:20:26.122859 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:26.122822    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:26.123325 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:26.122821    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:26.123325 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:26.122991    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjjx7" podUID="18b6cfa7-6d8f-4934-b78c-789e54bdbac9"
Jul 23 00:20:26.123325 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:26.123045    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bdx2" podUID="a594d680-4ddd-4df4-9130-0a4e075dd19a"
Jul 23 00:20:27.122926 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:27.122884    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:20:27.123370 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:27.123016    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pnlz" podUID="ae70da8b-d8aa-4b34-9780-3e53cb43fac9"
Jul 23 00:20:28.122654 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:28.122598    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:28.122821 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:28.122743    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjjx7" podUID="18b6cfa7-6d8f-4934-b78c-789e54bdbac9"
Jul 23 00:20:28.122821 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:28.122784    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:28.122948 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:28.122851    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bdx2" podUID="a594d680-4ddd-4df4-9130-0a4e075dd19a"
Jul 23 00:20:29.123414 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:29.123370    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:20:29.123903 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:29.123511    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pnlz" podUID="ae70da8b-d8aa-4b34-9780-3e53cb43fac9"
Jul 23 00:20:29.704393 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:29.704339    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-455s4\" (UniqueName: \"kubernetes.io/projected/ae70da8b-d8aa-4b34-9780-3e53cb43fac9-kube-api-access-455s4\") pod \"network-check-target-9pnlz\" (UID: \"ae70da8b-d8aa-4b34-9780-3e53cb43fac9\") " pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:20:29.704585 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:29.704444    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a594d680-4ddd-4df4-9130-0a4e075dd19a-metrics-certs\") pod \"network-metrics-daemon-5bdx2\" (UID: \"a594d680-4ddd-4df4-9130-0a4e075dd19a\") " pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:29.704585 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:29.704519    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 00:20:29.704585 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:29.704542    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 00:20:29.704585 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:29.704555    2575 projected.go:196] Error preparing data for projected volume kube-api-access-455s4 for pod openshift-network-diagnostics/network-check-target-9pnlz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 00:20:29.704585 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:29.704564    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 00:20:29.704836 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:29.704610    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae70da8b-d8aa-4b34-9780-3e53cb43fac9-kube-api-access-455s4 podName:ae70da8b-d8aa-4b34-9780-3e53cb43fac9 nodeName:}" failed. No retries permitted until 2026-07-23 00:20:45.704593519 +0000 UTC m=+34.108389953 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-455s4" (UniqueName: "kubernetes.io/projected/ae70da8b-d8aa-4b34-9780-3e53cb43fac9-kube-api-access-455s4") pod "network-check-target-9pnlz" (UID: "ae70da8b-d8aa-4b34-9780-3e53cb43fac9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 00:20:29.704836 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:29.704634    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a594d680-4ddd-4df4-9130-0a4e075dd19a-metrics-certs podName:a594d680-4ddd-4df4-9130-0a4e075dd19a nodeName:}" failed. No retries permitted until 2026-07-23 00:20:45.704623752 +0000 UTC m=+34.108420186 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a594d680-4ddd-4df4-9130-0a4e075dd19a-metrics-certs") pod "network-metrics-daemon-5bdx2" (UID: "a594d680-4ddd-4df4-9130-0a4e075dd19a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 00:20:29.805110 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:29.805025    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18b6cfa7-6d8f-4934-b78c-789e54bdbac9-original-pull-secret\") pod \"global-pull-secret-syncer-sjjx7\" (UID: \"18b6cfa7-6d8f-4934-b78c-789e54bdbac9\") " pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:29.805248 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:29.805196    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 00:20:29.805297 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:29.805284    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18b6cfa7-6d8f-4934-b78c-789e54bdbac9-original-pull-secret podName:18b6cfa7-6d8f-4934-b78c-789e54bdbac9 nodeName:}" failed. No retries permitted until 2026-07-23 00:20:45.805261193 +0000 UTC m=+34.209057661 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18b6cfa7-6d8f-4934-b78c-789e54bdbac9-original-pull-secret") pod "global-pull-secret-syncer-sjjx7" (UID: "18b6cfa7-6d8f-4934-b78c-789e54bdbac9") : object "kube-system"/"original-pull-secret" not registered
Jul 23 00:20:30.125709 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:30.125622    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:30.125709 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:30.125658    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:30.126235 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:30.125746    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bdx2" podUID="a594d680-4ddd-4df4-9130-0a4e075dd19a"
Jul 23 00:20:30.126235 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:30.126160    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjjx7" podUID="18b6cfa7-6d8f-4934-b78c-789e54bdbac9"
Jul 23 00:20:31.122520 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:31.122490    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:20:31.122710 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:31.122596    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pnlz" podUID="ae70da8b-d8aa-4b34-9780-3e53cb43fac9"
Jul 23 00:20:32.123981 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:32.123950    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:32.124444 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:32.124053    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjjx7" podUID="18b6cfa7-6d8f-4934-b78c-789e54bdbac9"
Jul 23 00:20:32.124444 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:32.124102    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:32.124444 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:32.124236    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bdx2" podUID="a594d680-4ddd-4df4-9130-0a4e075dd19a"
Jul 23 00:20:33.122746 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:33.122710    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:20:33.122962 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:33.122838    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pnlz" podUID="ae70da8b-d8aa-4b34-9780-3e53cb43fac9"
Jul 23 00:20:34.122865 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:34.122696    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:34.123698 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:34.122735    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:34.123698 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:34.122980    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjjx7" podUID="18b6cfa7-6d8f-4934-b78c-789e54bdbac9"
Jul 23 00:20:34.123698 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:34.123106    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bdx2" podUID="a594d680-4ddd-4df4-9130-0a4e075dd19a"
Jul 23 00:20:34.224560 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:34.224365    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6vfps" event={"ID":"b4e3ecfb-d1fe-463f-9bb5-b35da3031d52","Type":"ContainerStarted","Data":"b154ed58594e9cd201d8d734562a553b24c7e5b4542afcb580cddab827a1939a"}
Jul 23 00:20:34.225928 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:34.225883    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7wb6q" event={"ID":"d20d0267-ce15-40ee-8f79-a24b8ef3016c","Type":"ContainerStarted","Data":"f2cf5fa7a719e87e3aed532551da3d4e4b3992c263fef2defb3220b451e9b44b"}
Jul 23 00:20:34.227636 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:34.227609    2575 generic.go:356] "Generic (PLEG): container finished" podID="5354d283-a176-4db3-89b3-59b7d2081668" containerID="397667f49dd7e47a47a3ff6f74576ddeb0494a87dbe56c087e325f9d98d3f5c5" exitCode=0
Jul 23 00:20:34.227751 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:34.227689    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-45m4m" event={"ID":"5354d283-a176-4db3-89b3-59b7d2081668","Type":"ContainerDied","Data":"397667f49dd7e47a47a3ff6f74576ddeb0494a87dbe56c087e325f9d98d3f5c5"}
Jul 23 00:20:34.234337 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:34.234315    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7pgx5" event={"ID":"bceae902-761d-44c5-b35a-2e83f90ac653","Type":"ContainerStarted","Data":"66630eb41710d1993fe318fcc9fe3a89a8acba07c17c91affcfae1b9790888ff"}
Jul 23 00:20:34.238657 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:34.238571    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhvxb_b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9/ovn-acl-logging/0.log"
Jul 23 00:20:34.241236 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:34.241082    2575 generic.go:356] "Generic (PLEG): container finished" podID="b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9" containerID="947f2bc2a9c23713a0d3a5f58c62b512183fc62b56eaee45ddc1e35c9440345a" exitCode=1
Jul 23 00:20:34.241236 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:34.241115    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb" event={"ID":"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9","Type":"ContainerStarted","Data":"4e02c3aeb578d4dc38e6cd8737f8cd1fcf806282684312a6decabfed0addb151"}
Jul 23 00:20:34.241236 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:34.241053    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7wb6q" podStartSLOduration=3.50748527 podStartE2EDuration="22.241037772s" totalImagesPullingTime="18.733552502s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:20:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:20:34.240679617 +0000 UTC m=+22.644476082" watchObservedRunningTime="2026-07-23 00:20:34.241037772 +0000 UTC m=+22.644834231"
Jul 23 00:20:34.241236 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:34.241180    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb" event={"ID":"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9","Type":"ContainerStarted","Data":"5ff80808068d48bc2feb88374188c364fe524a871b3477407a7bb2e3e6d68cf8"}
Jul 23 00:20:34.241236 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:34.241224    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb" event={"ID":"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9","Type":"ContainerDied","Data":"947f2bc2a9c23713a0d3a5f58c62b512183fc62b56eaee45ddc1e35c9440345a"}
Jul 23 00:20:34.241473 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:34.241271    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb" event={"ID":"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9","Type":"ContainerStarted","Data":"1bfcdfb4acff5af14da24330ef81fb3c3be42f6e0b54c6ff24884f1cd70f762b"}
Jul 23 00:20:34.242930 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:34.242888    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fw9dw" event={"ID":"e2d0a009-a5ef-4d0e-a294-3e1f34647c9a","Type":"ContainerStarted","Data":"c9c8b7735d832bedfa4c97e87380e5aca989f3b37929376d285d8516a6328411"}
Jul 23 00:20:34.244470 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:34.244441    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8hpmj" event={"ID":"17093c98-5d84-4987-a1d7-d480d4f3bc29","Type":"ContainerStarted","Data":"6e82c6d2652bc19e16ebd332416775bf842f6a349ef18400bcfe2312420b58d7"}
Jul 23 00:20:34.245867 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:34.245847    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rstk9" event={"ID":"3c56952e-6052-40d6-ac90-f998ec05586a","Type":"ContainerStarted","Data":"91a91bbe4d50105944259230007ee88c013afe275b085e5bf7f2830bd3ee19c7"}
Jul 23 00:20:34.277638 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:34.277536    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7pgx5" podStartSLOduration=3.547853837 podStartE2EDuration="22.277522261s" totalImagesPullingTime="18.729668424s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:20:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:20:34.277408734 +0000 UTC m=+22.681205191" watchObservedRunningTime="2026-07-23 00:20:34.277522261 +0000 UTC m=+22.681318716"
Jul 23 00:20:34.289629 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:34.289595    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rstk9" podStartSLOduration=7.720767137 podStartE2EDuration="22.289581671s" totalImagesPullingTime="14.568814534s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:20:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:20:34.289406855 +0000 UTC m=+22.693203312" watchObservedRunningTime="2026-07-23 00:20:34.289581671 +0000 UTC m=+22.693378127"
Jul 23 00:20:34.304266 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:34.304212    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8hpmj" podStartSLOduration=3.510676663 podStartE2EDuration="22.3041973s" totalImagesPullingTime="18.793520637s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:20:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:20:34.303378592 +0000 UTC m=+22.707175050" watchObservedRunningTime="2026-07-23 00:20:34.3041973 +0000 UTC m=+22.707993757"
Jul 23 00:20:34.316687 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:34.316645    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fw9dw" podStartSLOduration=7.7641656 podStartE2EDuration="22.316629913s" totalImagesPullingTime="14.552464313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:20:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:20:34.315670974 +0000 UTC m=+22.719467432" watchObservedRunningTime="2026-07-23 00:20:34.316629913 +0000 UTC m=+22.720426370"
Jul 23 00:20:35.122675 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:35.122646    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:20:35.122842 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:35.122752    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pnlz" podUID="ae70da8b-d8aa-4b34-9780-3e53cb43fac9"
Jul 23 00:20:35.250687 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:35.250650    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6wl7h" event={"ID":"9f541343-d56e-484e-9baf-7c16d3a507e3","Type":"ContainerStarted","Data":"9b2c2006ae03c20cb8be2dd6dbb0e7f70b0774a731c08928dc2ede6718e5fd5c"}
Jul 23 00:20:35.254335 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:35.254313    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhvxb_b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9/ovn-acl-logging/0.log"
Jul 23 00:20:35.254831 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:35.254785    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb" event={"ID":"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9","Type":"ContainerStarted","Data":"eaef5255fa755d6a9c6f4597da1e8843cda02b5a67a219dc1aad1ae0cd6a263f"}
Jul 23 00:20:35.254950 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:35.254882    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb" event={"ID":"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9","Type":"ContainerStarted","Data":"790b77f944c8975b0fbbdb4ee956af8be2b40565b59061fea1491f61076ceca8"}
Jul 23 00:20:35.265106 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:35.265059    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6wl7h" podStartSLOduration=4.522087973 podStartE2EDuration="23.26504241s" totalImagesPullingTime="18.742954437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:20:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:20:35.264658264 +0000 UTC m=+23.668454725" watchObservedRunningTime="2026-07-23 00:20:35.26504241 +0000 UTC m=+23.668838867"
Jul 23 00:20:35.265571 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:35.265548    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 23 00:20:36.032529 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:36.032399    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T00:20:35.2655665Z","UUID":"435ff850-8ad5-49e7-ba6f-7be41616b9c6","Handler":null,"Name":"","Endpoint":""}
Jul 23 00:20:36.035386 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:36.035359    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 23 00:20:36.035533 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:36.035408    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 23 00:20:36.123239 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:36.123204    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:36.123411 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:36.123204    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:36.123411 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:36.123346    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bdx2" podUID="a594d680-4ddd-4df4-9130-0a4e075dd19a"
Jul 23 00:20:36.123503 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:36.123410    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjjx7" podUID="18b6cfa7-6d8f-4934-b78c-789e54bdbac9"
Jul 23 00:20:36.261438 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:36.261356    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6vfps" event={"ID":"b4e3ecfb-d1fe-463f-9bb5-b35da3031d52","Type":"ContainerStarted","Data":"9b7bac3b3204d32a82c88799caf33c1c8c2fcb331a217c127e423f26c3e69345"}
Jul 23 00:20:37.123357 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:37.123191    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:20:37.123507 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:37.123453    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pnlz" podUID="ae70da8b-d8aa-4b34-9780-3e53cb43fac9"
Jul 23 00:20:37.267045 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:37.267020    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhvxb_b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9/ovn-acl-logging/0.log"
Jul 23 00:20:37.267465 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:37.267440    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb" event={"ID":"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9","Type":"ContainerStarted","Data":"0e3184174612606d3fff76d7c6c91ac7f144aa8a56dc471d1b1fde6aeab2f3b5"}
Jul 23 00:20:37.269623 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:37.269579    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6vfps" event={"ID":"b4e3ecfb-d1fe-463f-9bb5-b35da3031d52","Type":"ContainerStarted","Data":"5557a844d067eb26334cd0734eb5bd0db180facb42608bcbc7a1b3166f825fb7"}
Jul 23 00:20:37.286042 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:37.285986    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6vfps" podStartSLOduration=4.151706033 podStartE2EDuration="25.285969848s" totalImagesPullingTime="21.134263815s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:20:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:20:37.285679977 +0000 UTC m=+25.689476433" watchObservedRunningTime="2026-07-23 00:20:37.285969848 +0000 UTC m=+25.689766304"
Jul 23 00:20:38.122351 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:38.122316    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:38.122351 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:38.122313    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:38.122628 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:38.122495    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjjx7" podUID="18b6cfa7-6d8f-4934-b78c-789e54bdbac9"
Jul 23 00:20:38.123000 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:38.122971    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bdx2" podUID="a594d680-4ddd-4df4-9130-0a4e075dd19a"
Jul 23 00:20:38.471112 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:38.471068    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fw9dw"
Jul 23 00:20:38.809667 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:38.809498    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fw9dw"
Jul 23 00:20:38.810312 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:38.810294    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fw9dw"
Jul 23 00:20:39.123267 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:39.123152    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:20:39.123414 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:39.123279    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pnlz" podUID="ae70da8b-d8aa-4b34-9780-3e53cb43fac9"
Jul 23 00:20:39.275744 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:39.275714    2575 generic.go:356] "Generic (PLEG): container finished" podID="5354d283-a176-4db3-89b3-59b7d2081668" containerID="afcc17948b0d873652537ad7d833e00d38bc61ce5e3cc1a657f4a6fbf11e7d5a" exitCode=0
Jul 23 00:20:39.275947 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:39.275792    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-45m4m" event={"ID":"5354d283-a176-4db3-89b3-59b7d2081668","Type":"ContainerDied","Data":"afcc17948b0d873652537ad7d833e00d38bc61ce5e3cc1a657f4a6fbf11e7d5a"}
Jul 23 00:20:39.279408 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:39.279388    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhvxb_b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9/ovn-acl-logging/0.log"
Jul 23 00:20:39.279743 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:39.279719    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb" event={"ID":"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9","Type":"ContainerStarted","Data":"538e459e7c0bfe2ec8e8fa0052024388872d13e92e7fae51070ebef416ee446e"}
Jul 23 00:20:39.280185 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:39.280167    2575 scope.go:117] "RemoveContainer" containerID="947f2bc2a9c23713a0d3a5f58c62b512183fc62b56eaee45ddc1e35c9440345a"
Jul 23 00:20:39.280330 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:39.280316    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fw9dw"
Jul 23 00:20:40.122712 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:40.122692    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:40.123404 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:40.122800    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjjx7" podUID="18b6cfa7-6d8f-4934-b78c-789e54bdbac9"
Jul 23 00:20:40.123404 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:40.122848    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:40.123404 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:40.122952    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bdx2" podUID="a594d680-4ddd-4df4-9130-0a4e075dd19a"
Jul 23 00:20:40.283858 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:40.283826    2575 generic.go:356] "Generic (PLEG): container finished" podID="5354d283-a176-4db3-89b3-59b7d2081668" containerID="fd916e92619181803bf6993b37689756f064548edfd187b661efc9ad70eb5639" exitCode=0
Jul 23 00:20:40.284018 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:40.283901    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-45m4m" event={"ID":"5354d283-a176-4db3-89b3-59b7d2081668","Type":"ContainerDied","Data":"fd916e92619181803bf6993b37689756f064548edfd187b661efc9ad70eb5639"}
Jul 23 00:20:40.290686 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:40.290667    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhvxb_b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9/ovn-acl-logging/0.log"
Jul 23 00:20:40.291127 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:40.291103    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb" event={"ID":"b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9","Type":"ContainerStarted","Data":"3435e4f3ec2324dbffcb61de0996e692871d3835220c262250752093bc9c93cc"}
Jul 23 00:20:40.291332 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:40.291300    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:40.291400 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:40.291361    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:40.291470 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:40.291409    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:40.307290 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:40.307266    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:40.307454 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:40.307441    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:20:40.325980 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:40.325939    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb" podStartSLOduration=9.537810135 podStartE2EDuration="28.325906497s" totalImagesPullingTime="18.788096362s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:20:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:20:40.325208373 +0000 UTC m=+28.729004830" watchObservedRunningTime="2026-07-23 00:20:40.325906497 +0000 UTC m=+28.729702955"
Jul 23 00:20:41.123062 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:41.123026    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:20:41.123509 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:41.123143    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pnlz" podUID="ae70da8b-d8aa-4b34-9780-3e53cb43fac9"
Jul 23 00:20:41.295266 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:41.295213    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-45m4m" event={"ID":"5354d283-a176-4db3-89b3-59b7d2081668","Type":"ContainerStarted","Data":"7068040e9591a21127e8ac27e4be4047b740af00ccf1a762bb72931ca6d70238"}
Jul 23 00:20:42.123688 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:42.123655    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:42.124140 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:42.123754    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjjx7" podUID="18b6cfa7-6d8f-4934-b78c-789e54bdbac9"
Jul 23 00:20:42.124140 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:42.123840    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:42.124140 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:42.123941    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bdx2" podUID="a594d680-4ddd-4df4-9130-0a4e075dd19a"
Jul 23 00:20:42.299866 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:42.299837    2575 generic.go:356] "Generic (PLEG): container finished" podID="5354d283-a176-4db3-89b3-59b7d2081668" containerID="7068040e9591a21127e8ac27e4be4047b740af00ccf1a762bb72931ca6d70238" exitCode=0
Jul 23 00:20:42.300044 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:42.299900    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-45m4m" event={"ID":"5354d283-a176-4db3-89b3-59b7d2081668","Type":"ContainerDied","Data":"7068040e9591a21127e8ac27e4be4047b740af00ccf1a762bb72931ca6d70238"}
Jul 23 00:20:43.123247 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:43.123213    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:20:43.123404 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:43.123346    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pnlz" podUID="ae70da8b-d8aa-4b34-9780-3e53cb43fac9"
Jul 23 00:20:44.122887 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:44.122859    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:44.123273 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:44.122975    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjjx7" podUID="18b6cfa7-6d8f-4934-b78c-789e54bdbac9"
Jul 23 00:20:44.123273 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:44.123100    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:44.123273 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:44.123194    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bdx2" podUID="a594d680-4ddd-4df4-9130-0a4e075dd19a"
Jul 23 00:20:45.123166 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:45.123129    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:20:45.123614 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:45.123255    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pnlz" podUID="ae70da8b-d8aa-4b34-9780-3e53cb43fac9"
Jul 23 00:20:45.717162 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:45.717127    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a594d680-4ddd-4df4-9130-0a4e075dd19a-metrics-certs\") pod \"network-metrics-daemon-5bdx2\" (UID: \"a594d680-4ddd-4df4-9130-0a4e075dd19a\") " pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:45.717397 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:45.717185    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-455s4\" (UniqueName: \"kubernetes.io/projected/ae70da8b-d8aa-4b34-9780-3e53cb43fac9-kube-api-access-455s4\") pod \"network-check-target-9pnlz\" (UID: \"ae70da8b-d8aa-4b34-9780-3e53cb43fac9\") " pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:20:45.717397 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:45.717308    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 00:20:45.717397 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:45.717323    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 00:20:45.717397 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:45.717339    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 00:20:45.717397 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:45.717350    2575 projected.go:196] Error preparing data for projected volume kube-api-access-455s4 for pod openshift-network-diagnostics/network-check-target-9pnlz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 00:20:45.717397 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:45.717382    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a594d680-4ddd-4df4-9130-0a4e075dd19a-metrics-certs podName:a594d680-4ddd-4df4-9130-0a4e075dd19a nodeName:}" failed. No retries permitted until 2026-07-23 00:21:17.71736071 +0000 UTC m=+66.121157165 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a594d680-4ddd-4df4-9130-0a4e075dd19a-metrics-certs") pod "network-metrics-daemon-5bdx2" (UID: "a594d680-4ddd-4df4-9130-0a4e075dd19a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 00:20:45.717397 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:45.717400    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae70da8b-d8aa-4b34-9780-3e53cb43fac9-kube-api-access-455s4 podName:ae70da8b-d8aa-4b34-9780-3e53cb43fac9 nodeName:}" failed. No retries permitted until 2026-07-23 00:21:17.71738934 +0000 UTC m=+66.121185794 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-455s4" (UniqueName: "kubernetes.io/projected/ae70da8b-d8aa-4b34-9780-3e53cb43fac9-kube-api-access-455s4") pod "network-check-target-9pnlz" (UID: "ae70da8b-d8aa-4b34-9780-3e53cb43fac9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 00:20:45.818578 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:45.818541    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18b6cfa7-6d8f-4934-b78c-789e54bdbac9-original-pull-secret\") pod \"global-pull-secret-syncer-sjjx7\" (UID: \"18b6cfa7-6d8f-4934-b78c-789e54bdbac9\") " pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:45.818780 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:45.818672    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 00:20:45.818780 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:45.818753    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18b6cfa7-6d8f-4934-b78c-789e54bdbac9-original-pull-secret podName:18b6cfa7-6d8f-4934-b78c-789e54bdbac9 nodeName:}" failed. No retries permitted until 2026-07-23 00:21:17.818739425 +0000 UTC m=+66.222535861 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18b6cfa7-6d8f-4934-b78c-789e54bdbac9-original-pull-secret") pod "global-pull-secret-syncer-sjjx7" (UID: "18b6cfa7-6d8f-4934-b78c-789e54bdbac9") : object "kube-system"/"original-pull-secret" not registered
Jul 23 00:20:46.122934 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:46.122837    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:46.123173 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:46.122837    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:46.123173 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:46.122986    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjjx7" podUID="18b6cfa7-6d8f-4934-b78c-789e54bdbac9"
Jul 23 00:20:46.123173 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:46.123038    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bdx2" podUID="a594d680-4ddd-4df4-9130-0a4e075dd19a"
Jul 23 00:20:47.122630 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:47.122598    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:20:47.122883 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:47.122752    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pnlz" podUID="ae70da8b-d8aa-4b34-9780-3e53cb43fac9"
Jul 23 00:20:48.122663 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:48.122502    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:48.123071 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:48.122567    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:48.123071 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:48.122734    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjjx7" podUID="18b6cfa7-6d8f-4934-b78c-789e54bdbac9"
Jul 23 00:20:48.123071 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:48.122831    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bdx2" podUID="a594d680-4ddd-4df4-9130-0a4e075dd19a"
Jul 23 00:20:48.317787 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:48.317755    2575 generic.go:356] "Generic (PLEG): container finished" podID="5354d283-a176-4db3-89b3-59b7d2081668" containerID="aa7581fb8ed00f5e8e91951203bcdd7d37eeb57db03448f3c60d5dee564a5dae" exitCode=0
Jul 23 00:20:48.317967 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:48.317821    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-45m4m" event={"ID":"5354d283-a176-4db3-89b3-59b7d2081668","Type":"ContainerDied","Data":"aa7581fb8ed00f5e8e91951203bcdd7d37eeb57db03448f3c60d5dee564a5dae"}
Jul 23 00:20:48.872526 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:48.872490    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9pnlz"]
Jul 23 00:20:48.872711 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:48.872697    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:20:48.872832 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:48.872811    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pnlz" podUID="ae70da8b-d8aa-4b34-9780-3e53cb43fac9"
Jul 23 00:20:48.875146 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:48.875118    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sjjx7"]
Jul 23 00:20:48.875266 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:48.875253    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:48.875379 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:48.875353    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjjx7" podUID="18b6cfa7-6d8f-4934-b78c-789e54bdbac9"
Jul 23 00:20:48.875816 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:48.875798    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5bdx2"]
Jul 23 00:20:48.875906 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:48.875889    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:48.876036 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:48.876013    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bdx2" podUID="a594d680-4ddd-4df4-9130-0a4e075dd19a"
Jul 23 00:20:49.323166 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:49.323136    2575 generic.go:356] "Generic (PLEG): container finished" podID="5354d283-a176-4db3-89b3-59b7d2081668" containerID="e9f11e7518a1b590785bbe5240b5c16556f1e677d6f4a0ad4922d2c67668d394" exitCode=0
Jul 23 00:20:49.323842 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:49.323177    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-45m4m" event={"ID":"5354d283-a176-4db3-89b3-59b7d2081668","Type":"ContainerDied","Data":"e9f11e7518a1b590785bbe5240b5c16556f1e677d6f4a0ad4922d2c67668d394"}
Jul 23 00:20:50.122860 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:50.122696    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:50.123063 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:50.122767    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:50.123063 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:50.122964    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjjx7" podUID="18b6cfa7-6d8f-4934-b78c-789e54bdbac9"
Jul 23 00:20:50.123063 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:50.123037    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bdx2" podUID="a594d680-4ddd-4df4-9130-0a4e075dd19a"
Jul 23 00:20:50.328102 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:50.328073    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-45m4m" event={"ID":"5354d283-a176-4db3-89b3-59b7d2081668","Type":"ContainerStarted","Data":"d21fff6bff77b3ddd686c02ce87f4417d618643644dc3b5177836f1ba67ed99e"}
Jul 23 00:20:50.347783 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:50.347740    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-45m4m" podStartSLOduration=8.185718376 podStartE2EDuration="38.347726141s" totalImagesPullingTime="30.162007765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:20:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:20:50.347229782 +0000 UTC m=+38.751026239" watchObservedRunningTime="2026-07-23 00:20:50.347726141 +0000 UTC m=+38.751522598"
Jul 23 00:20:51.123265 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:51.123231    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:20:51.123430 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:51.123333    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pnlz" podUID="ae70da8b-d8aa-4b34-9780-3e53cb43fac9"
Jul 23 00:20:52.124147 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:52.124109    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:52.124542 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:52.124189    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:52.124542 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:52.124200    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjjx7" podUID="18b6cfa7-6d8f-4934-b78c-789e54bdbac9"
Jul 23 00:20:52.124542 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:52.124290    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bdx2" podUID="a594d680-4ddd-4df4-9130-0a4e075dd19a"
Jul 23 00:20:52.956510 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:52.956479    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-176.ec2.internal" event="NodeReady"
Jul 23 00:20:52.956647 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:52.956611    2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 23 00:20:53.002411 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.002380    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lttw5"]
Jul 23 00:20:53.024032 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.024004    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8mfn4"]
Jul 23 00:20:53.024214 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.024133    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lttw5"
Jul 23 00:20:53.025987 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.025962    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 23 00:20:53.026118 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.026024    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 23 00:20:53.026118 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.026055    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rxnz4\""
Jul 23 00:20:53.026410 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.026395    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 23 00:20:53.045848 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.045816    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lttw5"]
Jul 23 00:20:53.045991 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.045857    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8mfn4"]
Jul 23 00:20:53.045991 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.045890    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vj6tt"]
Jul 23 00:20:53.045991 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.045959    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8mfn4"
Jul 23 00:20:53.048037 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.048014    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-t68f8\""
Jul 23 00:20:53.048158 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.048075    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 23 00:20:53.048158 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.048094    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 23 00:20:53.048314 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.048301    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 23 00:20:53.048384 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.048334    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 23 00:20:53.071965 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.071928    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vj6tt"]
Jul 23 00:20:53.072149 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.072046    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vj6tt"
Jul 23 00:20:53.074207 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.074178    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 23 00:20:53.074464 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.074446    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hzp88\""
Jul 23 00:20:53.074529 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.074511    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 23 00:20:53.123020 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.122988    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:20:53.125255 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.125232    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 00:20:53.125591 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.125303    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 00:20:53.125591 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.125323    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2ns5k\""
Jul 23 00:20:53.173177 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.173135    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/841648a1-4dc3-4f9b-8d9a-73ff42247e97-crio-socket\") pod \"insights-runtime-extractor-8mfn4\" (UID: \"841648a1-4dc3-4f9b-8d9a-73ff42247e97\") " pod="openshift-insights/insights-runtime-extractor-8mfn4"
Jul 23 00:20:53.173177 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.173173    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4xvl\" (UniqueName: \"kubernetes.io/projected/5dbe765c-2934-40bd-97b9-75fc214b64a8-kube-api-access-j4xvl\") pod \"ingress-canary-lttw5\" (UID: \"5dbe765c-2934-40bd-97b9-75fc214b64a8\") " pod="openshift-ingress-canary/ingress-canary-lttw5"
Jul 23 00:20:53.173377 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.173199    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx7pr\" (UniqueName: \"kubernetes.io/projected/841648a1-4dc3-4f9b-8d9a-73ff42247e97-kube-api-access-wx7pr\") pod \"insights-runtime-extractor-8mfn4\" (UID: \"841648a1-4dc3-4f9b-8d9a-73ff42247e97\") " pod="openshift-insights/insights-runtime-extractor-8mfn4"
Jul 23 00:20:53.173377 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.173219    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de945bad-e9e4-400d-9508-babe1303c5c8-metrics-tls\") pod \"dns-default-vj6tt\" (UID: \"de945bad-e9e4-400d-9508-babe1303c5c8\") " pod="openshift-dns/dns-default-vj6tt"
Jul 23 00:20:53.173377 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.173265    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4cq5\" (UniqueName: \"kubernetes.io/projected/de945bad-e9e4-400d-9508-babe1303c5c8-kube-api-access-w4cq5\") pod \"dns-default-vj6tt\" (UID: \"de945bad-e9e4-400d-9508-babe1303c5c8\") " pod="openshift-dns/dns-default-vj6tt"
Jul 23 00:20:53.173377 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.173296    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5dbe765c-2934-40bd-97b9-75fc214b64a8-cert\") pod \"ingress-canary-lttw5\" (UID: \"5dbe765c-2934-40bd-97b9-75fc214b64a8\") " pod="openshift-ingress-canary/ingress-canary-lttw5"
Jul 23 00:20:53.173377 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.173315    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de945bad-e9e4-400d-9508-babe1303c5c8-tmp-dir\") pod \"dns-default-vj6tt\" (UID: \"de945bad-e9e4-400d-9508-babe1303c5c8\") " pod="openshift-dns/dns-default-vj6tt"
Jul 23 00:20:53.173377 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.173334    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/841648a1-4dc3-4f9b-8d9a-73ff42247e97-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8mfn4\" (UID: \"841648a1-4dc3-4f9b-8d9a-73ff42247e97\") " pod="openshift-insights/insights-runtime-extractor-8mfn4"
Jul 23 00:20:53.173377 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.173358    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/841648a1-4dc3-4f9b-8d9a-73ff42247e97-data-volume\") pod \"insights-runtime-extractor-8mfn4\" (UID: \"841648a1-4dc3-4f9b-8d9a-73ff42247e97\") " pod="openshift-insights/insights-runtime-extractor-8mfn4"
Jul 23 00:20:53.173588 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.173430    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/841648a1-4dc3-4f9b-8d9a-73ff42247e97-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8mfn4\" (UID: \"841648a1-4dc3-4f9b-8d9a-73ff42247e97\") " pod="openshift-insights/insights-runtime-extractor-8mfn4"
Jul 23 00:20:53.173588 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.173461    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/de945bad-e9e4-400d-9508-babe1303c5c8-config-volume\") pod \"dns-default-vj6tt\" (UID: \"de945bad-e9e4-400d-9508-babe1303c5c8\") " pod="openshift-dns/dns-default-vj6tt"
Jul 23 00:20:53.274133 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.274050    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/de945bad-e9e4-400d-9508-babe1303c5c8-config-volume\") pod \"dns-default-vj6tt\" (UID: \"de945bad-e9e4-400d-9508-babe1303c5c8\") " pod="openshift-dns/dns-default-vj6tt"
Jul 23 00:20:53.274133 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.274101    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/841648a1-4dc3-4f9b-8d9a-73ff42247e97-crio-socket\") pod \"insights-runtime-extractor-8mfn4\" (UID: \"841648a1-4dc3-4f9b-8d9a-73ff42247e97\") " pod="openshift-insights/insights-runtime-extractor-8mfn4"
Jul 23 00:20:53.274133 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.274118    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4xvl\" (UniqueName: \"kubernetes.io/projected/5dbe765c-2934-40bd-97b9-75fc214b64a8-kube-api-access-j4xvl\") pod \"ingress-canary-lttw5\" (UID: \"5dbe765c-2934-40bd-97b9-75fc214b64a8\") " pod="openshift-ingress-canary/ingress-canary-lttw5"
Jul 23 00:20:53.274133 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.274133    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx7pr\" (UniqueName: \"kubernetes.io/projected/841648a1-4dc3-4f9b-8d9a-73ff42247e97-kube-api-access-wx7pr\") pod \"insights-runtime-extractor-8mfn4\" (UID: \"841648a1-4dc3-4f9b-8d9a-73ff42247e97\") " pod="openshift-insights/insights-runtime-extractor-8mfn4"
Jul 23 00:20:53.274411 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.274151    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de945bad-e9e4-400d-9508-babe1303c5c8-metrics-tls\") pod \"dns-default-vj6tt\" (UID: \"de945bad-e9e4-400d-9508-babe1303c5c8\") " pod="openshift-dns/dns-default-vj6tt"
Jul 23 00:20:53.274411 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.274169    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4cq5\" (UniqueName: \"kubernetes.io/projected/de945bad-e9e4-400d-9508-babe1303c5c8-kube-api-access-w4cq5\") pod \"dns-default-vj6tt\" (UID: \"de945bad-e9e4-400d-9508-babe1303c5c8\") " pod="openshift-dns/dns-default-vj6tt"
Jul 23 00:20:53.274411 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.274192    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5dbe765c-2934-40bd-97b9-75fc214b64a8-cert\") pod \"ingress-canary-lttw5\" (UID: \"5dbe765c-2934-40bd-97b9-75fc214b64a8\") " pod="openshift-ingress-canary/ingress-canary-lttw5"
Jul 23 00:20:53.274411 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.274215    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de945bad-e9e4-400d-9508-babe1303c5c8-tmp-dir\") pod \"dns-default-vj6tt\" (UID: \"de945bad-e9e4-400d-9508-babe1303c5c8\") " pod="openshift-dns/dns-default-vj6tt"
Jul 23 00:20:53.274411 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.274245    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/841648a1-4dc3-4f9b-8d9a-73ff42247e97-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8mfn4\" (UID: \"841648a1-4dc3-4f9b-8d9a-73ff42247e97\") " pod="openshift-insights/insights-runtime-extractor-8mfn4"
Jul 23 00:20:53.274411 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.274278    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/841648a1-4dc3-4f9b-8d9a-73ff42247e97-data-volume\") pod \"insights-runtime-extractor-8mfn4\" (UID: \"841648a1-4dc3-4f9b-8d9a-73ff42247e97\") " pod="openshift-insights/insights-runtime-extractor-8mfn4"
Jul 23 00:20:53.274411 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.274308    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/841648a1-4dc3-4f9b-8d9a-73ff42247e97-crio-socket\") pod \"insights-runtime-extractor-8mfn4\" (UID: \"841648a1-4dc3-4f9b-8d9a-73ff42247e97\") " pod="openshift-insights/insights-runtime-extractor-8mfn4"
Jul 23 00:20:53.274411 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.274321    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/841648a1-4dc3-4f9b-8d9a-73ff42247e97-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8mfn4\" (UID: \"841648a1-4dc3-4f9b-8d9a-73ff42247e97\") " pod="openshift-insights/insights-runtime-extractor-8mfn4"
Jul 23 00:20:53.274732 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.274707    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de945bad-e9e4-400d-9508-babe1303c5c8-tmp-dir\") pod \"dns-default-vj6tt\" (UID: \"de945bad-e9e4-400d-9508-babe1303c5c8\") " pod="openshift-dns/dns-default-vj6tt"
Jul 23 00:20:53.274784 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.274741    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/841648a1-4dc3-4f9b-8d9a-73ff42247e97-data-volume\") pod \"insights-runtime-extractor-8mfn4\" (UID: \"841648a1-4dc3-4f9b-8d9a-73ff42247e97\") " pod="openshift-insights/insights-runtime-extractor-8mfn4"
Jul 23 00:20:53.274956 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.274933    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/841648a1-4dc3-4f9b-8d9a-73ff42247e97-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8mfn4\" (UID: \"841648a1-4dc3-4f9b-8d9a-73ff42247e97\") " pod="openshift-insights/insights-runtime-extractor-8mfn4"
Jul 23 00:20:53.275260 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.275239    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/de945bad-e9e4-400d-9508-babe1303c5c8-config-volume\") pod \"dns-default-vj6tt\" (UID: \"de945bad-e9e4-400d-9508-babe1303c5c8\") " pod="openshift-dns/dns-default-vj6tt"
Jul 23 00:20:53.278272 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.278253    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de945bad-e9e4-400d-9508-babe1303c5c8-metrics-tls\") pod \"dns-default-vj6tt\" (UID: \"de945bad-e9e4-400d-9508-babe1303c5c8\") " pod="openshift-dns/dns-default-vj6tt"
Jul 23 00:20:53.278374 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.278283    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/841648a1-4dc3-4f9b-8d9a-73ff42247e97-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8mfn4\" (UID: \"841648a1-4dc3-4f9b-8d9a-73ff42247e97\") " pod="openshift-insights/insights-runtime-extractor-8mfn4"
Jul 23 00:20:53.278413 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.278399    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5dbe765c-2934-40bd-97b9-75fc214b64a8-cert\") pod \"ingress-canary-lttw5\" (UID: \"5dbe765c-2934-40bd-97b9-75fc214b64a8\") " pod="openshift-ingress-canary/ingress-canary-lttw5"
Jul 23 00:20:53.281631 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.281595    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx7pr\" (UniqueName: \"kubernetes.io/projected/841648a1-4dc3-4f9b-8d9a-73ff42247e97-kube-api-access-wx7pr\") pod \"insights-runtime-extractor-8mfn4\" (UID: \"841648a1-4dc3-4f9b-8d9a-73ff42247e97\") " pod="openshift-insights/insights-runtime-extractor-8mfn4"
Jul 23 00:20:53.281765 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.281747    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4xvl\" (UniqueName: \"kubernetes.io/projected/5dbe765c-2934-40bd-97b9-75fc214b64a8-kube-api-access-j4xvl\") pod \"ingress-canary-lttw5\" (UID: \"5dbe765c-2934-40bd-97b9-75fc214b64a8\") " pod="openshift-ingress-canary/ingress-canary-lttw5"
Jul 23 00:20:53.282239 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.282218    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4cq5\" (UniqueName: \"kubernetes.io/projected/de945bad-e9e4-400d-9508-babe1303c5c8-kube-api-access-w4cq5\") pod \"dns-default-vj6tt\" (UID: \"de945bad-e9e4-400d-9508-babe1303c5c8\") " pod="openshift-dns/dns-default-vj6tt"
Jul 23 00:20:53.333230 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.333198    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lttw5"
Jul 23 00:20:53.354753 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.354727    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8mfn4"
Jul 23 00:20:53.380897 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.380866    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vj6tt"
Jul 23 00:20:53.449859 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.448643    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-vx6kl"]
Jul 23 00:20:53.470271 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.469603    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-vx6kl"]
Jul 23 00:20:53.470271 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.469743    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-vx6kl"
Jul 23 00:20:53.474693 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.473740    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 23 00:20:53.474693 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.474016    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-jvg59\""
Jul 23 00:20:53.474693 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.474265    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 23 00:20:53.474693 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.474462    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 23 00:20:53.475430 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.475285    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 23 00:20:53.475534 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.475524    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 23 00:20:53.554050 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.554020    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8mfn4"]
Jul 23 00:20:53.557557 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.557530    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lttw5"]
Jul 23 00:20:53.557847 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:53.557819    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod841648a1_4dc3_4f9b_8d9a_73ff42247e97.slice/crio-1931fb37e16d41f56ea181a07c5670dd0d09d91335d2a2e0c162d24e38854343 WatchSource:0}: Error finding container 1931fb37e16d41f56ea181a07c5670dd0d09d91335d2a2e0c162d24e38854343: Status 404 returned error can't find the container with id 1931fb37e16d41f56ea181a07c5670dd0d09d91335d2a2e0c162d24e38854343
Jul 23 00:20:53.561036 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:53.561005    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dbe765c_2934_40bd_97b9_75fc214b64a8.slice/crio-e96efd5fbbe03af382b4d10b9c107e7cb6906b05e1e8fbba951a1864a0c947e3 WatchSource:0}: Error finding container e96efd5fbbe03af382b4d10b9c107e7cb6906b05e1e8fbba951a1864a0c947e3: Status 404 returned error can't find the container with id e96efd5fbbe03af382b4d10b9c107e7cb6906b05e1e8fbba951a1864a0c947e3
Jul 23 00:20:53.573205 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.573184    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vj6tt"]
Jul 23 00:20:53.577228 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.577203    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/daf53431-eab4-4429-8cc7-06ef23ca4ae6-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-vx6kl\" (UID: \"daf53431-eab4-4429-8cc7-06ef23ca4ae6\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-vx6kl"
Jul 23 00:20:53.577295 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.577235    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/daf53431-eab4-4429-8cc7-06ef23ca4ae6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-vx6kl\" (UID: \"daf53431-eab4-4429-8cc7-06ef23ca4ae6\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-vx6kl"
Jul 23 00:20:53.577295 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.577277    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/daf53431-eab4-4429-8cc7-06ef23ca4ae6-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-vx6kl\" (UID: \"daf53431-eab4-4429-8cc7-06ef23ca4ae6\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-vx6kl"
Jul 23 00:20:53.577359 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.577343    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2dd7\" (UniqueName: \"kubernetes.io/projected/daf53431-eab4-4429-8cc7-06ef23ca4ae6-kube-api-access-m2dd7\") pod \"prometheus-operator-5945b5cfd-vx6kl\" (UID: \"daf53431-eab4-4429-8cc7-06ef23ca4ae6\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-vx6kl"
Jul 23 00:20:53.579798 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:53.579778    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde945bad_e9e4_400d_9508_babe1303c5c8.slice/crio-0259031fdd1efcc6d435e2cc4a42c04f62a3c9e310873b401716b743a0e4a101 WatchSource:0}: Error finding container 0259031fdd1efcc6d435e2cc4a42c04f62a3c9e310873b401716b743a0e4a101: Status 404 returned error can't find the container with id 0259031fdd1efcc6d435e2cc4a42c04f62a3c9e310873b401716b743a0e4a101
Jul 23 00:20:53.677934 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.677869    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2dd7\" (UniqueName: \"kubernetes.io/projected/daf53431-eab4-4429-8cc7-06ef23ca4ae6-kube-api-access-m2dd7\") pod \"prometheus-operator-5945b5cfd-vx6kl\" (UID: \"daf53431-eab4-4429-8cc7-06ef23ca4ae6\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-vx6kl"
Jul 23 00:20:53.678131 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.677953    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/daf53431-eab4-4429-8cc7-06ef23ca4ae6-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-vx6kl\" (UID: \"daf53431-eab4-4429-8cc7-06ef23ca4ae6\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-vx6kl"
Jul 23 00:20:53.678131 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.677975    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/daf53431-eab4-4429-8cc7-06ef23ca4ae6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-vx6kl\" (UID: \"daf53431-eab4-4429-8cc7-06ef23ca4ae6\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-vx6kl"
Jul 23 00:20:53.678131 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.678009    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/daf53431-eab4-4429-8cc7-06ef23ca4ae6-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-vx6kl\" (UID: \"daf53431-eab4-4429-8cc7-06ef23ca4ae6\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-vx6kl"
Jul 23 00:20:53.678131 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:53.678108    2575 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 23 00:20:53.678347 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:20:53.678169    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daf53431-eab4-4429-8cc7-06ef23ca4ae6-prometheus-operator-tls podName:daf53431-eab4-4429-8cc7-06ef23ca4ae6 nodeName:}" failed. No retries permitted until 2026-07-23 00:20:54.178153683 +0000 UTC m=+42.581950125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/daf53431-eab4-4429-8cc7-06ef23ca4ae6-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-vx6kl" (UID: "daf53431-eab4-4429-8cc7-06ef23ca4ae6") : secret "prometheus-operator-tls" not found
Jul 23 00:20:53.679431 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.679408    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/daf53431-eab4-4429-8cc7-06ef23ca4ae6-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-vx6kl\" (UID: \"daf53431-eab4-4429-8cc7-06ef23ca4ae6\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-vx6kl"
Jul 23 00:20:53.680564 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.680546    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/daf53431-eab4-4429-8cc7-06ef23ca4ae6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-vx6kl\" (UID: \"daf53431-eab4-4429-8cc7-06ef23ca4ae6\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-vx6kl"
Jul 23 00:20:53.685224 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:53.685208    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2dd7\" (UniqueName: \"kubernetes.io/projected/daf53431-eab4-4429-8cc7-06ef23ca4ae6-kube-api-access-m2dd7\") pod \"prometheus-operator-5945b5cfd-vx6kl\" (UID: \"daf53431-eab4-4429-8cc7-06ef23ca4ae6\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-vx6kl"
Jul 23 00:20:54.055644 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.055610    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59c8dbcc66-2ttkb"]
Jul 23 00:20:54.076709 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.076667    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59c8dbcc66-2ttkb"]
Jul 23 00:20:54.076866 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.076796    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c8dbcc66-2ttkb"
Jul 23 00:20:54.079038 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.079015    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 23 00:20:54.079163 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.079133    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 23 00:20:54.079275 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.079258    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 23 00:20:54.079392 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.079264    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jjlcf\""
Jul 23 00:20:54.079392 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.079342    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 23 00:20:54.079667 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.079647    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 23 00:20:54.079872 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.079853    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 23 00:20:54.080084 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.079656    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 23 00:20:54.084860 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.084840    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 23 00:20:54.123187 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.123150    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:20:54.123365 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.123348    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:20:54.125602 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.125576    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 00:20:54.125993 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.125605    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 00:20:54.127081 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.127063    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-52cgs\""
Jul 23 00:20:54.182143 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.182101    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b25adab4-bc27-4385-a9d3-59e1cfe0e727-console-config\") pod \"console-59c8dbcc66-2ttkb\" (UID: \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\") " pod="openshift-console/console-59c8dbcc66-2ttkb"
Jul 23 00:20:54.182390 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.182220    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/daf53431-eab4-4429-8cc7-06ef23ca4ae6-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-vx6kl\" (UID: \"daf53431-eab4-4429-8cc7-06ef23ca4ae6\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-vx6kl"
Jul 23 00:20:54.182390 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.182277    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b25adab4-bc27-4385-a9d3-59e1cfe0e727-console-oauth-config\") pod \"console-59c8dbcc66-2ttkb\" (UID: \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\") " pod="openshift-console/console-59c8dbcc66-2ttkb"
Jul 23 00:20:54.182390 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.182302    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b25adab4-bc27-4385-a9d3-59e1cfe0e727-service-ca\") pod \"console-59c8dbcc66-2ttkb\" (UID: \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\") " pod="openshift-console/console-59c8dbcc66-2ttkb"
Jul 23 00:20:54.182390 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.182328    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b25adab4-bc27-4385-a9d3-59e1cfe0e727-oauth-serving-cert\") pod \"console-59c8dbcc66-2ttkb\" (UID: \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\") " pod="openshift-console/console-59c8dbcc66-2ttkb"
Jul 23 00:20:54.182390 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.182383    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b25adab4-bc27-4385-a9d3-59e1cfe0e727-trusted-ca-bundle\") pod \"console-59c8dbcc66-2ttkb\" (UID: \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\") " pod="openshift-console/console-59c8dbcc66-2ttkb"
Jul 23 00:20:54.182652 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.182415    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b25adab4-bc27-4385-a9d3-59e1cfe0e727-console-serving-cert\") pod \"console-59c8dbcc66-2ttkb\" (UID: \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\") " pod="openshift-console/console-59c8dbcc66-2ttkb"
Jul 23 00:20:54.182652 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.182437    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmpbz\" (UniqueName: \"kubernetes.io/projected/b25adab4-bc27-4385-a9d3-59e1cfe0e727-kube-api-access-mmpbz\") pod \"console-59c8dbcc66-2ttkb\" (UID: \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\") " pod="openshift-console/console-59c8dbcc66-2ttkb"
Jul 23 00:20:54.186160 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.186138    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/daf53431-eab4-4429-8cc7-06ef23ca4ae6-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-vx6kl\" (UID: \"daf53431-eab4-4429-8cc7-06ef23ca4ae6\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-vx6kl"
Jul 23 00:20:54.285496 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.283250    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b25adab4-bc27-4385-a9d3-59e1cfe0e727-console-oauth-config\") pod \"console-59c8dbcc66-2ttkb\" (UID: \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\") " pod="openshift-console/console-59c8dbcc66-2ttkb"
Jul 23 00:20:54.285496 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.283303    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b25adab4-bc27-4385-a9d3-59e1cfe0e727-service-ca\") pod \"console-59c8dbcc66-2ttkb\" (UID: \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\") " pod="openshift-console/console-59c8dbcc66-2ttkb"
Jul 23 00:20:54.285496 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.283330    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b25adab4-bc27-4385-a9d3-59e1cfe0e727-oauth-serving-cert\") pod \"console-59c8dbcc66-2ttkb\" (UID: \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\") " pod="openshift-console/console-59c8dbcc66-2ttkb"
Jul 23 00:20:54.285496 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.283360    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b25adab4-bc27-4385-a9d3-59e1cfe0e727-trusted-ca-bundle\") pod \"console-59c8dbcc66-2ttkb\" (UID: \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\") " pod="openshift-console/console-59c8dbcc66-2ttkb"
Jul 23 00:20:54.285496 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.283392    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b25adab4-bc27-4385-a9d3-59e1cfe0e727-console-serving-cert\") pod \"console-59c8dbcc66-2ttkb\" (UID: \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\") " pod="openshift-console/console-59c8dbcc66-2ttkb"
Jul 23 00:20:54.285496 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.283415    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmpbz\" (UniqueName: \"kubernetes.io/projected/b25adab4-bc27-4385-a9d3-59e1cfe0e727-kube-api-access-mmpbz\") pod \"console-59c8dbcc66-2ttkb\" (UID: \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\") " pod="openshift-console/console-59c8dbcc66-2ttkb"
Jul 23 00:20:54.285496 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.283494    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b25adab4-bc27-4385-a9d3-59e1cfe0e727-console-config\") pod \"console-59c8dbcc66-2ttkb\" (UID: \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\") " pod="openshift-console/console-59c8dbcc66-2ttkb"
Jul 23 00:20:54.285496 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.284599    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b25adab4-bc27-4385-a9d3-59e1cfe0e727-console-config\") pod \"console-59c8dbcc66-2ttkb\" (UID: \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\") " pod="openshift-console/console-59c8dbcc66-2ttkb"
Jul 23 00:20:54.285496 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.284602    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b25adab4-bc27-4385-a9d3-59e1cfe0e727-service-ca\") pod \"console-59c8dbcc66-2ttkb\" (UID: \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\") " pod="openshift-console/console-59c8dbcc66-2ttkb"
Jul 23 00:20:54.285496 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.284634    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b25adab4-bc27-4385-a9d3-59e1cfe0e727-oauth-serving-cert\") pod \"console-59c8dbcc66-2ttkb\" (UID: \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\") " pod="openshift-console/console-59c8dbcc66-2ttkb"
Jul 23 00:20:54.285496 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.284830    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b25adab4-bc27-4385-a9d3-59e1cfe0e727-trusted-ca-bundle\") pod \"console-59c8dbcc66-2ttkb\" (UID: \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\") " pod="openshift-console/console-59c8dbcc66-2ttkb"
Jul 23 00:20:54.286322 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.286276    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b25adab4-bc27-4385-a9d3-59e1cfe0e727-console-oauth-config\") pod \"console-59c8dbcc66-2ttkb\" (UID: \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\") " pod="openshift-console/console-59c8dbcc66-2ttkb"
Jul 23 00:20:54.287272 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.287245    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b25adab4-bc27-4385-a9d3-59e1cfe0e727-console-serving-cert\") pod \"console-59c8dbcc66-2ttkb\" (UID: \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\") " pod="openshift-console/console-59c8dbcc66-2ttkb"
Jul 23 00:20:54.290755 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.290731    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmpbz\" (UniqueName: \"kubernetes.io/projected/b25adab4-bc27-4385-a9d3-59e1cfe0e727-kube-api-access-mmpbz\") pod \"console-59c8dbcc66-2ttkb\" (UID: \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\") " pod="openshift-console/console-59c8dbcc66-2ttkb"
Jul 23 00:20:54.340095 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.339998    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vj6tt" event={"ID":"de945bad-e9e4-400d-9508-babe1303c5c8","Type":"ContainerStarted","Data":"0259031fdd1efcc6d435e2cc4a42c04f62a3c9e310873b401716b743a0e4a101"}
Jul 23 00:20:54.341286 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.341255    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8mfn4" event={"ID":"841648a1-4dc3-4f9b-8d9a-73ff42247e97","Type":"ContainerStarted","Data":"1931fb37e16d41f56ea181a07c5670dd0d09d91335d2a2e0c162d24e38854343"}
Jul 23 00:20:54.345608 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.345572    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lttw5" event={"ID":"5dbe765c-2934-40bd-97b9-75fc214b64a8","Type":"ContainerStarted","Data":"e96efd5fbbe03af382b4d10b9c107e7cb6906b05e1e8fbba951a1864a0c947e3"}
Jul 23 00:20:54.385152 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.385122    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-vx6kl"
Jul 23 00:20:54.389330 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.389302    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c8dbcc66-2ttkb"
Jul 23 00:20:54.582688 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.582652    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-vx6kl"]
Jul 23 00:20:54.589028 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:54.588965    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaf53431_eab4_4429_8cc7_06ef23ca4ae6.slice/crio-90d0503d8e3d76bfe55cf710a5f892af9c16df53013a16d3620eee584ed85edf WatchSource:0}: Error finding container 90d0503d8e3d76bfe55cf710a5f892af9c16df53013a16d3620eee584ed85edf: Status 404 returned error can't find the container with id 90d0503d8e3d76bfe55cf710a5f892af9c16df53013a16d3620eee584ed85edf
Jul 23 00:20:54.613705 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:54.613670    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59c8dbcc66-2ttkb"]
Jul 23 00:20:54.618431 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:20:54.618381    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb25adab4_bc27_4385_a9d3_59e1cfe0e727.slice/crio-514472d833f72a024a18590dd0dfa9c2b3cac3ce31eccbcb0b09a51be58fce96 WatchSource:0}: Error finding container 514472d833f72a024a18590dd0dfa9c2b3cac3ce31eccbcb0b09a51be58fce96: Status 404 returned error can't find the container with id 514472d833f72a024a18590dd0dfa9c2b3cac3ce31eccbcb0b09a51be58fce96
Jul 23 00:20:55.351355 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:55.351313    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c8dbcc66-2ttkb" event={"ID":"b25adab4-bc27-4385-a9d3-59e1cfe0e727","Type":"ContainerStarted","Data":"514472d833f72a024a18590dd0dfa9c2b3cac3ce31eccbcb0b09a51be58fce96"}
Jul 23 00:20:55.353275 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:20:55.353207    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-vx6kl" event={"ID":"daf53431-eab4-4429-8cc7-06ef23ca4ae6","Type":"ContainerStarted","Data":"90d0503d8e3d76bfe55cf710a5f892af9c16df53013a16d3620eee584ed85edf"}
Jul 23 00:21:02.375718 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:02.375682    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vj6tt" event={"ID":"de945bad-e9e4-400d-9508-babe1303c5c8","Type":"ContainerStarted","Data":"afbb9d55da12fa44894169b2aad3de4ad8f66b59e3bc1ca32ee84fb60127a88c"}
Jul 23 00:21:02.378081 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:02.378055    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lttw5" event={"ID":"5dbe765c-2934-40bd-97b9-75fc214b64a8","Type":"ContainerStarted","Data":"492be42e24ae5107b26db9dbb0a7d4f3325ae899487a069c0c023d00f971e322"}
Jul 23 00:21:02.380031 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:02.380000    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c8dbcc66-2ttkb" event={"ID":"b25adab4-bc27-4385-a9d3-59e1cfe0e727","Type":"ContainerStarted","Data":"3012f699c21c5ebb1e996ada1a45cd0f44ac24c3c0006c9794b73869d0dab8b3"}
Jul 23 00:21:02.383615 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:02.383582    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-vx6kl" event={"ID":"daf53431-eab4-4429-8cc7-06ef23ca4ae6","Type":"ContainerStarted","Data":"9ceaa619a0b5c6fcaeb113f440387bb59a658f04c619ab3cdf7fb5022e830722"}
Jul 23 00:21:02.383694 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:02.383652    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-vx6kl" event={"ID":"daf53431-eab4-4429-8cc7-06ef23ca4ae6","Type":"ContainerStarted","Data":"d212ceed80a960e33121fd7d9652d1bf57bc1c8d2146f3a1432ad4703f09182c"}
Jul 23 00:21:02.394678 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:02.394039    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lttw5" podStartSLOduration=2.475837308 podStartE2EDuration="10.394016152s" totalImagesPullingTime="7.918178844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:20:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:21:02.39317705 +0000 UTC m=+50.796973509" watchObservedRunningTime="2026-07-23 00:21:02.394016152 +0000 UTC m=+50.797812611"
Jul 23 00:21:02.410864 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:02.410383    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-vx6kl" podStartSLOduration=1.934493561 podStartE2EDuration="9.410362665s" totalImagesPullingTime="7.475869104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:21:02.409056172 +0000 UTC m=+50.812852628" watchObservedRunningTime="2026-07-23 00:21:02.410362665 +0000 UTC m=+50.814159103"
Jul 23 00:21:03.389726 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:03.389683    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vj6tt" event={"ID":"de945bad-e9e4-400d-9508-babe1303c5c8","Type":"ContainerStarted","Data":"6c2b125b8bdd0b8c4b5fc5ff5c8439f2b5f83bc113a2d1563f881295d580c254"}
Jul 23 00:21:03.390169 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:03.389799    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vj6tt"
Jul 23 00:21:03.392154 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:03.392066    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8mfn4" event={"ID":"841648a1-4dc3-4f9b-8d9a-73ff42247e97","Type":"ContainerStarted","Data":"66383d079b67ee82e74d72657f40ca1328dc1610888ed8993ce1c657db01de3e"}
Jul 23 00:21:03.405229 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:03.405134    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vj6tt" podStartSLOduration=2.984542222 podStartE2EDuration="10.405115071s" totalImagesPullingTime="7.420572849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:21:03.404576381 +0000 UTC m=+51.808372876" watchObservedRunningTime="2026-07-23 00:21:03.405115071 +0000 UTC m=+51.808911523"
Jul 23 00:21:03.405556 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:03.405513    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59c8dbcc66-2ttkb" podStartSLOduration=1.953954066 podStartE2EDuration="9.405500572s" totalImagesPullingTime="7.451546506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:20:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:21:02.425479818 +0000 UTC m=+50.829276278" watchObservedRunningTime="2026-07-23 00:21:03.405500572 +0000 UTC m=+51.809297031"
Jul 23 00:21:04.390238 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:04.390198    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59c8dbcc66-2ttkb"
Jul 23 00:21:04.390780 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:04.390271    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59c8dbcc66-2ttkb"
Jul 23 00:21:04.395747 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:04.395718    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59c8dbcc66-2ttkb"
Jul 23 00:21:04.831063 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:04.831029    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-2l2ld"]
Jul 23 00:21:04.970497 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:04.970456    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zlrql"]
Jul 23 00:21:04.970665 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:04.970592    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-2l2ld"
Jul 23 00:21:04.973078 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:04.973040    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 23 00:21:04.973537 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:04.973373    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 23 00:21:04.973537 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:04.973423    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 23 00:21:04.973537 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:04.973441    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-sw2xr\""
Jul 23 00:21:05.037458 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.037422    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-2l2ld"]
Jul 23 00:21:05.037649 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.037582    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zlrql"
Jul 23 00:21:05.039870 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.039845    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 23 00:21:05.040792 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.040207    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 23 00:21:05.040792 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.040576    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 23 00:21:05.040792 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.040583    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mjp2b\""
Jul 23 00:21:05.076624 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.076593    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq7vl\" (UniqueName: \"kubernetes.io/projected/a823e66e-cd38-4e40-a920-a0d75a158011-kube-api-access-bq7vl\") pod \"kube-state-metrics-56c5594674-2l2ld\" (UID: \"a823e66e-cd38-4e40-a920-a0d75a158011\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2l2ld"
Jul 23 00:21:05.076624 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.076632    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a823e66e-cd38-4e40-a920-a0d75a158011-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-2l2ld\" (UID: \"a823e66e-cd38-4e40-a920-a0d75a158011\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2l2ld"
Jul 23 00:21:05.076851 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.076651    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a823e66e-cd38-4e40-a920-a0d75a158011-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-2l2ld\" (UID: \"a823e66e-cd38-4e40-a920-a0d75a158011\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2l2ld"
Jul 23 00:21:05.076851 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.076756    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a823e66e-cd38-4e40-a920-a0d75a158011-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-2l2ld\" (UID: \"a823e66e-cd38-4e40-a920-a0d75a158011\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2l2ld"
Jul 23 00:21:05.076851 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.076794    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a823e66e-cd38-4e40-a920-a0d75a158011-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-2l2ld\" (UID: \"a823e66e-cd38-4e40-a920-a0d75a158011\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2l2ld"
Jul 23 00:21:05.077032 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.076878    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a823e66e-cd38-4e40-a920-a0d75a158011-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-2l2ld\" (UID: \"a823e66e-cd38-4e40-a920-a0d75a158011\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2l2ld"
Jul 23 00:21:05.177502 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.177466    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cffc3a24-6dbc-4704-be1a-5cc56ab9f522-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zlrql\" (UID: \"cffc3a24-6dbc-4704-be1a-5cc56ab9f522\") " pod="openshift-monitoring/node-exporter-zlrql"
Jul 23 00:21:05.177502 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.177504    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cffc3a24-6dbc-4704-be1a-5cc56ab9f522-node-exporter-textfile\") pod \"node-exporter-zlrql\" (UID: \"cffc3a24-6dbc-4704-be1a-5cc56ab9f522\") " pod="openshift-monitoring/node-exporter-zlrql"
Jul 23 00:21:05.177705 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.177523    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cffc3a24-6dbc-4704-be1a-5cc56ab9f522-node-exporter-wtmp\") pod \"node-exporter-zlrql\" (UID: \"cffc3a24-6dbc-4704-be1a-5cc56ab9f522\") " pod="openshift-monitoring/node-exporter-zlrql"
Jul 23 00:21:05.177705 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.177583    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cffc3a24-6dbc-4704-be1a-5cc56ab9f522-metrics-client-ca\") pod \"node-exporter-zlrql\" (UID: \"cffc3a24-6dbc-4704-be1a-5cc56ab9f522\") " pod="openshift-monitoring/node-exporter-zlrql"
Jul 23 00:21:05.177705 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.177628    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmfq4\" (UniqueName: \"kubernetes.io/projected/cffc3a24-6dbc-4704-be1a-5cc56ab9f522-kube-api-access-rmfq4\") pod \"node-exporter-zlrql\" (UID: \"cffc3a24-6dbc-4704-be1a-5cc56ab9f522\") " pod="openshift-monitoring/node-exporter-zlrql"
Jul 23 00:21:05.177705 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.177689    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cffc3a24-6dbc-4704-be1a-5cc56ab9f522-node-exporter-tls\") pod \"node-exporter-zlrql\" (UID: \"cffc3a24-6dbc-4704-be1a-5cc56ab9f522\") " pod="openshift-monitoring/node-exporter-zlrql"
Jul 23 00:21:05.177822 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.177714    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq7vl\" (UniqueName: \"kubernetes.io/projected/a823e66e-cd38-4e40-a920-a0d75a158011-kube-api-access-bq7vl\") pod \"kube-state-metrics-56c5594674-2l2ld\" (UID: \"a823e66e-cd38-4e40-a920-a0d75a158011\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2l2ld"
Jul 23 00:21:05.177822 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.177745    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a823e66e-cd38-4e40-a920-a0d75a158011-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-2l2ld\" (UID: \"a823e66e-cd38-4e40-a920-a0d75a158011\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2l2ld"
Jul 23 00:21:05.177822 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.177770    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a823e66e-cd38-4e40-a920-a0d75a158011-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-2l2ld\" (UID: \"a823e66e-cd38-4e40-a920-a0d75a158011\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2l2ld"
Jul 23 00:21:05.177974 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.177952    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cffc3a24-6dbc-4704-be1a-5cc56ab9f522-sys\") pod \"node-exporter-zlrql\" (UID: \"cffc3a24-6dbc-4704-be1a-5cc56ab9f522\") " pod="openshift-monitoring/node-exporter-zlrql"
Jul 23 00:21:05.178025 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.177999    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cffc3a24-6dbc-4704-be1a-5cc56ab9f522-node-exporter-accelerators-collector-config\") pod \"node-exporter-zlrql\" (UID: \"cffc3a24-6dbc-4704-be1a-5cc56ab9f522\") " pod="openshift-monitoring/node-exporter-zlrql"
Jul 23 00:21:05.178076 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.178041    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a823e66e-cd38-4e40-a920-a0d75a158011-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-2l2ld\" (UID: \"a823e66e-cd38-4e40-a920-a0d75a158011\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2l2ld"
Jul 23 00:21:05.178076 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.178067    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a823e66e-cd38-4e40-a920-a0d75a158011-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-2l2ld\" (UID: \"a823e66e-cd38-4e40-a920-a0d75a158011\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2l2ld"
Jul 23 00:21:05.178167 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.178083    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cffc3a24-6dbc-4704-be1a-5cc56ab9f522-root\") pod \"node-exporter-zlrql\" (UID: \"cffc3a24-6dbc-4704-be1a-5cc56ab9f522\") " pod="openshift-monitoring/node-exporter-zlrql"
Jul 23 00:21:05.178167 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.178129    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a823e66e-cd38-4e40-a920-a0d75a158011-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-2l2ld\" (UID: \"a823e66e-cd38-4e40-a920-a0d75a158011\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2l2ld"
Jul 23 00:21:05.178504 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.178466    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a823e66e-cd38-4e40-a920-a0d75a158011-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-2l2ld\" (UID: \"a823e66e-cd38-4e40-a920-a0d75a158011\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2l2ld"
Jul 23 00:21:05.178688 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.178668    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a823e66e-cd38-4e40-a920-a0d75a158011-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-2l2ld\" (UID: \"a823e66e-cd38-4e40-a920-a0d75a158011\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2l2ld"
Jul 23 00:21:05.178742 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.178728    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a823e66e-cd38-4e40-a920-a0d75a158011-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-2l2ld\" (UID: \"a823e66e-cd38-4e40-a920-a0d75a158011\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2l2ld"
Jul 23 00:21:05.180998 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.180981    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a823e66e-cd38-4e40-a920-a0d75a158011-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-2l2ld\" (UID: \"a823e66e-cd38-4e40-a920-a0d75a158011\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2l2ld"
Jul 23 00:21:05.181180 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.181161    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a823e66e-cd38-4e40-a920-a0d75a158011-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-2l2ld\" (UID: \"a823e66e-cd38-4e40-a920-a0d75a158011\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2l2ld"
Jul 23 00:21:05.188769 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.188745    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq7vl\" (UniqueName: \"kubernetes.io/projected/a823e66e-cd38-4e40-a920-a0d75a158011-kube-api-access-bq7vl\") pod \"kube-state-metrics-56c5594674-2l2ld\" (UID: \"a823e66e-cd38-4e40-a920-a0d75a158011\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2l2ld"
Jul 23 00:21:05.279216 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.279184    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cffc3a24-6dbc-4704-be1a-5cc56ab9f522-metrics-client-ca\") pod \"node-exporter-zlrql\" (UID: \"cffc3a24-6dbc-4704-be1a-5cc56ab9f522\") " pod="openshift-monitoring/node-exporter-zlrql"
Jul 23 00:21:05.279216 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.279223    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmfq4\" (UniqueName: \"kubernetes.io/projected/cffc3a24-6dbc-4704-be1a-5cc56ab9f522-kube-api-access-rmfq4\") pod \"node-exporter-zlrql\" (UID: \"cffc3a24-6dbc-4704-be1a-5cc56ab9f522\") " pod="openshift-monitoring/node-exporter-zlrql"
Jul 23 00:21:05.279428 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.279258    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cffc3a24-6dbc-4704-be1a-5cc56ab9f522-node-exporter-tls\") pod \"node-exporter-zlrql\" (UID: \"cffc3a24-6dbc-4704-be1a-5cc56ab9f522\") " pod="openshift-monitoring/node-exporter-zlrql"
Jul 23 00:21:05.279428 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.279299    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cffc3a24-6dbc-4704-be1a-5cc56ab9f522-sys\") pod \"node-exporter-zlrql\" (UID: \"cffc3a24-6dbc-4704-be1a-5cc56ab9f522\") " pod="openshift-monitoring/node-exporter-zlrql"
Jul 23 00:21:05.279428 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.279324    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cffc3a24-6dbc-4704-be1a-5cc56ab9f522-node-exporter-accelerators-collector-config\") pod \"node-exporter-zlrql\" (UID: \"cffc3a24-6dbc-4704-be1a-5cc56ab9f522\") " pod="openshift-monitoring/node-exporter-zlrql"
Jul 23 00:21:05.279428 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.279355    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cffc3a24-6dbc-4704-be1a-5cc56ab9f522-root\") pod \"node-exporter-zlrql\" (UID: \"cffc3a24-6dbc-4704-be1a-5cc56ab9f522\") " pod="openshift-monitoring/node-exporter-zlrql"
Jul 23 00:21:05.279428 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.279406    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cffc3a24-6dbc-4704-be1a-5cc56ab9f522-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zlrql\" (UID: \"cffc3a24-6dbc-4704-be1a-5cc56ab9f522\") " pod="openshift-monitoring/node-exporter-zlrql"
Jul 23 00:21:05.279428 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.279419    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cffc3a24-6dbc-4704-be1a-5cc56ab9f522-sys\") pod \"node-exporter-zlrql\" (UID: \"cffc3a24-6dbc-4704-be1a-5cc56ab9f522\") " pod="openshift-monitoring/node-exporter-zlrql"
Jul 23 00:21:05.279676 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.279433    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cffc3a24-6dbc-4704-be1a-5cc56ab9f522-node-exporter-textfile\") pod \"node-exporter-zlrql\" (UID: \"cffc3a24-6dbc-4704-be1a-5cc56ab9f522\") " pod="openshift-monitoring/node-exporter-zlrql"
Jul 23 00:21:05.279676 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.279455    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cffc3a24-6dbc-4704-be1a-5cc56ab9f522-node-exporter-wtmp\") pod \"node-exporter-zlrql\" (UID: \"cffc3a24-6dbc-4704-be1a-5cc56ab9f522\") " pod="openshift-monitoring/node-exporter-zlrql"
Jul 23 00:21:05.279676 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.279593    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cffc3a24-6dbc-4704-be1a-5cc56ab9f522-node-exporter-wtmp\") pod \"node-exporter-zlrql\" (UID: \"cffc3a24-6dbc-4704-be1a-5cc56ab9f522\") " pod="openshift-monitoring/node-exporter-zlrql"
Jul 23 00:21:05.279676 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.279642    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cffc3a24-6dbc-4704-be1a-5cc56ab9f522-root\") pod \"node-exporter-zlrql\" (UID: \"cffc3a24-6dbc-4704-be1a-5cc56ab9f522\") " pod="openshift-monitoring/node-exporter-zlrql"
Jul 23 00:21:05.279861 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.279770    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cffc3a24-6dbc-4704-be1a-5cc56ab9f522-node-exporter-textfile\") pod \"node-exporter-zlrql\" (UID: \"cffc3a24-6dbc-4704-be1a-5cc56ab9f522\") " pod="openshift-monitoring/node-exporter-zlrql"
Jul 23 00:21:05.279861 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.279822    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cffc3a24-6dbc-4704-be1a-5cc56ab9f522-metrics-client-ca\") pod \"node-exporter-zlrql\" (UID: \"cffc3a24-6dbc-4704-be1a-5cc56ab9f522\") " pod="openshift-monitoring/node-exporter-zlrql"
Jul 23 00:21:05.279861 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.279845    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cffc3a24-6dbc-4704-be1a-5cc56ab9f522-node-exporter-accelerators-collector-config\") pod \"node-exporter-zlrql\" (UID: \"cffc3a24-6dbc-4704-be1a-5cc56ab9f522\") " pod="openshift-monitoring/node-exporter-zlrql"
Jul 23 00:21:05.281678 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.281657    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cffc3a24-6dbc-4704-be1a-5cc56ab9f522-node-exporter-tls\") pod \"node-exporter-zlrql\" (UID: \"cffc3a24-6dbc-4704-be1a-5cc56ab9f522\") " pod="openshift-monitoring/node-exporter-zlrql"
Jul 23 00:21:05.281777 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.281724    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cffc3a24-6dbc-4704-be1a-5cc56ab9f522-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zlrql\" (UID: \"cffc3a24-6dbc-4704-be1a-5cc56ab9f522\") " pod="openshift-monitoring/node-exporter-zlrql"
Jul 23 00:21:05.281826 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.281789    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-2l2ld"
Jul 23 00:21:05.286230 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.286205    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmfq4\" (UniqueName: \"kubernetes.io/projected/cffc3a24-6dbc-4704-be1a-5cc56ab9f522-kube-api-access-rmfq4\") pod \"node-exporter-zlrql\" (UID: \"cffc3a24-6dbc-4704-be1a-5cc56ab9f522\") " pod="openshift-monitoring/node-exporter-zlrql"
Jul 23 00:21:05.349638 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.349611    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zlrql"
Jul 23 00:21:05.401463 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.401438    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59c8dbcc66-2ttkb"
Jul 23 00:21:05.876026 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.875989    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 00:21:05.885289 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.885263    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:05.887787 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.887566    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 23 00:21:05.887787 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.887597    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 23 00:21:05.887787 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.887611    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 23 00:21:05.887787 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.887611    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-k6vvj\""
Jul 23 00:21:05.887787 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.887651    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 23 00:21:05.887787 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.887676    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 23 00:21:05.888202 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.887985    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 23 00:21:05.888202 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.888021    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 23 00:21:05.888202 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.888048    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 23 00:21:05.888202 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.888125    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 23 00:21:05.893091 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.893024    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 00:21:05.985496 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.985364    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:05.985496 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.985409    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:05.985496 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.985448    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0340aa8d-daf9-455f-8994-0cd9f51b196e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:05.985779 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.985543    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0340aa8d-daf9-455f-8994-0cd9f51b196e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:05.985779 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.985577    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0340aa8d-daf9-455f-8994-0cd9f51b196e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:05.985779 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.985661    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llhmf\" (UniqueName: \"kubernetes.io/projected/0340aa8d-daf9-455f-8994-0cd9f51b196e-kube-api-access-llhmf\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:05.985779 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.985708    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:05.985779 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.985733    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:05.986069 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.985793    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0340aa8d-daf9-455f-8994-0cd9f51b196e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:05.986069 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.985817    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-web-config\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:05.986069 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.985855    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:05.986069 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.985950    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-config-volume\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:05.986069 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:05.985977    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0340aa8d-daf9-455f-8994-0cd9f51b196e-config-out\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:06.041263 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:21:06.041233    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcffc3a24_6dbc_4704_be1a_5cc56ab9f522.slice/crio-64488fe6e2449587e46ecd07650a3390d049414642cdcff7acf74a274b92facd WatchSource:0}: Error finding container 64488fe6e2449587e46ecd07650a3390d049414642cdcff7acf74a274b92facd: Status 404 returned error can't find the container with id 64488fe6e2449587e46ecd07650a3390d049414642cdcff7acf74a274b92facd
Jul 23 00:21:06.086868 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.086836    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:06.087004 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.086885    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:06.087004 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.086940    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0340aa8d-daf9-455f-8994-0cd9f51b196e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:06.087438 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.087335    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0340aa8d-daf9-455f-8994-0cd9f51b196e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:06.087438 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.087456    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0340aa8d-daf9-455f-8994-0cd9f51b196e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:06.087438 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.087489    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0340aa8d-daf9-455f-8994-0cd9f51b196e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:06.087438 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.087547    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llhmf\" (UniqueName: \"kubernetes.io/projected/0340aa8d-daf9-455f-8994-0cd9f51b196e-kube-api-access-llhmf\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:06.087438 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.087593    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:06.087438 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.087618    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:06.087438 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.087664    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0340aa8d-daf9-455f-8994-0cd9f51b196e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:06.087438 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.087688    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-web-config\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:06.087438 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.087727    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:06.087438 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.087773    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-config-volume\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:06.087438 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.087797    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0340aa8d-daf9-455f-8994-0cd9f51b196e-config-out\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:06.089959 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.089709    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0340aa8d-daf9-455f-8994-0cd9f51b196e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:06.090988 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.090326    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0340aa8d-daf9-455f-8994-0cd9f51b196e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:06.090988 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.090790    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:06.091354 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.091305    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:06.091354 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.091331    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0340aa8d-daf9-455f-8994-0cd9f51b196e-config-out\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:06.091829 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.091808    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0340aa8d-daf9-455f-8994-0cd9f51b196e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:06.092861 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.092835    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:06.093520 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.093497    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:06.093717 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.093699    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-web-config\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:06.094261 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.094192    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-config-volume\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:06.094349 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.094292    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:06.098270 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.098247    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llhmf\" (UniqueName: \"kubernetes.io/projected/0340aa8d-daf9-455f-8994-0cd9f51b196e-kube-api-access-llhmf\") pod \"alertmanager-main-0\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:06.176444 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.176412    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-2l2ld"]
Jul 23 00:21:06.180127 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:21:06.180096    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda823e66e_cd38_4e40_a920_a0d75a158011.slice/crio-d077fab82cb35e2b1e2c27771e0ef94e8742792749b3759ab5f61548411fa58c WatchSource:0}: Error finding container d077fab82cb35e2b1e2c27771e0ef94e8742792749b3759ab5f61548411fa58c: Status 404 returned error can't find the container with id d077fab82cb35e2b1e2c27771e0ef94e8742792749b3759ab5f61548411fa58c
Jul 23 00:21:06.198463 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.198435    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:21:06.328969 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.328933    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 00:21:06.332653 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:21:06.332624    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0340aa8d_daf9_455f_8994_0cd9f51b196e.slice/crio-6691563ecfed928cd3de08ce08eece57f1c0117beec02d3256cc11ea4824edf5 WatchSource:0}: Error finding container 6691563ecfed928cd3de08ce08eece57f1c0117beec02d3256cc11ea4824edf5: Status 404 returned error can't find the container with id 6691563ecfed928cd3de08ce08eece57f1c0117beec02d3256cc11ea4824edf5
Jul 23 00:21:06.405351 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.405312    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2l2ld" event={"ID":"a823e66e-cd38-4e40-a920-a0d75a158011","Type":"ContainerStarted","Data":"d077fab82cb35e2b1e2c27771e0ef94e8742792749b3759ab5f61548411fa58c"}
Jul 23 00:21:06.406595 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.406567    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zlrql" event={"ID":"cffc3a24-6dbc-4704-be1a-5cc56ab9f522","Type":"ContainerStarted","Data":"64488fe6e2449587e46ecd07650a3390d049414642cdcff7acf74a274b92facd"}
Jul 23 00:21:06.408552 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.408529    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8mfn4" event={"ID":"841648a1-4dc3-4f9b-8d9a-73ff42247e97","Type":"ContainerStarted","Data":"b8171a4a3ba81eecde3e33326d516a0e45bf45014f702db443195ff6145c8b7c"}
Jul 23 00:21:06.409663 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:06.409643    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0340aa8d-daf9-455f-8994-0cd9f51b196e","Type":"ContainerStarted","Data":"6691563ecfed928cd3de08ce08eece57f1c0117beec02d3256cc11ea4824edf5"}
Jul 23 00:21:07.416370 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:07.416327    2575 generic.go:356] "Generic (PLEG): container finished" podID="cffc3a24-6dbc-4704-be1a-5cc56ab9f522" containerID="ae56747b2411c640643a8a2b714a3130835fde8262ef14ece2fcd5934fbbf266" exitCode=0
Jul 23 00:21:07.416750 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:07.416396    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zlrql" event={"ID":"cffc3a24-6dbc-4704-be1a-5cc56ab9f522","Type":"ContainerDied","Data":"ae56747b2411c640643a8a2b714a3130835fde8262ef14ece2fcd5934fbbf266"}
Jul 23 00:21:08.422356 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:08.422311    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zlrql" event={"ID":"cffc3a24-6dbc-4704-be1a-5cc56ab9f522","Type":"ContainerStarted","Data":"885eecc2e5c09053fc9b923b976f7ac3f5ab3cc77264e2b40773ea1285d3a929"}
Jul 23 00:21:08.422761 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:08.422367    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zlrql" event={"ID":"cffc3a24-6dbc-4704-be1a-5cc56ab9f522","Type":"ContainerStarted","Data":"feafa4fa3f12ad5d56075b122f050acee64957f2c62d2bf1c6e8163125f1645d"}
Jul 23 00:21:08.438614 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:08.438566    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zlrql" podStartSLOduration=3.273757194 podStartE2EDuration="4.43854803s" totalImagesPullingTime="1.07392714s" totalInitContainerRuntime="90.863696ms" isStatefulPod=true podCreationTimestamp="2026-07-23 00:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:21:08.437512498 +0000 UTC m=+56.841308955" watchObservedRunningTime="2026-07-23 00:21:08.43854803 +0000 UTC m=+56.842344466"
Jul 23 00:21:09.120653 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.120620    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5ffb48784-4fmw9"]
Jul 23 00:21:09.129658 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.129634    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5ffb48784-4fmw9"
Jul 23 00:21:09.133799 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.132649    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-k6mtj\""
Jul 23 00:21:09.133799 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.132944    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 23 00:21:09.133799 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.133226    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 23 00:21:09.133799 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.133457    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-eg691btv2umd2\""
Jul 23 00:21:09.133799 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.133671    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 23 00:21:09.134768 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.134747    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 23 00:21:09.135079 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.135061    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5ffb48784-4fmw9"]
Jul 23 00:21:09.319171 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.319133    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c8952341-5010-4da4-8713-7812a19701d5-secret-metrics-server-client-certs\") pod \"metrics-server-5ffb48784-4fmw9\" (UID: \"c8952341-5010-4da4-8713-7812a19701d5\") " pod="openshift-monitoring/metrics-server-5ffb48784-4fmw9"
Jul 23 00:21:09.319171 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.319172    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8lj2\" (UniqueName: \"kubernetes.io/projected/c8952341-5010-4da4-8713-7812a19701d5-kube-api-access-g8lj2\") pod \"metrics-server-5ffb48784-4fmw9\" (UID: \"c8952341-5010-4da4-8713-7812a19701d5\") " pod="openshift-monitoring/metrics-server-5ffb48784-4fmw9"
Jul 23 00:21:09.319425 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.319221    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c8952341-5010-4da4-8713-7812a19701d5-secret-metrics-server-tls\") pod \"metrics-server-5ffb48784-4fmw9\" (UID: \"c8952341-5010-4da4-8713-7812a19701d5\") " pod="openshift-monitoring/metrics-server-5ffb48784-4fmw9"
Jul 23 00:21:09.319425 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.319280    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8952341-5010-4da4-8713-7812a19701d5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5ffb48784-4fmw9\" (UID: \"c8952341-5010-4da4-8713-7812a19701d5\") " pod="openshift-monitoring/metrics-server-5ffb48784-4fmw9"
Jul 23 00:21:09.319425 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.319331    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c8952341-5010-4da4-8713-7812a19701d5-client-ca-bundle\") pod \"metrics-server-5ffb48784-4fmw9\" (UID: \"c8952341-5010-4da4-8713-7812a19701d5\") " pod="openshift-monitoring/metrics-server-5ffb48784-4fmw9"
Jul 23 00:21:09.319566 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.319440    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c8952341-5010-4da4-8713-7812a19701d5-metrics-server-audit-profiles\") pod \"metrics-server-5ffb48784-4fmw9\" (UID: \"c8952341-5010-4da4-8713-7812a19701d5\") " pod="openshift-monitoring/metrics-server-5ffb48784-4fmw9"
Jul 23 00:21:09.319566 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.319487    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c8952341-5010-4da4-8713-7812a19701d5-audit-log\") pod \"metrics-server-5ffb48784-4fmw9\" (UID: \"c8952341-5010-4da4-8713-7812a19701d5\") " pod="openshift-monitoring/metrics-server-5ffb48784-4fmw9"
Jul 23 00:21:09.420794 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.420753    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c8952341-5010-4da4-8713-7812a19701d5-secret-metrics-server-tls\") pod \"metrics-server-5ffb48784-4fmw9\" (UID: \"c8952341-5010-4da4-8713-7812a19701d5\") " pod="openshift-monitoring/metrics-server-5ffb48784-4fmw9"
Jul 23 00:21:09.420794 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.420796    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8952341-5010-4da4-8713-7812a19701d5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5ffb48784-4fmw9\" (UID: \"c8952341-5010-4da4-8713-7812a19701d5\") " pod="openshift-monitoring/metrics-server-5ffb48784-4fmw9"
Jul 23 00:21:09.421065 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.420820    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c8952341-5010-4da4-8713-7812a19701d5-client-ca-bundle\") pod \"metrics-server-5ffb48784-4fmw9\" (UID: \"c8952341-5010-4da4-8713-7812a19701d5\") " pod="openshift-monitoring/metrics-server-5ffb48784-4fmw9"
Jul 23 00:21:09.421065 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.420900    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c8952341-5010-4da4-8713-7812a19701d5-metrics-server-audit-profiles\") pod \"metrics-server-5ffb48784-4fmw9\" (UID: \"c8952341-5010-4da4-8713-7812a19701d5\") " pod="openshift-monitoring/metrics-server-5ffb48784-4fmw9"
Jul 23 00:21:09.422961 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.422413    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c8952341-5010-4da4-8713-7812a19701d5-metrics-server-audit-profiles\") pod \"metrics-server-5ffb48784-4fmw9\" (UID: \"c8952341-5010-4da4-8713-7812a19701d5\") " pod="openshift-monitoring/metrics-server-5ffb48784-4fmw9"
Jul 23 00:21:09.424965 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.424056    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c8952341-5010-4da4-8713-7812a19701d5-audit-log\") pod \"metrics-server-5ffb48784-4fmw9\" (UID: \"c8952341-5010-4da4-8713-7812a19701d5\") " pod="openshift-monitoring/metrics-server-5ffb48784-4fmw9"
Jul 23 00:21:09.424965 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.424159    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c8952341-5010-4da4-8713-7812a19701d5-secret-metrics-server-client-certs\") pod \"metrics-server-5ffb48784-4fmw9\" (UID: \"c8952341-5010-4da4-8713-7812a19701d5\") " pod="openshift-monitoring/metrics-server-5ffb48784-4fmw9"
Jul 23 00:21:09.424965 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.424217    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8lj2\" (UniqueName: \"kubernetes.io/projected/c8952341-5010-4da4-8713-7812a19701d5-kube-api-access-g8lj2\") pod \"metrics-server-5ffb48784-4fmw9\" (UID: \"c8952341-5010-4da4-8713-7812a19701d5\") " pod="openshift-monitoring/metrics-server-5ffb48784-4fmw9"
Jul 23 00:21:09.424965 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.424582    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8952341-5010-4da4-8713-7812a19701d5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5ffb48784-4fmw9\" (UID: \"c8952341-5010-4da4-8713-7812a19701d5\") " pod="openshift-monitoring/metrics-server-5ffb48784-4fmw9"
Jul 23 00:21:09.424965 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.424899    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c8952341-5010-4da4-8713-7812a19701d5-audit-log\") pod \"metrics-server-5ffb48784-4fmw9\" (UID: \"c8952341-5010-4da4-8713-7812a19701d5\") " pod="openshift-monitoring/metrics-server-5ffb48784-4fmw9"
Jul 23 00:21:09.428749 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.427094    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c8952341-5010-4da4-8713-7812a19701d5-secret-metrics-server-tls\") pod \"metrics-server-5ffb48784-4fmw9\" (UID: \"c8952341-5010-4da4-8713-7812a19701d5\") " pod="openshift-monitoring/metrics-server-5ffb48784-4fmw9"
Jul 23 00:21:09.428749 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.427329    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c8952341-5010-4da4-8713-7812a19701d5-client-ca-bundle\") pod \"metrics-server-5ffb48784-4fmw9\" (UID: \"c8952341-5010-4da4-8713-7812a19701d5\") " pod="openshift-monitoring/metrics-server-5ffb48784-4fmw9"
Jul 23 00:21:09.428749 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.427392    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c8952341-5010-4da4-8713-7812a19701d5-secret-metrics-server-client-certs\") pod \"metrics-server-5ffb48784-4fmw9\" (UID: \"c8952341-5010-4da4-8713-7812a19701d5\") " pod="openshift-monitoring/metrics-server-5ffb48784-4fmw9"
Jul 23 00:21:09.432333 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.432306    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8lj2\" (UniqueName: \"kubernetes.io/projected/c8952341-5010-4da4-8713-7812a19701d5-kube-api-access-g8lj2\") pod \"metrics-server-5ffb48784-4fmw9\" (UID: \"c8952341-5010-4da4-8713-7812a19701d5\") " pod="openshift-monitoring/metrics-server-5ffb48784-4fmw9"
Jul 23 00:21:09.443061 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:09.443039    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5ffb48784-4fmw9"
Jul 23 00:21:10.178934 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:10.177726    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5ffb48784-4fmw9"]
Jul 23 00:21:10.437011 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:10.436968    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2l2ld" event={"ID":"a823e66e-cd38-4e40-a920-a0d75a158011","Type":"ContainerStarted","Data":"c2c5c76d15085c0650c0bea30c31489b15fca048404e7a7fd243552a8720421c"}
Jul 23 00:21:10.437457 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:10.437048    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2l2ld" event={"ID":"a823e66e-cd38-4e40-a920-a0d75a158011","Type":"ContainerStarted","Data":"1f393f3b3037086cc50a324a1bec46f0f9efafa7dfb16504428a992ea938df03"}
Jul 23 00:21:10.437457 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:10.437082    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2l2ld" event={"ID":"a823e66e-cd38-4e40-a920-a0d75a158011","Type":"ContainerStarted","Data":"d190029c7013a8cbc899c25d29a44db9b658a79cf49e318fb7cf3178cc103684"}
Jul 23 00:21:10.439102 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:10.439075    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8mfn4" event={"ID":"841648a1-4dc3-4f9b-8d9a-73ff42247e97","Type":"ContainerStarted","Data":"425a852862505b4a9b9e57b0ab9023ae5357e63bf8804f8bed17838f62fff872"}
Jul 23 00:21:10.440564 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:10.440545    2575 generic.go:356] "Generic (PLEG): container finished" podID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerID="4560e05555d435db8eb6d124875bb68c1c66278485dcc098960b220aab4f5838" exitCode=0
Jul 23 00:21:10.440664 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:10.440610    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0340aa8d-daf9-455f-8994-0cd9f51b196e","Type":"ContainerDied","Data":"4560e05555d435db8eb6d124875bb68c1c66278485dcc098960b220aab4f5838"}
Jul 23 00:21:10.441961 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:10.441941    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5ffb48784-4fmw9" event={"ID":"c8952341-5010-4da4-8713-7812a19701d5","Type":"ContainerStarted","Data":"9504cdc9672e38ec2be7bef0f2666c45ae55cb75c3f359ef9d879c14588bf6d5"}
Jul 23 00:21:10.455177 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:10.455133    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-2l2ld" podStartSLOduration=2.610934727 podStartE2EDuration="6.455115254s" totalImagesPullingTime="3.844180527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:21:10.453788926 +0000 UTC m=+58.857585382" watchObservedRunningTime="2026-07-23 00:21:10.455115254 +0000 UTC m=+58.858911712"
Jul 23 00:21:10.470715 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:10.470667    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8mfn4" podStartSLOduration=2.140724107 podStartE2EDuration="18.470654591s" totalImagesPullingTime="16.329930484s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:20:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:21:10.469900233 +0000 UTC m=+58.873696691" watchObservedRunningTime="2026-07-23 00:21:10.470654591 +0000 UTC m=+58.874451026"
Jul 23 00:21:11.033133 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.033097    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 00:21:11.037942 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.037894    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.040351 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.040302    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3o6c9o2b3dteb\""
Jul 23 00:21:11.040489 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.040369    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 23 00:21:11.040542 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.040302    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 23 00:21:11.040591 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.040572    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 23 00:21:11.040859 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.040698    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 23 00:21:11.041877 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.041328    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 23 00:21:11.041877 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.041539    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 23 00:21:11.041877 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.041727    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 23 00:21:11.042305 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.042155    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 23 00:21:11.042615 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.042587    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 23 00:21:11.042695 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.042587    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 23 00:21:11.042695 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.042586    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 23 00:21:11.042998 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.042977    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 23 00:21:11.043108 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.043090    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-j8rw5\""
Jul 23 00:21:11.049411 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.049390    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 23 00:21:11.052685 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.052663    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 23 00:21:11.055577 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.055557    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 00:21:11.139879 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.139842    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.140134 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.139937    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.140134 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.139976    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.140134 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.140007    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.140134 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.140029    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.140134 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.140057    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3c7d9ffe-f398-4596-88a9-26772996e52f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.140134 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.140096    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.140134 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.140118    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.140599 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.140151    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.140599 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.140189    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c7d9ffe-f398-4596-88a9-26772996e52f-config-out\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.140599 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.140275    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.140599 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.140297    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-web-config\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.140599 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.140324    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c7d9ffe-f398-4596-88a9-26772996e52f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.140599 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.140356    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-config\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.140599 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.140378    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.140599 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.140405    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.140599 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.140431    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.140599 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.140455    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.140599 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.140476    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.140599 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.140498    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkbvj\" (UniqueName: \"kubernetes.io/projected/3c7d9ffe-f398-4596-88a9-26772996e52f-kube-api-access-lkbvj\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.243834 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.243794    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.244044 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.243846    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.244044 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.243873    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.244044 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.243889    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.244044 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.243933    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3c7d9ffe-f398-4596-88a9-26772996e52f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.244044 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.243969    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.244044 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.243994    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.244044 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.244025    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.244362 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.244064    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c7d9ffe-f398-4596-88a9-26772996e52f-config-out\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.244362 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.244152    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.244362 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.244175    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-web-config\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.244362 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.244203    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c7d9ffe-f398-4596-88a9-26772996e52f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.244362 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.244230    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-config\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.244362 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.244254    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.244362 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.244280    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.244362 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.244306    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.244362 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.244328    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.244362 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.244362    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.244821 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.244385    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkbvj\" (UniqueName: \"kubernetes.io/projected/3c7d9ffe-f398-4596-88a9-26772996e52f-kube-api-access-lkbvj\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.244821 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.244423    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.245299 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.245269    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.246674 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.245990    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3c7d9ffe-f398-4596-88a9-26772996e52f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.246674 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.246254    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.246674 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.246488    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.246674 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.246525    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.247299 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.247277    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.248695 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.248415    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.252289 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.251695    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.252670 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.252647    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.255494 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.255433    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.257151 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.257107    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.258571 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.258342    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c7d9ffe-f398-4596-88a9-26772996e52f-config-out\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.258571 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.258529    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-config\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.258729 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.258703    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.260701 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.259416    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.260701 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.259813    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.260701 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.260207    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-web-config\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.260701 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.260649    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.261032 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.260831    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c7d9ffe-f398-4596-88a9-26772996e52f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.261668 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.261647    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkbvj\" (UniqueName: \"kubernetes.io/projected/3c7d9ffe-f398-4596-88a9-26772996e52f-kube-api-access-lkbvj\") pod \"prometheus-k8s-0\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.353983 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.353872    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:11.573702 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:11.573593    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 00:21:11.576788 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:21:11.576755    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c7d9ffe_f398_4596_88a9_26772996e52f.slice/crio-0bb1c337b90dd12b50083abc291ddc62d4458d1767853e39b9f148941400c21a WatchSource:0}: Error finding container 0bb1c337b90dd12b50083abc291ddc62d4458d1767853e39b9f148941400c21a: Status 404 returned error can't find the container with id 0bb1c337b90dd12b50083abc291ddc62d4458d1767853e39b9f148941400c21a
Jul 23 00:21:12.312323 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:12.312290    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhvxb"
Jul 23 00:21:12.452094 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:12.452057    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5ffb48784-4fmw9" event={"ID":"c8952341-5010-4da4-8713-7812a19701d5","Type":"ContainerStarted","Data":"eb0efcc1b6888a1697ee0dc0a02e83f1b617fa1199a9a8ffdd50bf05d0ce185a"}
Jul 23 00:21:12.453954 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:12.453779    2575 generic.go:356] "Generic (PLEG): container finished" podID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerID="d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab" exitCode=0
Jul 23 00:21:12.453954 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:12.453814    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c7d9ffe-f398-4596-88a9-26772996e52f","Type":"ContainerDied","Data":"d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab"}
Jul 23 00:21:12.453954 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:12.453893    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c7d9ffe-f398-4596-88a9-26772996e52f","Type":"ContainerStarted","Data":"0bb1c337b90dd12b50083abc291ddc62d4458d1767853e39b9f148941400c21a"}
Jul 23 00:21:12.471365 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:12.471314    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5ffb48784-4fmw9" podStartSLOduration=1.512652245 podStartE2EDuration="3.471296098s" totalImagesPullingTime="1.958643853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:21:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:21:12.471025193 +0000 UTC m=+60.874821651" watchObservedRunningTime="2026-07-23 00:21:12.471296098 +0000 UTC m=+60.875092556"
Jul 23 00:21:13.397966 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:13.397937    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vj6tt"
Jul 23 00:21:13.462402 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:13.462330    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0340aa8d-daf9-455f-8994-0cd9f51b196e","Type":"ContainerStarted","Data":"5134f0eb126e2b68a99329cbeb1afcc45839c38927b01ada1d3f7ac084127ac3"}
Jul 23 00:21:13.462551 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:13.462423    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0340aa8d-daf9-455f-8994-0cd9f51b196e","Type":"ContainerStarted","Data":"ef576e4fbf79897863047a5fc674ca71d33e34f325ebc77aac6bbfa6e4c6a1c4"}
Jul 23 00:21:13.462551 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:13.462471    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0340aa8d-daf9-455f-8994-0cd9f51b196e","Type":"ContainerStarted","Data":"2cc499724c3b3d880b50c756640bbf68a60c35169490a7dd34b6b1ef53ebd9eb"}
Jul 23 00:21:13.462551 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:13.462510    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0340aa8d-daf9-455f-8994-0cd9f51b196e","Type":"ContainerStarted","Data":"8d6bc46580f0dbd22412a3f4fb08fbe1d8f6632112a5cb3b7932bdc149867c42"}
Jul 23 00:21:13.462551 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:13.462546    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0340aa8d-daf9-455f-8994-0cd9f51b196e","Type":"ContainerStarted","Data":"fb6cee4c602fc11a93aae476954e32d6a694faa89000386020b582b3ce2cbc2b"}
Jul 23 00:21:14.470128 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:14.470089    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0340aa8d-daf9-455f-8994-0cd9f51b196e","Type":"ContainerStarted","Data":"287cfbd19f13aa7b2d9119a4fba7b9acaaa00f41e19642ea81fa85c15fa3d701"}
Jul 23 00:21:14.497703 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:14.497650    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.91913922 podStartE2EDuration="9.497633378s" totalImagesPullingTime="6.557625638s" totalInitContainerRuntime="20.86852ms" isStatefulPod=false podCreationTimestamp="2026-07-23 00:21:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:21:14.49601587 +0000 UTC m=+62.899812353" watchObservedRunningTime="2026-07-23 00:21:14.497633378 +0000 UTC m=+62.901429834"
Jul 23 00:21:16.480087 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:16.480050    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c7d9ffe-f398-4596-88a9-26772996e52f","Type":"ContainerStarted","Data":"6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680"}
Jul 23 00:21:16.480467 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:16.480115    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c7d9ffe-f398-4596-88a9-26772996e52f","Type":"ContainerStarted","Data":"6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87"}
Jul 23 00:21:17.809177 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:17.809134    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a594d680-4ddd-4df4-9130-0a4e075dd19a-metrics-certs\") pod \"network-metrics-daemon-5bdx2\" (UID: \"a594d680-4ddd-4df4-9130-0a4e075dd19a\") " pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:21:17.809637 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:17.809212    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-455s4\" (UniqueName: \"kubernetes.io/projected/ae70da8b-d8aa-4b34-9780-3e53cb43fac9-kube-api-access-455s4\") pod \"network-check-target-9pnlz\" (UID: \"ae70da8b-d8aa-4b34-9780-3e53cb43fac9\") " pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:21:17.811179 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:17.811161    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 00:21:17.811600 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:17.811578    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 00:21:17.821730 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:17.821711    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 00:21:17.822449 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:17.822429    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a594d680-4ddd-4df4-9130-0a4e075dd19a-metrics-certs\") pod \"network-metrics-daemon-5bdx2\" (UID: \"a594d680-4ddd-4df4-9130-0a4e075dd19a\") " pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:21:17.832715 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:17.832691    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-455s4\" (UniqueName: \"kubernetes.io/projected/ae70da8b-d8aa-4b34-9780-3e53cb43fac9-kube-api-access-455s4\") pod \"network-check-target-9pnlz\" (UID: \"ae70da8b-d8aa-4b34-9780-3e53cb43fac9\") " pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:21:17.846394 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:17.846370    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-52cgs\""
Jul 23 00:21:17.854974 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:17.854952    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bdx2"
Jul 23 00:21:17.910116 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:17.909792    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18b6cfa7-6d8f-4934-b78c-789e54bdbac9-original-pull-secret\") pod \"global-pull-secret-syncer-sjjx7\" (UID: \"18b6cfa7-6d8f-4934-b78c-789e54bdbac9\") " pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:21:17.912033 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:17.912014    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 00:21:17.923546 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:17.923519    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18b6cfa7-6d8f-4934-b78c-789e54bdbac9-original-pull-secret\") pod \"global-pull-secret-syncer-sjjx7\" (UID: \"18b6cfa7-6d8f-4934-b78c-789e54bdbac9\") " pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:21:18.013228 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.013114    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5bdx2"]
Jul 23 00:21:18.034335 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.034297    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2ns5k\""
Jul 23 00:21:18.042948 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.042903    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:21:18.138408 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.138380    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjjx7"
Jul 23 00:21:18.323042 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.323009    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8f8c9dffc-knswq"]
Jul 23 00:21:18.345435 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.345357    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8f8c9dffc-knswq"]
Jul 23 00:21:18.345580 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.345488    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f8c9dffc-knswq"
Jul 23 00:21:18.415403 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.415359    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkdpq\" (UniqueName: \"kubernetes.io/projected/5f9edd20-66af-42f1-a19b-3dbe3094b850-kube-api-access-tkdpq\") pod \"console-8f8c9dffc-knswq\" (UID: \"5f9edd20-66af-42f1-a19b-3dbe3094b850\") " pod="openshift-console/console-8f8c9dffc-knswq"
Jul 23 00:21:18.415578 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.415409    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f9edd20-66af-42f1-a19b-3dbe3094b850-console-oauth-config\") pod \"console-8f8c9dffc-knswq\" (UID: \"5f9edd20-66af-42f1-a19b-3dbe3094b850\") " pod="openshift-console/console-8f8c9dffc-knswq"
Jul 23 00:21:18.415578 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.415440    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f9edd20-66af-42f1-a19b-3dbe3094b850-service-ca\") pod \"console-8f8c9dffc-knswq\" (UID: \"5f9edd20-66af-42f1-a19b-3dbe3094b850\") " pod="openshift-console/console-8f8c9dffc-knswq"
Jul 23 00:21:18.415578 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.415463    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9edd20-66af-42f1-a19b-3dbe3094b850-trusted-ca-bundle\") pod \"console-8f8c9dffc-knswq\" (UID: \"5f9edd20-66af-42f1-a19b-3dbe3094b850\") " pod="openshift-console/console-8f8c9dffc-knswq"
Jul 23 00:21:18.415578 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.415550    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f9edd20-66af-42f1-a19b-3dbe3094b850-console-serving-cert\") pod \"console-8f8c9dffc-knswq\" (UID: \"5f9edd20-66af-42f1-a19b-3dbe3094b850\") " pod="openshift-console/console-8f8c9dffc-knswq"
Jul 23 00:21:18.415578 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.415571    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f9edd20-66af-42f1-a19b-3dbe3094b850-oauth-serving-cert\") pod \"console-8f8c9dffc-knswq\" (UID: \"5f9edd20-66af-42f1-a19b-3dbe3094b850\") " pod="openshift-console/console-8f8c9dffc-knswq"
Jul 23 00:21:18.415781 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.415600    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f9edd20-66af-42f1-a19b-3dbe3094b850-console-config\") pod \"console-8f8c9dffc-knswq\" (UID: \"5f9edd20-66af-42f1-a19b-3dbe3094b850\") " pod="openshift-console/console-8f8c9dffc-knswq"
Jul 23 00:21:18.516754 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.516715    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f9edd20-66af-42f1-a19b-3dbe3094b850-console-serving-cert\") pod \"console-8f8c9dffc-knswq\" (UID: \"5f9edd20-66af-42f1-a19b-3dbe3094b850\") " pod="openshift-console/console-8f8c9dffc-knswq"
Jul 23 00:21:18.516969 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.516764    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f9edd20-66af-42f1-a19b-3dbe3094b850-oauth-serving-cert\") pod \"console-8f8c9dffc-knswq\" (UID: \"5f9edd20-66af-42f1-a19b-3dbe3094b850\") " pod="openshift-console/console-8f8c9dffc-knswq"
Jul 23 00:21:18.516969 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.516798    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f9edd20-66af-42f1-a19b-3dbe3094b850-console-config\") pod \"console-8f8c9dffc-knswq\" (UID: \"5f9edd20-66af-42f1-a19b-3dbe3094b850\") " pod="openshift-console/console-8f8c9dffc-knswq"
Jul 23 00:21:18.516969 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.516847    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkdpq\" (UniqueName: \"kubernetes.io/projected/5f9edd20-66af-42f1-a19b-3dbe3094b850-kube-api-access-tkdpq\") pod \"console-8f8c9dffc-knswq\" (UID: \"5f9edd20-66af-42f1-a19b-3dbe3094b850\") " pod="openshift-console/console-8f8c9dffc-knswq"
Jul 23 00:21:18.516969 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.516878    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f9edd20-66af-42f1-a19b-3dbe3094b850-console-oauth-config\") pod \"console-8f8c9dffc-knswq\" (UID: \"5f9edd20-66af-42f1-a19b-3dbe3094b850\") " pod="openshift-console/console-8f8c9dffc-knswq"
Jul 23 00:21:18.516969 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.516936    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f9edd20-66af-42f1-a19b-3dbe3094b850-service-ca\") pod \"console-8f8c9dffc-knswq\" (UID: \"5f9edd20-66af-42f1-a19b-3dbe3094b850\") " pod="openshift-console/console-8f8c9dffc-knswq"
Jul 23 00:21:18.516969 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.516962    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9edd20-66af-42f1-a19b-3dbe3094b850-trusted-ca-bundle\") pod \"console-8f8c9dffc-knswq\" (UID: \"5f9edd20-66af-42f1-a19b-3dbe3094b850\") " pod="openshift-console/console-8f8c9dffc-knswq"
Jul 23 00:21:18.518946 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.517869    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f9edd20-66af-42f1-a19b-3dbe3094b850-console-config\") pod \"console-8f8c9dffc-knswq\" (UID: \"5f9edd20-66af-42f1-a19b-3dbe3094b850\") " pod="openshift-console/console-8f8c9dffc-knswq"
Jul 23 00:21:18.519537 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.519510    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f9edd20-66af-42f1-a19b-3dbe3094b850-service-ca\") pod \"console-8f8c9dffc-knswq\" (UID: \"5f9edd20-66af-42f1-a19b-3dbe3094b850\") " pod="openshift-console/console-8f8c9dffc-knswq"
Jul 23 00:21:18.520636 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.520606    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f9edd20-66af-42f1-a19b-3dbe3094b850-oauth-serving-cert\") pod \"console-8f8c9dffc-knswq\" (UID: \"5f9edd20-66af-42f1-a19b-3dbe3094b850\") " pod="openshift-console/console-8f8c9dffc-knswq"
Jul 23 00:21:18.520984 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.520959    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9edd20-66af-42f1-a19b-3dbe3094b850-trusted-ca-bundle\") pod \"console-8f8c9dffc-knswq\" (UID: \"5f9edd20-66af-42f1-a19b-3dbe3094b850\") " pod="openshift-console/console-8f8c9dffc-knswq"
Jul 23 00:21:18.522432 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.522404    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f9edd20-66af-42f1-a19b-3dbe3094b850-console-oauth-config\") pod \"console-8f8c9dffc-knswq\" (UID: \"5f9edd20-66af-42f1-a19b-3dbe3094b850\") " pod="openshift-console/console-8f8c9dffc-knswq"
Jul 23 00:21:18.522674 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.522650    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f9edd20-66af-42f1-a19b-3dbe3094b850-console-serving-cert\") pod \"console-8f8c9dffc-knswq\" (UID: \"5f9edd20-66af-42f1-a19b-3dbe3094b850\") " pod="openshift-console/console-8f8c9dffc-knswq"
Jul 23 00:21:18.527276 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.527254    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkdpq\" (UniqueName: \"kubernetes.io/projected/5f9edd20-66af-42f1-a19b-3dbe3094b850-kube-api-access-tkdpq\") pod \"console-8f8c9dffc-knswq\" (UID: \"5f9edd20-66af-42f1-a19b-3dbe3094b850\") " pod="openshift-console/console-8f8c9dffc-knswq"
Jul 23 00:21:18.592969 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:21:18.592937    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda594d680_4ddd_4df4_9130_0a4e075dd19a.slice/crio-e1b06dc7a153f27336802a210c211d297c93ee008b2444b1c29ab7f57ed980cd WatchSource:0}: Error finding container e1b06dc7a153f27336802a210c211d297c93ee008b2444b1c29ab7f57ed980cd: Status 404 returned error can't find the container with id e1b06dc7a153f27336802a210c211d297c93ee008b2444b1c29ab7f57ed980cd
Jul 23 00:21:18.662682 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.662637    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f8c9dffc-knswq"
Jul 23 00:21:18.750039 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.749996    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9pnlz"]
Jul 23 00:21:18.760509 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:21:18.760472    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae70da8b_d8aa_4b34_9780_3e53cb43fac9.slice/crio-66432fd35f7c384e415cefe98a4bab747a919bb4441e40a36162a55ee96a12d3 WatchSource:0}: Error finding container 66432fd35f7c384e415cefe98a4bab747a919bb4441e40a36162a55ee96a12d3: Status 404 returned error can't find the container with id 66432fd35f7c384e415cefe98a4bab747a919bb4441e40a36162a55ee96a12d3
Jul 23 00:21:18.765930 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.765887    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sjjx7"]
Jul 23 00:21:18.826873 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:18.826839    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8f8c9dffc-knswq"]
Jul 23 00:21:18.832034 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:21:18.831956    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f9edd20_66af_42f1_a19b_3dbe3094b850.slice/crio-1937a3c7835888ee78c4c0691e301fd4a09996a949f92d22663d68575d5933f8 WatchSource:0}: Error finding container 1937a3c7835888ee78c4c0691e301fd4a09996a949f92d22663d68575d5933f8: Status 404 returned error can't find the container with id 1937a3c7835888ee78c4c0691e301fd4a09996a949f92d22663d68575d5933f8
Jul 23 00:21:19.507525 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:19.506132    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c7d9ffe-f398-4596-88a9-26772996e52f","Type":"ContainerStarted","Data":"c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa"}
Jul 23 00:21:19.507525 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:19.506265    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c7d9ffe-f398-4596-88a9-26772996e52f","Type":"ContainerStarted","Data":"b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5"}
Jul 23 00:21:19.507525 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:19.506311    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c7d9ffe-f398-4596-88a9-26772996e52f","Type":"ContainerStarted","Data":"72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366"}
Jul 23 00:21:19.507525 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:19.506352    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c7d9ffe-f398-4596-88a9-26772996e52f","Type":"ContainerStarted","Data":"927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788"}
Jul 23 00:21:19.510297 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:19.510264    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f8c9dffc-knswq" event={"ID":"5f9edd20-66af-42f1-a19b-3dbe3094b850","Type":"ContainerStarted","Data":"911220b64b9bdca166081d44c062ac12cda7ff5f4e698b50078da79936676d16"}
Jul 23 00:21:19.510428 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:19.510326    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f8c9dffc-knswq" event={"ID":"5f9edd20-66af-42f1-a19b-3dbe3094b850","Type":"ContainerStarted","Data":"1937a3c7835888ee78c4c0691e301fd4a09996a949f92d22663d68575d5933f8"}
Jul 23 00:21:19.511877 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:19.511844    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sjjx7" event={"ID":"18b6cfa7-6d8f-4934-b78c-789e54bdbac9","Type":"ContainerStarted","Data":"9b9f6bfcb4d645638b21a3612049368a1816a6d37bcbbe08a5cc699746bb0e67"}
Jul 23 00:21:19.513808 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:19.513782    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9pnlz" event={"ID":"ae70da8b-d8aa-4b34-9780-3e53cb43fac9","Type":"ContainerStarted","Data":"66432fd35f7c384e415cefe98a4bab747a919bb4441e40a36162a55ee96a12d3"}
Jul 23 00:21:19.515821 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:19.515790    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5bdx2" event={"ID":"a594d680-4ddd-4df4-9130-0a4e075dd19a","Type":"ContainerStarted","Data":"e1b06dc7a153f27336802a210c211d297c93ee008b2444b1c29ab7f57ed980cd"}
Jul 23 00:21:19.537342 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:19.537205    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.510968991 podStartE2EDuration="8.53718141s" totalImagesPullingTime="6.002184708s" totalInitContainerRuntime="24.027711ms" isStatefulPod=false podCreationTimestamp="2026-07-23 00:21:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:21:19.534625065 +0000 UTC m=+67.938421522" watchObservedRunningTime="2026-07-23 00:21:19.53718141 +0000 UTC m=+67.940977868"
Jul 23 00:21:19.553443 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:19.553353    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8f8c9dffc-knswq" podStartSLOduration=1.5533347979999999 podStartE2EDuration="1.553334798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:21:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:21:19.551529439 +0000 UTC m=+67.955325900" watchObservedRunningTime="2026-07-23 00:21:19.553334798 +0000 UTC m=+67.957131254"
Jul 23 00:21:20.523278 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:20.523230    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5bdx2" event={"ID":"a594d680-4ddd-4df4-9130-0a4e075dd19a","Type":"ContainerStarted","Data":"ccd2be0521485db9d9aa5092a1963a401537d00d82f12163011548e29ae2c34d"}
Jul 23 00:21:20.523722 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:20.523294    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5bdx2" event={"ID":"a594d680-4ddd-4df4-9130-0a4e075dd19a","Type":"ContainerStarted","Data":"75a7084aa5459bbbc68c240a6fddf6ad6c9018c2c856717e4ef4d6ce013478fd"}
Jul 23 00:21:20.537442 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:20.537376    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5bdx2" podStartSLOduration=67.23022815 podStartE2EDuration="1m8.537356246s" totalImagesPullingTime="1.307128096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:20:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:21:20.536165385 +0000 UTC m=+68.939961843" watchObservedRunningTime="2026-07-23 00:21:20.537356246 +0000 UTC m=+68.941152704"
Jul 23 00:21:21.357193 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:21.357044    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:21:24.543344 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:24.543308    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sjjx7" event={"ID":"18b6cfa7-6d8f-4934-b78c-789e54bdbac9","Type":"ContainerStarted","Data":"b13d153e745d5468c70b593f8d0ebad5757c6b6c8a5f33776386f7aa2de08331"}
Jul 23 00:21:24.544959 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:24.544933    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9pnlz" event={"ID":"ae70da8b-d8aa-4b34-9780-3e53cb43fac9","Type":"ContainerStarted","Data":"d7e0fd3b32961dd1e746701c8c597eaad6029c9985a55818fa5d6ee8f3e36a83"}
Jul 23 00:21:24.545087 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:24.545069    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:21:24.558981 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:24.558932    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-sjjx7" podStartSLOduration=67.774113761 podStartE2EDuration="1m12.558898339s" totalImagesPullingTime="4.784784578s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:20:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:21:24.557987033 +0000 UTC m=+72.961783489" watchObservedRunningTime="2026-07-23 00:21:24.558898339 +0000 UTC m=+72.962694796"
Jul 23 00:21:24.572371 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:24.572311    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9pnlz" podStartSLOduration=67.784005357 podStartE2EDuration="1m12.572296492s" totalImagesPullingTime="4.788291135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:20:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:21:24.571131287 +0000 UTC m=+72.974927744" watchObservedRunningTime="2026-07-23 00:21:24.572296492 +0000 UTC m=+72.976092949"
Jul 23 00:21:28.663641 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:28.663598    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8f8c9dffc-knswq"
Jul 23 00:21:28.664246 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:28.663679    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8f8c9dffc-knswq"
Jul 23 00:21:28.668180 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:28.668160    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8f8c9dffc-knswq"
Jul 23 00:21:29.443771 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:29.443735    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5ffb48784-4fmw9"
Jul 23 00:21:29.443959 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:29.443811    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5ffb48784-4fmw9"
Jul 23 00:21:29.569762 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:29.569727    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8f8c9dffc-knswq"
Jul 23 00:21:29.616205 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:29.616172    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59c8dbcc66-2ttkb"]
Jul 23 00:21:49.448237 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:49.448126    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5ffb48784-4fmw9"
Jul 23 00:21:49.452256 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:49.452240    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5ffb48784-4fmw9"
Jul 23 00:21:54.644282 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:54.644237    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59c8dbcc66-2ttkb" podUID="b25adab4-bc27-4385-a9d3-59e1cfe0e727" containerName="console" containerID="cri-o://3012f699c21c5ebb1e996ada1a45cd0f44ac24c3c0006c9794b73869d0dab8b3" gracePeriod=15
Jul 23 00:21:54.881177 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:54.881154    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c8dbcc66-2ttkb"
Jul 23 00:21:54.938605 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:54.938579    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmpbz\" (UniqueName: \"kubernetes.io/projected/b25adab4-bc27-4385-a9d3-59e1cfe0e727-kube-api-access-mmpbz\") pod \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\" (UID: \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\") "
Jul 23 00:21:54.938785 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:54.938622    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b25adab4-bc27-4385-a9d3-59e1cfe0e727-trusted-ca-bundle\") pod \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\" (UID: \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\") "
Jul 23 00:21:54.938785 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:54.938673    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b25adab4-bc27-4385-a9d3-59e1cfe0e727-service-ca\") pod \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\" (UID: \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\") "
Jul 23 00:21:54.938785 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:54.938691    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b25adab4-bc27-4385-a9d3-59e1cfe0e727-oauth-serving-cert\") pod \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\" (UID: \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\") "
Jul 23 00:21:54.938785 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:54.938712    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b25adab4-bc27-4385-a9d3-59e1cfe0e727-console-serving-cert\") pod \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\" (UID: \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\") "
Jul 23 00:21:54.938785 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:54.938731    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b25adab4-bc27-4385-a9d3-59e1cfe0e727-console-oauth-config\") pod \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\" (UID: \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\") "
Jul 23 00:21:54.938785 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:54.938757    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b25adab4-bc27-4385-a9d3-59e1cfe0e727-console-config\") pod \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\" (UID: \"b25adab4-bc27-4385-a9d3-59e1cfe0e727\") "
Jul 23 00:21:54.939189 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:54.939161    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b25adab4-bc27-4385-a9d3-59e1cfe0e727-service-ca" (OuterVolumeSpecName: "service-ca") pod "b25adab4-bc27-4385-a9d3-59e1cfe0e727" (UID: "b25adab4-bc27-4385-a9d3-59e1cfe0e727"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:21:54.939189 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:54.939171    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b25adab4-bc27-4385-a9d3-59e1cfe0e727-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b25adab4-bc27-4385-a9d3-59e1cfe0e727" (UID: "b25adab4-bc27-4385-a9d3-59e1cfe0e727"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:21:54.939189 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:54.939166    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b25adab4-bc27-4385-a9d3-59e1cfe0e727-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b25adab4-bc27-4385-a9d3-59e1cfe0e727" (UID: "b25adab4-bc27-4385-a9d3-59e1cfe0e727"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:21:54.939381 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:54.939256    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b25adab4-bc27-4385-a9d3-59e1cfe0e727-console-config" (OuterVolumeSpecName: "console-config") pod "b25adab4-bc27-4385-a9d3-59e1cfe0e727" (UID: "b25adab4-bc27-4385-a9d3-59e1cfe0e727"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:21:54.941099 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:54.941071    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b25adab4-bc27-4385-a9d3-59e1cfe0e727-kube-api-access-mmpbz" (OuterVolumeSpecName: "kube-api-access-mmpbz") pod "b25adab4-bc27-4385-a9d3-59e1cfe0e727" (UID: "b25adab4-bc27-4385-a9d3-59e1cfe0e727"). InnerVolumeSpecName "kube-api-access-mmpbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:21:54.941391 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:54.941351    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b25adab4-bc27-4385-a9d3-59e1cfe0e727-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b25adab4-bc27-4385-a9d3-59e1cfe0e727" (UID: "b25adab4-bc27-4385-a9d3-59e1cfe0e727"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:21:54.941482 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:54.941400    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b25adab4-bc27-4385-a9d3-59e1cfe0e727-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b25adab4-bc27-4385-a9d3-59e1cfe0e727" (UID: "b25adab4-bc27-4385-a9d3-59e1cfe0e727"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:21:55.039820 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:55.039781    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmpbz\" (UniqueName: \"kubernetes.io/projected/b25adab4-bc27-4385-a9d3-59e1cfe0e727-kube-api-access-mmpbz\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:21:55.039820 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:55.039812    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b25adab4-bc27-4385-a9d3-59e1cfe0e727-trusted-ca-bundle\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:21:55.039820 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:55.039823    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b25adab4-bc27-4385-a9d3-59e1cfe0e727-service-ca\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:21:55.040059 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:55.039831    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b25adab4-bc27-4385-a9d3-59e1cfe0e727-oauth-serving-cert\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:21:55.040059 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:55.039840    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b25adab4-bc27-4385-a9d3-59e1cfe0e727-console-serving-cert\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:21:55.040059 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:55.039848    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b25adab4-bc27-4385-a9d3-59e1cfe0e727-console-oauth-config\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:21:55.040059 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:55.039857    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b25adab4-bc27-4385-a9d3-59e1cfe0e727-console-config\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:21:55.551059 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:55.551032    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9pnlz"
Jul 23 00:21:55.671014 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:55.670983    2575 generic.go:356] "Generic (PLEG): container finished" podID="b25adab4-bc27-4385-a9d3-59e1cfe0e727" containerID="3012f699c21c5ebb1e996ada1a45cd0f44ac24c3c0006c9794b73869d0dab8b3" exitCode=0
Jul 23 00:21:55.671399 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:55.671031    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c8dbcc66-2ttkb"
Jul 23 00:21:55.671399 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:55.671039    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c8dbcc66-2ttkb" event={"ID":"b25adab4-bc27-4385-a9d3-59e1cfe0e727","Type":"ContainerDied","Data":"3012f699c21c5ebb1e996ada1a45cd0f44ac24c3c0006c9794b73869d0dab8b3"}
Jul 23 00:21:55.671399 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:55.671080    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c8dbcc66-2ttkb" event={"ID":"b25adab4-bc27-4385-a9d3-59e1cfe0e727","Type":"ContainerDied","Data":"514472d833f72a024a18590dd0dfa9c2b3cac3ce31eccbcb0b09a51be58fce96"}
Jul 23 00:21:55.671399 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:55.671098    2575 scope.go:117] "RemoveContainer" containerID="3012f699c21c5ebb1e996ada1a45cd0f44ac24c3c0006c9794b73869d0dab8b3"
Jul 23 00:21:55.679767 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:55.679745    2575 scope.go:117] "RemoveContainer" containerID="3012f699c21c5ebb1e996ada1a45cd0f44ac24c3c0006c9794b73869d0dab8b3"
Jul 23 00:21:55.680035 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:21:55.680016    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3012f699c21c5ebb1e996ada1a45cd0f44ac24c3c0006c9794b73869d0dab8b3\": container with ID starting with 3012f699c21c5ebb1e996ada1a45cd0f44ac24c3c0006c9794b73869d0dab8b3 not found: ID does not exist" containerID="3012f699c21c5ebb1e996ada1a45cd0f44ac24c3c0006c9794b73869d0dab8b3"
Jul 23 00:21:55.680095 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:55.680044    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3012f699c21c5ebb1e996ada1a45cd0f44ac24c3c0006c9794b73869d0dab8b3"} err="failed to get container status \"3012f699c21c5ebb1e996ada1a45cd0f44ac24c3c0006c9794b73869d0dab8b3\": rpc error: code = NotFound desc = could not find container \"3012f699c21c5ebb1e996ada1a45cd0f44ac24c3c0006c9794b73869d0dab8b3\": container with ID starting with 3012f699c21c5ebb1e996ada1a45cd0f44ac24c3c0006c9794b73869d0dab8b3 not found: ID does not exist"
Jul 23 00:21:55.690129 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:55.690099    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59c8dbcc66-2ttkb"]
Jul 23 00:21:55.695767 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:55.695746    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59c8dbcc66-2ttkb"]
Jul 23 00:21:56.126801 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:21:56.126769    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b25adab4-bc27-4385-a9d3-59e1cfe0e727" path="/var/lib/kubelet/pods/b25adab4-bc27-4385-a9d3-59e1cfe0e727/volumes"
Jul 23 00:22:11.108404 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:11.108358    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:11.129082 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:11.129050    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:11.370488 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:11.370414    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:25.175557 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:25.175522    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 00:22:25.176020 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:25.175839    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerName="alertmanager" containerID="cri-o://fb6cee4c602fc11a93aae476954e32d6a694faa89000386020b582b3ce2cbc2b" gracePeriod=120
Jul 23 00:22:25.176020 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:25.175865    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerName="kube-rbac-proxy-web" containerID="cri-o://2cc499724c3b3d880b50c756640bbf68a60c35169490a7dd34b6b1ef53ebd9eb" gracePeriod=120
Jul 23 00:22:25.176020 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:25.175886    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerName="kube-rbac-proxy-metric" containerID="cri-o://5134f0eb126e2b68a99329cbeb1afcc45839c38927b01ada1d3f7ac084127ac3" gracePeriod=120
Jul 23 00:22:25.176020 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:25.175956    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerName="prom-label-proxy" containerID="cri-o://287cfbd19f13aa7b2d9119a4fba7b9acaaa00f41e19642ea81fa85c15fa3d701" gracePeriod=120
Jul 23 00:22:25.176246 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:25.175960    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerName="config-reloader" containerID="cri-o://8d6bc46580f0dbd22412a3f4fb08fbe1d8f6632112a5cb3b7932bdc149867c42" gracePeriod=120
Jul 23 00:22:25.176246 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:25.175886    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerName="kube-rbac-proxy" containerID="cri-o://ef576e4fbf79897863047a5fc674ca71d33e34f325ebc77aac6bbfa6e4c6a1c4" gracePeriod=120
Jul 23 00:22:25.791815 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:25.791788    2575 generic.go:356] "Generic (PLEG): container finished" podID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerID="287cfbd19f13aa7b2d9119a4fba7b9acaaa00f41e19642ea81fa85c15fa3d701" exitCode=0
Jul 23 00:22:25.791815 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:25.791810    2575 generic.go:356] "Generic (PLEG): container finished" podID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerID="ef576e4fbf79897863047a5fc674ca71d33e34f325ebc77aac6bbfa6e4c6a1c4" exitCode=0
Jul 23 00:22:25.791815 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:25.791816    2575 generic.go:356] "Generic (PLEG): container finished" podID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerID="8d6bc46580f0dbd22412a3f4fb08fbe1d8f6632112a5cb3b7932bdc149867c42" exitCode=0
Jul 23 00:22:25.791815 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:25.791822    2575 generic.go:356] "Generic (PLEG): container finished" podID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerID="fb6cee4c602fc11a93aae476954e32d6a694faa89000386020b582b3ce2cbc2b" exitCode=0
Jul 23 00:22:25.792151 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:25.791861    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0340aa8d-daf9-455f-8994-0cd9f51b196e","Type":"ContainerDied","Data":"287cfbd19f13aa7b2d9119a4fba7b9acaaa00f41e19642ea81fa85c15fa3d701"}
Jul 23 00:22:25.792151 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:25.791968    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0340aa8d-daf9-455f-8994-0cd9f51b196e","Type":"ContainerDied","Data":"ef576e4fbf79897863047a5fc674ca71d33e34f325ebc77aac6bbfa6e4c6a1c4"}
Jul 23 00:22:25.792151 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:25.792013    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0340aa8d-daf9-455f-8994-0cd9f51b196e","Type":"ContainerDied","Data":"8d6bc46580f0dbd22412a3f4fb08fbe1d8f6632112a5cb3b7932bdc149867c42"}
Jul 23 00:22:25.792151 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:25.792051    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0340aa8d-daf9-455f-8994-0cd9f51b196e","Type":"ContainerDied","Data":"fb6cee4c602fc11a93aae476954e32d6a694faa89000386020b582b3ce2cbc2b"}
Jul 23 00:22:26.423262 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.423240    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:22:26.502701 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.502669    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-config-volume\") pod \"0340aa8d-daf9-455f-8994-0cd9f51b196e\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") "
Jul 23 00:22:26.502877 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.502706    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0340aa8d-daf9-455f-8994-0cd9f51b196e-alertmanager-trusted-ca-bundle\") pod \"0340aa8d-daf9-455f-8994-0cd9f51b196e\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") "
Jul 23 00:22:26.502877 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.502730    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-secret-alertmanager-kube-rbac-proxy-web\") pod \"0340aa8d-daf9-455f-8994-0cd9f51b196e\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") "
Jul 23 00:22:26.502877 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.502753    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0340aa8d-daf9-455f-8994-0cd9f51b196e-metrics-client-ca\") pod \"0340aa8d-daf9-455f-8994-0cd9f51b196e\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") "
Jul 23 00:22:26.503076 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.502893    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0340aa8d-daf9-455f-8994-0cd9f51b196e-tls-assets\") pod \"0340aa8d-daf9-455f-8994-0cd9f51b196e\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") "
Jul 23 00:22:26.503076 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.502959    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-secret-alertmanager-main-tls\") pod \"0340aa8d-daf9-455f-8994-0cd9f51b196e\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") "
Jul 23 00:22:26.503076 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.503016    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llhmf\" (UniqueName: \"kubernetes.io/projected/0340aa8d-daf9-455f-8994-0cd9f51b196e-kube-api-access-llhmf\") pod \"0340aa8d-daf9-455f-8994-0cd9f51b196e\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") "
Jul 23 00:22:26.503076 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.503056    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0340aa8d-daf9-455f-8994-0cd9f51b196e-alertmanager-main-db\") pod \"0340aa8d-daf9-455f-8994-0cd9f51b196e\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") "
Jul 23 00:22:26.503274 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.503087    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-secret-alertmanager-kube-rbac-proxy\") pod \"0340aa8d-daf9-455f-8994-0cd9f51b196e\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") "
Jul 23 00:22:26.503274 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.503123    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"0340aa8d-daf9-455f-8994-0cd9f51b196e\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") "
Jul 23 00:22:26.503274 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.503168    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0340aa8d-daf9-455f-8994-0cd9f51b196e-config-out\") pod \"0340aa8d-daf9-455f-8994-0cd9f51b196e\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") "
Jul 23 00:22:26.503274 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.503200    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-web-config\") pod \"0340aa8d-daf9-455f-8994-0cd9f51b196e\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") "
Jul 23 00:22:26.503274 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.503257    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-cluster-tls-config\") pod \"0340aa8d-daf9-455f-8994-0cd9f51b196e\" (UID: \"0340aa8d-daf9-455f-8994-0cd9f51b196e\") "
Jul 23 00:22:26.503839 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.503194    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0340aa8d-daf9-455f-8994-0cd9f51b196e-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "0340aa8d-daf9-455f-8994-0cd9f51b196e" (UID: "0340aa8d-daf9-455f-8994-0cd9f51b196e"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:22:26.503839 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.503393    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0340aa8d-daf9-455f-8994-0cd9f51b196e-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "0340aa8d-daf9-455f-8994-0cd9f51b196e" (UID: "0340aa8d-daf9-455f-8994-0cd9f51b196e"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:22:26.503839 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.503432    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0340aa8d-daf9-455f-8994-0cd9f51b196e-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "0340aa8d-daf9-455f-8994-0cd9f51b196e" (UID: "0340aa8d-daf9-455f-8994-0cd9f51b196e"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:22:26.506517 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.506445    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0340aa8d-daf9-455f-8994-0cd9f51b196e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0340aa8d-daf9-455f-8994-0cd9f51b196e" (UID: "0340aa8d-daf9-455f-8994-0cd9f51b196e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:22:26.506859 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.506824    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-config-volume" (OuterVolumeSpecName: "config-volume") pod "0340aa8d-daf9-455f-8994-0cd9f51b196e" (UID: "0340aa8d-daf9-455f-8994-0cd9f51b196e"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:22:26.507389 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.507348    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "0340aa8d-daf9-455f-8994-0cd9f51b196e" (UID: "0340aa8d-daf9-455f-8994-0cd9f51b196e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:22:26.507763 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.507724    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0340aa8d-daf9-455f-8994-0cd9f51b196e-kube-api-access-llhmf" (OuterVolumeSpecName: "kube-api-access-llhmf") pod "0340aa8d-daf9-455f-8994-0cd9f51b196e" (UID: "0340aa8d-daf9-455f-8994-0cd9f51b196e"). InnerVolumeSpecName "kube-api-access-llhmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:22:26.508175 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.508140    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0340aa8d-daf9-455f-8994-0cd9f51b196e-config-out" (OuterVolumeSpecName: "config-out") pod "0340aa8d-daf9-455f-8994-0cd9f51b196e" (UID: "0340aa8d-daf9-455f-8994-0cd9f51b196e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:22:26.508321 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.508219    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "0340aa8d-daf9-455f-8994-0cd9f51b196e" (UID: "0340aa8d-daf9-455f-8994-0cd9f51b196e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:22:26.508417 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.508389    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "0340aa8d-daf9-455f-8994-0cd9f51b196e" (UID: "0340aa8d-daf9-455f-8994-0cd9f51b196e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:22:26.508495 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.508478    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "0340aa8d-daf9-455f-8994-0cd9f51b196e" (UID: "0340aa8d-daf9-455f-8994-0cd9f51b196e"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:22:26.511342 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.511321    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "0340aa8d-daf9-455f-8994-0cd9f51b196e" (UID: "0340aa8d-daf9-455f-8994-0cd9f51b196e"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:22:26.517028 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.517006    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-web-config" (OuterVolumeSpecName: "web-config") pod "0340aa8d-daf9-455f-8994-0cd9f51b196e" (UID: "0340aa8d-daf9-455f-8994-0cd9f51b196e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:22:26.604228 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.604195    2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-config-volume\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:26.604228 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.604226    2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0340aa8d-daf9-455f-8994-0cd9f51b196e-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:26.604403 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.604239    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:26.604403 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.604250    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0340aa8d-daf9-455f-8994-0cd9f51b196e-metrics-client-ca\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:26.604403 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.604259    2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0340aa8d-daf9-455f-8994-0cd9f51b196e-tls-assets\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:26.604403 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.604269    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-secret-alertmanager-main-tls\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:26.604403 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.604278    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llhmf\" (UniqueName: \"kubernetes.io/projected/0340aa8d-daf9-455f-8994-0cd9f51b196e-kube-api-access-llhmf\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:26.604403 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.604285    2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0340aa8d-daf9-455f-8994-0cd9f51b196e-alertmanager-main-db\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:26.604403 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.604294    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:26.604403 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.604303    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:26.604403 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.604312    2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0340aa8d-daf9-455f-8994-0cd9f51b196e-config-out\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:26.604403 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.604319    2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-web-config\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:26.604403 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.604352    2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0340aa8d-daf9-455f-8994-0cd9f51b196e-cluster-tls-config\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:26.798502 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.798421    2575 generic.go:356] "Generic (PLEG): container finished" podID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerID="5134f0eb126e2b68a99329cbeb1afcc45839c38927b01ada1d3f7ac084127ac3" exitCode=0
Jul 23 00:22:26.798502 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.798447    2575 generic.go:356] "Generic (PLEG): container finished" podID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerID="2cc499724c3b3d880b50c756640bbf68a60c35169490a7dd34b6b1ef53ebd9eb" exitCode=0
Jul 23 00:22:26.798502 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.798497    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 00:22:26.798685 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.798506    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0340aa8d-daf9-455f-8994-0cd9f51b196e","Type":"ContainerDied","Data":"5134f0eb126e2b68a99329cbeb1afcc45839c38927b01ada1d3f7ac084127ac3"}
Jul 23 00:22:26.798685 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.798577    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0340aa8d-daf9-455f-8994-0cd9f51b196e","Type":"ContainerDied","Data":"2cc499724c3b3d880b50c756640bbf68a60c35169490a7dd34b6b1ef53ebd9eb"}
Jul 23 00:22:26.798685 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.798606    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0340aa8d-daf9-455f-8994-0cd9f51b196e","Type":"ContainerDied","Data":"6691563ecfed928cd3de08ce08eece57f1c0117beec02d3256cc11ea4824edf5"}
Jul 23 00:22:26.798685 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.798647    2575 scope.go:117] "RemoveContainer" containerID="287cfbd19f13aa7b2d9119a4fba7b9acaaa00f41e19642ea81fa85c15fa3d701"
Jul 23 00:22:26.808511 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.808490    2575 scope.go:117] "RemoveContainer" containerID="5134f0eb126e2b68a99329cbeb1afcc45839c38927b01ada1d3f7ac084127ac3"
Jul 23 00:22:26.816195 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.816179    2575 scope.go:117] "RemoveContainer" containerID="ef576e4fbf79897863047a5fc674ca71d33e34f325ebc77aac6bbfa6e4c6a1c4"
Jul 23 00:22:26.822346 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.822323    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 00:22:26.823859 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.823838    2575 scope.go:117] "RemoveContainer" containerID="2cc499724c3b3d880b50c756640bbf68a60c35169490a7dd34b6b1ef53ebd9eb"
Jul 23 00:22:26.827261 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.827240    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 00:22:26.830880 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.830853    2575 scope.go:117] "RemoveContainer" containerID="8d6bc46580f0dbd22412a3f4fb08fbe1d8f6632112a5cb3b7932bdc149867c42"
Jul 23 00:22:26.837665 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.837651    2575 scope.go:117] "RemoveContainer" containerID="fb6cee4c602fc11a93aae476954e32d6a694faa89000386020b582b3ce2cbc2b"
Jul 23 00:22:26.844452 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.844423    2575 scope.go:117] "RemoveContainer" containerID="4560e05555d435db8eb6d124875bb68c1c66278485dcc098960b220aab4f5838"
Jul 23 00:22:26.851653 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.851636    2575 scope.go:117] "RemoveContainer" containerID="287cfbd19f13aa7b2d9119a4fba7b9acaaa00f41e19642ea81fa85c15fa3d701"
Jul 23 00:22:26.851937 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:22:26.851898    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"287cfbd19f13aa7b2d9119a4fba7b9acaaa00f41e19642ea81fa85c15fa3d701\": container with ID starting with 287cfbd19f13aa7b2d9119a4fba7b9acaaa00f41e19642ea81fa85c15fa3d701 not found: ID does not exist" containerID="287cfbd19f13aa7b2d9119a4fba7b9acaaa00f41e19642ea81fa85c15fa3d701"
Jul 23 00:22:26.852024 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.851944    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"287cfbd19f13aa7b2d9119a4fba7b9acaaa00f41e19642ea81fa85c15fa3d701"} err="failed to get container status \"287cfbd19f13aa7b2d9119a4fba7b9acaaa00f41e19642ea81fa85c15fa3d701\": rpc error: code = NotFound desc = could not find container \"287cfbd19f13aa7b2d9119a4fba7b9acaaa00f41e19642ea81fa85c15fa3d701\": container with ID starting with 287cfbd19f13aa7b2d9119a4fba7b9acaaa00f41e19642ea81fa85c15fa3d701 not found: ID does not exist"
Jul 23 00:22:26.852024 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.851963    2575 scope.go:117] "RemoveContainer" containerID="5134f0eb126e2b68a99329cbeb1afcc45839c38927b01ada1d3f7ac084127ac3"
Jul 23 00:22:26.852225 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:22:26.852208    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5134f0eb126e2b68a99329cbeb1afcc45839c38927b01ada1d3f7ac084127ac3\": container with ID starting with 5134f0eb126e2b68a99329cbeb1afcc45839c38927b01ada1d3f7ac084127ac3 not found: ID does not exist" containerID="5134f0eb126e2b68a99329cbeb1afcc45839c38927b01ada1d3f7ac084127ac3"
Jul 23 00:22:26.852295 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.852234    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5134f0eb126e2b68a99329cbeb1afcc45839c38927b01ada1d3f7ac084127ac3"} err="failed to get container status \"5134f0eb126e2b68a99329cbeb1afcc45839c38927b01ada1d3f7ac084127ac3\": rpc error: code = NotFound desc = could not find container \"5134f0eb126e2b68a99329cbeb1afcc45839c38927b01ada1d3f7ac084127ac3\": container with ID starting with 5134f0eb126e2b68a99329cbeb1afcc45839c38927b01ada1d3f7ac084127ac3 not found: ID does not exist"
Jul 23 00:22:26.852295 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.852256    2575 scope.go:117] "RemoveContainer" containerID="ef576e4fbf79897863047a5fc674ca71d33e34f325ebc77aac6bbfa6e4c6a1c4"
Jul 23 00:22:26.852516 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:22:26.852500    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef576e4fbf79897863047a5fc674ca71d33e34f325ebc77aac6bbfa6e4c6a1c4\": container with ID starting with ef576e4fbf79897863047a5fc674ca71d33e34f325ebc77aac6bbfa6e4c6a1c4 not found: ID does not exist" containerID="ef576e4fbf79897863047a5fc674ca71d33e34f325ebc77aac6bbfa6e4c6a1c4"
Jul 23 00:22:26.852562 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.852520    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef576e4fbf79897863047a5fc674ca71d33e34f325ebc77aac6bbfa6e4c6a1c4"} err="failed to get container status \"ef576e4fbf79897863047a5fc674ca71d33e34f325ebc77aac6bbfa6e4c6a1c4\": rpc error: code = NotFound desc = could not find container \"ef576e4fbf79897863047a5fc674ca71d33e34f325ebc77aac6bbfa6e4c6a1c4\": container with ID starting with ef576e4fbf79897863047a5fc674ca71d33e34f325ebc77aac6bbfa6e4c6a1c4 not found: ID does not exist"
Jul 23 00:22:26.852562 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.852533    2575 scope.go:117] "RemoveContainer" containerID="2cc499724c3b3d880b50c756640bbf68a60c35169490a7dd34b6b1ef53ebd9eb"
Jul 23 00:22:26.852773 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:22:26.852757    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cc499724c3b3d880b50c756640bbf68a60c35169490a7dd34b6b1ef53ebd9eb\": container with ID starting with 2cc499724c3b3d880b50c756640bbf68a60c35169490a7dd34b6b1ef53ebd9eb not found: ID does not exist" containerID="2cc499724c3b3d880b50c756640bbf68a60c35169490a7dd34b6b1ef53ebd9eb"
Jul 23 00:22:26.852818 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.852778    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cc499724c3b3d880b50c756640bbf68a60c35169490a7dd34b6b1ef53ebd9eb"} err="failed to get container status \"2cc499724c3b3d880b50c756640bbf68a60c35169490a7dd34b6b1ef53ebd9eb\": rpc error: code = NotFound desc = could not find container \"2cc499724c3b3d880b50c756640bbf68a60c35169490a7dd34b6b1ef53ebd9eb\": container with ID starting with 2cc499724c3b3d880b50c756640bbf68a60c35169490a7dd34b6b1ef53ebd9eb not found: ID does not exist"
Jul 23 00:22:26.852818 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.852793    2575 scope.go:117] "RemoveContainer" containerID="8d6bc46580f0dbd22412a3f4fb08fbe1d8f6632112a5cb3b7932bdc149867c42"
Jul 23 00:22:26.853015 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:22:26.852997    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d6bc46580f0dbd22412a3f4fb08fbe1d8f6632112a5cb3b7932bdc149867c42\": container with ID starting with 8d6bc46580f0dbd22412a3f4fb08fbe1d8f6632112a5cb3b7932bdc149867c42 not found: ID does not exist" containerID="8d6bc46580f0dbd22412a3f4fb08fbe1d8f6632112a5cb3b7932bdc149867c42"
Jul 23 00:22:26.853056 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.853019    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d6bc46580f0dbd22412a3f4fb08fbe1d8f6632112a5cb3b7932bdc149867c42"} err="failed to get container status \"8d6bc46580f0dbd22412a3f4fb08fbe1d8f6632112a5cb3b7932bdc149867c42\": rpc error: code = NotFound desc = could not find container \"8d6bc46580f0dbd22412a3f4fb08fbe1d8f6632112a5cb3b7932bdc149867c42\": container with ID starting with 8d6bc46580f0dbd22412a3f4fb08fbe1d8f6632112a5cb3b7932bdc149867c42 not found: ID does not exist"
Jul 23 00:22:26.853056 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.853032    2575 scope.go:117] "RemoveContainer" containerID="fb6cee4c602fc11a93aae476954e32d6a694faa89000386020b582b3ce2cbc2b"
Jul 23 00:22:26.853240 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:22:26.853222    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb6cee4c602fc11a93aae476954e32d6a694faa89000386020b582b3ce2cbc2b\": container with ID starting with fb6cee4c602fc11a93aae476954e32d6a694faa89000386020b582b3ce2cbc2b not found: ID does not exist" containerID="fb6cee4c602fc11a93aae476954e32d6a694faa89000386020b582b3ce2cbc2b"
Jul 23 00:22:26.853276 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.853247    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb6cee4c602fc11a93aae476954e32d6a694faa89000386020b582b3ce2cbc2b"} err="failed to get container status \"fb6cee4c602fc11a93aae476954e32d6a694faa89000386020b582b3ce2cbc2b\": rpc error: code = NotFound desc = could not find container \"fb6cee4c602fc11a93aae476954e32d6a694faa89000386020b582b3ce2cbc2b\": container with ID starting with fb6cee4c602fc11a93aae476954e32d6a694faa89000386020b582b3ce2cbc2b not found: ID does not exist"
Jul 23 00:22:26.853276 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.853260    2575 scope.go:117] "RemoveContainer" containerID="4560e05555d435db8eb6d124875bb68c1c66278485dcc098960b220aab4f5838"
Jul 23 00:22:26.853472 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:22:26.853457    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4560e05555d435db8eb6d124875bb68c1c66278485dcc098960b220aab4f5838\": container with ID starting with 4560e05555d435db8eb6d124875bb68c1c66278485dcc098960b220aab4f5838 not found: ID does not exist" containerID="4560e05555d435db8eb6d124875bb68c1c66278485dcc098960b220aab4f5838"
Jul 23 00:22:26.853510 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.853475    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4560e05555d435db8eb6d124875bb68c1c66278485dcc098960b220aab4f5838"} err="failed to get container status \"4560e05555d435db8eb6d124875bb68c1c66278485dcc098960b220aab4f5838\": rpc error: code = NotFound desc = could not find container \"4560e05555d435db8eb6d124875bb68c1c66278485dcc098960b220aab4f5838\": container with ID starting with 4560e05555d435db8eb6d124875bb68c1c66278485dcc098960b220aab4f5838 not found: ID does not exist"
Jul 23 00:22:26.853510 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.853487    2575 scope.go:117] "RemoveContainer" containerID="287cfbd19f13aa7b2d9119a4fba7b9acaaa00f41e19642ea81fa85c15fa3d701"
Jul 23 00:22:26.853678 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.853662    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"287cfbd19f13aa7b2d9119a4fba7b9acaaa00f41e19642ea81fa85c15fa3d701"} err="failed to get container status \"287cfbd19f13aa7b2d9119a4fba7b9acaaa00f41e19642ea81fa85c15fa3d701\": rpc error: code = NotFound desc = could not find container \"287cfbd19f13aa7b2d9119a4fba7b9acaaa00f41e19642ea81fa85c15fa3d701\": container with ID starting with 287cfbd19f13aa7b2d9119a4fba7b9acaaa00f41e19642ea81fa85c15fa3d701 not found: ID does not exist"
Jul 23 00:22:26.853718 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.853678    2575 scope.go:117] "RemoveContainer" containerID="5134f0eb126e2b68a99329cbeb1afcc45839c38927b01ada1d3f7ac084127ac3"
Jul 23 00:22:26.853860 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.853842    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5134f0eb126e2b68a99329cbeb1afcc45839c38927b01ada1d3f7ac084127ac3"} err="failed to get container status \"5134f0eb126e2b68a99329cbeb1afcc45839c38927b01ada1d3f7ac084127ac3\": rpc error: code = NotFound desc = could not find container \"5134f0eb126e2b68a99329cbeb1afcc45839c38927b01ada1d3f7ac084127ac3\": container with ID starting with 5134f0eb126e2b68a99329cbeb1afcc45839c38927b01ada1d3f7ac084127ac3 not found: ID does not exist"
Jul 23 00:22:26.853900 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.853861    2575 scope.go:117] "RemoveContainer" containerID="ef576e4fbf79897863047a5fc674ca71d33e34f325ebc77aac6bbfa6e4c6a1c4"
Jul 23 00:22:26.854038 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.854020    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef576e4fbf79897863047a5fc674ca71d33e34f325ebc77aac6bbfa6e4c6a1c4"} err="failed to get container status \"ef576e4fbf79897863047a5fc674ca71d33e34f325ebc77aac6bbfa6e4c6a1c4\": rpc error: code = NotFound desc = could not find container \"ef576e4fbf79897863047a5fc674ca71d33e34f325ebc77aac6bbfa6e4c6a1c4\": container with ID starting with ef576e4fbf79897863047a5fc674ca71d33e34f325ebc77aac6bbfa6e4c6a1c4 not found: ID does not exist"
Jul 23 00:22:26.854100 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.854040    2575 scope.go:117] "RemoveContainer" containerID="2cc499724c3b3d880b50c756640bbf68a60c35169490a7dd34b6b1ef53ebd9eb"
Jul 23 00:22:26.854426 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.854386    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cc499724c3b3d880b50c756640bbf68a60c35169490a7dd34b6b1ef53ebd9eb"} err="failed to get container status \"2cc499724c3b3d880b50c756640bbf68a60c35169490a7dd34b6b1ef53ebd9eb\": rpc error: code = NotFound desc = could not find container \"2cc499724c3b3d880b50c756640bbf68a60c35169490a7dd34b6b1ef53ebd9eb\": container with ID starting with 2cc499724c3b3d880b50c756640bbf68a60c35169490a7dd34b6b1ef53ebd9eb not found: ID does not exist"
Jul 23 00:22:26.854528 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.854436    2575 scope.go:117] "RemoveContainer" containerID="8d6bc46580f0dbd22412a3f4fb08fbe1d8f6632112a5cb3b7932bdc149867c42"
Jul 23 00:22:26.854724 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.854702    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d6bc46580f0dbd22412a3f4fb08fbe1d8f6632112a5cb3b7932bdc149867c42"} err="failed to get container status \"8d6bc46580f0dbd22412a3f4fb08fbe1d8f6632112a5cb3b7932bdc149867c42\": rpc error: code = NotFound desc = could not find container \"8d6bc46580f0dbd22412a3f4fb08fbe1d8f6632112a5cb3b7932bdc149867c42\": container with ID starting with 8d6bc46580f0dbd22412a3f4fb08fbe1d8f6632112a5cb3b7932bdc149867c42 not found: ID does not exist"
Jul 23 00:22:26.854724 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.854724    2575 scope.go:117] "RemoveContainer" containerID="fb6cee4c602fc11a93aae476954e32d6a694faa89000386020b582b3ce2cbc2b"
Jul 23 00:22:26.854996 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.854977    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb6cee4c602fc11a93aae476954e32d6a694faa89000386020b582b3ce2cbc2b"} err="failed to get container status \"fb6cee4c602fc11a93aae476954e32d6a694faa89000386020b582b3ce2cbc2b\": rpc error: code = NotFound desc = could not find container \"fb6cee4c602fc11a93aae476954e32d6a694faa89000386020b582b3ce2cbc2b\": container with ID starting with fb6cee4c602fc11a93aae476954e32d6a694faa89000386020b582b3ce2cbc2b not found: ID does not exist"
Jul 23 00:22:26.855078 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.854997    2575 scope.go:117] "RemoveContainer" containerID="4560e05555d435db8eb6d124875bb68c1c66278485dcc098960b220aab4f5838"
Jul 23 00:22:26.855268 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:26.855250    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4560e05555d435db8eb6d124875bb68c1c66278485dcc098960b220aab4f5838"} err="failed to get container status \"4560e05555d435db8eb6d124875bb68c1c66278485dcc098960b220aab4f5838\": rpc error: code = NotFound desc = could not find container \"4560e05555d435db8eb6d124875bb68c1c66278485dcc098960b220aab4f5838\": container with ID starting with 4560e05555d435db8eb6d124875bb68c1c66278485dcc098960b220aab4f5838 not found: ID does not exist"
Jul 23 00:22:28.130935 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:28.128636    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0340aa8d-daf9-455f-8994-0cd9f51b196e" path="/var/lib/kubelet/pods/0340aa8d-daf9-455f-8994-0cd9f51b196e/volumes"
Jul 23 00:22:29.453044 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.452878    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 00:22:29.453529 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.453316    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerName="prometheus" containerID="cri-o://6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87" gracePeriod=600
Jul 23 00:22:29.453529 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.453353    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa" gracePeriod=600
Jul 23 00:22:29.453529 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.453503    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerName="kube-rbac-proxy" containerID="cri-o://b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5" gracePeriod=600
Jul 23 00:22:29.453970 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.453581    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerName="kube-rbac-proxy-web" containerID="cri-o://72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366" gracePeriod=600
Jul 23 00:22:29.453970 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.453646    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerName="thanos-sidecar" containerID="cri-o://927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788" gracePeriod=600
Jul 23 00:22:29.453970 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.453733    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerName="config-reloader" containerID="cri-o://6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680" gracePeriod=600
Jul 23 00:22:29.704590 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.704523    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:29.813650 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.813615    2575 generic.go:356] "Generic (PLEG): container finished" podID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerID="c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa" exitCode=0
Jul 23 00:22:29.813650 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.813647    2575 generic.go:356] "Generic (PLEG): container finished" podID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerID="b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5" exitCode=0
Jul 23 00:22:29.813650 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.813656    2575 generic.go:356] "Generic (PLEG): container finished" podID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerID="72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366" exitCode=0
Jul 23 00:22:29.813650 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.813657    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c7d9ffe-f398-4596-88a9-26772996e52f","Type":"ContainerDied","Data":"c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa"}
Jul 23 00:22:29.813935 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.813706    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:29.813935 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.813724    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c7d9ffe-f398-4596-88a9-26772996e52f","Type":"ContainerDied","Data":"b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5"}
Jul 23 00:22:29.813935 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.813664    2575 generic.go:356] "Generic (PLEG): container finished" podID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerID="927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788" exitCode=0
Jul 23 00:22:29.813935 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.813764    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c7d9ffe-f398-4596-88a9-26772996e52f","Type":"ContainerDied","Data":"72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366"}
Jul 23 00:22:29.813935 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.813775    2575 generic.go:356] "Generic (PLEG): container finished" podID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerID="6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680" exitCode=0
Jul 23 00:22:29.813935 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.813790    2575 generic.go:356] "Generic (PLEG): container finished" podID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerID="6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87" exitCode=0
Jul 23 00:22:29.813935 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.813805    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c7d9ffe-f398-4596-88a9-26772996e52f","Type":"ContainerDied","Data":"927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788"}
Jul 23 00:22:29.813935 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.813842    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c7d9ffe-f398-4596-88a9-26772996e52f","Type":"ContainerDied","Data":"6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680"}
Jul 23 00:22:29.813935 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.813871    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c7d9ffe-f398-4596-88a9-26772996e52f","Type":"ContainerDied","Data":"6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87"}
Jul 23 00:22:29.813935 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.813894    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c7d9ffe-f398-4596-88a9-26772996e52f","Type":"ContainerDied","Data":"0bb1c337b90dd12b50083abc291ddc62d4458d1767853e39b9f148941400c21a"}
Jul 23 00:22:29.813935 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.813841    2575 scope.go:117] "RemoveContainer" containerID="c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa"
Jul 23 00:22:29.821452 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.821434    2575 scope.go:117] "RemoveContainer" containerID="b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5"
Jul 23 00:22:29.828065 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.828052    2575 scope.go:117] "RemoveContainer" containerID="72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366"
Jul 23 00:22:29.831103 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.831085    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-configmap-serving-certs-ca-bundle\") pod \"3c7d9ffe-f398-4596-88a9-26772996e52f\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") "
Jul 23 00:22:29.831187 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.831118    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-configmap-kubelet-serving-ca-bundle\") pod \"3c7d9ffe-f398-4596-88a9-26772996e52f\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") "
Jul 23 00:22:29.831187 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.831140    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"3c7d9ffe-f398-4596-88a9-26772996e52f\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") "
Jul 23 00:22:29.831187 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.831167    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c7d9ffe-f398-4596-88a9-26772996e52f-tls-assets\") pod \"3c7d9ffe-f398-4596-88a9-26772996e52f\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") "
Jul 23 00:22:29.831329 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.831202    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-configmap-metrics-client-ca\") pod \"3c7d9ffe-f398-4596-88a9-26772996e52f\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") "
Jul 23 00:22:29.831329 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.831230    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c7d9ffe-f398-4596-88a9-26772996e52f-config-out\") pod \"3c7d9ffe-f398-4596-88a9-26772996e52f\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") "
Jul 23 00:22:29.831329 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.831253    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-web-config\") pod \"3c7d9ffe-f398-4596-88a9-26772996e52f\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") "
Jul 23 00:22:29.831329 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.831279    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-prometheus-k8s-tls\") pod \"3c7d9ffe-f398-4596-88a9-26772996e52f\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") "
Jul 23 00:22:29.831329 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.831306    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-metrics-client-certs\") pod \"3c7d9ffe-f398-4596-88a9-26772996e52f\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") "
Jul 23 00:22:29.831329 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.831328    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-prometheus-k8s-rulefiles-2\") pod \"3c7d9ffe-f398-4596-88a9-26772996e52f\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") "
Jul 23 00:22:29.831619 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.831363    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkbvj\" (UniqueName: \"kubernetes.io/projected/3c7d9ffe-f398-4596-88a9-26772996e52f-kube-api-access-lkbvj\") pod \"3c7d9ffe-f398-4596-88a9-26772996e52f\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") "
Jul 23 00:22:29.831619 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.831423    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-prometheus-trusted-ca-bundle\") pod \"3c7d9ffe-f398-4596-88a9-26772996e52f\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") "
Jul 23 00:22:29.831619 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.831454    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-thanos-prometheus-http-client-file\") pod \"3c7d9ffe-f398-4596-88a9-26772996e52f\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") "
Jul 23 00:22:29.831619 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.831467    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "3c7d9ffe-f398-4596-88a9-26772996e52f" (UID: "3c7d9ffe-f398-4596-88a9-26772996e52f"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:22:29.831619 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.831487    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-config\") pod \"3c7d9ffe-f398-4596-88a9-26772996e52f\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") "
Jul 23 00:22:29.831619 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.831514    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3c7d9ffe-f398-4596-88a9-26772996e52f-prometheus-k8s-db\") pod \"3c7d9ffe-f398-4596-88a9-26772996e52f\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") "
Jul 23 00:22:29.831619 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.831536    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-grpc-tls\") pod \"3c7d9ffe-f398-4596-88a9-26772996e52f\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") "
Jul 23 00:22:29.831619 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.831566    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-prometheus-k8s-rulefiles-1\") pod \"3c7d9ffe-f398-4596-88a9-26772996e52f\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") "
Jul 23 00:22:29.831619 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.831594    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"3c7d9ffe-f398-4596-88a9-26772996e52f\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") "
Jul 23 00:22:29.831619 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.831621    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-prometheus-k8s-rulefiles-0\") pod \"3c7d9ffe-f398-4596-88a9-26772996e52f\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") "
Jul 23 00:22:29.832291 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.831654    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-kube-rbac-proxy\") pod \"3c7d9ffe-f398-4596-88a9-26772996e52f\" (UID: \"3c7d9ffe-f398-4596-88a9-26772996e52f\") "
Jul 23 00:22:29.832291 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.831687    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "3c7d9ffe-f398-4596-88a9-26772996e52f" (UID: "3c7d9ffe-f398-4596-88a9-26772996e52f"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:22:29.832291 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.831883    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "3c7d9ffe-f398-4596-88a9-26772996e52f" (UID: "3c7d9ffe-f398-4596-88a9-26772996e52f"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:22:29.832291 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.832266    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "3c7d9ffe-f398-4596-88a9-26772996e52f" (UID: "3c7d9ffe-f398-4596-88a9-26772996e52f"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:22:29.832501 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.832407    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "3c7d9ffe-f398-4596-88a9-26772996e52f" (UID: "3c7d9ffe-f398-4596-88a9-26772996e52f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:22:29.833942 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.832607    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "3c7d9ffe-f398-4596-88a9-26772996e52f" (UID: "3c7d9ffe-f398-4596-88a9-26772996e52f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:22:29.834195 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.834177    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:29.836221 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.834379    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-configmap-metrics-client-ca\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:29.836221 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.835619    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c7d9ffe-f398-4596-88a9-26772996e52f-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "3c7d9ffe-f398-4596-88a9-26772996e52f" (UID: "3c7d9ffe-f398-4596-88a9-26772996e52f"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:22:29.836355 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.836110    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "3c7d9ffe-f398-4596-88a9-26772996e52f" (UID: "3c7d9ffe-f398-4596-88a9-26772996e52f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:22:29.837060 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.836624    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c7d9ffe-f398-4596-88a9-26772996e52f-config-out" (OuterVolumeSpecName: "config-out") pod "3c7d9ffe-f398-4596-88a9-26772996e52f" (UID: "3c7d9ffe-f398-4596-88a9-26772996e52f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:22:29.837060 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.836690    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c7d9ffe-f398-4596-88a9-26772996e52f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3c7d9ffe-f398-4596-88a9-26772996e52f" (UID: "3c7d9ffe-f398-4596-88a9-26772996e52f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:22:29.837060 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.836887    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "3c7d9ffe-f398-4596-88a9-26772996e52f" (UID: "3c7d9ffe-f398-4596-88a9-26772996e52f"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:22:29.837060 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.837011    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "3c7d9ffe-f398-4596-88a9-26772996e52f" (UID: "3c7d9ffe-f398-4596-88a9-26772996e52f"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:22:29.837060 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.837032    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "3c7d9ffe-f398-4596-88a9-26772996e52f" (UID: "3c7d9ffe-f398-4596-88a9-26772996e52f"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:22:29.837478 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.837156    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "3c7d9ffe-f398-4596-88a9-26772996e52f" (UID: "3c7d9ffe-f398-4596-88a9-26772996e52f"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:22:29.837478 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.837206    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c7d9ffe-f398-4596-88a9-26772996e52f-kube-api-access-lkbvj" (OuterVolumeSpecName: "kube-api-access-lkbvj") pod "3c7d9ffe-f398-4596-88a9-26772996e52f" (UID: "3c7d9ffe-f398-4596-88a9-26772996e52f"). InnerVolumeSpecName "kube-api-access-lkbvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:22:29.837478 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.837362    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "3c7d9ffe-f398-4596-88a9-26772996e52f" (UID: "3c7d9ffe-f398-4596-88a9-26772996e52f"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:22:29.837622 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.837577    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-config" (OuterVolumeSpecName: "config") pod "3c7d9ffe-f398-4596-88a9-26772996e52f" (UID: "3c7d9ffe-f398-4596-88a9-26772996e52f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:22:29.837698 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.837678    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "3c7d9ffe-f398-4596-88a9-26772996e52f" (UID: "3c7d9ffe-f398-4596-88a9-26772996e52f"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:22:29.837764 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.837746    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "3c7d9ffe-f398-4596-88a9-26772996e52f" (UID: "3c7d9ffe-f398-4596-88a9-26772996e52f"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:22:29.838507 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.838493    2575 scope.go:117] "RemoveContainer" containerID="927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788"
Jul 23 00:22:29.844843 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.844829    2575 scope.go:117] "RemoveContainer" containerID="6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680"
Jul 23 00:22:29.845296 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.845273    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-web-config" (OuterVolumeSpecName: "web-config") pod "3c7d9ffe-f398-4596-88a9-26772996e52f" (UID: "3c7d9ffe-f398-4596-88a9-26772996e52f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:22:29.851088 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.851070    2575 scope.go:117] "RemoveContainer" containerID="6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87"
Jul 23 00:22:29.857665 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.857645    2575 scope.go:117] "RemoveContainer" containerID="d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab"
Jul 23 00:22:29.864813 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.864794    2575 scope.go:117] "RemoveContainer" containerID="c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa"
Jul 23 00:22:29.865090 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:22:29.865073    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa\": container with ID starting with c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa not found: ID does not exist" containerID="c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa"
Jul 23 00:22:29.865154 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.865097    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa"} err="failed to get container status \"c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa\": rpc error: code = NotFound desc = could not find container \"c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa\": container with ID starting with c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa not found: ID does not exist"
Jul 23 00:22:29.865154 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.865114    2575 scope.go:117] "RemoveContainer" containerID="b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5"
Jul 23 00:22:29.865378 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:22:29.865361    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5\": container with ID starting with b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5 not found: ID does not exist" containerID="b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5"
Jul 23 00:22:29.865420 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.865394    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5"} err="failed to get container status \"b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5\": rpc error: code = NotFound desc = could not find container \"b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5\": container with ID starting with b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5 not found: ID does not exist"
Jul 23 00:22:29.865420 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.865409    2575 scope.go:117] "RemoveContainer" containerID="72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366"
Jul 23 00:22:29.865639 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:22:29.865623    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366\": container with ID starting with 72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366 not found: ID does not exist" containerID="72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366"
Jul 23 00:22:29.865677 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.865646    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366"} err="failed to get container status \"72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366\": rpc error: code = NotFound desc = could not find container \"72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366\": container with ID starting with 72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366 not found: ID does not exist"
Jul 23 00:22:29.865677 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.865662    2575 scope.go:117] "RemoveContainer" containerID="927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788"
Jul 23 00:22:29.865934 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:22:29.865898    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788\": container with ID starting with 927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788 not found: ID does not exist" containerID="927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788"
Jul 23 00:22:29.866046 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.865938    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788"} err="failed to get container status \"927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788\": rpc error: code = NotFound desc = could not find container \"927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788\": container with ID starting with 927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788 not found: ID does not exist"
Jul 23 00:22:29.866046 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.865952    2575 scope.go:117] "RemoveContainer" containerID="6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680"
Jul 23 00:22:29.866174 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:22:29.866155    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680\": container with ID starting with 6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680 not found: ID does not exist" containerID="6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680"
Jul 23 00:22:29.866223 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.866177    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680"} err="failed to get container status \"6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680\": rpc error: code = NotFound desc = could not find container \"6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680\": container with ID starting with 6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680 not found: ID does not exist"
Jul 23 00:22:29.866223 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.866190    2575 scope.go:117] "RemoveContainer" containerID="6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87"
Jul 23 00:22:29.866384 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:22:29.866370    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87\": container with ID starting with 6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87 not found: ID does not exist" containerID="6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87"
Jul 23 00:22:29.866418 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.866386    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87"} err="failed to get container status \"6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87\": rpc error: code = NotFound desc = could not find container \"6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87\": container with ID starting with 6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87 not found: ID does not exist"
Jul 23 00:22:29.866418 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.866397    2575 scope.go:117] "RemoveContainer" containerID="d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab"
Jul 23 00:22:29.866594 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:22:29.866581    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab\": container with ID starting with d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab not found: ID does not exist" containerID="d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab"
Jul 23 00:22:29.866625 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.866597    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab"} err="failed to get container status \"d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab\": rpc error: code = NotFound desc = could not find container \"d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab\": container with ID starting with d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab not found: ID does not exist"
Jul 23 00:22:29.866625 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.866608    2575 scope.go:117] "RemoveContainer" containerID="c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa"
Jul 23 00:22:29.866795 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.866780    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa"} err="failed to get container status \"c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa\": rpc error: code = NotFound desc = could not find container \"c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa\": container with ID starting with c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa not found: ID does not exist"
Jul 23 00:22:29.866841 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.866795    2575 scope.go:117] "RemoveContainer" containerID="b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5"
Jul 23 00:22:29.866979 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.866961    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5"} err="failed to get container status \"b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5\": rpc error: code = NotFound desc = could not find container \"b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5\": container with ID starting with b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5 not found: ID does not exist"
Jul 23 00:22:29.867045 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.866980    2575 scope.go:117] "RemoveContainer" containerID="72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366"
Jul 23 00:22:29.867153 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.867136    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366"} err="failed to get container status \"72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366\": rpc error: code = NotFound desc = could not find container \"72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366\": container with ID starting with 72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366 not found: ID does not exist"
Jul 23 00:22:29.867193 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.867157    2575 scope.go:117] "RemoveContainer" containerID="927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788"
Jul 23 00:22:29.867375 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.867358    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788"} err="failed to get container status \"927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788\": rpc error: code = NotFound desc = could not find container \"927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788\": container with ID starting with 927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788 not found: ID does not exist"
Jul 23 00:22:29.867416 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.867377    2575 scope.go:117] "RemoveContainer" containerID="6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680"
Jul 23 00:22:29.867556 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.867541    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680"} err="failed to get container status \"6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680\": rpc error: code = NotFound desc = could not find container \"6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680\": container with ID starting with 6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680 not found: ID does not exist"
Jul 23 00:22:29.867593 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.867557    2575 scope.go:117] "RemoveContainer" containerID="6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87"
Jul 23 00:22:29.867798 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.867782    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87"} err="failed to get container status \"6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87\": rpc error: code = NotFound desc = could not find container \"6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87\": container with ID starting with 6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87 not found: ID does not exist"
Jul 23 00:22:29.867846 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.867799    2575 scope.go:117] "RemoveContainer" containerID="d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab"
Jul 23 00:22:29.868048 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.868031    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab"} err="failed to get container status \"d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab\": rpc error: code = NotFound desc = could not find container \"d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab\": container with ID starting with d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab not found: ID does not exist"
Jul 23 00:22:29.868094 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.868050    2575 scope.go:117] "RemoveContainer" containerID="c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa"
Jul 23 00:22:29.868273 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.868255    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa"} err="failed to get container status \"c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa\": rpc error: code = NotFound desc = could not find container \"c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa\": container with ID starting with c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa not found: ID does not exist"
Jul 23 00:22:29.868335 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.868274    2575 scope.go:117] "RemoveContainer" containerID="b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5"
Jul 23 00:22:29.868490 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.868474    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5"} err="failed to get container status \"b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5\": rpc error: code = NotFound desc = could not find container \"b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5\": container with ID starting with b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5 not found: ID does not exist"
Jul 23 00:22:29.868547 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.868490    2575 scope.go:117] "RemoveContainer" containerID="72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366"
Jul 23 00:22:29.868711 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.868694    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366"} err="failed to get container status \"72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366\": rpc error: code = NotFound desc = could not find container \"72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366\": container with ID starting with 72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366 not found: ID does not exist"
Jul 23 00:22:29.868748 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.868713    2575 scope.go:117] "RemoveContainer" containerID="927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788"
Jul 23 00:22:29.868888 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.868873    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788"} err="failed to get container status \"927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788\": rpc error: code = NotFound desc = could not find container \"927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788\": container with ID starting with 927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788 not found: ID does not exist"
Jul 23 00:22:29.868948 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.868888    2575 scope.go:117] "RemoveContainer" containerID="6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680"
Jul 23 00:22:29.869085 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.869070    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680"} err="failed to get container status \"6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680\": rpc error: code = NotFound desc = could not find container \"6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680\": container with ID starting with 6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680 not found: ID does not exist"
Jul 23 00:22:29.869121 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.869085    2575 scope.go:117] "RemoveContainer" containerID="6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87"
Jul 23 00:22:29.869252 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.869238    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87"} err="failed to get container status \"6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87\": rpc error: code = NotFound desc = could not find container \"6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87\": container with ID starting with 6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87 not found: ID does not exist"
Jul 23 00:22:29.869292 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.869253    2575 scope.go:117] "RemoveContainer" containerID="d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab"
Jul 23 00:22:29.869415 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.869400    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab"} err="failed to get container status \"d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab\": rpc error: code = NotFound desc = could not find container \"d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab\": container with ID starting with d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab not found: ID does not exist"
Jul 23 00:22:29.869458 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.869416    2575 scope.go:117] "RemoveContainer" containerID="c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa"
Jul 23 00:22:29.869578 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.869563    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa"} err="failed to get container status \"c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa\": rpc error: code = NotFound desc = could not find container \"c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa\": container with ID starting with c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa not found: ID does not exist"
Jul 23 00:22:29.869617 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.869578    2575 scope.go:117] "RemoveContainer" containerID="b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5"
Jul 23 00:22:29.869745 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.869731    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5"} err="failed to get container status \"b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5\": rpc error: code = NotFound desc = could not find container \"b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5\": container with ID starting with b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5 not found: ID does not exist"
Jul 23 00:22:29.869781 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.869746    2575 scope.go:117] "RemoveContainer" containerID="72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366"
Jul 23 00:22:29.869904 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.869891    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366"} err="failed to get container status \"72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366\": rpc error: code = NotFound desc = could not find container \"72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366\": container with ID starting with 72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366 not found: ID does not exist"
Jul 23 00:22:29.869967 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.869904    2575 scope.go:117] "RemoveContainer" containerID="927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788"
Jul 23 00:22:29.870105 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.870087    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788"} err="failed to get container status \"927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788\": rpc error: code = NotFound desc = could not find container \"927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788\": container with ID starting with 927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788 not found: ID does not exist"
Jul 23 00:22:29.870147 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.870106    2575 scope.go:117] "RemoveContainer" containerID="6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680"
Jul 23 00:22:29.870297 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.870281    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680"} err="failed to get container status \"6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680\": rpc error: code = NotFound desc = could not find container \"6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680\": container with ID starting with 6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680 not found: ID does not exist"
Jul 23 00:22:29.870341 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.870296    2575 scope.go:117] "RemoveContainer" containerID="6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87"
Jul 23 00:22:29.870511 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.870495    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87"} err="failed to get container status \"6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87\": rpc error: code = NotFound desc = could not find container \"6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87\": container with ID starting with 6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87 not found: ID does not exist"
Jul 23 00:22:29.870548 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.870512    2575 scope.go:117] "RemoveContainer" containerID="d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab"
Jul 23 00:22:29.870731 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.870705    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab"} err="failed to get container status \"d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab\": rpc error: code = NotFound desc = could not find container \"d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab\": container with ID starting with d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab not found: ID does not exist"
Jul 23 00:22:29.870803 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.870735    2575 scope.go:117] "RemoveContainer" containerID="c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa"
Jul 23 00:22:29.870984 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.870967    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa"} err="failed to get container status \"c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa\": rpc error: code = NotFound desc = could not find container \"c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa\": container with ID starting with c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa not found: ID does not exist"
Jul 23 00:22:29.871032 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.870985    2575 scope.go:117] "RemoveContainer" containerID="b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5"
Jul 23 00:22:29.871191 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.871176    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5"} err="failed to get container status \"b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5\": rpc error: code = NotFound desc = could not find container \"b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5\": container with ID starting with b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5 not found: ID does not exist"
Jul 23 00:22:29.871231 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.871192    2575 scope.go:117] "RemoveContainer" containerID="72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366"
Jul 23 00:22:29.871399 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.871383    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366"} err="failed to get container status \"72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366\": rpc error: code = NotFound desc = could not find container \"72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366\": container with ID starting with 72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366 not found: ID does not exist"
Jul 23 00:22:29.871443 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.871401    2575 scope.go:117] "RemoveContainer" containerID="927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788"
Jul 23 00:22:29.871585 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.871570    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788"} err="failed to get container status \"927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788\": rpc error: code = NotFound desc = could not find container \"927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788\": container with ID starting with 927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788 not found: ID does not exist"
Jul 23 00:22:29.871624 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.871585    2575 scope.go:117] "RemoveContainer" containerID="6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680"
Jul 23 00:22:29.871788 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.871771    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680"} err="failed to get container status \"6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680\": rpc error: code = NotFound desc = could not find container \"6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680\": container with ID starting with 6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680 not found: ID does not exist"
Jul 23 00:22:29.871836 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.871789    2575 scope.go:117] "RemoveContainer" containerID="6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87"
Jul 23 00:22:29.872009 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.871988    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87"} err="failed to get container status \"6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87\": rpc error: code = NotFound desc = could not find container \"6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87\": container with ID starting with 6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87 not found: ID does not exist"
Jul 23 00:22:29.872077 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.872011    2575 scope.go:117] "RemoveContainer" containerID="d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab"
Jul 23 00:22:29.872243 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.872227    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab"} err="failed to get container status \"d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab\": rpc error: code = NotFound desc = could not find container \"d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab\": container with ID starting with d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab not found: ID does not exist"
Jul 23 00:22:29.872311 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.872253    2575 scope.go:117] "RemoveContainer" containerID="c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa"
Jul 23 00:22:29.872475 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.872459    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa"} err="failed to get container status \"c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa\": rpc error: code = NotFound desc = could not find container \"c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa\": container with ID starting with c56dd1dfce6ec88fbddaa86a177bef3c8c3378506c5b15ff3f51ed447812fcfa not found: ID does not exist"
Jul 23 00:22:29.872532 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.872476    2575 scope.go:117] "RemoveContainer" containerID="b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5"
Jul 23 00:22:29.872673 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.872657    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5"} err="failed to get container status \"b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5\": rpc error: code = NotFound desc = could not find container \"b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5\": container with ID starting with b92697bed7bcb8cb5c314d46ef87c3fa5d356d8348f21a4d4a0b95f1f0892da5 not found: ID does not exist"
Jul 23 00:22:29.872716 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.872672    2575 scope.go:117] "RemoveContainer" containerID="72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366"
Jul 23 00:22:29.872869 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.872852    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366"} err="failed to get container status \"72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366\": rpc error: code = NotFound desc = could not find container \"72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366\": container with ID starting with 72d5ad0eb5e3d4bbb787442e4a7a3e6aca857f06f0a4888498a63e06be384366 not found: ID does not exist"
Jul 23 00:22:29.872950 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.872870    2575 scope.go:117] "RemoveContainer" containerID="927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788"
Jul 23 00:22:29.873073 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.873057    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788"} err="failed to get container status \"927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788\": rpc error: code = NotFound desc = could not find container \"927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788\": container with ID starting with 927bd7204f636a7292f1aee34be2a6d1034c9fa110b59374b9cca97247cc0788 not found: ID does not exist"
Jul 23 00:22:29.873118 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.873074    2575 scope.go:117] "RemoveContainer" containerID="6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680"
Jul 23 00:22:29.873259 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.873242    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680"} err="failed to get container status \"6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680\": rpc error: code = NotFound desc = could not find container \"6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680\": container with ID starting with 6d268eb90cbb214ecf4b156046832d9fc62d6beb57b41b64210e619ea3cb6680 not found: ID does not exist"
Jul 23 00:22:29.873303 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.873260    2575 scope.go:117] "RemoveContainer" containerID="6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87"
Jul 23 00:22:29.873479 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.873461    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87"} err="failed to get container status \"6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87\": rpc error: code = NotFound desc = could not find container \"6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87\": container with ID starting with 6ed6f4172c4e9373a635921e4adcf0af50be28185175a8fa4b9c07177c17bd87 not found: ID does not exist"
Jul 23 00:22:29.873547 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.873490    2575 scope.go:117] "RemoveContainer" containerID="d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab"
Jul 23 00:22:29.873728 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.873711    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab"} err="failed to get container status \"d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab\": rpc error: code = NotFound desc = could not find container \"d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab\": container with ID starting with d1541edd182c5d95f18f018a424e05e26bbc25460c8b3f0d2d9a37d19ce4b5ab not found: ID does not exist"
Jul 23 00:22:29.936836 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.936804    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3c7d9ffe-f398-4596-88a9-26772996e52f-prometheus-k8s-db\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:29.936836 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.936830    2575 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-grpc-tls\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:29.936836 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.936839    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:29.937079 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.936848    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:29.937079 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.936859    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:29.937079 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.936867    2575 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-kube-rbac-proxy\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:29.937079 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.936876    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:29.937079 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.936885    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:29.937079 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.936893    2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c7d9ffe-f398-4596-88a9-26772996e52f-tls-assets\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:29.937079 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.936900    2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c7d9ffe-f398-4596-88a9-26772996e52f-config-out\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:29.937079 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.936948    2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-web-config\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:29.937079 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.936957    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:29.937079 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.936966    2575 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-secret-metrics-client-certs\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:29.937079 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.936974    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:29.937079 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.936984    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkbvj\" (UniqueName: \"kubernetes.io/projected/3c7d9ffe-f398-4596-88a9-26772996e52f-kube-api-access-lkbvj\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:29.937079 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.936992    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c7d9ffe-f398-4596-88a9-26772996e52f-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:29.937079 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.937000    2575 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:29.937079 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:29.937008    2575 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/3c7d9ffe-f398-4596-88a9-26772996e52f-config\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:22:30.138511 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.138479    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 00:22:30.142064 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.142035    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 00:22:30.169150 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169119    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 00:22:30.169353 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169341    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerName="kube-rbac-proxy-web"
Jul 23 00:22:30.169398 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169354    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerName="kube-rbac-proxy-web"
Jul 23 00:22:30.169398 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169365    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerName="init-config-reloader"
Jul 23 00:22:30.169398 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169370    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerName="init-config-reloader"
Jul 23 00:22:30.169398 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169378    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerName="kube-rbac-proxy"
Jul 23 00:22:30.169398 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169383    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerName="kube-rbac-proxy"
Jul 23 00:22:30.169398 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169390    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerName="kube-rbac-proxy-thanos"
Jul 23 00:22:30.169398 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169395    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerName="kube-rbac-proxy-thanos"
Jul 23 00:22:30.169579 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169403    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerName="kube-rbac-proxy-web"
Jul 23 00:22:30.169579 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169408    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerName="kube-rbac-proxy-web"
Jul 23 00:22:30.169579 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169416    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerName="config-reloader"
Jul 23 00:22:30.169579 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169421    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerName="config-reloader"
Jul 23 00:22:30.169579 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169429    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerName="init-config-reloader"
Jul 23 00:22:30.169579 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169434    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerName="init-config-reloader"
Jul 23 00:22:30.169579 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169441    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b25adab4-bc27-4385-a9d3-59e1cfe0e727" containerName="console"
Jul 23 00:22:30.169579 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169445    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b25adab4-bc27-4385-a9d3-59e1cfe0e727" containerName="console"
Jul 23 00:22:30.169579 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169451    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerName="prom-label-proxy"
Jul 23 00:22:30.169579 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169456    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerName="prom-label-proxy"
Jul 23 00:22:30.169579 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169485    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerName="prometheus"
Jul 23 00:22:30.169579 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169491    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerName="prometheus"
Jul 23 00:22:30.169579 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169498    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerName="alertmanager"
Jul 23 00:22:30.169579 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169503    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerName="alertmanager"
Jul 23 00:22:30.169579 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169508    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerName="thanos-sidecar"
Jul 23 00:22:30.169579 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169512    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerName="thanos-sidecar"
Jul 23 00:22:30.169579 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169519    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerName="kube-rbac-proxy-metric"
Jul 23 00:22:30.169579 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169523    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerName="kube-rbac-proxy-metric"
Jul 23 00:22:30.169579 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169528    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerName="kube-rbac-proxy"
Jul 23 00:22:30.169579 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169533    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerName="kube-rbac-proxy"
Jul 23 00:22:30.169579 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169539    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerName="config-reloader"
Jul 23 00:22:30.169579 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169544    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerName="config-reloader"
Jul 23 00:22:30.169579 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169582    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerName="config-reloader"
Jul 23 00:22:30.169579 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169588    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerName="kube-rbac-proxy"
Jul 23 00:22:30.170210 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169595    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerName="alertmanager"
Jul 23 00:22:30.170210 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169599    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerName="config-reloader"
Jul 23 00:22:30.170210 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169605    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerName="kube-rbac-proxy"
Jul 23 00:22:30.170210 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169611    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerName="prom-label-proxy"
Jul 23 00:22:30.170210 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169616    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerName="kube-rbac-proxy-thanos"
Jul 23 00:22:30.170210 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169621    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerName="thanos-sidecar"
Jul 23 00:22:30.170210 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169625    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerName="kube-rbac-proxy-web"
Jul 23 00:22:30.170210 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169630    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b25adab4-bc27-4385-a9d3-59e1cfe0e727" containerName="console"
Jul 23 00:22:30.170210 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169635    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerName="kube-rbac-proxy-web"
Jul 23 00:22:30.170210 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169639    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0340aa8d-daf9-455f-8994-0cd9f51b196e" containerName="kube-rbac-proxy-metric"
Jul 23 00:22:30.170210 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.169644    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c7d9ffe-f398-4596-88a9-26772996e52f" containerName="prometheus"
Jul 23 00:22:30.173240 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.173225    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.177001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.176610    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 23 00:22:30.177001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.176653    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 23 00:22:30.177001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.176691    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 23 00:22:30.177001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.176704    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 23 00:22:30.177001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.176740    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 23 00:22:30.177001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.176746    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 23 00:22:30.177001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.176653    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 23 00:22:30.177001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.176696    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 23 00:22:30.177001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.176653    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 23 00:22:30.177001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.176698    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 23 00:22:30.177001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.177002    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 23 00:22:30.177601 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.177112    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3o6c9o2b3dteb\""
Jul 23 00:22:30.177601 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.177389    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 23 00:22:30.177601 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.177577    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-j8rw5\""
Jul 23 00:22:30.179866 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.179848    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 23 00:22:30.181879 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.181859    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 23 00:22:30.188292 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.188272    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 00:22:30.339071 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.339035    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6a094377-c795-429c-9bcf-096d0e0a8c93-web-config\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.339071 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.339075    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a094377-c795-429c-9bcf-096d0e0a8c93-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.339252 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.339098    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a094377-c795-429c-9bcf-096d0e0a8c93-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.339252 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.339123    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a094377-c795-429c-9bcf-096d0e0a8c93-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.339252 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.339143    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a094377-c795-429c-9bcf-096d0e0a8c93-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.339252 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.339163    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6a094377-c795-429c-9bcf-096d0e0a8c93-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.339252 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.339231    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6a094377-c795-429c-9bcf-096d0e0a8c93-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.339401 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.339275    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6a094377-c795-429c-9bcf-096d0e0a8c93-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.339401 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.339294    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fml8x\" (UniqueName: \"kubernetes.io/projected/6a094377-c795-429c-9bcf-096d0e0a8c93-kube-api-access-fml8x\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.339401 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.339333    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6a094377-c795-429c-9bcf-096d0e0a8c93-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.339401 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.339355    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6a094377-c795-429c-9bcf-096d0e0a8c93-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.339401 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.339381    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6a094377-c795-429c-9bcf-096d0e0a8c93-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.339401 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.339397    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a094377-c795-429c-9bcf-096d0e0a8c93-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.339571 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.339416    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6a094377-c795-429c-9bcf-096d0e0a8c93-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.339571 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.339435    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6a094377-c795-429c-9bcf-096d0e0a8c93-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.339571 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.339465    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6a094377-c795-429c-9bcf-096d0e0a8c93-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.339571 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.339481    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a094377-c795-429c-9bcf-096d0e0a8c93-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.339571 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.339496    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6a094377-c795-429c-9bcf-096d0e0a8c93-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.339745 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.339564    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6a094377-c795-429c-9bcf-096d0e0a8c93-config-out\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.339745 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.339596    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6a094377-c795-429c-9bcf-096d0e0a8c93-config\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.440315 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.440279    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6a094377-c795-429c-9bcf-096d0e0a8c93-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.440315 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.440316    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6a094377-c795-429c-9bcf-096d0e0a8c93-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.440572 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.440345    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6a094377-c795-429c-9bcf-096d0e0a8c93-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.440572 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.440363    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a094377-c795-429c-9bcf-096d0e0a8c93-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.440572 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.440379    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6a094377-c795-429c-9bcf-096d0e0a8c93-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.440572 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.440417    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6a094377-c795-429c-9bcf-096d0e0a8c93-config-out\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.440572 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.440441    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6a094377-c795-429c-9bcf-096d0e0a8c93-config\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.440572 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.440470    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6a094377-c795-429c-9bcf-096d0e0a8c93-web-config\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.440572 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.440498    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a094377-c795-429c-9bcf-096d0e0a8c93-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.440572 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.440523    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a094377-c795-429c-9bcf-096d0e0a8c93-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.440572 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.440541    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a094377-c795-429c-9bcf-096d0e0a8c93-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.440572 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.440564    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a094377-c795-429c-9bcf-096d0e0a8c93-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.441073 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.440581    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6a094377-c795-429c-9bcf-096d0e0a8c93-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.441073 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.440603    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6a094377-c795-429c-9bcf-096d0e0a8c93-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.441073 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.440640    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6a094377-c795-429c-9bcf-096d0e0a8c93-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.441073 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.440667    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fml8x\" (UniqueName: \"kubernetes.io/projected/6a094377-c795-429c-9bcf-096d0e0a8c93-kube-api-access-fml8x\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.441073 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.440697    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6a094377-c795-429c-9bcf-096d0e0a8c93-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.441073 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.440726    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6a094377-c795-429c-9bcf-096d0e0a8c93-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.441073 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.440753    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6a094377-c795-429c-9bcf-096d0e0a8c93-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.441073 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.440779    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a094377-c795-429c-9bcf-096d0e0a8c93-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.441073 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.440784    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6a094377-c795-429c-9bcf-096d0e0a8c93-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.442435 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.441810    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a094377-c795-429c-9bcf-096d0e0a8c93-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.442435 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.441880    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a094377-c795-429c-9bcf-096d0e0a8c93-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.442435 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.442129    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a094377-c795-429c-9bcf-096d0e0a8c93-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.443798 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.442738    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6a094377-c795-429c-9bcf-096d0e0a8c93-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.443798 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.443277    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6a094377-c795-429c-9bcf-096d0e0a8c93-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.443798 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.443657    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6a094377-c795-429c-9bcf-096d0e0a8c93-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.444040 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.443895    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a094377-c795-429c-9bcf-096d0e0a8c93-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.444721 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.444312    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6a094377-c795-429c-9bcf-096d0e0a8c93-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.444721 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.444679    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6a094377-c795-429c-9bcf-096d0e0a8c93-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.444867 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.444739    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6a094377-c795-429c-9bcf-096d0e0a8c93-config-out\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.444939 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.444889    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6a094377-c795-429c-9bcf-096d0e0a8c93-web-config\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.444994 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.444931    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6a094377-c795-429c-9bcf-096d0e0a8c93-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.445319 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.445296    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6a094377-c795-429c-9bcf-096d0e0a8c93-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.446220 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.446198    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a094377-c795-429c-9bcf-096d0e0a8c93-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.446310 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.446261    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a094377-c795-429c-9bcf-096d0e0a8c93-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.446361 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.446345    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6a094377-c795-429c-9bcf-096d0e0a8c93-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.446587 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.446571    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6a094377-c795-429c-9bcf-096d0e0a8c93-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.446774 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.446758    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6a094377-c795-429c-9bcf-096d0e0a8c93-config\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.449621 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.449595    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fml8x\" (UniqueName: \"kubernetes.io/projected/6a094377-c795-429c-9bcf-096d0e0a8c93-kube-api-access-fml8x\") pod \"prometheus-k8s-0\" (UID: \"6a094377-c795-429c-9bcf-096d0e0a8c93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.485742 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.485722    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:30.618342 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.618319    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 00:22:30.620712 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:22:30.620683    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a094377_c795_429c_9bcf_096d0e0a8c93.slice/crio-c5c15eea8dbd100d50836f6b045fde9537b8f5af58c3943855e9184ad456dcd2 WatchSource:0}: Error finding container c5c15eea8dbd100d50836f6b045fde9537b8f5af58c3943855e9184ad456dcd2: Status 404 returned error can't find the container with id c5c15eea8dbd100d50836f6b045fde9537b8f5af58c3943855e9184ad456dcd2
Jul 23 00:22:30.819354 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.819323    2575 generic.go:356] "Generic (PLEG): container finished" podID="6a094377-c795-429c-9bcf-096d0e0a8c93" containerID="4f042ecd085cdc470a0cc4dd9fa9f089d2e95e29071778c5aa67d793c824c532" exitCode=0
Jul 23 00:22:30.819497 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.819384    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a094377-c795-429c-9bcf-096d0e0a8c93","Type":"ContainerDied","Data":"4f042ecd085cdc470a0cc4dd9fa9f089d2e95e29071778c5aa67d793c824c532"}
Jul 23 00:22:30.819497 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:30.819458    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a094377-c795-429c-9bcf-096d0e0a8c93","Type":"ContainerStarted","Data":"c5c15eea8dbd100d50836f6b045fde9537b8f5af58c3943855e9184ad456dcd2"}
Jul 23 00:22:31.829945 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:31.829889    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a094377-c795-429c-9bcf-096d0e0a8c93","Type":"ContainerStarted","Data":"fffce48ee19cce5426ccfa4de33cb46ceee67ec91cb06c518d34b5a72977c2bf"}
Jul 23 00:22:31.830456 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:31.829988    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a094377-c795-429c-9bcf-096d0e0a8c93","Type":"ContainerStarted","Data":"c14f828bff1a9a273be948047becc275973c629fdf474ef7e541112be4f954c4"}
Jul 23 00:22:31.830456 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:31.830030    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a094377-c795-429c-9bcf-096d0e0a8c93","Type":"ContainerStarted","Data":"d82530ca45ee4a3a504cec8bc09ed32b5ce63cd6f471ebc85e7c87363e43cb99"}
Jul 23 00:22:31.830456 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:31.830067    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a094377-c795-429c-9bcf-096d0e0a8c93","Type":"ContainerStarted","Data":"2e922d8c68ce567bb9673fdc4db51ff5336fd9e192aaee4795aa4e5dace02f35"}
Jul 23 00:22:31.830456 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:31.830105    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a094377-c795-429c-9bcf-096d0e0a8c93","Type":"ContainerStarted","Data":"5399b15e2c1a4601b3b054863b15fe93d6c9f057e04d70c52c209c6ae50f1d34"}
Jul 23 00:22:31.830456 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:31.830138    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a094377-c795-429c-9bcf-096d0e0a8c93","Type":"ContainerStarted","Data":"b42a13ddca5af945346eba3fcc90f251aeb8a1ea38bb31f52f4cfb76d5aca088"}
Jul 23 00:22:31.856833 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:31.856487    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.8369000880000002 podStartE2EDuration="1.856463948s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.56386ms" isStatefulPod=false podCreationTimestamp="2026-07-23 00:22:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:22:31.854747201 +0000 UTC m=+140.258543659" watchObservedRunningTime="2026-07-23 00:22:31.856463948 +0000 UTC m=+140.260260407"
Jul 23 00:22:32.127244 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:32.127171    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c7d9ffe-f398-4596-88a9-26772996e52f" path="/var/lib/kubelet/pods/3c7d9ffe-f398-4596-88a9-26772996e52f/volumes"
Jul 23 00:22:35.486390 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:35.486340    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:22:35.921733 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:22:35.921696    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8f8c9dffc-knswq"]
Jul 23 00:23:00.942407 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:00.942346    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8f8c9dffc-knswq" podUID="5f9edd20-66af-42f1-a19b-3dbe3094b850" containerName="console" containerID="cri-o://911220b64b9bdca166081d44c062ac12cda7ff5f4e698b50078da79936676d16" gracePeriod=15
Jul 23 00:23:01.182230 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.182202    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f8c9dffc-knswq"
Jul 23 00:23:01.269833 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.269753    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f9edd20-66af-42f1-a19b-3dbe3094b850-console-config\") pod \"5f9edd20-66af-42f1-a19b-3dbe3094b850\" (UID: \"5f9edd20-66af-42f1-a19b-3dbe3094b850\") "
Jul 23 00:23:01.269833 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.269818    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkdpq\" (UniqueName: \"kubernetes.io/projected/5f9edd20-66af-42f1-a19b-3dbe3094b850-kube-api-access-tkdpq\") pod \"5f9edd20-66af-42f1-a19b-3dbe3094b850\" (UID: \"5f9edd20-66af-42f1-a19b-3dbe3094b850\") "
Jul 23 00:23:01.270085 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.269857    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f9edd20-66af-42f1-a19b-3dbe3094b850-console-oauth-config\") pod \"5f9edd20-66af-42f1-a19b-3dbe3094b850\" (UID: \"5f9edd20-66af-42f1-a19b-3dbe3094b850\") "
Jul 23 00:23:01.270085 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.269876    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f9edd20-66af-42f1-a19b-3dbe3094b850-console-serving-cert\") pod \"5f9edd20-66af-42f1-a19b-3dbe3094b850\" (UID: \"5f9edd20-66af-42f1-a19b-3dbe3094b850\") "
Jul 23 00:23:01.270085 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.269899    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9edd20-66af-42f1-a19b-3dbe3094b850-trusted-ca-bundle\") pod \"5f9edd20-66af-42f1-a19b-3dbe3094b850\" (UID: \"5f9edd20-66af-42f1-a19b-3dbe3094b850\") "
Jul 23 00:23:01.270085 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.269942    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f9edd20-66af-42f1-a19b-3dbe3094b850-oauth-serving-cert\") pod \"5f9edd20-66af-42f1-a19b-3dbe3094b850\" (UID: \"5f9edd20-66af-42f1-a19b-3dbe3094b850\") "
Jul 23 00:23:01.270085 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.269974    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f9edd20-66af-42f1-a19b-3dbe3094b850-service-ca\") pod \"5f9edd20-66af-42f1-a19b-3dbe3094b850\" (UID: \"5f9edd20-66af-42f1-a19b-3dbe3094b850\") "
Jul 23 00:23:01.270324 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.270276    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f9edd20-66af-42f1-a19b-3dbe3094b850-console-config" (OuterVolumeSpecName: "console-config") pod "5f9edd20-66af-42f1-a19b-3dbe3094b850" (UID: "5f9edd20-66af-42f1-a19b-3dbe3094b850"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:23:01.270423 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.270405    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f9edd20-66af-42f1-a19b-3dbe3094b850-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5f9edd20-66af-42f1-a19b-3dbe3094b850" (UID: "5f9edd20-66af-42f1-a19b-3dbe3094b850"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:23:01.270476 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.270429    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f9edd20-66af-42f1-a19b-3dbe3094b850-service-ca" (OuterVolumeSpecName: "service-ca") pod "5f9edd20-66af-42f1-a19b-3dbe3094b850" (UID: "5f9edd20-66af-42f1-a19b-3dbe3094b850"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:23:01.270476 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.270426    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f9edd20-66af-42f1-a19b-3dbe3094b850-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5f9edd20-66af-42f1-a19b-3dbe3094b850" (UID: "5f9edd20-66af-42f1-a19b-3dbe3094b850"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:23:01.272213 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.272191    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f9edd20-66af-42f1-a19b-3dbe3094b850-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5f9edd20-66af-42f1-a19b-3dbe3094b850" (UID: "5f9edd20-66af-42f1-a19b-3dbe3094b850"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:23:01.272640 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.272617    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f9edd20-66af-42f1-a19b-3dbe3094b850-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5f9edd20-66af-42f1-a19b-3dbe3094b850" (UID: "5f9edd20-66af-42f1-a19b-3dbe3094b850"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:23:01.272732 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.272661    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f9edd20-66af-42f1-a19b-3dbe3094b850-kube-api-access-tkdpq" (OuterVolumeSpecName: "kube-api-access-tkdpq") pod "5f9edd20-66af-42f1-a19b-3dbe3094b850" (UID: "5f9edd20-66af-42f1-a19b-3dbe3094b850"). InnerVolumeSpecName "kube-api-access-tkdpq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:23:01.370690 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.370654    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkdpq\" (UniqueName: \"kubernetes.io/projected/5f9edd20-66af-42f1-a19b-3dbe3094b850-kube-api-access-tkdpq\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:23:01.370690 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.370682    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f9edd20-66af-42f1-a19b-3dbe3094b850-console-oauth-config\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:23:01.370690 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.370692    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f9edd20-66af-42f1-a19b-3dbe3094b850-console-serving-cert\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:23:01.370937 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.370700    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9edd20-66af-42f1-a19b-3dbe3094b850-trusted-ca-bundle\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:23:01.370937 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.370708    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f9edd20-66af-42f1-a19b-3dbe3094b850-oauth-serving-cert\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:23:01.370937 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.370718    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f9edd20-66af-42f1-a19b-3dbe3094b850-service-ca\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:23:01.370937 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.370727    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f9edd20-66af-42f1-a19b-3dbe3094b850-console-config\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:23:01.939201 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.939166    2575 generic.go:356] "Generic (PLEG): container finished" podID="5f9edd20-66af-42f1-a19b-3dbe3094b850" containerID="911220b64b9bdca166081d44c062ac12cda7ff5f4e698b50078da79936676d16" exitCode=0
Jul 23 00:23:01.939384 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.939237    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f8c9dffc-knswq"
Jul 23 00:23:01.939384 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.939254    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f8c9dffc-knswq" event={"ID":"5f9edd20-66af-42f1-a19b-3dbe3094b850","Type":"ContainerDied","Data":"911220b64b9bdca166081d44c062ac12cda7ff5f4e698b50078da79936676d16"}
Jul 23 00:23:01.939384 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.939346    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f8c9dffc-knswq" event={"ID":"5f9edd20-66af-42f1-a19b-3dbe3094b850","Type":"ContainerDied","Data":"1937a3c7835888ee78c4c0691e301fd4a09996a949f92d22663d68575d5933f8"}
Jul 23 00:23:01.939384 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.939373    2575 scope.go:117] "RemoveContainer" containerID="911220b64b9bdca166081d44c062ac12cda7ff5f4e698b50078da79936676d16"
Jul 23 00:23:01.947964 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.947797    2575 scope.go:117] "RemoveContainer" containerID="911220b64b9bdca166081d44c062ac12cda7ff5f4e698b50078da79936676d16"
Jul 23 00:23:01.948166 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:23:01.948083    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"911220b64b9bdca166081d44c062ac12cda7ff5f4e698b50078da79936676d16\": container with ID starting with 911220b64b9bdca166081d44c062ac12cda7ff5f4e698b50078da79936676d16 not found: ID does not exist" containerID="911220b64b9bdca166081d44c062ac12cda7ff5f4e698b50078da79936676d16"
Jul 23 00:23:01.948166 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.948108    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"911220b64b9bdca166081d44c062ac12cda7ff5f4e698b50078da79936676d16"} err="failed to get container status \"911220b64b9bdca166081d44c062ac12cda7ff5f4e698b50078da79936676d16\": rpc error: code = NotFound desc = could not find container \"911220b64b9bdca166081d44c062ac12cda7ff5f4e698b50078da79936676d16\": container with ID starting with 911220b64b9bdca166081d44c062ac12cda7ff5f4e698b50078da79936676d16 not found: ID does not exist"
Jul 23 00:23:01.958182 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.958159    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8f8c9dffc-knswq"]
Jul 23 00:23:01.963307 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:01.963284    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8f8c9dffc-knswq"]
Jul 23 00:23:02.126847 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:02.126816    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f9edd20-66af-42f1-a19b-3dbe3094b850" path="/var/lib/kubelet/pods/5f9edd20-66af-42f1-a19b-3dbe3094b850/volumes"
Jul 23 00:23:30.486750 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:30.486714    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:23:30.502301 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:30.502276    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:23:31.067079 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:31.067055    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 00:23:44.906934 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:44.906885    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4xsgk"]
Jul 23 00:23:44.907314 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:44.907159    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f9edd20-66af-42f1-a19b-3dbe3094b850" containerName="console"
Jul 23 00:23:44.907314 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:44.907170    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f9edd20-66af-42f1-a19b-3dbe3094b850" containerName="console"
Jul 23 00:23:44.907314 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:44.907210    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f9edd20-66af-42f1-a19b-3dbe3094b850" containerName="console"
Jul 23 00:23:44.910288 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:44.910273    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-4xsgk"
Jul 23 00:23:44.912594 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:44.912569    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 23 00:23:44.912706 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:44.912637    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-cfzc8\""
Jul 23 00:23:44.913188 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:44.913171    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 23 00:23:44.917536 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:44.917517    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4xsgk"]
Jul 23 00:23:45.013327 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:45.013295    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/78955c09-f2ed-45c6-9929-a88f2c22716f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4xsgk\" (UID: \"78955c09-f2ed-45c6-9929-a88f2c22716f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4xsgk"
Jul 23 00:23:45.013485 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:45.013362    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf7v7\" (UniqueName: \"kubernetes.io/projected/78955c09-f2ed-45c6-9929-a88f2c22716f-kube-api-access-qf7v7\") pod \"cert-manager-webhook-6486ffd997-4xsgk\" (UID: \"78955c09-f2ed-45c6-9929-a88f2c22716f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4xsgk"
Jul 23 00:23:45.113825 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:45.113792    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf7v7\" (UniqueName: \"kubernetes.io/projected/78955c09-f2ed-45c6-9929-a88f2c22716f-kube-api-access-qf7v7\") pod \"cert-manager-webhook-6486ffd997-4xsgk\" (UID: \"78955c09-f2ed-45c6-9929-a88f2c22716f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4xsgk"
Jul 23 00:23:45.114009 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:45.113834    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/78955c09-f2ed-45c6-9929-a88f2c22716f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4xsgk\" (UID: \"78955c09-f2ed-45c6-9929-a88f2c22716f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4xsgk"
Jul 23 00:23:45.121668 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:45.121644    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/78955c09-f2ed-45c6-9929-a88f2c22716f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4xsgk\" (UID: \"78955c09-f2ed-45c6-9929-a88f2c22716f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4xsgk"
Jul 23 00:23:45.121774 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:45.121698    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf7v7\" (UniqueName: \"kubernetes.io/projected/78955c09-f2ed-45c6-9929-a88f2c22716f-kube-api-access-qf7v7\") pod \"cert-manager-webhook-6486ffd997-4xsgk\" (UID: \"78955c09-f2ed-45c6-9929-a88f2c22716f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4xsgk"
Jul 23 00:23:45.228616 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:45.228534    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-4xsgk"
Jul 23 00:23:45.359355 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:45.359320    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4xsgk"]
Jul 23 00:23:45.362120 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:23:45.362096    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod78955c09_f2ed_45c6_9929_a88f2c22716f.slice/crio-82131cda3b908fd859640a3bda5b931371a48afb7a5f0fb5ed1363c799a6b84f WatchSource:0}: Error finding container 82131cda3b908fd859640a3bda5b931371a48afb7a5f0fb5ed1363c799a6b84f: Status 404 returned error can't find the container with id 82131cda3b908fd859640a3bda5b931371a48afb7a5f0fb5ed1363c799a6b84f
Jul 23 00:23:46.102699 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:46.102660    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-4xsgk" event={"ID":"78955c09-f2ed-45c6-9929-a88f2c22716f","Type":"ContainerStarted","Data":"82131cda3b908fd859640a3bda5b931371a48afb7a5f0fb5ed1363c799a6b84f"}
Jul 23 00:23:49.116816 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:49.116727    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-4xsgk" event={"ID":"78955c09-f2ed-45c6-9929-a88f2c22716f","Type":"ContainerStarted","Data":"f9bdebf17f9ffde9392d332b7cbc80fd9133dce3215a9c7918007f2ed8e4cd61"}
Jul 23 00:23:49.116816 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:49.116798    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-4xsgk"
Jul 23 00:23:49.132609 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:49.132560    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-4xsgk" podStartSLOduration=1.6467441790000001 podStartE2EDuration="5.132543584s" totalImagesPullingTime="3.485799405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:23:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:23:49.131189957 +0000 UTC m=+217.534986413" watchObservedRunningTime="2026-07-23 00:23:49.132543584 +0000 UTC m=+217.536340040"
Jul 23 00:23:55.127974 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:55.127946    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-4xsgk"
Jul 23 00:23:58.185103 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:58.185049    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4llq"]
Jul 23 00:23:58.188813 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:58.188785    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4llq"
Jul 23 00:23:58.191191 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:58.191162    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 23 00:23:58.191850 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:58.191821    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-slbgb\""
Jul 23 00:23:58.191991 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:58.191863    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 23 00:23:58.198205 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:58.198168    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4llq"]
Jul 23 00:23:58.222597 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:58.222566    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2f7v\" (UniqueName: \"kubernetes.io/projected/3a8833d9-ec42-4088-866e-1120e9ba922b-kube-api-access-r2f7v\") pod \"openshift-lws-operator-fd8ccff4c-h4llq\" (UID: \"3a8833d9-ec42-4088-866e-1120e9ba922b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4llq"
Jul 23 00:23:58.222759 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:58.222613    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a8833d9-ec42-4088-866e-1120e9ba922b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-h4llq\" (UID: \"3a8833d9-ec42-4088-866e-1120e9ba922b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4llq"
Jul 23 00:23:58.323207 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:58.323178    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2f7v\" (UniqueName: \"kubernetes.io/projected/3a8833d9-ec42-4088-866e-1120e9ba922b-kube-api-access-r2f7v\") pod \"openshift-lws-operator-fd8ccff4c-h4llq\" (UID: \"3a8833d9-ec42-4088-866e-1120e9ba922b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4llq"
Jul 23 00:23:58.323351 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:58.323220    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a8833d9-ec42-4088-866e-1120e9ba922b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-h4llq\" (UID: \"3a8833d9-ec42-4088-866e-1120e9ba922b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4llq"
Jul 23 00:23:58.323605 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:58.323588    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a8833d9-ec42-4088-866e-1120e9ba922b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-h4llq\" (UID: \"3a8833d9-ec42-4088-866e-1120e9ba922b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4llq"
Jul 23 00:23:58.331198 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:58.331169    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2f7v\" (UniqueName: \"kubernetes.io/projected/3a8833d9-ec42-4088-866e-1120e9ba922b-kube-api-access-r2f7v\") pod \"openshift-lws-operator-fd8ccff4c-h4llq\" (UID: \"3a8833d9-ec42-4088-866e-1120e9ba922b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4llq"
Jul 23 00:23:58.500493 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:58.500399    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4llq"
Jul 23 00:23:58.629850 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:58.629828    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4llq"]
Jul 23 00:23:58.632574 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:23:58.632546    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a8833d9_ec42_4088_866e_1120e9ba922b.slice/crio-a869e44e8a44229eafa8ec0c3a1e75e75bcd061f779b37c003a5fb8ec8418ad0 WatchSource:0}: Error finding container a869e44e8a44229eafa8ec0c3a1e75e75bcd061f779b37c003a5fb8ec8418ad0: Status 404 returned error can't find the container with id a869e44e8a44229eafa8ec0c3a1e75e75bcd061f779b37c003a5fb8ec8418ad0
Jul 23 00:23:59.155922 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:23:59.155887    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4llq" event={"ID":"3a8833d9-ec42-4088-866e-1120e9ba922b","Type":"ContainerStarted","Data":"a869e44e8a44229eafa8ec0c3a1e75e75bcd061f779b37c003a5fb8ec8418ad0"}
Jul 23 00:24:02.172193 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:02.172158    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4llq" event={"ID":"3a8833d9-ec42-4088-866e-1120e9ba922b","Type":"ContainerStarted","Data":"7a8244d97612e7fd907d50bb348b9c6052dbd2bc3bbcc6c23f5f5b57eb550311"}
Jul 23 00:24:02.187870 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:02.187826    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4llq" podStartSLOduration=1.548369444 podStartE2EDuration="4.187811886s" totalImagesPullingTime="2.639442442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:23:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:24:02.186766814 +0000 UTC m=+230.590563272" watchObservedRunningTime="2026-07-23 00:24:02.187811886 +0000 UTC m=+230.591608400"
Jul 23 00:24:21.466380 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:21.466340    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6958b76574-n6hh7"]
Jul 23 00:24:21.513851 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:21.513810    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6958b76574-n6hh7"]
Jul 23 00:24:21.514039 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:21.513942    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6958b76574-n6hh7"
Jul 23 00:24:21.517179 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:21.517156    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-l4272\""
Jul 23 00:24:21.517340 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:21.517162    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 23 00:24:21.517340 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:21.517162    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 23 00:24:21.517340 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:21.517237    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 23 00:24:21.588865 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:21.588825    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/157f0e77-d450-47cb-bca0-cfc72b993919-manager-config\") pod \"lws-controller-manager-6958b76574-n6hh7\" (UID: \"157f0e77-d450-47cb-bca0-cfc72b993919\") " pod="openshift-lws-operator/lws-controller-manager-6958b76574-n6hh7"
Jul 23 00:24:21.588865 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:21.588870    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/157f0e77-d450-47cb-bca0-cfc72b993919-cert\") pod \"lws-controller-manager-6958b76574-n6hh7\" (UID: \"157f0e77-d450-47cb-bca0-cfc72b993919\") " pod="openshift-lws-operator/lws-controller-manager-6958b76574-n6hh7"
Jul 23 00:24:21.589111 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:21.588975    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5skf\" (UniqueName: \"kubernetes.io/projected/157f0e77-d450-47cb-bca0-cfc72b993919-kube-api-access-c5skf\") pod \"lws-controller-manager-6958b76574-n6hh7\" (UID: \"157f0e77-d450-47cb-bca0-cfc72b993919\") " pod="openshift-lws-operator/lws-controller-manager-6958b76574-n6hh7"
Jul 23 00:24:21.589111 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:21.589007    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/157f0e77-d450-47cb-bca0-cfc72b993919-metrics-cert\") pod \"lws-controller-manager-6958b76574-n6hh7\" (UID: \"157f0e77-d450-47cb-bca0-cfc72b993919\") " pod="openshift-lws-operator/lws-controller-manager-6958b76574-n6hh7"
Jul 23 00:24:21.689976 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:21.689935    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5skf\" (UniqueName: \"kubernetes.io/projected/157f0e77-d450-47cb-bca0-cfc72b993919-kube-api-access-c5skf\") pod \"lws-controller-manager-6958b76574-n6hh7\" (UID: \"157f0e77-d450-47cb-bca0-cfc72b993919\") " pod="openshift-lws-operator/lws-controller-manager-6958b76574-n6hh7"
Jul 23 00:24:21.689976 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:21.689977    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/157f0e77-d450-47cb-bca0-cfc72b993919-metrics-cert\") pod \"lws-controller-manager-6958b76574-n6hh7\" (UID: \"157f0e77-d450-47cb-bca0-cfc72b993919\") " pod="openshift-lws-operator/lws-controller-manager-6958b76574-n6hh7"
Jul 23 00:24:21.690192 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:21.690030    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/157f0e77-d450-47cb-bca0-cfc72b993919-manager-config\") pod \"lws-controller-manager-6958b76574-n6hh7\" (UID: \"157f0e77-d450-47cb-bca0-cfc72b993919\") " pod="openshift-lws-operator/lws-controller-manager-6958b76574-n6hh7"
Jul 23 00:24:21.690192 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:21.690067    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/157f0e77-d450-47cb-bca0-cfc72b993919-cert\") pod \"lws-controller-manager-6958b76574-n6hh7\" (UID: \"157f0e77-d450-47cb-bca0-cfc72b993919\") " pod="openshift-lws-operator/lws-controller-manager-6958b76574-n6hh7"
Jul 23 00:24:21.690682 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:21.690657    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/157f0e77-d450-47cb-bca0-cfc72b993919-manager-config\") pod \"lws-controller-manager-6958b76574-n6hh7\" (UID: \"157f0e77-d450-47cb-bca0-cfc72b993919\") " pod="openshift-lws-operator/lws-controller-manager-6958b76574-n6hh7"
Jul 23 00:24:21.692752 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:21.692727    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/157f0e77-d450-47cb-bca0-cfc72b993919-metrics-cert\") pod \"lws-controller-manager-6958b76574-n6hh7\" (UID: \"157f0e77-d450-47cb-bca0-cfc72b993919\") " pod="openshift-lws-operator/lws-controller-manager-6958b76574-n6hh7"
Jul 23 00:24:21.692752 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:21.692750    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/157f0e77-d450-47cb-bca0-cfc72b993919-cert\") pod \"lws-controller-manager-6958b76574-n6hh7\" (UID: \"157f0e77-d450-47cb-bca0-cfc72b993919\") " pod="openshift-lws-operator/lws-controller-manager-6958b76574-n6hh7"
Jul 23 00:24:21.698232 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:21.698209    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5skf\" (UniqueName: \"kubernetes.io/projected/157f0e77-d450-47cb-bca0-cfc72b993919-kube-api-access-c5skf\") pod \"lws-controller-manager-6958b76574-n6hh7\" (UID: \"157f0e77-d450-47cb-bca0-cfc72b993919\") " pod="openshift-lws-operator/lws-controller-manager-6958b76574-n6hh7"
Jul 23 00:24:21.823334 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:21.823248    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6958b76574-n6hh7"
Jul 23 00:24:21.978047 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:21.977967    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6958b76574-n6hh7"]
Jul 23 00:24:21.986037 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:24:21.986010    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod157f0e77_d450_47cb_bca0_cfc72b993919.slice/crio-b9af344f58564d95beca5426408219c58e0944d32a4393d8abb884f47aca1927 WatchSource:0}: Error finding container b9af344f58564d95beca5426408219c58e0944d32a4393d8abb884f47aca1927: Status 404 returned error can't find the container with id b9af344f58564d95beca5426408219c58e0944d32a4393d8abb884f47aca1927
Jul 23 00:24:22.149058 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:22.149025    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8844c5db8-99wht"]
Jul 23 00:24:22.172650 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:22.172598    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8844c5db8-99wht"
Jul 23 00:24:22.175581 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:22.175512    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 23 00:24:22.175581 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:22.175536    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rqkdt\""
Jul 23 00:24:22.175787 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:22.175665    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8844c5db8-99wht"]
Jul 23 00:24:22.179148 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:22.178897    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 23 00:24:22.179438 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:22.179409    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 23 00:24:22.179735 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:22.179717    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 23 00:24:22.194736 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:22.194703    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f40f44ec-ef17-4a08-bb43-0e97e404e012-manifests\") pod \"opendatahub-operator-controller-manager-8844c5db8-99wht\" (UID: \"f40f44ec-ef17-4a08-bb43-0e97e404e012\") " pod="opendatahub/opendatahub-operator-controller-manager-8844c5db8-99wht"
Jul 23 00:24:22.194877 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:22.194754    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f40f44ec-ef17-4a08-bb43-0e97e404e012-webhook-cert\") pod \"opendatahub-operator-controller-manager-8844c5db8-99wht\" (UID: \"f40f44ec-ef17-4a08-bb43-0e97e404e012\") " pod="opendatahub/opendatahub-operator-controller-manager-8844c5db8-99wht"
Jul 23 00:24:22.194877 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:22.194795    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f40f44ec-ef17-4a08-bb43-0e97e404e012-tmp\") pod \"opendatahub-operator-controller-manager-8844c5db8-99wht\" (UID: \"f40f44ec-ef17-4a08-bb43-0e97e404e012\") " pod="opendatahub/opendatahub-operator-controller-manager-8844c5db8-99wht"
Jul 23 00:24:22.195035 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:22.194934    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7kdx\" (UniqueName: \"kubernetes.io/projected/f40f44ec-ef17-4a08-bb43-0e97e404e012-kube-api-access-w7kdx\") pod \"opendatahub-operator-controller-manager-8844c5db8-99wht\" (UID: \"f40f44ec-ef17-4a08-bb43-0e97e404e012\") " pod="opendatahub/opendatahub-operator-controller-manager-8844c5db8-99wht"
Jul 23 00:24:22.195035 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:22.195002    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f40f44ec-ef17-4a08-bb43-0e97e404e012-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8844c5db8-99wht\" (UID: \"f40f44ec-ef17-4a08-bb43-0e97e404e012\") " pod="opendatahub/opendatahub-operator-controller-manager-8844c5db8-99wht"
Jul 23 00:24:22.243710 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:22.243675    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6958b76574-n6hh7" event={"ID":"157f0e77-d450-47cb-bca0-cfc72b993919","Type":"ContainerStarted","Data":"b9af344f58564d95beca5426408219c58e0944d32a4393d8abb884f47aca1927"}
Jul 23 00:24:22.295602 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:22.295573    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f40f44ec-ef17-4a08-bb43-0e97e404e012-manifests\") pod \"opendatahub-operator-controller-manager-8844c5db8-99wht\" (UID: \"f40f44ec-ef17-4a08-bb43-0e97e404e012\") " pod="opendatahub/opendatahub-operator-controller-manager-8844c5db8-99wht"
Jul 23 00:24:22.295784 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:22.295610    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f40f44ec-ef17-4a08-bb43-0e97e404e012-webhook-cert\") pod \"opendatahub-operator-controller-manager-8844c5db8-99wht\" (UID: \"f40f44ec-ef17-4a08-bb43-0e97e404e012\") " pod="opendatahub/opendatahub-operator-controller-manager-8844c5db8-99wht"
Jul 23 00:24:22.295784 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:22.295634    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f40f44ec-ef17-4a08-bb43-0e97e404e012-tmp\") pod \"opendatahub-operator-controller-manager-8844c5db8-99wht\" (UID: \"f40f44ec-ef17-4a08-bb43-0e97e404e012\") " pod="opendatahub/opendatahub-operator-controller-manager-8844c5db8-99wht"
Jul 23 00:24:22.295784 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:22.295676    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7kdx\" (UniqueName: \"kubernetes.io/projected/f40f44ec-ef17-4a08-bb43-0e97e404e012-kube-api-access-w7kdx\") pod \"opendatahub-operator-controller-manager-8844c5db8-99wht\" (UID: \"f40f44ec-ef17-4a08-bb43-0e97e404e012\") " pod="opendatahub/opendatahub-operator-controller-manager-8844c5db8-99wht"
Jul 23 00:24:22.295784 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:22.295719    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f40f44ec-ef17-4a08-bb43-0e97e404e012-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8844c5db8-99wht\" (UID: \"f40f44ec-ef17-4a08-bb43-0e97e404e012\") " pod="opendatahub/opendatahub-operator-controller-manager-8844c5db8-99wht"
Jul 23 00:24:22.296075 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:22.296054    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f40f44ec-ef17-4a08-bb43-0e97e404e012-manifests\") pod \"opendatahub-operator-controller-manager-8844c5db8-99wht\" (UID: \"f40f44ec-ef17-4a08-bb43-0e97e404e012\") " pod="opendatahub/opendatahub-operator-controller-manager-8844c5db8-99wht"
Jul 23 00:24:22.298049 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:22.298027    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f40f44ec-ef17-4a08-bb43-0e97e404e012-tmp\") pod \"opendatahub-operator-controller-manager-8844c5db8-99wht\" (UID: \"f40f44ec-ef17-4a08-bb43-0e97e404e012\") " pod="opendatahub/opendatahub-operator-controller-manager-8844c5db8-99wht"
Jul 23 00:24:22.298378 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:22.298358    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f40f44ec-ef17-4a08-bb43-0e97e404e012-webhook-cert\") pod \"opendatahub-operator-controller-manager-8844c5db8-99wht\" (UID: \"f40f44ec-ef17-4a08-bb43-0e97e404e012\") " pod="opendatahub/opendatahub-operator-controller-manager-8844c5db8-99wht"
Jul 23 00:24:22.298419 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:22.298358    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f40f44ec-ef17-4a08-bb43-0e97e404e012-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8844c5db8-99wht\" (UID: \"f40f44ec-ef17-4a08-bb43-0e97e404e012\") " pod="opendatahub/opendatahub-operator-controller-manager-8844c5db8-99wht"
Jul 23 00:24:22.313731 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:22.313703    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7kdx\" (UniqueName: \"kubernetes.io/projected/f40f44ec-ef17-4a08-bb43-0e97e404e012-kube-api-access-w7kdx\") pod \"opendatahub-operator-controller-manager-8844c5db8-99wht\" (UID: \"f40f44ec-ef17-4a08-bb43-0e97e404e012\") " pod="opendatahub/opendatahub-operator-controller-manager-8844c5db8-99wht"
Jul 23 00:24:22.488953 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:22.488832    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8844c5db8-99wht"
Jul 23 00:24:22.635222 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:22.635180    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8844c5db8-99wht"]
Jul 23 00:24:22.642762 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:24:22.642724    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf40f44ec_ef17_4a08_bb43_0e97e404e012.slice/crio-0639bb41ce9db8ab26eed048800c98bb1cb962b6ed731fab8a281e718d38ee98 WatchSource:0}: Error finding container 0639bb41ce9db8ab26eed048800c98bb1cb962b6ed731fab8a281e718d38ee98: Status 404 returned error can't find the container with id 0639bb41ce9db8ab26eed048800c98bb1cb962b6ed731fab8a281e718d38ee98
Jul 23 00:24:23.249564 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:23.249520    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8844c5db8-99wht" event={"ID":"f40f44ec-ef17-4a08-bb43-0e97e404e012","Type":"ContainerStarted","Data":"0639bb41ce9db8ab26eed048800c98bb1cb962b6ed731fab8a281e718d38ee98"}
Jul 23 00:24:24.256382 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:24.256347    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6958b76574-n6hh7" event={"ID":"157f0e77-d450-47cb-bca0-cfc72b993919","Type":"ContainerStarted","Data":"799386cbd3fdb311eb9e56baaaa447c8ed21dae02723395093e39556124d1774"}
Jul 23 00:24:24.256838 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:24.256504    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6958b76574-n6hh7"
Jul 23 00:24:24.277294 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:24.277240    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6958b76574-n6hh7" podStartSLOduration=1.6927262060000001 podStartE2EDuration="3.277223443s" totalImagesPullingTime="1.584497237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:24:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:24:24.275205606 +0000 UTC m=+252.679002065" watchObservedRunningTime="2026-07-23 00:24:24.277223443 +0000 UTC m=+252.681019900"
Jul 23 00:24:26.266657 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:26.266570    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8844c5db8-99wht" event={"ID":"f40f44ec-ef17-4a08-bb43-0e97e404e012","Type":"ContainerStarted","Data":"de5c0a50d1191a6b2d78196670fce5213ee2c48506a9237de7bfcb18f907053a"}
Jul 23 00:24:27.271682 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:27.271647    2575 generic.go:356] "Generic (PLEG): container finished" podID="f40f44ec-ef17-4a08-bb43-0e97e404e012" containerID="de5c0a50d1191a6b2d78196670fce5213ee2c48506a9237de7bfcb18f907053a" exitCode=0
Jul 23 00:24:27.272070 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:27.271715    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8844c5db8-99wht" event={"ID":"f40f44ec-ef17-4a08-bb43-0e97e404e012","Type":"ContainerDied","Data":"de5c0a50d1191a6b2d78196670fce5213ee2c48506a9237de7bfcb18f907053a"}
Jul 23 00:24:28.277053 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:28.277020    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8844c5db8-99wht" event={"ID":"f40f44ec-ef17-4a08-bb43-0e97e404e012","Type":"ContainerStarted","Data":"7fc7f89f960b03ab89d1c3e65476d22ab4c48f95370d0121f42b34afe99795cc"}
Jul 23 00:24:28.277476 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:28.277133    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8844c5db8-99wht"
Jul 23 00:24:28.296736 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:28.296678    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8844c5db8-99wht" podStartSLOduration=1.475113904 podStartE2EDuration="6.296661756s" totalImagesPullingTime="3.734763945s" totalInitContainerRuntime="1.086783907s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:24:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:24:28.295188822 +0000 UTC m=+256.698985279" watchObservedRunningTime="2026-07-23 00:24:28.296661756 +0000 UTC m=+256.700458213"
Jul 23 00:24:35.263679 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:35.263604    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6958b76574-n6hh7"
Jul 23 00:24:39.282587 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:39.282547    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8844c5db8-99wht"
Jul 23 00:24:41.520708 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:41.520657    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-c7d578648-f7ns9"]
Jul 23 00:24:41.530338 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:41.530310    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-c7d578648-f7ns9"
Jul 23 00:24:41.532478 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:41.532453    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 23 00:24:41.532478 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:41.532496    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 23 00:24:41.532853 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:41.532835    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-mqsp8\""
Jul 23 00:24:41.532953 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:41.532842    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 23 00:24:41.532953 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:41.532864    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 23 00:24:41.535734 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:41.535711    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-c7d578648-f7ns9"]
Jul 23 00:24:41.651964 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:41.651932    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49318c5f-cdb9-4ea0-b402-3bb49b67644f-tmp\") pod \"kube-auth-proxy-c7d578648-f7ns9\" (UID: \"49318c5f-cdb9-4ea0-b402-3bb49b67644f\") " pod="openshift-ingress/kube-auth-proxy-c7d578648-f7ns9"
Jul 23 00:24:41.652124 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:41.651986    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr8kr\" (UniqueName: \"kubernetes.io/projected/49318c5f-cdb9-4ea0-b402-3bb49b67644f-kube-api-access-wr8kr\") pod \"kube-auth-proxy-c7d578648-f7ns9\" (UID: \"49318c5f-cdb9-4ea0-b402-3bb49b67644f\") " pod="openshift-ingress/kube-auth-proxy-c7d578648-f7ns9"
Jul 23 00:24:41.652124 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:41.652069    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49318c5f-cdb9-4ea0-b402-3bb49b67644f-tls-certs\") pod \"kube-auth-proxy-c7d578648-f7ns9\" (UID: \"49318c5f-cdb9-4ea0-b402-3bb49b67644f\") " pod="openshift-ingress/kube-auth-proxy-c7d578648-f7ns9"
Jul 23 00:24:41.753302 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:41.753260    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr8kr\" (UniqueName: \"kubernetes.io/projected/49318c5f-cdb9-4ea0-b402-3bb49b67644f-kube-api-access-wr8kr\") pod \"kube-auth-proxy-c7d578648-f7ns9\" (UID: \"49318c5f-cdb9-4ea0-b402-3bb49b67644f\") " pod="openshift-ingress/kube-auth-proxy-c7d578648-f7ns9"
Jul 23 00:24:41.753506 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:41.753326    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49318c5f-cdb9-4ea0-b402-3bb49b67644f-tls-certs\") pod \"kube-auth-proxy-c7d578648-f7ns9\" (UID: \"49318c5f-cdb9-4ea0-b402-3bb49b67644f\") " pod="openshift-ingress/kube-auth-proxy-c7d578648-f7ns9"
Jul 23 00:24:41.753506 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:41.753391    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49318c5f-cdb9-4ea0-b402-3bb49b67644f-tmp\") pod \"kube-auth-proxy-c7d578648-f7ns9\" (UID: \"49318c5f-cdb9-4ea0-b402-3bb49b67644f\") " pod="openshift-ingress/kube-auth-proxy-c7d578648-f7ns9"
Jul 23 00:24:41.755789 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:41.755763    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49318c5f-cdb9-4ea0-b402-3bb49b67644f-tmp\") pod \"kube-auth-proxy-c7d578648-f7ns9\" (UID: \"49318c5f-cdb9-4ea0-b402-3bb49b67644f\") " pod="openshift-ingress/kube-auth-proxy-c7d578648-f7ns9"
Jul 23 00:24:41.756014 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:41.755997    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49318c5f-cdb9-4ea0-b402-3bb49b67644f-tls-certs\") pod \"kube-auth-proxy-c7d578648-f7ns9\" (UID: \"49318c5f-cdb9-4ea0-b402-3bb49b67644f\") " pod="openshift-ingress/kube-auth-proxy-c7d578648-f7ns9"
Jul 23 00:24:41.761705 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:41.761669    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr8kr\" (UniqueName: \"kubernetes.io/projected/49318c5f-cdb9-4ea0-b402-3bb49b67644f-kube-api-access-wr8kr\") pod \"kube-auth-proxy-c7d578648-f7ns9\" (UID: \"49318c5f-cdb9-4ea0-b402-3bb49b67644f\") " pod="openshift-ingress/kube-auth-proxy-c7d578648-f7ns9"
Jul 23 00:24:41.841447 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:41.841346    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-c7d578648-f7ns9"
Jul 23 00:24:41.987246 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:41.987206    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-c7d578648-f7ns9"]
Jul 23 00:24:41.990207 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:24:41.990180    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49318c5f_cdb9_4ea0_b402_3bb49b67644f.slice/crio-50bebc0112ea669d62a4420395740b9dfcce30f6dd05102163c9901e714aea69 WatchSource:0}: Error finding container 50bebc0112ea669d62a4420395740b9dfcce30f6dd05102163c9901e714aea69: Status 404 returned error can't find the container with id 50bebc0112ea669d62a4420395740b9dfcce30f6dd05102163c9901e714aea69
Jul 23 00:24:42.328987 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:42.328954    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-c7d578648-f7ns9" event={"ID":"49318c5f-cdb9-4ea0-b402-3bb49b67644f","Type":"ContainerStarted","Data":"50bebc0112ea669d62a4420395740b9dfcce30f6dd05102163c9901e714aea69"}
Jul 23 00:24:45.347518 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:45.347427    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-c7d578648-f7ns9" event={"ID":"49318c5f-cdb9-4ea0-b402-3bb49b67644f","Type":"ContainerStarted","Data":"119da286fcfa42b8cce46e97a9cd4241f34426d57cfb08b296f94b2a0fe9928a"}
Jul 23 00:24:45.363278 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:45.363217    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-c7d578648-f7ns9" podStartSLOduration=1.42458159 podStartE2EDuration="4.36319795s" totalImagesPullingTime="2.93861636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:24:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:24:45.362438443 +0000 UTC m=+273.766234892" watchObservedRunningTime="2026-07-23 00:24:45.36319795 +0000 UTC m=+273.766994411"
Jul 23 00:24:51.217771 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:51.217742    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-gbk9t"]
Jul 23 00:24:51.220134 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:51.220112    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gbk9t"
Jul 23 00:24:51.222247 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:51.222226    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-mx58r\""
Jul 23 00:24:51.222415 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:51.222395    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 23 00:24:51.229344 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:51.229322    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-gbk9t"]
Jul 23 00:24:51.335003 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:51.334964    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f5ad1df-3fca-439e-a497-cfb2e9b5abd6-cert\") pod \"kserve-controller-manager-d6f4b65b8-gbk9t\" (UID: \"6f5ad1df-3fca-439e-a497-cfb2e9b5abd6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gbk9t"
Jul 23 00:24:51.335183 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:51.335035    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw9gm\" (UniqueName: \"kubernetes.io/projected/6f5ad1df-3fca-439e-a497-cfb2e9b5abd6-kube-api-access-pw9gm\") pod \"kserve-controller-manager-d6f4b65b8-gbk9t\" (UID: \"6f5ad1df-3fca-439e-a497-cfb2e9b5abd6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gbk9t"
Jul 23 00:24:51.435553 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:51.435522    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw9gm\" (UniqueName: \"kubernetes.io/projected/6f5ad1df-3fca-439e-a497-cfb2e9b5abd6-kube-api-access-pw9gm\") pod \"kserve-controller-manager-d6f4b65b8-gbk9t\" (UID: \"6f5ad1df-3fca-439e-a497-cfb2e9b5abd6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gbk9t"
Jul 23 00:24:51.435749 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:51.435586    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f5ad1df-3fca-439e-a497-cfb2e9b5abd6-cert\") pod \"kserve-controller-manager-d6f4b65b8-gbk9t\" (UID: \"6f5ad1df-3fca-439e-a497-cfb2e9b5abd6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gbk9t"
Jul 23 00:24:51.435749 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:24:51.435695    2575 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 23 00:24:51.435864 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:24:51.435756    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f5ad1df-3fca-439e-a497-cfb2e9b5abd6-cert podName:6f5ad1df-3fca-439e-a497-cfb2e9b5abd6 nodeName:}" failed. No retries permitted until 2026-07-23 00:24:51.935740754 +0000 UTC m=+280.339537192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6f5ad1df-3fca-439e-a497-cfb2e9b5abd6-cert") pod "kserve-controller-manager-d6f4b65b8-gbk9t" (UID: "6f5ad1df-3fca-439e-a497-cfb2e9b5abd6") : secret "kserve-webhook-server-cert" not found
Jul 23 00:24:51.449230 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:51.449196    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw9gm\" (UniqueName: \"kubernetes.io/projected/6f5ad1df-3fca-439e-a497-cfb2e9b5abd6-kube-api-access-pw9gm\") pod \"kserve-controller-manager-d6f4b65b8-gbk9t\" (UID: \"6f5ad1df-3fca-439e-a497-cfb2e9b5abd6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gbk9t"
Jul 23 00:24:51.941147 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:51.941112    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f5ad1df-3fca-439e-a497-cfb2e9b5abd6-cert\") pod \"kserve-controller-manager-d6f4b65b8-gbk9t\" (UID: \"6f5ad1df-3fca-439e-a497-cfb2e9b5abd6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gbk9t"
Jul 23 00:24:51.941317 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:24:51.941233    2575 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 23 00:24:51.941317 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:24:51.941282    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f5ad1df-3fca-439e-a497-cfb2e9b5abd6-cert podName:6f5ad1df-3fca-439e-a497-cfb2e9b5abd6 nodeName:}" failed. No retries permitted until 2026-07-23 00:24:52.941268396 +0000 UTC m=+281.345064831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6f5ad1df-3fca-439e-a497-cfb2e9b5abd6-cert") pod "kserve-controller-manager-d6f4b65b8-gbk9t" (UID: "6f5ad1df-3fca-439e-a497-cfb2e9b5abd6") : secret "kserve-webhook-server-cert" not found
Jul 23 00:24:52.949512 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:52.949470    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f5ad1df-3fca-439e-a497-cfb2e9b5abd6-cert\") pod \"kserve-controller-manager-d6f4b65b8-gbk9t\" (UID: \"6f5ad1df-3fca-439e-a497-cfb2e9b5abd6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gbk9t"
Jul 23 00:24:52.952100 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:52.952074    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f5ad1df-3fca-439e-a497-cfb2e9b5abd6-cert\") pod \"kserve-controller-manager-d6f4b65b8-gbk9t\" (UID: \"6f5ad1df-3fca-439e-a497-cfb2e9b5abd6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gbk9t"
Jul 23 00:24:53.031640 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:53.031599    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gbk9t"
Jul 23 00:24:53.160816 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:53.160712    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-gbk9t"]
Jul 23 00:24:53.163564 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:24:53.163534    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f5ad1df_3fca_439e_a497_cfb2e9b5abd6.slice/crio-536cb5cb330d7659a26f7ea5676a8b9befa330c5fd80144a8a779d3844ef84f3 WatchSource:0}: Error finding container 536cb5cb330d7659a26f7ea5676a8b9befa330c5fd80144a8a779d3844ef84f3: Status 404 returned error can't find the container with id 536cb5cb330d7659a26f7ea5676a8b9befa330c5fd80144a8a779d3844ef84f3
Jul 23 00:24:53.381006 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:53.380902    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gbk9t" event={"ID":"6f5ad1df-3fca-439e-a497-cfb2e9b5abd6","Type":"ContainerStarted","Data":"536cb5cb330d7659a26f7ea5676a8b9befa330c5fd80144a8a779d3844ef84f3"}
Jul 23 00:24:56.394231 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:56.394198    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gbk9t" event={"ID":"6f5ad1df-3fca-439e-a497-cfb2e9b5abd6","Type":"ContainerStarted","Data":"f90765106041e2bc8bf4161c55993ac41dd8f19e8d5e76cdebe24523acf25601"}
Jul 23 00:24:56.394629 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:56.394263    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gbk9t"
Jul 23 00:24:56.409573 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:24:56.409520    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gbk9t" podStartSLOduration=2.744544442 podStartE2EDuration="5.409500584s" totalImagesPullingTime="2.664956142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:24:56.408615956 +0000 UTC m=+284.812412412" watchObservedRunningTime="2026-07-23 00:24:56.409500584 +0000 UTC m=+284.813297040"
Jul 23 00:25:11.981466 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:25:11.981436    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhvxb_b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9/ovn-acl-logging/0.log"
Jul 23 00:25:11.982714 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:25:11.982693    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhvxb_b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9/ovn-acl-logging/0.log"
Jul 23 00:25:11.988101 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:25:11.988082    2575 kubelet.go:1648] "Image garbage collection succeeded"
Jul 23 00:25:27.408008 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:25:27.407979    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gbk9t"
Jul 23 00:26:30.698455 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:26:30.698413    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-whwfd"]
Jul 23 00:26:30.703568 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:26:30.703532    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-whwfd"
Jul 23 00:26:30.705839 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:26:30.705813    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 00:26:30.706001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:26:30.705814    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 23 00:26:30.706001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:26:30.705814    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 00:26:30.706352 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:26:30.706329    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6blfh\""
Jul 23 00:26:30.706450 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:26:30.706352    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 23 00:26:30.711534 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:26:30.711514    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-whwfd"]
Jul 23 00:26:30.751174 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:26:30.751140    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5da15e12-dbb2-4333-bb81-bb4ba87ff4a1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-whwfd\" (UID: \"5da15e12-dbb2-4333-bb81-bb4ba87ff4a1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-whwfd"
Jul 23 00:26:30.751365 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:26:30.751201    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5da15e12-dbb2-4333-bb81-bb4ba87ff4a1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-whwfd\" (UID: \"5da15e12-dbb2-4333-bb81-bb4ba87ff4a1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-whwfd"
Jul 23 00:26:30.751365 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:26:30.751230    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn4k6\" (UniqueName: \"kubernetes.io/projected/5da15e12-dbb2-4333-bb81-bb4ba87ff4a1-kube-api-access-bn4k6\") pod \"kuadrant-console-plugin-66b5774985-whwfd\" (UID: \"5da15e12-dbb2-4333-bb81-bb4ba87ff4a1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-whwfd"
Jul 23 00:26:30.852034 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:26:30.851998    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn4k6\" (UniqueName: \"kubernetes.io/projected/5da15e12-dbb2-4333-bb81-bb4ba87ff4a1-kube-api-access-bn4k6\") pod \"kuadrant-console-plugin-66b5774985-whwfd\" (UID: \"5da15e12-dbb2-4333-bb81-bb4ba87ff4a1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-whwfd"
Jul 23 00:26:30.852237 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:26:30.852064    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5da15e12-dbb2-4333-bb81-bb4ba87ff4a1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-whwfd\" (UID: \"5da15e12-dbb2-4333-bb81-bb4ba87ff4a1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-whwfd"
Jul 23 00:26:30.852237 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:26:30.852112    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5da15e12-dbb2-4333-bb81-bb4ba87ff4a1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-whwfd\" (UID: \"5da15e12-dbb2-4333-bb81-bb4ba87ff4a1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-whwfd"
Jul 23 00:26:30.852237 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:26:30.852164    2575 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 23 00:26:30.852529 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:26:30.852252    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5da15e12-dbb2-4333-bb81-bb4ba87ff4a1-plugin-serving-cert podName:5da15e12-dbb2-4333-bb81-bb4ba87ff4a1 nodeName:}" failed. No retries permitted until 2026-07-23 00:26:31.352231269 +0000 UTC m=+379.756027716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/5da15e12-dbb2-4333-bb81-bb4ba87ff4a1-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-whwfd" (UID: "5da15e12-dbb2-4333-bb81-bb4ba87ff4a1") : secret "plugin-serving-cert" not found
Jul 23 00:26:30.852746 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:26:30.852730    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5da15e12-dbb2-4333-bb81-bb4ba87ff4a1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-whwfd\" (UID: \"5da15e12-dbb2-4333-bb81-bb4ba87ff4a1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-whwfd"
Jul 23 00:26:30.866058 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:26:30.866021    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn4k6\" (UniqueName: \"kubernetes.io/projected/5da15e12-dbb2-4333-bb81-bb4ba87ff4a1-kube-api-access-bn4k6\") pod \"kuadrant-console-plugin-66b5774985-whwfd\" (UID: \"5da15e12-dbb2-4333-bb81-bb4ba87ff4a1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-whwfd"
Jul 23 00:26:31.356410 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:26:31.356356    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5da15e12-dbb2-4333-bb81-bb4ba87ff4a1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-whwfd\" (UID: \"5da15e12-dbb2-4333-bb81-bb4ba87ff4a1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-whwfd"
Jul 23 00:26:31.358922 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:26:31.358889    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5da15e12-dbb2-4333-bb81-bb4ba87ff4a1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-whwfd\" (UID: \"5da15e12-dbb2-4333-bb81-bb4ba87ff4a1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-whwfd"
Jul 23 00:26:31.613987 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:26:31.613881    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-whwfd"
Jul 23 00:26:31.751365 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:26:31.751342    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-whwfd"]
Jul 23 00:26:31.754197 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:26:31.754169    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5da15e12_dbb2_4333_bb81_bb4ba87ff4a1.slice/crio-ef322da304c284f5629b073b2bfc071074a9f1b841cbef90a16828a547634165 WatchSource:0}: Error finding container ef322da304c284f5629b073b2bfc071074a9f1b841cbef90a16828a547634165: Status 404 returned error can't find the container with id ef322da304c284f5629b073b2bfc071074a9f1b841cbef90a16828a547634165
Jul 23 00:26:31.755973 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:26:31.755956    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 00:26:31.783239 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:26:31.783207    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-whwfd" event={"ID":"5da15e12-dbb2-4333-bb81-bb4ba87ff4a1","Type":"ContainerStarted","Data":"ef322da304c284f5629b073b2bfc071074a9f1b841cbef90a16828a547634165"}
Jul 23 00:26:55.896722 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:26:55.896687    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-whwfd" event={"ID":"5da15e12-dbb2-4333-bb81-bb4ba87ff4a1","Type":"ContainerStarted","Data":"69a69876499667ed5dbab7915bdc8c3af80cccffe4c3dfd053580e6482598106"}
Jul 23 00:26:55.914895 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:26:55.914848    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-whwfd" podStartSLOduration=2.815990906 podStartE2EDuration="25.914833855s" totalImagesPullingTime="23.098842949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:26:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:26:55.913830862 +0000 UTC m=+404.317627312" watchObservedRunningTime="2026-07-23 00:26:55.914833855 +0000 UTC m=+404.318630312"
Jul 23 00:27:12.868220 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:12.868189    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:27:12.933755 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:12.933722    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:27:12.933755 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:12.933763    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:27:12.934020 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:12.933841    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-24n2q"
Jul 23 00:27:12.935710 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:12.935690    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 23 00:27:13.022903 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:13.022868    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bd87d66a-faf7-4a41-ba16-3a672ea8a7c2-config-file\") pod \"limitador-limitador-54d6d988d5-24n2q\" (UID: \"bd87d66a-faf7-4a41-ba16-3a672ea8a7c2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-24n2q"
Jul 23 00:27:13.023087 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:13.022966    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzxxt\" (UniqueName: \"kubernetes.io/projected/bd87d66a-faf7-4a41-ba16-3a672ea8a7c2-kube-api-access-xzxxt\") pod \"limitador-limitador-54d6d988d5-24n2q\" (UID: \"bd87d66a-faf7-4a41-ba16-3a672ea8a7c2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-24n2q"
Jul 23 00:27:13.123602 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:13.123503    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bd87d66a-faf7-4a41-ba16-3a672ea8a7c2-config-file\") pod \"limitador-limitador-54d6d988d5-24n2q\" (UID: \"bd87d66a-faf7-4a41-ba16-3a672ea8a7c2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-24n2q"
Jul 23 00:27:13.123602 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:13.123597    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzxxt\" (UniqueName: \"kubernetes.io/projected/bd87d66a-faf7-4a41-ba16-3a672ea8a7c2-kube-api-access-xzxxt\") pod \"limitador-limitador-54d6d988d5-24n2q\" (UID: \"bd87d66a-faf7-4a41-ba16-3a672ea8a7c2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-24n2q"
Jul 23 00:27:13.124289 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:13.124269    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bd87d66a-faf7-4a41-ba16-3a672ea8a7c2-config-file\") pod \"limitador-limitador-54d6d988d5-24n2q\" (UID: \"bd87d66a-faf7-4a41-ba16-3a672ea8a7c2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-24n2q"
Jul 23 00:27:13.131743 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:13.131709    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzxxt\" (UniqueName: \"kubernetes.io/projected/bd87d66a-faf7-4a41-ba16-3a672ea8a7c2-kube-api-access-xzxxt\") pod \"limitador-limitador-54d6d988d5-24n2q\" (UID: \"bd87d66a-faf7-4a41-ba16-3a672ea8a7c2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-24n2q"
Jul 23 00:27:13.244136 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:13.244098    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-24n2q"
Jul 23 00:27:13.388548 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:13.388441    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:27:13.391189 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:27:13.391162    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd87d66a_faf7_4a41_ba16_3a672ea8a7c2.slice/crio-95ecdd635ea1a75cb19a8748bbf88c8a29d333f273f0e7e439e6dac94261b549 WatchSource:0}: Error finding container 95ecdd635ea1a75cb19a8748bbf88c8a29d333f273f0e7e439e6dac94261b549: Status 404 returned error can't find the container with id 95ecdd635ea1a75cb19a8748bbf88c8a29d333f273f0e7e439e6dac94261b549
Jul 23 00:27:13.547559 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:13.547523    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-vjp8q"]
Jul 23 00:27:13.552093 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:13.552070    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vjp8q"
Jul 23 00:27:13.554041 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:13.554023    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pslbj\""
Jul 23 00:27:13.557233 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:13.557212    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vjp8q"]
Jul 23 00:27:13.628550 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:13.628481    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbp29\" (UniqueName: \"kubernetes.io/projected/a1ef3448-308d-43cb-a63c-88aacf8a5753-kube-api-access-wbp29\") pod \"authorino-75d556bd77-vjp8q\" (UID: \"a1ef3448-308d-43cb-a63c-88aacf8a5753\") " pod="kuadrant-system/authorino-75d556bd77-vjp8q"
Jul 23 00:27:13.729831 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:13.729780    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbp29\" (UniqueName: \"kubernetes.io/projected/a1ef3448-308d-43cb-a63c-88aacf8a5753-kube-api-access-wbp29\") pod \"authorino-75d556bd77-vjp8q\" (UID: \"a1ef3448-308d-43cb-a63c-88aacf8a5753\") " pod="kuadrant-system/authorino-75d556bd77-vjp8q"
Jul 23 00:27:13.738057 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:13.738030    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbp29\" (UniqueName: \"kubernetes.io/projected/a1ef3448-308d-43cb-a63c-88aacf8a5753-kube-api-access-wbp29\") pod \"authorino-75d556bd77-vjp8q\" (UID: \"a1ef3448-308d-43cb-a63c-88aacf8a5753\") " pod="kuadrant-system/authorino-75d556bd77-vjp8q"
Jul 23 00:27:13.863046 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:13.863008    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vjp8q"
Jul 23 00:27:13.973812 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:13.973700    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-24n2q" event={"ID":"bd87d66a-faf7-4a41-ba16-3a672ea8a7c2","Type":"ContainerStarted","Data":"95ecdd635ea1a75cb19a8748bbf88c8a29d333f273f0e7e439e6dac94261b549"}
Jul 23 00:27:14.006772 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:14.005711    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vjp8q"]
Jul 23 00:27:14.982996 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:14.982952    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vjp8q" event={"ID":"a1ef3448-308d-43cb-a63c-88aacf8a5753","Type":"ContainerStarted","Data":"d58a84728c4a2aac7163e0eadbedbc3bf55cad7d0c91ce070e2c2b1047378f62"}
Jul 23 00:27:18.000404 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:18.000368    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vjp8q" event={"ID":"a1ef3448-308d-43cb-a63c-88aacf8a5753","Type":"ContainerStarted","Data":"28b009e1b8dbee5360931f8e948f3131c65dc5a84cf55e749e2525dbdb566e1f"}
Jul 23 00:27:18.002192 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:18.002162    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-24n2q" event={"ID":"bd87d66a-faf7-4a41-ba16-3a672ea8a7c2","Type":"ContainerStarted","Data":"90b8929397cd3cf0f522698957fc8590f376aa933826a4ca55b51d0b68c034e7"}
Jul 23 00:27:18.002362 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:18.002245    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-24n2q"
Jul 23 00:27:18.013877 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:18.013830    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-vjp8q" podStartSLOduration=1.14949136 podStartE2EDuration="5.013814172s" totalImagesPullingTime="3.864322812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:27:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:27:18.012629341 +0000 UTC m=+426.416425839" watchObservedRunningTime="2026-07-23 00:27:18.013814172 +0000 UTC m=+426.417610638"
Jul 23 00:27:18.029115 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:18.028993    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-24n2q" podStartSLOduration=1.547668281 podStartE2EDuration="6.028970437s" totalImagesPullingTime="4.481302156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:27:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:27:18.027740759 +0000 UTC m=+426.431537216" watchObservedRunningTime="2026-07-23 00:27:18.028970437 +0000 UTC m=+426.432766896"
Jul 23 00:27:29.007976 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:29.007946    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-24n2q"
Jul 23 00:27:48.567796 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:48.567711    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vjp8q"]
Jul 23 00:27:48.568409 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:48.567939    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-vjp8q" podUID="a1ef3448-308d-43cb-a63c-88aacf8a5753" containerName="authorino" containerID="cri-o://28b009e1b8dbee5360931f8e948f3131c65dc5a84cf55e749e2525dbdb566e1f" gracePeriod=30
Jul 23 00:27:48.808978 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:48.808951    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vjp8q"
Jul 23 00:27:48.929524 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:48.929498    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbp29\" (UniqueName: \"kubernetes.io/projected/a1ef3448-308d-43cb-a63c-88aacf8a5753-kube-api-access-wbp29\") pod \"a1ef3448-308d-43cb-a63c-88aacf8a5753\" (UID: \"a1ef3448-308d-43cb-a63c-88aacf8a5753\") "
Jul 23 00:27:48.931725 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:48.931696    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1ef3448-308d-43cb-a63c-88aacf8a5753-kube-api-access-wbp29" (OuterVolumeSpecName: "kube-api-access-wbp29") pod "a1ef3448-308d-43cb-a63c-88aacf8a5753" (UID: "a1ef3448-308d-43cb-a63c-88aacf8a5753"). InnerVolumeSpecName "kube-api-access-wbp29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:27:49.030169 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:49.030138    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbp29\" (UniqueName: \"kubernetes.io/projected/a1ef3448-308d-43cb-a63c-88aacf8a5753-kube-api-access-wbp29\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:27:49.130618 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:49.130587    2575 generic.go:356] "Generic (PLEG): container finished" podID="a1ef3448-308d-43cb-a63c-88aacf8a5753" containerID="28b009e1b8dbee5360931f8e948f3131c65dc5a84cf55e749e2525dbdb566e1f" exitCode=0
Jul 23 00:27:49.130787 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:49.130627    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vjp8q"
Jul 23 00:27:49.130787 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:49.130633    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vjp8q" event={"ID":"a1ef3448-308d-43cb-a63c-88aacf8a5753","Type":"ContainerDied","Data":"28b009e1b8dbee5360931f8e948f3131c65dc5a84cf55e749e2525dbdb566e1f"}
Jul 23 00:27:49.130787 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:49.130662    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vjp8q" event={"ID":"a1ef3448-308d-43cb-a63c-88aacf8a5753","Type":"ContainerDied","Data":"d58a84728c4a2aac7163e0eadbedbc3bf55cad7d0c91ce070e2c2b1047378f62"}
Jul 23 00:27:49.130787 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:49.130678    2575 scope.go:117] "RemoveContainer" containerID="28b009e1b8dbee5360931f8e948f3131c65dc5a84cf55e749e2525dbdb566e1f"
Jul 23 00:27:49.139061 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:49.139046    2575 scope.go:117] "RemoveContainer" containerID="28b009e1b8dbee5360931f8e948f3131c65dc5a84cf55e749e2525dbdb566e1f"
Jul 23 00:27:49.139297 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:27:49.139280    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28b009e1b8dbee5360931f8e948f3131c65dc5a84cf55e749e2525dbdb566e1f\": container with ID starting with 28b009e1b8dbee5360931f8e948f3131c65dc5a84cf55e749e2525dbdb566e1f not found: ID does not exist" containerID="28b009e1b8dbee5360931f8e948f3131c65dc5a84cf55e749e2525dbdb566e1f"
Jul 23 00:27:49.139359 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:49.139304    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28b009e1b8dbee5360931f8e948f3131c65dc5a84cf55e749e2525dbdb566e1f"} err="failed to get container status \"28b009e1b8dbee5360931f8e948f3131c65dc5a84cf55e749e2525dbdb566e1f\": rpc error: code = NotFound desc = could not find container \"28b009e1b8dbee5360931f8e948f3131c65dc5a84cf55e749e2525dbdb566e1f\": container with ID starting with 28b009e1b8dbee5360931f8e948f3131c65dc5a84cf55e749e2525dbdb566e1f not found: ID does not exist"
Jul 23 00:27:49.149005 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:49.148983    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vjp8q"]
Jul 23 00:27:49.151018 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:49.150995    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vjp8q"]
Jul 23 00:27:50.128760 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:27:50.128721    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1ef3448-308d-43cb-a63c-88aacf8a5753" path="/var/lib/kubelet/pods/a1ef3448-308d-43cb-a63c-88aacf8a5753/volumes"
Jul 23 00:28:30.508812 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:28:30.508781    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:28:49.572059 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:28:49.572018    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:29:00.862048 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:00.862014    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:29:09.963054 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:09.962976    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:29:28.161320 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:28.161283    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7"]
Jul 23 00:29:28.161776 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:28.161595    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1ef3448-308d-43cb-a63c-88aacf8a5753" containerName="authorino"
Jul 23 00:29:28.161776 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:28.161607    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1ef3448-308d-43cb-a63c-88aacf8a5753" containerName="authorino"
Jul 23 00:29:28.161776 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:28.161665    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1ef3448-308d-43cb-a63c-88aacf8a5753" containerName="authorino"
Jul 23 00:29:28.163711 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:28.163693    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7"
Jul 23 00:29:28.166322 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:28.166297    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 23 00:29:28.166442 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:28.166318    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 23 00:29:28.166442 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:28.166339    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4vnxc\""
Jul 23 00:29:28.166442 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:28.166392    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 23 00:29:28.173523 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:28.173500    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7"]
Jul 23 00:29:28.276961 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:28.276904    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abe7524a-b31f-43ff-84b7-4a73fd65288e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7\" (UID: \"abe7524a-b31f-43ff-84b7-4a73fd65288e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7"
Jul 23 00:29:28.277159 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:28.277060    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abe7524a-b31f-43ff-84b7-4a73fd65288e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7\" (UID: \"abe7524a-b31f-43ff-84b7-4a73fd65288e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7"
Jul 23 00:29:28.277235 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:28.277206    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abe7524a-b31f-43ff-84b7-4a73fd65288e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7\" (UID: \"abe7524a-b31f-43ff-84b7-4a73fd65288e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7"
Jul 23 00:29:28.277290 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:28.277239    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abe7524a-b31f-43ff-84b7-4a73fd65288e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7\" (UID: \"abe7524a-b31f-43ff-84b7-4a73fd65288e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7"
Jul 23 00:29:28.277374 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:28.277354    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abe7524a-b31f-43ff-84b7-4a73fd65288e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7\" (UID: \"abe7524a-b31f-43ff-84b7-4a73fd65288e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7"
Jul 23 00:29:28.277466 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:28.277443    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tbtk\" (UniqueName: \"kubernetes.io/projected/abe7524a-b31f-43ff-84b7-4a73fd65288e-kube-api-access-8tbtk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7\" (UID: \"abe7524a-b31f-43ff-84b7-4a73fd65288e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7"
Jul 23 00:29:28.377846 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:28.377806    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abe7524a-b31f-43ff-84b7-4a73fd65288e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7\" (UID: \"abe7524a-b31f-43ff-84b7-4a73fd65288e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7"
Jul 23 00:29:28.377846 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:28.377846    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abe7524a-b31f-43ff-84b7-4a73fd65288e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7\" (UID: \"abe7524a-b31f-43ff-84b7-4a73fd65288e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7"
Jul 23 00:29:28.378046 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:28.377867    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abe7524a-b31f-43ff-84b7-4a73fd65288e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7\" (UID: \"abe7524a-b31f-43ff-84b7-4a73fd65288e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7"
Jul 23 00:29:28.378046 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:28.377892    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tbtk\" (UniqueName: \"kubernetes.io/projected/abe7524a-b31f-43ff-84b7-4a73fd65288e-kube-api-access-8tbtk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7\" (UID: \"abe7524a-b31f-43ff-84b7-4a73fd65288e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7"
Jul 23 00:29:28.378046 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:28.377987    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abe7524a-b31f-43ff-84b7-4a73fd65288e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7\" (UID: \"abe7524a-b31f-43ff-84b7-4a73fd65288e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7"
Jul 23 00:29:28.378046 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:28.378012    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abe7524a-b31f-43ff-84b7-4a73fd65288e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7\" (UID: \"abe7524a-b31f-43ff-84b7-4a73fd65288e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7"
Jul 23 00:29:28.378295 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:28.378273    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abe7524a-b31f-43ff-84b7-4a73fd65288e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7\" (UID: \"abe7524a-b31f-43ff-84b7-4a73fd65288e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7"
Jul 23 00:29:28.378331 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:28.378289    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abe7524a-b31f-43ff-84b7-4a73fd65288e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7\" (UID: \"abe7524a-b31f-43ff-84b7-4a73fd65288e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7"
Jul 23 00:29:28.378374 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:28.378337    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abe7524a-b31f-43ff-84b7-4a73fd65288e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7\" (UID: \"abe7524a-b31f-43ff-84b7-4a73fd65288e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7"
Jul 23 00:29:28.380345 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:28.380314    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abe7524a-b31f-43ff-84b7-4a73fd65288e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7\" (UID: \"abe7524a-b31f-43ff-84b7-4a73fd65288e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7"
Jul 23 00:29:28.380616 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:28.380599    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abe7524a-b31f-43ff-84b7-4a73fd65288e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7\" (UID: \"abe7524a-b31f-43ff-84b7-4a73fd65288e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7"
Jul 23 00:29:28.385365 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:28.385346    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tbtk\" (UniqueName: \"kubernetes.io/projected/abe7524a-b31f-43ff-84b7-4a73fd65288e-kube-api-access-8tbtk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7\" (UID: \"abe7524a-b31f-43ff-84b7-4a73fd65288e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7"
Jul 23 00:29:28.475281 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:28.475184    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7"
Jul 23 00:29:28.604653 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:28.604632    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7"]
Jul 23 00:29:28.607146 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:29:28.607110    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabe7524a_b31f_43ff_84b7_4a73fd65288e.slice/crio-4c9a2051825b229a11accfec35ebfe59c3a0b267013b4c7a90aa5caea81979d0 WatchSource:0}: Error finding container 4c9a2051825b229a11accfec35ebfe59c3a0b267013b4c7a90aa5caea81979d0: Status 404 returned error can't find the container with id 4c9a2051825b229a11accfec35ebfe59c3a0b267013b4c7a90aa5caea81979d0
Jul 23 00:29:29.539075 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:29.539041    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7" event={"ID":"abe7524a-b31f-43ff-84b7-4a73fd65288e","Type":"ContainerStarted","Data":"4c9a2051825b229a11accfec35ebfe59c3a0b267013b4c7a90aa5caea81979d0"}
Jul 23 00:29:29.759636 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:29.759602    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:29:30.545484 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:30.545450    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7" event={"ID":"abe7524a-b31f-43ff-84b7-4a73fd65288e","Type":"ContainerStarted","Data":"85567f0588cd61ce1450d1503a2e00a27dd95403228b28a0feb221f52173c235"}
Jul 23 00:29:30.562408 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:30.562361    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7" podStartSLOduration=1.585383079 podStartE2EDuration="2.562344442s" totalImagesPullingTime="976.961363ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:29:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:29:30.561253955 +0000 UTC m=+558.965050411" watchObservedRunningTime="2026-07-23 00:29:30.562344442 +0000 UTC m=+558.966140899"
Jul 23 00:29:38.263614 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:38.263576    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:29:38.475342 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:38.475299    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7"
Jul 23 00:29:38.475533 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:38.475376    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7"
Jul 23 00:29:38.487803 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:38.487777    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7"
Jul 23 00:29:38.596073 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:29:38.595992    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7"
Jul 23 00:30:12.007241 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:12.007213    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhvxb_b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9/ovn-acl-logging/0.log"
Jul 23 00:30:12.007777 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:12.007281    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhvxb_b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9/ovn-acl-logging/0.log"
Jul 23 00:30:17.060529 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:17.060497    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-dknz7"]
Jul 23 00:30:17.063488 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:17.063473    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dknz7"
Jul 23 00:30:17.065706 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:17.065689    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 23 00:30:17.073510 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:17.073488    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-dknz7"]
Jul 23 00:30:17.203289 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:17.203250    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a37524e-81e6-4dca-87e9-36b9a09f1e48-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dknz7\" (UID: \"0a37524e-81e6-4dca-87e9-36b9a09f1e48\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dknz7"
Jul 23 00:30:17.203289 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:17.203294    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr7cb\" (UniqueName: \"kubernetes.io/projected/0a37524e-81e6-4dca-87e9-36b9a09f1e48-kube-api-access-vr7cb\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dknz7\" (UID: \"0a37524e-81e6-4dca-87e9-36b9a09f1e48\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dknz7"
Jul 23 00:30:17.203502 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:17.203384    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a37524e-81e6-4dca-87e9-36b9a09f1e48-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dknz7\" (UID: \"0a37524e-81e6-4dca-87e9-36b9a09f1e48\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dknz7"
Jul 23 00:30:17.203502 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:17.203409    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a37524e-81e6-4dca-87e9-36b9a09f1e48-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dknz7\" (UID: \"0a37524e-81e6-4dca-87e9-36b9a09f1e48\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dknz7"
Jul 23 00:30:17.203502 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:17.203452    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a37524e-81e6-4dca-87e9-36b9a09f1e48-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dknz7\" (UID: \"0a37524e-81e6-4dca-87e9-36b9a09f1e48\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dknz7"
Jul 23 00:30:17.203502 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:17.203501    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a37524e-81e6-4dca-87e9-36b9a09f1e48-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dknz7\" (UID: \"0a37524e-81e6-4dca-87e9-36b9a09f1e48\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dknz7"
Jul 23 00:30:17.304275 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:17.304239    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a37524e-81e6-4dca-87e9-36b9a09f1e48-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dknz7\" (UID: \"0a37524e-81e6-4dca-87e9-36b9a09f1e48\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dknz7"
Jul 23 00:30:17.304275 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:17.304278    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a37524e-81e6-4dca-87e9-36b9a09f1e48-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dknz7\" (UID: \"0a37524e-81e6-4dca-87e9-36b9a09f1e48\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dknz7"
Jul 23 00:30:17.304538 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:17.304300    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a37524e-81e6-4dca-87e9-36b9a09f1e48-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dknz7\" (UID: \"0a37524e-81e6-4dca-87e9-36b9a09f1e48\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dknz7"
Jul 23 00:30:17.304538 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:17.304337    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a37524e-81e6-4dca-87e9-36b9a09f1e48-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dknz7\" (UID: \"0a37524e-81e6-4dca-87e9-36b9a09f1e48\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dknz7"
Jul 23 00:30:17.304538 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:17.304357    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a37524e-81e6-4dca-87e9-36b9a09f1e48-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dknz7\" (UID: \"0a37524e-81e6-4dca-87e9-36b9a09f1e48\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dknz7"
Jul 23 00:30:17.304538 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:17.304376    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr7cb\" (UniqueName: \"kubernetes.io/projected/0a37524e-81e6-4dca-87e9-36b9a09f1e48-kube-api-access-vr7cb\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dknz7\" (UID: \"0a37524e-81e6-4dca-87e9-36b9a09f1e48\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dknz7"
Jul 23 00:30:17.304785 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:17.304762    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a37524e-81e6-4dca-87e9-36b9a09f1e48-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dknz7\" (UID: \"0a37524e-81e6-4dca-87e9-36b9a09f1e48\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dknz7"
Jul 23 00:30:17.304842 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:17.304815    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a37524e-81e6-4dca-87e9-36b9a09f1e48-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dknz7\" (UID: \"0a37524e-81e6-4dca-87e9-36b9a09f1e48\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dknz7"
Jul 23 00:30:17.304941 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:17.304894    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a37524e-81e6-4dca-87e9-36b9a09f1e48-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dknz7\" (UID: \"0a37524e-81e6-4dca-87e9-36b9a09f1e48\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dknz7"
Jul 23 00:30:17.306547 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:17.306525    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a37524e-81e6-4dca-87e9-36b9a09f1e48-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dknz7\" (UID: \"0a37524e-81e6-4dca-87e9-36b9a09f1e48\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dknz7"
Jul 23 00:30:17.306786 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:17.306768    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a37524e-81e6-4dca-87e9-36b9a09f1e48-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dknz7\" (UID: \"0a37524e-81e6-4dca-87e9-36b9a09f1e48\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dknz7"
Jul 23 00:30:17.315364 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:17.315302    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr7cb\" (UniqueName: \"kubernetes.io/projected/0a37524e-81e6-4dca-87e9-36b9a09f1e48-kube-api-access-vr7cb\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dknz7\" (UID: \"0a37524e-81e6-4dca-87e9-36b9a09f1e48\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dknz7"
Jul 23 00:30:17.372010 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:17.371967    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dknz7"
Jul 23 00:30:17.507532 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:17.507364    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-dknz7"]
Jul 23 00:30:17.510811 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:30:17.510785    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a37524e_81e6_4dca_87e9_36b9a09f1e48.slice/crio-baaa9f6d6a703b7173889d0f512f361eeefde451d7ff7a9bbc6757be783a7a13 WatchSource:0}: Error finding container baaa9f6d6a703b7173889d0f512f361eeefde451d7ff7a9bbc6757be783a7a13: Status 404 returned error can't find the container with id baaa9f6d6a703b7173889d0f512f361eeefde451d7ff7a9bbc6757be783a7a13
Jul 23 00:30:17.747161 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:17.747134    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dknz7" event={"ID":"0a37524e-81e6-4dca-87e9-36b9a09f1e48","Type":"ContainerStarted","Data":"33647d3d53ffab53b5b732f190ce924c1a275120e7a09106a038e0501f16d741"}
Jul 23 00:30:17.747278 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:17.747177    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dknz7" event={"ID":"0a37524e-81e6-4dca-87e9-36b9a09f1e48","Type":"ContainerStarted","Data":"baaa9f6d6a703b7173889d0f512f361eeefde451d7ff7a9bbc6757be783a7a13"}
Jul 23 00:30:17.764136 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:17.764084    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dknz7" podStartSLOduration=0.585617294 podStartE2EDuration="764.069156ms" totalImagesPullingTime="178.451862ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:30:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:30:17.762337474 +0000 UTC m=+606.166133935" watchObservedRunningTime="2026-07-23 00:30:17.764069156 +0000 UTC m=+606.167865613"
Jul 23 00:30:19.356480 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:19.356448    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:30:27.372850 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:27.372818    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dknz7"
Jul 23 00:30:27.373262 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:27.372865    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dknz7"
Jul 23 00:30:27.385353 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:27.385333    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dknz7"
Jul 23 00:30:27.802281 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:30:27.802254    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dknz7"
Jul 23 00:31:11.670276 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:31:11.670244    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-667c59d9d8-2w9jz"]
Jul 23 00:31:11.673140 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:31:11.673119    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-667c59d9d8-2w9jz"
Jul 23 00:31:11.675566 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:31:11.675544    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pslbj\""
Jul 23 00:31:11.675692 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:31:11.675547    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 23 00:31:11.682144 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:31:11.682117    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-667c59d9d8-2w9jz"]
Jul 23 00:31:11.780676 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:31:11.780638    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwbvd\" (UniqueName: \"kubernetes.io/projected/55f29927-2fbe-4289-b6ab-06decfe49a2d-kube-api-access-wwbvd\") pod \"authorino-667c59d9d8-2w9jz\" (UID: \"55f29927-2fbe-4289-b6ab-06decfe49a2d\") " pod="kuadrant-system/authorino-667c59d9d8-2w9jz"
Jul 23 00:31:11.780855 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:31:11.780708    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/55f29927-2fbe-4289-b6ab-06decfe49a2d-tls-cert\") pod \"authorino-667c59d9d8-2w9jz\" (UID: \"55f29927-2fbe-4289-b6ab-06decfe49a2d\") " pod="kuadrant-system/authorino-667c59d9d8-2w9jz"
Jul 23 00:31:11.881699 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:31:11.881656    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/55f29927-2fbe-4289-b6ab-06decfe49a2d-tls-cert\") pod \"authorino-667c59d9d8-2w9jz\" (UID: \"55f29927-2fbe-4289-b6ab-06decfe49a2d\") " pod="kuadrant-system/authorino-667c59d9d8-2w9jz"
Jul 23 00:31:11.881861 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:31:11.881757    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwbvd\" (UniqueName: \"kubernetes.io/projected/55f29927-2fbe-4289-b6ab-06decfe49a2d-kube-api-access-wwbvd\") pod \"authorino-667c59d9d8-2w9jz\" (UID: \"55f29927-2fbe-4289-b6ab-06decfe49a2d\") " pod="kuadrant-system/authorino-667c59d9d8-2w9jz"
Jul 23 00:31:11.884344 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:31:11.884324    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/55f29927-2fbe-4289-b6ab-06decfe49a2d-tls-cert\") pod \"authorino-667c59d9d8-2w9jz\" (UID: \"55f29927-2fbe-4289-b6ab-06decfe49a2d\") " pod="kuadrant-system/authorino-667c59d9d8-2w9jz"
Jul 23 00:31:11.889602 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:31:11.889575    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwbvd\" (UniqueName: \"kubernetes.io/projected/55f29927-2fbe-4289-b6ab-06decfe49a2d-kube-api-access-wwbvd\") pod \"authorino-667c59d9d8-2w9jz\" (UID: \"55f29927-2fbe-4289-b6ab-06decfe49a2d\") " pod="kuadrant-system/authorino-667c59d9d8-2w9jz"
Jul 23 00:31:11.984806 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:31:11.984738    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pslbj\""
Jul 23 00:31:11.993100 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:31:11.993077    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-667c59d9d8-2w9jz"
Jul 23 00:31:12.138293 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:31:12.138263    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-667c59d9d8-2w9jz"]
Jul 23 00:31:12.141443 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:31:12.141420    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55f29927_2fbe_4289_b6ab_06decfe49a2d.slice/crio-b83ec7a5cfadc96580f70b204df5c91af4c0b6a2559c56dcdd2382ea5484938f WatchSource:0}: Error finding container b83ec7a5cfadc96580f70b204df5c91af4c0b6a2559c56dcdd2382ea5484938f: Status 404 returned error can't find the container with id b83ec7a5cfadc96580f70b204df5c91af4c0b6a2559c56dcdd2382ea5484938f
Jul 23 00:31:12.999102 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:31:12.999053    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-667c59d9d8-2w9jz" event={"ID":"55f29927-2fbe-4289-b6ab-06decfe49a2d","Type":"ContainerStarted","Data":"b83ec7a5cfadc96580f70b204df5c91af4c0b6a2559c56dcdd2382ea5484938f"}
Jul 23 00:31:14.005848 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:31:14.005799    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-667c59d9d8-2w9jz" event={"ID":"55f29927-2fbe-4289-b6ab-06decfe49a2d","Type":"ContainerStarted","Data":"b5330f1d7cabf2621d9dee42469babbfbd9c516d76e5c11cafea3c036839799e"}
Jul 23 00:31:14.020989 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:31:14.020021    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-667c59d9d8-2w9jz" podStartSLOduration=2.228843871 podStartE2EDuration="3.019999839s" totalImagesPullingTime="791.155968ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:31:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:31:14.019143507 +0000 UTC m=+662.422939964" watchObservedRunningTime="2026-07-23 00:31:14.019999839 +0000 UTC m=+662.423796297"
Jul 23 00:31:40.760004 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:31:40.759962    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:31:52.158415 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:31:52.158383    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:32:02.162535 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:32:02.162502    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:33:41.566148 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:33:41.566065    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:33:53.165293 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:33:53.165257    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:34:23.566462 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:34:23.566428    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:34:30.959126 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:34:30.959089    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:34:41.759345 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:34:41.759302    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:34:47.461662 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:34:47.461625    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:34:58.667482 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:34:58.667450    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:35:07.966302 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:35:07.966265    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:35:12.039767 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:35:12.039739    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhvxb_b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9/ovn-acl-logging/0.log"
Jul 23 00:35:12.040273 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:35:12.039990    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhvxb_b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9/ovn-acl-logging/0.log"
Jul 23 00:35:19.365517 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:35:19.365482    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:35:29.960535 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:35:29.960501    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:35:52.655392 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:35:52.655357    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:36:03.160864 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:36:03.160831    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:36:25.859454 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:36:25.859416    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:36:38.566510 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:36:38.566427    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:36:52.760763 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:36:52.760725    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:37:04.460985 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:37:04.460945    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:37:13.956286 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:37:13.956245    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:37:23.692582 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:37:23.692545    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:37:32.258715 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:37:32.258676    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:39:22.204933 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:39:22.204879    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:39:32.051269 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:39:32.051237    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:39:42.863230 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:39:42.863185    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:39:56.365861 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:39:56.365819    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:40:05.757274 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:40:05.757239    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:40:12.064775 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:40:12.064743    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhvxb_b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9/ovn-acl-logging/0.log"
Jul 23 00:40:12.065451 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:40:12.065429    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhvxb_b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9/ovn-acl-logging/0.log"
Jul 23 00:40:14.963276 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:40:14.963240    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:40:25.459698 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:40:25.459659    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:40:35.161058 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:40:35.161024    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:40:47.168495 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:40:47.168461    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:40:55.858001 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:40:55.857962    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:41:06.563411 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:06.563333    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:41:28.162269 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:28.162232    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:41:36.964398 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:36.964358    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:41:50.868487 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:50.868452    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"]
Jul 23 00:41:50.871591 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:50.871574    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"
Jul 23 00:41:50.873511 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:50.873488    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-aef15edc-kserve-self-signed-certs\""
Jul 23 00:41:50.889661 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:50.889635    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"]
Jul 23 00:41:51.054296 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:51.054267    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1958e754-9843-422f-b06c-097c15c425c2-model-cache\") pod \"e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk\" (UID: \"1958e754-9843-422f-b06c-097c15c425c2\") " pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"
Jul 23 00:41:51.054296 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:51.054299    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1958e754-9843-422f-b06c-097c15c425c2-tmp-dir\") pod \"e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk\" (UID: \"1958e754-9843-422f-b06c-097c15c425c2\") " pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"
Jul 23 00:41:51.054504 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:51.054326    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1958e754-9843-422f-b06c-097c15c425c2-dshm\") pod \"e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk\" (UID: \"1958e754-9843-422f-b06c-097c15c425c2\") " pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"
Jul 23 00:41:51.054504 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:51.054432    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1958e754-9843-422f-b06c-097c15c425c2-home\") pod \"e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk\" (UID: \"1958e754-9843-422f-b06c-097c15c425c2\") " pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"
Jul 23 00:41:51.054580 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:51.054528    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1958e754-9843-422f-b06c-097c15c425c2-tls-certs\") pod \"e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk\" (UID: \"1958e754-9843-422f-b06c-097c15c425c2\") " pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"
Jul 23 00:41:51.054617 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:51.054582    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r8z9\" (UniqueName: \"kubernetes.io/projected/1958e754-9843-422f-b06c-097c15c425c2-kube-api-access-4r8z9\") pod \"e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk\" (UID: \"1958e754-9843-422f-b06c-097c15c425c2\") " pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"
Jul 23 00:41:51.155114 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:51.155086    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1958e754-9843-422f-b06c-097c15c425c2-model-cache\") pod \"e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk\" (UID: \"1958e754-9843-422f-b06c-097c15c425c2\") " pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"
Jul 23 00:41:51.155275 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:51.155117    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1958e754-9843-422f-b06c-097c15c425c2-tmp-dir\") pod \"e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk\" (UID: \"1958e754-9843-422f-b06c-097c15c425c2\") " pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"
Jul 23 00:41:51.155275 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:51.155157    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1958e754-9843-422f-b06c-097c15c425c2-dshm\") pod \"e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk\" (UID: \"1958e754-9843-422f-b06c-097c15c425c2\") " pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"
Jul 23 00:41:51.155275 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:51.155199    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1958e754-9843-422f-b06c-097c15c425c2-home\") pod \"e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk\" (UID: \"1958e754-9843-422f-b06c-097c15c425c2\") " pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"
Jul 23 00:41:51.155275 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:51.155255    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1958e754-9843-422f-b06c-097c15c425c2-tls-certs\") pod \"e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk\" (UID: \"1958e754-9843-422f-b06c-097c15c425c2\") " pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"
Jul 23 00:41:51.155468 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:51.155315    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r8z9\" (UniqueName: \"kubernetes.io/projected/1958e754-9843-422f-b06c-097c15c425c2-kube-api-access-4r8z9\") pod \"e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk\" (UID: \"1958e754-9843-422f-b06c-097c15c425c2\") " pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"
Jul 23 00:41:51.155521 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:51.155505    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1958e754-9843-422f-b06c-097c15c425c2-model-cache\") pod \"e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk\" (UID: \"1958e754-9843-422f-b06c-097c15c425c2\") " pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"
Jul 23 00:41:51.155580 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:51.155542    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1958e754-9843-422f-b06c-097c15c425c2-tmp-dir\") pod \"e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk\" (UID: \"1958e754-9843-422f-b06c-097c15c425c2\") " pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"
Jul 23 00:41:51.155696 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:51.155676    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1958e754-9843-422f-b06c-097c15c425c2-home\") pod \"e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk\" (UID: \"1958e754-9843-422f-b06c-097c15c425c2\") " pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"
Jul 23 00:41:51.157638 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:51.157612    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1958e754-9843-422f-b06c-097c15c425c2-dshm\") pod \"e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk\" (UID: \"1958e754-9843-422f-b06c-097c15c425c2\") " pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"
Jul 23 00:41:51.157926 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:51.157888    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1958e754-9843-422f-b06c-097c15c425c2-tls-certs\") pod \"e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk\" (UID: \"1958e754-9843-422f-b06c-097c15c425c2\") " pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"
Jul 23 00:41:51.162325 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:51.162304    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r8z9\" (UniqueName: \"kubernetes.io/projected/1958e754-9843-422f-b06c-097c15c425c2-kube-api-access-4r8z9\") pod \"e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk\" (UID: \"1958e754-9843-422f-b06c-097c15c425c2\") " pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"
Jul 23 00:41:51.180167 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:51.180143    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"
Jul 23 00:41:51.310344 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:51.310317    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"]
Jul 23 00:41:51.312969 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:41:51.312944    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1958e754_9843_422f_b06c_097c15c425c2.slice/crio-2a4a40d90dbe6c69ee5142183d2f343a626dc4c35014a02f3a0629d5dcf3664d WatchSource:0}: Error finding container 2a4a40d90dbe6c69ee5142183d2f343a626dc4c35014a02f3a0629d5dcf3664d: Status 404 returned error can't find the container with id 2a4a40d90dbe6c69ee5142183d2f343a626dc4c35014a02f3a0629d5dcf3664d
Jul 23 00:41:51.776928 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:51.776870    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk" event={"ID":"1958e754-9843-422f-b06c-097c15c425c2","Type":"ContainerStarted","Data":"36b7210ca4339d5a49f03a0992001e433e8fdcdb11057d8840caf0ae0a128c7a"}
Jul 23 00:41:51.777093 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:51.776944    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk" event={"ID":"1958e754-9843-422f-b06c-097c15c425c2","Type":"ContainerStarted","Data":"2a4a40d90dbe6c69ee5142183d2f343a626dc4c35014a02f3a0629d5dcf3664d"}
Jul 23 00:41:51.798015 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:51.797966    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk" podStartSLOduration=1.797949818 podStartE2EDuration="1.797949818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:41:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:41:51.79586305 +0000 UTC m=+1300.199659518" watchObservedRunningTime="2026-07-23 00:41:51.797949818 +0000 UTC m=+1300.201746274"
Jul 23 00:41:53.664063 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:53.664027    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:41:58.259856 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:58.259826    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"]
Jul 23 00:41:58.263393 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:58.263373    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"
Jul 23 00:41:58.265290 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:58.265271    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-aef15edc-kserve-self-signed-certs\""
Jul 23 00:41:58.272457 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:58.272427    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"]
Jul 23 00:41:58.314709 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:58.314684    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ce2d077-bca1-4ca5-9970-455bb7b1344d-model-cache\") pod \"e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8\" (UID: \"5ce2d077-bca1-4ca5-9970-455bb7b1344d\") " pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"
Jul 23 00:41:58.314831 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:58.314717    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ce2d077-bca1-4ca5-9970-455bb7b1344d-tmp-dir\") pod \"e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8\" (UID: \"5ce2d077-bca1-4ca5-9970-455bb7b1344d\") " pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"
Jul 23 00:41:58.314831 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:58.314740    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ce2d077-bca1-4ca5-9970-455bb7b1344d-tls-certs\") pod \"e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8\" (UID: \"5ce2d077-bca1-4ca5-9970-455bb7b1344d\") " pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"
Jul 23 00:41:58.314831 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:58.314785    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ce2d077-bca1-4ca5-9970-455bb7b1344d-home\") pod \"e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8\" (UID: \"5ce2d077-bca1-4ca5-9970-455bb7b1344d\") " pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"
Jul 23 00:41:58.314831 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:58.314822    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtklc\" (UniqueName: \"kubernetes.io/projected/5ce2d077-bca1-4ca5-9970-455bb7b1344d-kube-api-access-wtklc\") pod \"e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8\" (UID: \"5ce2d077-bca1-4ca5-9970-455bb7b1344d\") " pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"
Jul 23 00:41:58.315005 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:58.314878    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ce2d077-bca1-4ca5-9970-455bb7b1344d-dshm\") pod \"e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8\" (UID: \"5ce2d077-bca1-4ca5-9970-455bb7b1344d\") " pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"
Jul 23 00:41:58.416010 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:58.415975    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ce2d077-bca1-4ca5-9970-455bb7b1344d-home\") pod \"e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8\" (UID: \"5ce2d077-bca1-4ca5-9970-455bb7b1344d\") " pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"
Jul 23 00:41:58.416187 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:58.416020    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtklc\" (UniqueName: \"kubernetes.io/projected/5ce2d077-bca1-4ca5-9970-455bb7b1344d-kube-api-access-wtklc\") pod \"e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8\" (UID: \"5ce2d077-bca1-4ca5-9970-455bb7b1344d\") " pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"
Jul 23 00:41:58.416187 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:58.416088    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ce2d077-bca1-4ca5-9970-455bb7b1344d-dshm\") pod \"e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8\" (UID: \"5ce2d077-bca1-4ca5-9970-455bb7b1344d\") " pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"
Jul 23 00:41:58.416187 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:58.416128    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ce2d077-bca1-4ca5-9970-455bb7b1344d-model-cache\") pod \"e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8\" (UID: \"5ce2d077-bca1-4ca5-9970-455bb7b1344d\") " pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"
Jul 23 00:41:58.416187 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:58.416155    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ce2d077-bca1-4ca5-9970-455bb7b1344d-tmp-dir\") pod \"e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8\" (UID: \"5ce2d077-bca1-4ca5-9970-455bb7b1344d\") " pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"
Jul 23 00:41:58.416187 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:58.416170    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ce2d077-bca1-4ca5-9970-455bb7b1344d-tls-certs\") pod \"e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8\" (UID: \"5ce2d077-bca1-4ca5-9970-455bb7b1344d\") " pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"
Jul 23 00:41:58.416484 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:58.416457    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ce2d077-bca1-4ca5-9970-455bb7b1344d-home\") pod \"e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8\" (UID: \"5ce2d077-bca1-4ca5-9970-455bb7b1344d\") " pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"
Jul 23 00:41:58.416545 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:58.416494    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ce2d077-bca1-4ca5-9970-455bb7b1344d-model-cache\") pod \"e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8\" (UID: \"5ce2d077-bca1-4ca5-9970-455bb7b1344d\") " pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"
Jul 23 00:41:58.416586 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:58.416545    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ce2d077-bca1-4ca5-9970-455bb7b1344d-tmp-dir\") pod \"e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8\" (UID: \"5ce2d077-bca1-4ca5-9970-455bb7b1344d\") " pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"
Jul 23 00:41:58.418562 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:58.418537    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ce2d077-bca1-4ca5-9970-455bb7b1344d-dshm\") pod \"e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8\" (UID: \"5ce2d077-bca1-4ca5-9970-455bb7b1344d\") " pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"
Jul 23 00:41:58.418647 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:58.418633    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ce2d077-bca1-4ca5-9970-455bb7b1344d-tls-certs\") pod \"e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8\" (UID: \"5ce2d077-bca1-4ca5-9970-455bb7b1344d\") " pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"
Jul 23 00:41:58.422991 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:58.422963    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtklc\" (UniqueName: \"kubernetes.io/projected/5ce2d077-bca1-4ca5-9970-455bb7b1344d-kube-api-access-wtklc\") pod \"e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8\" (UID: \"5ce2d077-bca1-4ca5-9970-455bb7b1344d\") " pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"
Jul 23 00:41:58.573498 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:58.573417    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"
Jul 23 00:41:58.704426 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:58.704390    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"]
Jul 23 00:41:58.707411 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:41:58.707383    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ce2d077_bca1_4ca5_9970_455bb7b1344d.slice/crio-70e9d09f07f8ab419aeadaa277f672acaba5a567805971ce82092b910ca0fe49 WatchSource:0}: Error finding container 70e9d09f07f8ab419aeadaa277f672acaba5a567805971ce82092b910ca0fe49: Status 404 returned error can't find the container with id 70e9d09f07f8ab419aeadaa277f672acaba5a567805971ce82092b910ca0fe49
Jul 23 00:41:58.811978 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:58.811946    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8" event={"ID":"5ce2d077-bca1-4ca5-9970-455bb7b1344d","Type":"ContainerStarted","Data":"0a6d4342d00049cc1c02e329cee74ba12d8631f52556dce8001c907bb63ae778"}
Jul 23 00:41:58.812202 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:58.811988    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8" event={"ID":"5ce2d077-bca1-4ca5-9970-455bb7b1344d","Type":"ContainerStarted","Data":"70e9d09f07f8ab419aeadaa277f672acaba5a567805971ce82092b910ca0fe49"}
Jul 23 00:41:58.833496 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:41:58.833402    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8" podStartSLOduration=0.833383566 podStartE2EDuration="833.383566ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:41:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:41:58.831304925 +0000 UTC m=+1307.235101382" watchObservedRunningTime="2026-07-23 00:41:58.833383566 +0000 UTC m=+1307.237180001"
Jul 23 00:42:01.180414 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:01.180377    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"
Jul 23 00:42:01.180414 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:01.180425    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"
Jul 23 00:42:01.192825 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:01.192795    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"
Jul 23 00:42:01.835689 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:01.835603    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"
Jul 23 00:42:08.573750 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:08.573711    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"
Jul 23 00:42:08.574214 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:08.573798    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"
Jul 23 00:42:08.586130 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:08.586107    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"
Jul 23 00:42:08.869650 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:08.869569    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"
Jul 23 00:42:09.256166 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:09.256137    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:42:32.702130 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:32.702051    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"]
Jul 23 00:42:33.291151 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:33.291109    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"]
Jul 23 00:42:36.459519 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:36.459484    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:42:47.723250 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:47.723209    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk" podUID="1958e754-9843-422f-b06c-097c15c425c2" containerName="main" containerID="cri-o://36b7210ca4339d5a49f03a0992001e433e8fdcdb11057d8840caf0ae0a128c7a" gracePeriod=45
Jul 23 00:42:47.970650 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:47.970621    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"
Jul 23 00:42:48.030234 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.030144    2575 generic.go:356] "Generic (PLEG): container finished" podID="1958e754-9843-422f-b06c-097c15c425c2" containerID="36b7210ca4339d5a49f03a0992001e433e8fdcdb11057d8840caf0ae0a128c7a" exitCode=0
Jul 23 00:42:48.030234 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.030199    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"
Jul 23 00:42:48.030234 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.030215    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk" event={"ID":"1958e754-9843-422f-b06c-097c15c425c2","Type":"ContainerDied","Data":"36b7210ca4339d5a49f03a0992001e433e8fdcdb11057d8840caf0ae0a128c7a"}
Jul 23 00:42:48.030457 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.030256    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk" event={"ID":"1958e754-9843-422f-b06c-097c15c425c2","Type":"ContainerDied","Data":"2a4a40d90dbe6c69ee5142183d2f343a626dc4c35014a02f3a0629d5dcf3664d"}
Jul 23 00:42:48.030457 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.030273    2575 scope.go:117] "RemoveContainer" containerID="36b7210ca4339d5a49f03a0992001e433e8fdcdb11057d8840caf0ae0a128c7a"
Jul 23 00:42:48.039463 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.039441    2575 scope.go:117] "RemoveContainer" containerID="36b7210ca4339d5a49f03a0992001e433e8fdcdb11057d8840caf0ae0a128c7a"
Jul 23 00:42:48.039764 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:42:48.039740    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36b7210ca4339d5a49f03a0992001e433e8fdcdb11057d8840caf0ae0a128c7a\": container with ID starting with 36b7210ca4339d5a49f03a0992001e433e8fdcdb11057d8840caf0ae0a128c7a not found: ID does not exist" containerID="36b7210ca4339d5a49f03a0992001e433e8fdcdb11057d8840caf0ae0a128c7a"
Jul 23 00:42:48.039865 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.039770    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36b7210ca4339d5a49f03a0992001e433e8fdcdb11057d8840caf0ae0a128c7a"} err="failed to get container status \"36b7210ca4339d5a49f03a0992001e433e8fdcdb11057d8840caf0ae0a128c7a\": rpc error: code = NotFound desc = could not find container \"36b7210ca4339d5a49f03a0992001e433e8fdcdb11057d8840caf0ae0a128c7a\": container with ID starting with 36b7210ca4339d5a49f03a0992001e433e8fdcdb11057d8840caf0ae0a128c7a not found: ID does not exist"
Jul 23 00:42:48.056205 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.056177    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1958e754-9843-422f-b06c-097c15c425c2-dshm\") pod \"1958e754-9843-422f-b06c-097c15c425c2\" (UID: \"1958e754-9843-422f-b06c-097c15c425c2\") "
Jul 23 00:42:48.056205 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.056207    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1958e754-9843-422f-b06c-097c15c425c2-home\") pod \"1958e754-9843-422f-b06c-097c15c425c2\" (UID: \"1958e754-9843-422f-b06c-097c15c425c2\") "
Jul 23 00:42:48.056419 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.056245    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1958e754-9843-422f-b06c-097c15c425c2-model-cache\") pod \"1958e754-9843-422f-b06c-097c15c425c2\" (UID: \"1958e754-9843-422f-b06c-097c15c425c2\") "
Jul 23 00:42:48.056419 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.056263    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1958e754-9843-422f-b06c-097c15c425c2-tls-certs\") pod \"1958e754-9843-422f-b06c-097c15c425c2\" (UID: \"1958e754-9843-422f-b06c-097c15c425c2\") "
Jul 23 00:42:48.056419 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.056293    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1958e754-9843-422f-b06c-097c15c425c2-tmp-dir\") pod \"1958e754-9843-422f-b06c-097c15c425c2\" (UID: \"1958e754-9843-422f-b06c-097c15c425c2\") "
Jul 23 00:42:48.056419 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.056357    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4r8z9\" (UniqueName: \"kubernetes.io/projected/1958e754-9843-422f-b06c-097c15c425c2-kube-api-access-4r8z9\") pod \"1958e754-9843-422f-b06c-097c15c425c2\" (UID: \"1958e754-9843-422f-b06c-097c15c425c2\") "
Jul 23 00:42:48.056611 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.056513    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1958e754-9843-422f-b06c-097c15c425c2-home" (OuterVolumeSpecName: "home") pod "1958e754-9843-422f-b06c-097c15c425c2" (UID: "1958e754-9843-422f-b06c-097c15c425c2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:42:48.056611 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.056531    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1958e754-9843-422f-b06c-097c15c425c2-model-cache" (OuterVolumeSpecName: "model-cache") pod "1958e754-9843-422f-b06c-097c15c425c2" (UID: "1958e754-9843-422f-b06c-097c15c425c2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:42:48.056739 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.056694    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1958e754-9843-422f-b06c-097c15c425c2-home\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:42:48.056795 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.056747    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1958e754-9843-422f-b06c-097c15c425c2-model-cache\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:42:48.056795 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.056753    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1958e754-9843-422f-b06c-097c15c425c2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1958e754-9843-422f-b06c-097c15c425c2" (UID: "1958e754-9843-422f-b06c-097c15c425c2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:42:48.058646 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.058616    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1958e754-9843-422f-b06c-097c15c425c2-dshm" (OuterVolumeSpecName: "dshm") pod "1958e754-9843-422f-b06c-097c15c425c2" (UID: "1958e754-9843-422f-b06c-097c15c425c2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:42:48.058789 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.058669    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1958e754-9843-422f-b06c-097c15c425c2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1958e754-9843-422f-b06c-097c15c425c2" (UID: "1958e754-9843-422f-b06c-097c15c425c2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:42:48.058789 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.058677    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1958e754-9843-422f-b06c-097c15c425c2-kube-api-access-4r8z9" (OuterVolumeSpecName: "kube-api-access-4r8z9") pod "1958e754-9843-422f-b06c-097c15c425c2" (UID: "1958e754-9843-422f-b06c-097c15c425c2"). InnerVolumeSpecName "kube-api-access-4r8z9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:42:48.157378 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.157341    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1958e754-9843-422f-b06c-097c15c425c2-tmp-dir\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:42:48.157378 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.157371    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4r8z9\" (UniqueName: \"kubernetes.io/projected/1958e754-9843-422f-b06c-097c15c425c2-kube-api-access-4r8z9\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:42:48.157378 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.157381    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1958e754-9843-422f-b06c-097c15c425c2-dshm\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:42:48.157613 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.157390    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1958e754-9843-422f-b06c-097c15c425c2-tls-certs\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:42:48.311489 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.311392    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8" podUID="5ce2d077-bca1-4ca5-9970-455bb7b1344d" containerName="main" containerID="cri-o://0a6d4342d00049cc1c02e329cee74ba12d8631f52556dce8001c907bb63ae778" gracePeriod=45
Jul 23 00:42:48.379801 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.379758    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"]
Jul 23 00:42:48.383870 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.383842    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-aef15edc-kserve-5cc6d6d74c-mpszk"]
Jul 23 00:42:48.544446 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.544410    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"
Jul 23 00:42:48.561188 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.561119    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ce2d077-bca1-4ca5-9970-455bb7b1344d-model-cache\") pod \"5ce2d077-bca1-4ca5-9970-455bb7b1344d\" (UID: \"5ce2d077-bca1-4ca5-9970-455bb7b1344d\") "
Jul 23 00:42:48.561188 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.561167    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ce2d077-bca1-4ca5-9970-455bb7b1344d-tls-certs\") pod \"5ce2d077-bca1-4ca5-9970-455bb7b1344d\" (UID: \"5ce2d077-bca1-4ca5-9970-455bb7b1344d\") "
Jul 23 00:42:48.561542 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.561246    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ce2d077-bca1-4ca5-9970-455bb7b1344d-tmp-dir\") pod \"5ce2d077-bca1-4ca5-9970-455bb7b1344d\" (UID: \"5ce2d077-bca1-4ca5-9970-455bb7b1344d\") "
Jul 23 00:42:48.561542 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.561273    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtklc\" (UniqueName: \"kubernetes.io/projected/5ce2d077-bca1-4ca5-9970-455bb7b1344d-kube-api-access-wtklc\") pod \"5ce2d077-bca1-4ca5-9970-455bb7b1344d\" (UID: \"5ce2d077-bca1-4ca5-9970-455bb7b1344d\") "
Jul 23 00:42:48.561542 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.561347    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ce2d077-bca1-4ca5-9970-455bb7b1344d-home\") pod \"5ce2d077-bca1-4ca5-9970-455bb7b1344d\" (UID: \"5ce2d077-bca1-4ca5-9970-455bb7b1344d\") "
Jul 23 00:42:48.561542 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.561374    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ce2d077-bca1-4ca5-9970-455bb7b1344d-dshm\") pod \"5ce2d077-bca1-4ca5-9970-455bb7b1344d\" (UID: \"5ce2d077-bca1-4ca5-9970-455bb7b1344d\") "
Jul 23 00:42:48.561774 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.561651    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ce2d077-bca1-4ca5-9970-455bb7b1344d-model-cache" (OuterVolumeSpecName: "model-cache") pod "5ce2d077-bca1-4ca5-9970-455bb7b1344d" (UID: "5ce2d077-bca1-4ca5-9970-455bb7b1344d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:42:48.561832 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.561811    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ce2d077-bca1-4ca5-9970-455bb7b1344d-model-cache\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:42:48.561983 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.561888    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ce2d077-bca1-4ca5-9970-455bb7b1344d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5ce2d077-bca1-4ca5-9970-455bb7b1344d" (UID: "5ce2d077-bca1-4ca5-9970-455bb7b1344d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:42:48.562077 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.562039    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ce2d077-bca1-4ca5-9970-455bb7b1344d-home" (OuterVolumeSpecName: "home") pod "5ce2d077-bca1-4ca5-9970-455bb7b1344d" (UID: "5ce2d077-bca1-4ca5-9970-455bb7b1344d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:42:48.564181 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.564147    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ce2d077-bca1-4ca5-9970-455bb7b1344d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5ce2d077-bca1-4ca5-9970-455bb7b1344d" (UID: "5ce2d077-bca1-4ca5-9970-455bb7b1344d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:42:48.564181 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.564167    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ce2d077-bca1-4ca5-9970-455bb7b1344d-kube-api-access-wtklc" (OuterVolumeSpecName: "kube-api-access-wtklc") pod "5ce2d077-bca1-4ca5-9970-455bb7b1344d" (UID: "5ce2d077-bca1-4ca5-9970-455bb7b1344d"). InnerVolumeSpecName "kube-api-access-wtklc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:42:48.564305 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.564243    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ce2d077-bca1-4ca5-9970-455bb7b1344d-dshm" (OuterVolumeSpecName: "dshm") pod "5ce2d077-bca1-4ca5-9970-455bb7b1344d" (UID: "5ce2d077-bca1-4ca5-9970-455bb7b1344d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:42:48.663058 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.663022    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ce2d077-bca1-4ca5-9970-455bb7b1344d-tmp-dir\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:42:48.663058 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.663051    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtklc\" (UniqueName: \"kubernetes.io/projected/5ce2d077-bca1-4ca5-9970-455bb7b1344d-kube-api-access-wtklc\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:42:48.663058 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.663062    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ce2d077-bca1-4ca5-9970-455bb7b1344d-home\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:42:48.663296 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.663071    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ce2d077-bca1-4ca5-9970-455bb7b1344d-dshm\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:42:48.663296 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:48.663078    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ce2d077-bca1-4ca5-9970-455bb7b1344d-tls-certs\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:42:49.038036 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:49.038003    2575 generic.go:356] "Generic (PLEG): container finished" podID="5ce2d077-bca1-4ca5-9970-455bb7b1344d" containerID="0a6d4342d00049cc1c02e329cee74ba12d8631f52556dce8001c907bb63ae778" exitCode=0
Jul 23 00:42:49.038503 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:49.038053    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"
Jul 23 00:42:49.038503 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:49.038095    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8" event={"ID":"5ce2d077-bca1-4ca5-9970-455bb7b1344d","Type":"ContainerDied","Data":"0a6d4342d00049cc1c02e329cee74ba12d8631f52556dce8001c907bb63ae778"}
Jul 23 00:42:49.038503 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:49.038142    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8" event={"ID":"5ce2d077-bca1-4ca5-9970-455bb7b1344d","Type":"ContainerDied","Data":"70e9d09f07f8ab419aeadaa277f672acaba5a567805971ce82092b910ca0fe49"}
Jul 23 00:42:49.038503 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:49.038164    2575 scope.go:117] "RemoveContainer" containerID="0a6d4342d00049cc1c02e329cee74ba12d8631f52556dce8001c907bb63ae778"
Jul 23 00:42:49.047744 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:49.047726    2575 scope.go:117] "RemoveContainer" containerID="0a6d4342d00049cc1c02e329cee74ba12d8631f52556dce8001c907bb63ae778"
Jul 23 00:42:49.048084 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:42:49.048063    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a6d4342d00049cc1c02e329cee74ba12d8631f52556dce8001c907bb63ae778\": container with ID starting with 0a6d4342d00049cc1c02e329cee74ba12d8631f52556dce8001c907bb63ae778 not found: ID does not exist" containerID="0a6d4342d00049cc1c02e329cee74ba12d8631f52556dce8001c907bb63ae778"
Jul 23 00:42:49.048181 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:49.048091    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a6d4342d00049cc1c02e329cee74ba12d8631f52556dce8001c907bb63ae778"} err="failed to get container status \"0a6d4342d00049cc1c02e329cee74ba12d8631f52556dce8001c907bb63ae778\": rpc error: code = NotFound desc = could not find container \"0a6d4342d00049cc1c02e329cee74ba12d8631f52556dce8001c907bb63ae778\": container with ID starting with 0a6d4342d00049cc1c02e329cee74ba12d8631f52556dce8001c907bb63ae778 not found: ID does not exist"
Jul 23 00:42:49.059320 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:49.059283    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"]
Jul 23 00:42:49.062652 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:49.062622    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-aef15edc-kserve-5c9dc6fb7f-zdqb8"]
Jul 23 00:42:49.365420 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:49.365322    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:42:50.130559 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:50.130528    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1958e754-9843-422f-b06c-097c15c425c2" path="/var/lib/kubelet/pods/1958e754-9843-422f-b06c-097c15c425c2/volumes"
Jul 23 00:42:50.130956 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:50.130905    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ce2d077-bca1-4ca5-9970-455bb7b1344d" path="/var/lib/kubelet/pods/5ce2d077-bca1-4ca5-9970-455bb7b1344d/volumes"
Jul 23 00:42:58.568075 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:42:58.568040    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:43:10.270760 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:43:10.266463    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:43:19.656002 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:43:19.655967    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:43:28.956591 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:43:28.956554    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:43:39.362292 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:43:39.362248    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:43:48.796229 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:43:48.796196    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:44:07.258631 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:44:07.258535    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:44:16.664106 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:44:16.664065    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:44:25.870651 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:44:25.870609    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:44:35.368572 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:44:35.368539    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:44:46.667544 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:44:46.667507    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:44:59.179333 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:44:59.179296    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:45:07.754724 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:45:07.754686    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:45:12.090178 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:45:12.090154    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhvxb_b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9/ovn-acl-logging/0.log"
Jul 23 00:45:12.091636 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:45:12.091614    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhvxb_b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9/ovn-acl-logging/0.log"
Jul 23 00:45:19.266651 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:45:19.266611    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:45:31.361956 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:45:31.361905    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:45:42.256373 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:45:42.256340    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:45:54.665538 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:45:54.665496    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:46:04.160075 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:46:04.160026    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:46:13.662949 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:46:13.661939    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:46:24.563818 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:46:24.563780    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:46:56.883008 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:46:56.882971    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:47:08.164831 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:47:08.164748    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:47:40.558719 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:47:40.558686    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:47:51.857973 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:47:51.857937    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:48:24.159365 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:48:24.159331    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:48:37.060284 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:48:37.060200    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:49:08.457449 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:49:08.457405    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:50:12.114159 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:50:12.114131    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhvxb_b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9/ovn-acl-logging/0.log"
Jul 23 00:50:12.116403 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:50:12.116379    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhvxb_b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9/ovn-acl-logging/0.log"
Jul 23 00:50:36.460732 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:50:36.460695    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:50:47.065901 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:50:47.065862    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:50:56.959560 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:50:56.959517    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:51:16.255200 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:16.255166    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:51:54.157980 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:54.157873    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:51:58.877865 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:58.877829    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"]
Jul 23 00:51:58.878307 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:58.878292    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1958e754-9843-422f-b06c-097c15c425c2" containerName="main"
Jul 23 00:51:58.878350 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:58.878311    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1958e754-9843-422f-b06c-097c15c425c2" containerName="main"
Jul 23 00:51:58.878388 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:58.878350    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ce2d077-bca1-4ca5-9970-455bb7b1344d" containerName="main"
Jul 23 00:51:58.878388 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:58.878358    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ce2d077-bca1-4ca5-9970-455bb7b1344d" containerName="main"
Jul 23 00:51:58.878449 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:58.878427    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ce2d077-bca1-4ca5-9970-455bb7b1344d" containerName="main"
Jul 23 00:51:58.878449 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:58.878439    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1958e754-9843-422f-b06c-097c15c425c2" containerName="main"
Jul 23 00:51:58.881623 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:58.881605    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"
Jul 23 00:51:58.884337 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:58.884312    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-3c46ebab\"/\"default-dockercfg-gqgxr\""
Jul 23 00:51:58.884566 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:58.884337    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-3c46ebab\"/\"kube-root-ca.crt\""
Jul 23 00:51:58.884566 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:58.884368    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-3c46ebab\"/\"openshift-service-ca.crt\""
Jul 23 00:51:58.884566 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:58.884315    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-3c46ebab\"/\"e2e-lifecycle-model-3c46ebab-kserve-self-signed-certs\""
Jul 23 00:51:58.889742 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:58.889503    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"]
Jul 23 00:51:58.997158 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:58.997120    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-model-cache\") pod \"e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk\" (UID: \"d4a5f7c2-5b2b-4020-a605-307ef4850ad6\") " pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"
Jul 23 00:51:58.997329 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:58.997192    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-home\") pod \"e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk\" (UID: \"d4a5f7c2-5b2b-4020-a605-307ef4850ad6\") " pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"
Jul 23 00:51:58.997329 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:58.997215    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-dshm\") pod \"e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk\" (UID: \"d4a5f7c2-5b2b-4020-a605-307ef4850ad6\") " pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"
Jul 23 00:51:58.997329 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:58.997269    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-tmp-dir\") pod \"e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk\" (UID: \"d4a5f7c2-5b2b-4020-a605-307ef4850ad6\") " pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"
Jul 23 00:51:58.997329 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:58.997300    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-tls-certs\") pod \"e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk\" (UID: \"d4a5f7c2-5b2b-4020-a605-307ef4850ad6\") " pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"
Jul 23 00:51:58.997329 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:58.997321    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48zr8\" (UniqueName: \"kubernetes.io/projected/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-kube-api-access-48zr8\") pod \"e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk\" (UID: \"d4a5f7c2-5b2b-4020-a605-307ef4850ad6\") " pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"
Jul 23 00:51:59.098076 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:59.098042    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-home\") pod \"e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk\" (UID: \"d4a5f7c2-5b2b-4020-a605-307ef4850ad6\") " pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"
Jul 23 00:51:59.098076 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:59.098077    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-dshm\") pod \"e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk\" (UID: \"d4a5f7c2-5b2b-4020-a605-307ef4850ad6\") " pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"
Jul 23 00:51:59.098297 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:59.098135    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-tmp-dir\") pod \"e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk\" (UID: \"d4a5f7c2-5b2b-4020-a605-307ef4850ad6\") " pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"
Jul 23 00:51:59.098297 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:59.098168    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-tls-certs\") pod \"e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk\" (UID: \"d4a5f7c2-5b2b-4020-a605-307ef4850ad6\") " pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"
Jul 23 00:51:59.098297 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:59.098197    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48zr8\" (UniqueName: \"kubernetes.io/projected/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-kube-api-access-48zr8\") pod \"e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk\" (UID: \"d4a5f7c2-5b2b-4020-a605-307ef4850ad6\") " pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"
Jul 23 00:51:59.098297 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:59.098264    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-model-cache\") pod \"e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk\" (UID: \"d4a5f7c2-5b2b-4020-a605-307ef4850ad6\") " pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"
Jul 23 00:51:59.098504 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:59.098484    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-home\") pod \"e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk\" (UID: \"d4a5f7c2-5b2b-4020-a605-307ef4850ad6\") " pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"
Jul 23 00:51:59.098560 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:59.098532    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-tmp-dir\") pod \"e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk\" (UID: \"d4a5f7c2-5b2b-4020-a605-307ef4850ad6\") " pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"
Jul 23 00:51:59.098615 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:59.098596    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-model-cache\") pod \"e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk\" (UID: \"d4a5f7c2-5b2b-4020-a605-307ef4850ad6\") " pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"
Jul 23 00:51:59.100479 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:59.100454    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-dshm\") pod \"e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk\" (UID: \"d4a5f7c2-5b2b-4020-a605-307ef4850ad6\") " pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"
Jul 23 00:51:59.100724 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:59.100708    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-tls-certs\") pod \"e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk\" (UID: \"d4a5f7c2-5b2b-4020-a605-307ef4850ad6\") " pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"
Jul 23 00:51:59.105543 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:59.105526    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48zr8\" (UniqueName: \"kubernetes.io/projected/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-kube-api-access-48zr8\") pod \"e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk\" (UID: \"d4a5f7c2-5b2b-4020-a605-307ef4850ad6\") " pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"
Jul 23 00:51:59.192053 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:59.192017    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"
Jul 23 00:51:59.324676 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:59.324559    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"]
Jul 23 00:51:59.329644 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:51:59.329615    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4a5f7c2_5b2b_4020_a605_307ef4850ad6.slice/crio-265a191ead7fd13f4404365ad926761ca7fa04e24a857111fe2b3e037f618e94 WatchSource:0}: Error finding container 265a191ead7fd13f4404365ad926761ca7fa04e24a857111fe2b3e037f618e94: Status 404 returned error can't find the container with id 265a191ead7fd13f4404365ad926761ca7fa04e24a857111fe2b3e037f618e94
Jul 23 00:51:59.449425 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:59.449347    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk" event={"ID":"d4a5f7c2-5b2b-4020-a605-307ef4850ad6","Type":"ContainerStarted","Data":"c44c2f499aed9a900cfeb298f0a6847ecd2115e94a53ed516620e2911c7e0892"}
Jul 23 00:51:59.449425 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:59.449392    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk" event={"ID":"d4a5f7c2-5b2b-4020-a605-307ef4850ad6","Type":"ContainerStarted","Data":"265a191ead7fd13f4404365ad926761ca7fa04e24a857111fe2b3e037f618e94"}
Jul 23 00:51:59.466288 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:51:59.466241    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk" podStartSLOduration=1.466225233 podStartE2EDuration="1.466225233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:51:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:51:59.464582324 +0000 UTC m=+1907.868378797" watchObservedRunningTime="2026-07-23 00:51:59.466225233 +0000 UTC m=+1907.870021688"
Jul 23 00:52:05.974773 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:52:05.974732    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:52:09.192857 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:52:09.192824    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"
Jul 23 00:52:09.193291 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:52:09.193105    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"
Jul 23 00:52:09.205434 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:52:09.205410    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"
Jul 23 00:52:09.504447 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:52:09.504376    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"
Jul 23 00:52:26.867931 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:52:26.867875    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:52:44.358125 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:52:44.358088    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:52:54.262944 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:52:54.259772    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:52:57.809544 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:52:57.809511    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"]
Jul 23 00:53:12.831366 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:12.831276    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk" podUID="d4a5f7c2-5b2b-4020-a605-307ef4850ad6" containerName="main" containerID="cri-o://c44c2f499aed9a900cfeb298f0a6847ecd2115e94a53ed516620e2911c7e0892" gracePeriod=45
Jul 23 00:53:13.084009 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:13.083953    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"
Jul 23 00:53:13.162455 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:13.162369    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48zr8\" (UniqueName: \"kubernetes.io/projected/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-kube-api-access-48zr8\") pod \"d4a5f7c2-5b2b-4020-a605-307ef4850ad6\" (UID: \"d4a5f7c2-5b2b-4020-a605-307ef4850ad6\") "
Jul 23 00:53:13.162613 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:13.162508    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-home\") pod \"d4a5f7c2-5b2b-4020-a605-307ef4850ad6\" (UID: \"d4a5f7c2-5b2b-4020-a605-307ef4850ad6\") "
Jul 23 00:53:13.162613 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:13.162527    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-dshm\") pod \"d4a5f7c2-5b2b-4020-a605-307ef4850ad6\" (UID: \"d4a5f7c2-5b2b-4020-a605-307ef4850ad6\") "
Jul 23 00:53:13.162613 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:13.162599    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-tls-certs\") pod \"d4a5f7c2-5b2b-4020-a605-307ef4850ad6\" (UID: \"d4a5f7c2-5b2b-4020-a605-307ef4850ad6\") "
Jul 23 00:53:13.162763 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:13.162645    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-tmp-dir\") pod \"d4a5f7c2-5b2b-4020-a605-307ef4850ad6\" (UID: \"d4a5f7c2-5b2b-4020-a605-307ef4850ad6\") "
Jul 23 00:53:13.162763 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:13.162678    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-model-cache\") pod \"d4a5f7c2-5b2b-4020-a605-307ef4850ad6\" (UID: \"d4a5f7c2-5b2b-4020-a605-307ef4850ad6\") "
Jul 23 00:53:13.162867 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:13.162785    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-home" (OuterVolumeSpecName: "home") pod "d4a5f7c2-5b2b-4020-a605-307ef4850ad6" (UID: "d4a5f7c2-5b2b-4020-a605-307ef4850ad6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:53:13.162975 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:13.162948    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d4a5f7c2-5b2b-4020-a605-307ef4850ad6" (UID: "d4a5f7c2-5b2b-4020-a605-307ef4850ad6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:53:13.163045 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:13.163020    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-home\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:53:13.163213 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:13.163183    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-model-cache" (OuterVolumeSpecName: "model-cache") pod "d4a5f7c2-5b2b-4020-a605-307ef4850ad6" (UID: "d4a5f7c2-5b2b-4020-a605-307ef4850ad6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:53:13.164586 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:13.164559    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-kube-api-access-48zr8" (OuterVolumeSpecName: "kube-api-access-48zr8") pod "d4a5f7c2-5b2b-4020-a605-307ef4850ad6" (UID: "d4a5f7c2-5b2b-4020-a605-307ef4850ad6"). InnerVolumeSpecName "kube-api-access-48zr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:53:13.164775 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:13.164757    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-dshm" (OuterVolumeSpecName: "dshm") pod "d4a5f7c2-5b2b-4020-a605-307ef4850ad6" (UID: "d4a5f7c2-5b2b-4020-a605-307ef4850ad6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:53:13.164816 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:13.164788    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d4a5f7c2-5b2b-4020-a605-307ef4850ad6" (UID: "d4a5f7c2-5b2b-4020-a605-307ef4850ad6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:53:13.264256 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:13.264210    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-tmp-dir\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:53:13.264256 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:13.264249    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-model-cache\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:53:13.264256 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:13.264262    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48zr8\" (UniqueName: \"kubernetes.io/projected/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-kube-api-access-48zr8\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:53:13.264492 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:13.264273    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-dshm\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:53:13.264492 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:13.264286    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4a5f7c2-5b2b-4020-a605-307ef4850ad6-tls-certs\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:53:13.778226 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:13.778191    2575 generic.go:356] "Generic (PLEG): container finished" podID="d4a5f7c2-5b2b-4020-a605-307ef4850ad6" containerID="c44c2f499aed9a900cfeb298f0a6847ecd2115e94a53ed516620e2911c7e0892" exitCode=0
Jul 23 00:53:13.778404 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:13.778241    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk" event={"ID":"d4a5f7c2-5b2b-4020-a605-307ef4850ad6","Type":"ContainerDied","Data":"c44c2f499aed9a900cfeb298f0a6847ecd2115e94a53ed516620e2911c7e0892"}
Jul 23 00:53:13.778404 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:13.778280    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk" event={"ID":"d4a5f7c2-5b2b-4020-a605-307ef4850ad6","Type":"ContainerDied","Data":"265a191ead7fd13f4404365ad926761ca7fa04e24a857111fe2b3e037f618e94"}
Jul 23 00:53:13.778404 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:13.778299    2575 scope.go:117] "RemoveContainer" containerID="c44c2f499aed9a900cfeb298f0a6847ecd2115e94a53ed516620e2911c7e0892"
Jul 23 00:53:13.778404 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:13.778248    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"
Jul 23 00:53:13.787988 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:13.787972    2575 scope.go:117] "RemoveContainer" containerID="c44c2f499aed9a900cfeb298f0a6847ecd2115e94a53ed516620e2911c7e0892"
Jul 23 00:53:13.788240 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:53:13.788210    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c44c2f499aed9a900cfeb298f0a6847ecd2115e94a53ed516620e2911c7e0892\": container with ID starting with c44c2f499aed9a900cfeb298f0a6847ecd2115e94a53ed516620e2911c7e0892 not found: ID does not exist" containerID="c44c2f499aed9a900cfeb298f0a6847ecd2115e94a53ed516620e2911c7e0892"
Jul 23 00:53:13.788331 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:13.788248    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c44c2f499aed9a900cfeb298f0a6847ecd2115e94a53ed516620e2911c7e0892"} err="failed to get container status \"c44c2f499aed9a900cfeb298f0a6847ecd2115e94a53ed516620e2911c7e0892\": rpc error: code = NotFound desc = could not find container \"c44c2f499aed9a900cfeb298f0a6847ecd2115e94a53ed516620e2911c7e0892\": container with ID starting with c44c2f499aed9a900cfeb298f0a6847ecd2115e94a53ed516620e2911c7e0892 not found: ID does not exist"
Jul 23 00:53:13.798984 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:13.798929    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"]
Jul 23 00:53:13.802764 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:13.802745    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-3c46ebab/e2e-lifecycle-model-3c46ebab-kserve-6469c74d75-w8rqk"]
Jul 23 00:53:14.127869 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:14.127788    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4a5f7c2-5b2b-4020-a605-307ef4850ad6" path="/var/lib/kubelet/pods/d4a5f7c2-5b2b-4020-a605-307ef4850ad6/volumes"
Jul 23 00:53:44.662439 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:44.662403    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:53:54.468423 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:53:54.468383    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:54:43.756717 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:54:43.756634    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:55:00.571339 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:00.571296    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:55:12.146518 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:12.146491    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhvxb_b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9/ovn-acl-logging/0.log"
Jul 23 00:55:12.148436 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:12.148407    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhvxb_b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9/ovn-acl-logging/0.log"
Jul 23 00:55:15.862998 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:15.862966    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"]
Jul 23 00:55:15.863480 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:15.863464    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4a5f7c2-5b2b-4020-a605-307ef4850ad6" containerName="main"
Jul 23 00:55:15.863550 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:15.863484    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4a5f7c2-5b2b-4020-a605-307ef4850ad6" containerName="main"
Jul 23 00:55:15.863603 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:15.863569    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4a5f7c2-5b2b-4020-a605-307ef4850ad6" containerName="main"
Jul 23 00:55:15.866500 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:15.866479    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"
Jul 23 00:55:15.868230 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:15.868206    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-551ea4\"/\"kube-root-ca.crt\""
Jul 23 00:55:15.868704 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:15.868688    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-551ea4\"/\"default-dockercfg-ctcdk\""
Jul 23 00:55:15.868788 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:15.868708    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-551ea4\"/\"openshift-service-ca.crt\""
Jul 23 00:55:15.869006 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:15.868791    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-551ea4\"/\"test-model-551ea4-kserve-self-signed-certs\""
Jul 23 00:55:15.875555 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:15.875533    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"]
Jul 23 00:55:15.962620 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:15.962588    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-tmp-dir\") pod \"test-model-551ea4-kserve-b45d4bc6c-msgfv\" (UID: \"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76\") " pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"
Jul 23 00:55:15.962793 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:15.962627    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-model-cache\") pod \"test-model-551ea4-kserve-b45d4bc6c-msgfv\" (UID: \"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76\") " pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"
Jul 23 00:55:15.962793 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:15.962650    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4btz\" (UniqueName: \"kubernetes.io/projected/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-kube-api-access-t4btz\") pod \"test-model-551ea4-kserve-b45d4bc6c-msgfv\" (UID: \"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76\") " pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"
Jul 23 00:55:15.962793 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:15.962741    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-home\") pod \"test-model-551ea4-kserve-b45d4bc6c-msgfv\" (UID: \"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76\") " pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"
Jul 23 00:55:15.962793 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:15.962779    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-tls-certs\") pod \"test-model-551ea4-kserve-b45d4bc6c-msgfv\" (UID: \"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76\") " pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"
Jul 23 00:55:15.962980 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:15.962824    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-dshm\") pod \"test-model-551ea4-kserve-b45d4bc6c-msgfv\" (UID: \"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76\") " pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"
Jul 23 00:55:16.063618 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:16.063590    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-home\") pod \"test-model-551ea4-kserve-b45d4bc6c-msgfv\" (UID: \"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76\") " pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"
Jul 23 00:55:16.063618 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:16.063625    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-tls-certs\") pod \"test-model-551ea4-kserve-b45d4bc6c-msgfv\" (UID: \"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76\") " pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"
Jul 23 00:55:16.063861 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:16.063659    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-dshm\") pod \"test-model-551ea4-kserve-b45d4bc6c-msgfv\" (UID: \"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76\") " pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"
Jul 23 00:55:16.063861 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:16.063686    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-tmp-dir\") pod \"test-model-551ea4-kserve-b45d4bc6c-msgfv\" (UID: \"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76\") " pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"
Jul 23 00:55:16.063861 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:16.063709    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-model-cache\") pod \"test-model-551ea4-kserve-b45d4bc6c-msgfv\" (UID: \"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76\") " pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"
Jul 23 00:55:16.063861 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:16.063728    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4btz\" (UniqueName: \"kubernetes.io/projected/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-kube-api-access-t4btz\") pod \"test-model-551ea4-kserve-b45d4bc6c-msgfv\" (UID: \"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76\") " pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"
Jul 23 00:55:16.064112 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:16.064085    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-tmp-dir\") pod \"test-model-551ea4-kserve-b45d4bc6c-msgfv\" (UID: \"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76\") " pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"
Jul 23 00:55:16.064183 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:16.064166    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-model-cache\") pod \"test-model-551ea4-kserve-b45d4bc6c-msgfv\" (UID: \"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76\") " pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"
Jul 23 00:55:16.064297 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:16.064277    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-home\") pod \"test-model-551ea4-kserve-b45d4bc6c-msgfv\" (UID: \"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76\") " pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"
Jul 23 00:55:16.065876 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:16.065860    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-dshm\") pod \"test-model-551ea4-kserve-b45d4bc6c-msgfv\" (UID: \"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76\") " pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"
Jul 23 00:55:16.066547 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:16.066527    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-tls-certs\") pod \"test-model-551ea4-kserve-b45d4bc6c-msgfv\" (UID: \"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76\") " pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"
Jul 23 00:55:16.071246 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:16.071224    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4btz\" (UniqueName: \"kubernetes.io/projected/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-kube-api-access-t4btz\") pod \"test-model-551ea4-kserve-b45d4bc6c-msgfv\" (UID: \"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76\") " pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"
Jul 23 00:55:16.177199 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:16.177173    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"
Jul 23 00:55:16.307960 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:16.307848    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"]
Jul 23 00:55:16.310680 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:55:16.310654    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79cc0100_ffdf_4bf6_8e43_fe67cddb5d76.slice/crio-b7e150e40227355a5347d0cedd7d4252f7cb0f380007d827f881551c3fe0835d WatchSource:0}: Error finding container b7e150e40227355a5347d0cedd7d4252f7cb0f380007d827f881551c3fe0835d: Status 404 returned error can't find the container with id b7e150e40227355a5347d0cedd7d4252f7cb0f380007d827f881551c3fe0835d
Jul 23 00:55:17.308970 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:17.308903    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv" event={"ID":"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76","Type":"ContainerStarted","Data":"15ed01e72d155f9d7a9daead4b89051bf1628fb5c291b8fd1f99b7ded14fd5ba"}
Jul 23 00:55:17.309400 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:17.308980    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv" event={"ID":"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76","Type":"ContainerStarted","Data":"b7e150e40227355a5347d0cedd7d4252f7cb0f380007d827f881551c3fe0835d"}
Jul 23 00:55:17.325513 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:17.325459    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv" podStartSLOduration=2.32544235 podStartE2EDuration="2.32544235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:55:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:55:17.324290791 +0000 UTC m=+2105.728087243" watchObservedRunningTime="2026-07-23 00:55:17.32544235 +0000 UTC m=+2105.729238807"
Jul 23 00:55:19.362754 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:19.362721    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:55:26.177649 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:26.177605    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"
Jul 23 00:55:26.178106 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:26.177667    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"
Jul 23 00:55:26.190315 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:26.190293    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"
Jul 23 00:55:26.364030 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:26.364000    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"
Jul 23 00:55:30.655975 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:30.655932    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:55:44.070251 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:44.070214    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"]
Jul 23 00:55:44.073533 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:44.073509    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"
Jul 23 00:55:44.075720 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:44.075698    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-fb82e4\"/\"openshift-service-ca.crt\""
Jul 23 00:55:44.076256 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:44.076238    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-fb82e4\"/\"kube-root-ca.crt\""
Jul 23 00:55:44.076309 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:44.076245    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-fb82e4\"/\"default-dockercfg-zrs4m\""
Jul 23 00:55:44.076309 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:44.076286    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-fb82e4\"/\"test-model-fb82e4-kserve-self-signed-certs\""
Jul 23 00:55:44.085340 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:44.085314    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"]
Jul 23 00:55:44.218990 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:44.218954    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbad8736-be45-4636-8a68-76d4a3fd7f72-dshm\") pod \"test-model-fb82e4-kserve-7fdb9dc6c5-jvqql\" (UID: \"bbad8736-be45-4636-8a68-76d4a3fd7f72\") " pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"
Jul 23 00:55:44.218990 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:44.218993    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbad8736-be45-4636-8a68-76d4a3fd7f72-home\") pod \"test-model-fb82e4-kserve-7fdb9dc6c5-jvqql\" (UID: \"bbad8736-be45-4636-8a68-76d4a3fd7f72\") " pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"
Jul 23 00:55:44.219258 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:44.219009    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbx9d\" (UniqueName: \"kubernetes.io/projected/bbad8736-be45-4636-8a68-76d4a3fd7f72-kube-api-access-sbx9d\") pod \"test-model-fb82e4-kserve-7fdb9dc6c5-jvqql\" (UID: \"bbad8736-be45-4636-8a68-76d4a3fd7f72\") " pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"
Jul 23 00:55:44.219258 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:44.219092    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbad8736-be45-4636-8a68-76d4a3fd7f72-model-cache\") pod \"test-model-fb82e4-kserve-7fdb9dc6c5-jvqql\" (UID: \"bbad8736-be45-4636-8a68-76d4a3fd7f72\") " pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"
Jul 23 00:55:44.219258 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:44.219172    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbad8736-be45-4636-8a68-76d4a3fd7f72-tls-certs\") pod \"test-model-fb82e4-kserve-7fdb9dc6c5-jvqql\" (UID: \"bbad8736-be45-4636-8a68-76d4a3fd7f72\") " pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"
Jul 23 00:55:44.219258 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:44.219240    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbad8736-be45-4636-8a68-76d4a3fd7f72-tmp-dir\") pod \"test-model-fb82e4-kserve-7fdb9dc6c5-jvqql\" (UID: \"bbad8736-be45-4636-8a68-76d4a3fd7f72\") " pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"
Jul 23 00:55:44.320030 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:44.319989    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbad8736-be45-4636-8a68-76d4a3fd7f72-model-cache\") pod \"test-model-fb82e4-kserve-7fdb9dc6c5-jvqql\" (UID: \"bbad8736-be45-4636-8a68-76d4a3fd7f72\") " pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"
Jul 23 00:55:44.320237 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:44.320074    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbad8736-be45-4636-8a68-76d4a3fd7f72-tls-certs\") pod \"test-model-fb82e4-kserve-7fdb9dc6c5-jvqql\" (UID: \"bbad8736-be45-4636-8a68-76d4a3fd7f72\") " pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"
Jul 23 00:55:44.320237 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:44.320137    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbad8736-be45-4636-8a68-76d4a3fd7f72-tmp-dir\") pod \"test-model-fb82e4-kserve-7fdb9dc6c5-jvqql\" (UID: \"bbad8736-be45-4636-8a68-76d4a3fd7f72\") " pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"
Jul 23 00:55:44.320237 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:44.320177    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbad8736-be45-4636-8a68-76d4a3fd7f72-dshm\") pod \"test-model-fb82e4-kserve-7fdb9dc6c5-jvqql\" (UID: \"bbad8736-be45-4636-8a68-76d4a3fd7f72\") " pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"
Jul 23 00:55:44.320237 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:44.320201    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbad8736-be45-4636-8a68-76d4a3fd7f72-home\") pod \"test-model-fb82e4-kserve-7fdb9dc6c5-jvqql\" (UID: \"bbad8736-be45-4636-8a68-76d4a3fd7f72\") " pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"
Jul 23 00:55:44.320488 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:44.320271    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbx9d\" (UniqueName: \"kubernetes.io/projected/bbad8736-be45-4636-8a68-76d4a3fd7f72-kube-api-access-sbx9d\") pod \"test-model-fb82e4-kserve-7fdb9dc6c5-jvqql\" (UID: \"bbad8736-be45-4636-8a68-76d4a3fd7f72\") " pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"
Jul 23 00:55:44.320488 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:44.320425    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbad8736-be45-4636-8a68-76d4a3fd7f72-model-cache\") pod \"test-model-fb82e4-kserve-7fdb9dc6c5-jvqql\" (UID: \"bbad8736-be45-4636-8a68-76d4a3fd7f72\") " pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"
Jul 23 00:55:44.320610 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:44.320517    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbad8736-be45-4636-8a68-76d4a3fd7f72-tmp-dir\") pod \"test-model-fb82e4-kserve-7fdb9dc6c5-jvqql\" (UID: \"bbad8736-be45-4636-8a68-76d4a3fd7f72\") " pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"
Jul 23 00:55:44.320610 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:44.320572    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbad8736-be45-4636-8a68-76d4a3fd7f72-home\") pod \"test-model-fb82e4-kserve-7fdb9dc6c5-jvqql\" (UID: \"bbad8736-be45-4636-8a68-76d4a3fd7f72\") " pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"
Jul 23 00:55:44.322668 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:44.322644    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbad8736-be45-4636-8a68-76d4a3fd7f72-dshm\") pod \"test-model-fb82e4-kserve-7fdb9dc6c5-jvqql\" (UID: \"bbad8736-be45-4636-8a68-76d4a3fd7f72\") " pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"
Jul 23 00:55:44.322825 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:44.322809    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbad8736-be45-4636-8a68-76d4a3fd7f72-tls-certs\") pod \"test-model-fb82e4-kserve-7fdb9dc6c5-jvqql\" (UID: \"bbad8736-be45-4636-8a68-76d4a3fd7f72\") " pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"
Jul 23 00:55:44.327733 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:44.327706    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbx9d\" (UniqueName: \"kubernetes.io/projected/bbad8736-be45-4636-8a68-76d4a3fd7f72-kube-api-access-sbx9d\") pod \"test-model-fb82e4-kserve-7fdb9dc6c5-jvqql\" (UID: \"bbad8736-be45-4636-8a68-76d4a3fd7f72\") " pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"
Jul 23 00:55:44.385119 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:44.385070    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"
Jul 23 00:55:44.522729 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:44.522703    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"]
Jul 23 00:55:44.525429 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:55:44.525402    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbad8736_be45_4636_8a68_76d4a3fd7f72.slice/crio-71f2e413f3489e131f28c950d872397670ec2a320a2e6a45836a951ca224d0b2 WatchSource:0}: Error finding container 71f2e413f3489e131f28c950d872397670ec2a320a2e6a45836a951ca224d0b2: Status 404 returned error can't find the container with id 71f2e413f3489e131f28c950d872397670ec2a320a2e6a45836a951ca224d0b2
Jul 23 00:55:45.436667 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:45.436630    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql" event={"ID":"bbad8736-be45-4636-8a68-76d4a3fd7f72","Type":"ContainerStarted","Data":"f0ae6a7b36a55f527fe7f4024eeb149d063469b2c1c6856d8d8187eed05b7bee"}
Jul 23 00:55:45.437090 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:45.436679    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql" event={"ID":"bbad8736-be45-4636-8a68-76d4a3fd7f72","Type":"ContainerStarted","Data":"71f2e413f3489e131f28c950d872397670ec2a320a2e6a45836a951ca224d0b2"}
Jul 23 00:55:45.453006 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:45.452955    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql" podStartSLOduration=1.452938142 podStartE2EDuration="1.452938142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:55:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:55:45.450873724 +0000 UTC m=+2133.854670205" watchObservedRunningTime="2026-07-23 00:55:45.452938142 +0000 UTC m=+2133.856734598"
Jul 23 00:55:49.759466 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:49.759432    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:55:54.385487 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:54.385448    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"
Jul 23 00:55:54.385941 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:54.385500    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"
Jul 23 00:55:54.398243 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:54.398222    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"
Jul 23 00:55:54.485065 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:55:54.485032    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"
Jul 23 00:56:23.165039 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:23.164959    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"]
Jul 23 00:56:24.187847 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:24.187813    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"]
Jul 23 00:56:27.663977 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:27.663939    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:56:38.185839 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:38.185777    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv" podUID="79cc0100-ffdf-4bf6-8e43-fe67cddb5d76" containerName="main" containerID="cri-o://15ed01e72d155f9d7a9daead4b89051bf1628fb5c291b8fd1f99b7ded14fd5ba" gracePeriod=45
Jul 23 00:56:38.455942 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:38.455899    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"
Jul 23 00:56:38.504720 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:38.504687    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-dshm\") pod \"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76\" (UID: \"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76\") "
Jul 23 00:56:38.504941 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:38.504739    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4btz\" (UniqueName: \"kubernetes.io/projected/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-kube-api-access-t4btz\") pod \"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76\" (UID: \"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76\") "
Jul 23 00:56:38.504941 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:38.504773    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-tls-certs\") pod \"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76\" (UID: \"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76\") "
Jul 23 00:56:38.504941 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:38.504802    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-tmp-dir\") pod \"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76\" (UID: \"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76\") "
Jul 23 00:56:38.504941 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:38.504858    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-home\") pod \"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76\" (UID: \"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76\") "
Jul 23 00:56:38.504941 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:38.504885    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-model-cache\") pod \"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76\" (UID: \"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76\") "
Jul 23 00:56:38.505191 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:38.505125    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-home" (OuterVolumeSpecName: "home") pod "79cc0100-ffdf-4bf6-8e43-fe67cddb5d76" (UID: "79cc0100-ffdf-4bf6-8e43-fe67cddb5d76"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:56:38.505191 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:38.505159    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "79cc0100-ffdf-4bf6-8e43-fe67cddb5d76" (UID: "79cc0100-ffdf-4bf6-8e43-fe67cddb5d76"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:56:38.505191 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:38.505150    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-model-cache" (OuterVolumeSpecName: "model-cache") pod "79cc0100-ffdf-4bf6-8e43-fe67cddb5d76" (UID: "79cc0100-ffdf-4bf6-8e43-fe67cddb5d76"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:56:38.507204 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:38.507180    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "79cc0100-ffdf-4bf6-8e43-fe67cddb5d76" (UID: "79cc0100-ffdf-4bf6-8e43-fe67cddb5d76"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:56:38.507415 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:38.507394    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-dshm" (OuterVolumeSpecName: "dshm") pod "79cc0100-ffdf-4bf6-8e43-fe67cddb5d76" (UID: "79cc0100-ffdf-4bf6-8e43-fe67cddb5d76"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:56:38.507494 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:38.507437    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-kube-api-access-t4btz" (OuterVolumeSpecName: "kube-api-access-t4btz") pod "79cc0100-ffdf-4bf6-8e43-fe67cddb5d76" (UID: "79cc0100-ffdf-4bf6-8e43-fe67cddb5d76"). InnerVolumeSpecName "kube-api-access-t4btz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:56:38.611238 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:38.606769    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-tls-certs\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:56:38.611238 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:38.606804    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-tmp-dir\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:56:38.611238 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:38.606827    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-home\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:56:38.611238 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:38.606843    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-model-cache\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:56:38.611238 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:38.606855    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-dshm\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:56:38.611238 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:38.606869    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4btz\" (UniqueName: \"kubernetes.io/projected/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76-kube-api-access-t4btz\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:56:38.674332 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:38.674297    2575 generic.go:356] "Generic (PLEG): container finished" podID="79cc0100-ffdf-4bf6-8e43-fe67cddb5d76" containerID="15ed01e72d155f9d7a9daead4b89051bf1628fb5c291b8fd1f99b7ded14fd5ba" exitCode=0
Jul 23 00:56:38.674517 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:38.674348    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"
Jul 23 00:56:38.674517 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:38.674381    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv" event={"ID":"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76","Type":"ContainerDied","Data":"15ed01e72d155f9d7a9daead4b89051bf1628fb5c291b8fd1f99b7ded14fd5ba"}
Jul 23 00:56:38.674517 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:38.674435    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv" event={"ID":"79cc0100-ffdf-4bf6-8e43-fe67cddb5d76","Type":"ContainerDied","Data":"b7e150e40227355a5347d0cedd7d4252f7cb0f380007d827f881551c3fe0835d"}
Jul 23 00:56:38.674517 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:38.674457    2575 scope.go:117] "RemoveContainer" containerID="15ed01e72d155f9d7a9daead4b89051bf1628fb5c291b8fd1f99b7ded14fd5ba"
Jul 23 00:56:38.683269 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:38.683252    2575 scope.go:117] "RemoveContainer" containerID="15ed01e72d155f9d7a9daead4b89051bf1628fb5c291b8fd1f99b7ded14fd5ba"
Jul 23 00:56:38.683508 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:56:38.683487    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15ed01e72d155f9d7a9daead4b89051bf1628fb5c291b8fd1f99b7ded14fd5ba\": container with ID starting with 15ed01e72d155f9d7a9daead4b89051bf1628fb5c291b8fd1f99b7ded14fd5ba not found: ID does not exist" containerID="15ed01e72d155f9d7a9daead4b89051bf1628fb5c291b8fd1f99b7ded14fd5ba"
Jul 23 00:56:38.683570 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:38.683520    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15ed01e72d155f9d7a9daead4b89051bf1628fb5c291b8fd1f99b7ded14fd5ba"} err="failed to get container status \"15ed01e72d155f9d7a9daead4b89051bf1628fb5c291b8fd1f99b7ded14fd5ba\": rpc error: code = NotFound desc = could not find container \"15ed01e72d155f9d7a9daead4b89051bf1628fb5c291b8fd1f99b7ded14fd5ba\": container with ID starting with 15ed01e72d155f9d7a9daead4b89051bf1628fb5c291b8fd1f99b7ded14fd5ba not found: ID does not exist"
Jul 23 00:56:38.693922 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:38.693854    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"]
Jul 23 00:56:38.697378 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:38.697358    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-551ea4/test-model-551ea4-kserve-b45d4bc6c-msgfv"]
Jul 23 00:56:39.208072 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:39.208032    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql" podUID="bbad8736-be45-4636-8a68-76d4a3fd7f72" containerName="main" containerID="cri-o://f0ae6a7b36a55f527fe7f4024eeb149d063469b2c1c6856d8d8187eed05b7bee" gracePeriod=45
Jul 23 00:56:39.461061 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:39.461001    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"
Jul 23 00:56:39.513319 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:39.513292    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbad8736-be45-4636-8a68-76d4a3fd7f72-dshm\") pod \"bbad8736-be45-4636-8a68-76d4a3fd7f72\" (UID: \"bbad8736-be45-4636-8a68-76d4a3fd7f72\") "
Jul 23 00:56:39.513498 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:39.513337    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbad8736-be45-4636-8a68-76d4a3fd7f72-home\") pod \"bbad8736-be45-4636-8a68-76d4a3fd7f72\" (UID: \"bbad8736-be45-4636-8a68-76d4a3fd7f72\") "
Jul 23 00:56:39.513498 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:39.513356    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbad8736-be45-4636-8a68-76d4a3fd7f72-tls-certs\") pod \"bbad8736-be45-4636-8a68-76d4a3fd7f72\" (UID: \"bbad8736-be45-4636-8a68-76d4a3fd7f72\") "
Jul 23 00:56:39.513498 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:39.513382    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbad8736-be45-4636-8a68-76d4a3fd7f72-model-cache\") pod \"bbad8736-be45-4636-8a68-76d4a3fd7f72\" (UID: \"bbad8736-be45-4636-8a68-76d4a3fd7f72\") "
Jul 23 00:56:39.513498 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:39.513421    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbad8736-be45-4636-8a68-76d4a3fd7f72-tmp-dir\") pod \"bbad8736-be45-4636-8a68-76d4a3fd7f72\" (UID: \"bbad8736-be45-4636-8a68-76d4a3fd7f72\") "
Jul 23 00:56:39.513498 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:39.513441    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbx9d\" (UniqueName: \"kubernetes.io/projected/bbad8736-be45-4636-8a68-76d4a3fd7f72-kube-api-access-sbx9d\") pod \"bbad8736-be45-4636-8a68-76d4a3fd7f72\" (UID: \"bbad8736-be45-4636-8a68-76d4a3fd7f72\") "
Jul 23 00:56:39.513749 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:39.513603    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbad8736-be45-4636-8a68-76d4a3fd7f72-model-cache" (OuterVolumeSpecName: "model-cache") pod "bbad8736-be45-4636-8a68-76d4a3fd7f72" (UID: "bbad8736-be45-4636-8a68-76d4a3fd7f72"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:56:39.513749 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:39.513616    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbad8736-be45-4636-8a68-76d4a3fd7f72-home" (OuterVolumeSpecName: "home") pod "bbad8736-be45-4636-8a68-76d4a3fd7f72" (UID: "bbad8736-be45-4636-8a68-76d4a3fd7f72"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:56:39.513749 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:39.513703    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbad8736-be45-4636-8a68-76d4a3fd7f72-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bbad8736-be45-4636-8a68-76d4a3fd7f72" (UID: "bbad8736-be45-4636-8a68-76d4a3fd7f72"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:56:39.515666 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:39.515646    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbad8736-be45-4636-8a68-76d4a3fd7f72-dshm" (OuterVolumeSpecName: "dshm") pod "bbad8736-be45-4636-8a68-76d4a3fd7f72" (UID: "bbad8736-be45-4636-8a68-76d4a3fd7f72"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:56:39.515737 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:39.515666    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbad8736-be45-4636-8a68-76d4a3fd7f72-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bbad8736-be45-4636-8a68-76d4a3fd7f72" (UID: "bbad8736-be45-4636-8a68-76d4a3fd7f72"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:56:39.515775 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:39.515742    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbad8736-be45-4636-8a68-76d4a3fd7f72-kube-api-access-sbx9d" (OuterVolumeSpecName: "kube-api-access-sbx9d") pod "bbad8736-be45-4636-8a68-76d4a3fd7f72" (UID: "bbad8736-be45-4636-8a68-76d4a3fd7f72"). InnerVolumeSpecName "kube-api-access-sbx9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:56:39.614281 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:39.614232    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbad8736-be45-4636-8a68-76d4a3fd7f72-dshm\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:56:39.614281 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:39.614274    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbad8736-be45-4636-8a68-76d4a3fd7f72-home\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:56:39.614281 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:39.614288    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbad8736-be45-4636-8a68-76d4a3fd7f72-tls-certs\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:56:39.614506 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:39.614301    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbad8736-be45-4636-8a68-76d4a3fd7f72-model-cache\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:56:39.614506 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:39.614312    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbad8736-be45-4636-8a68-76d4a3fd7f72-tmp-dir\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:56:39.614506 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:39.614322    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbx9d\" (UniqueName: \"kubernetes.io/projected/bbad8736-be45-4636-8a68-76d4a3fd7f72-kube-api-access-sbx9d\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 00:56:39.679700 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:39.679666    2575 generic.go:356] "Generic (PLEG): container finished" podID="bbad8736-be45-4636-8a68-76d4a3fd7f72" containerID="f0ae6a7b36a55f527fe7f4024eeb149d063469b2c1c6856d8d8187eed05b7bee" exitCode=0
Jul 23 00:56:39.679867 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:39.679713    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"
Jul 23 00:56:39.679867 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:39.679756    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql" event={"ID":"bbad8736-be45-4636-8a68-76d4a3fd7f72","Type":"ContainerDied","Data":"f0ae6a7b36a55f527fe7f4024eeb149d063469b2c1c6856d8d8187eed05b7bee"}
Jul 23 00:56:39.679867 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:39.679804    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql" event={"ID":"bbad8736-be45-4636-8a68-76d4a3fd7f72","Type":"ContainerDied","Data":"71f2e413f3489e131f28c950d872397670ec2a320a2e6a45836a951ca224d0b2"}
Jul 23 00:56:39.679867 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:39.679826    2575 scope.go:117] "RemoveContainer" containerID="f0ae6a7b36a55f527fe7f4024eeb149d063469b2c1c6856d8d8187eed05b7bee"
Jul 23 00:56:39.688745 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:39.688727    2575 scope.go:117] "RemoveContainer" containerID="f0ae6a7b36a55f527fe7f4024eeb149d063469b2c1c6856d8d8187eed05b7bee"
Jul 23 00:56:39.689047 ip-10-0-141-176 kubenswrapper[2575]: E0723 00:56:39.689025    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0ae6a7b36a55f527fe7f4024eeb149d063469b2c1c6856d8d8187eed05b7bee\": container with ID starting with f0ae6a7b36a55f527fe7f4024eeb149d063469b2c1c6856d8d8187eed05b7bee not found: ID does not exist" containerID="f0ae6a7b36a55f527fe7f4024eeb149d063469b2c1c6856d8d8187eed05b7bee"
Jul 23 00:56:39.689137 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:39.689052    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0ae6a7b36a55f527fe7f4024eeb149d063469b2c1c6856d8d8187eed05b7bee"} err="failed to get container status \"f0ae6a7b36a55f527fe7f4024eeb149d063469b2c1c6856d8d8187eed05b7bee\": rpc error: code = NotFound desc = could not find container \"f0ae6a7b36a55f527fe7f4024eeb149d063469b2c1c6856d8d8187eed05b7bee\": container with ID starting with f0ae6a7b36a55f527fe7f4024eeb149d063469b2c1c6856d8d8187eed05b7bee not found: ID does not exist"
Jul 23 00:56:39.701102 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:39.701082    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"]
Jul 23 00:56:39.706843 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:39.706822    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-fb82e4/test-model-fb82e4-kserve-7fdb9dc6c5-jvqql"]
Jul 23 00:56:40.128737 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:40.128704    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79cc0100-ffdf-4bf6-8e43-fe67cddb5d76" path="/var/lib/kubelet/pods/79cc0100-ffdf-4bf6-8e43-fe67cddb5d76/volumes"
Jul 23 00:56:40.129129 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:40.129115    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbad8736-be45-4636-8a68-76d4a3fd7f72" path="/var/lib/kubelet/pods/bbad8736-be45-4636-8a68-76d4a3fd7f72/volumes"
Jul 23 00:56:40.359097 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:40.359060    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:56:59.959625 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:56:59.959584    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:57:15.356547 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:57:15.356514    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:57:34.662122 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:57:34.662037    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:57:52.459321 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:57:52.459278    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:58:19.561090 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:58:19.561049    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:58:38.157257 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:58:38.157222    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:58:52.655666 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:58:52.655630    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:58:59.765154 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:58:59.765115    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"]
Jul 23 00:58:59.765523 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:58:59.765419    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbad8736-be45-4636-8a68-76d4a3fd7f72" containerName="main"
Jul 23 00:58:59.765523 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:58:59.765429    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbad8736-be45-4636-8a68-76d4a3fd7f72" containerName="main"
Jul 23 00:58:59.765523 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:58:59.765451    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79cc0100-ffdf-4bf6-8e43-fe67cddb5d76" containerName="main"
Jul 23 00:58:59.765523 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:58:59.765457    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="79cc0100-ffdf-4bf6-8e43-fe67cddb5d76" containerName="main"
Jul 23 00:58:59.765523 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:58:59.765506    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="79cc0100-ffdf-4bf6-8e43-fe67cddb5d76" containerName="main"
Jul 23 00:58:59.765523 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:58:59.765514    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbad8736-be45-4636-8a68-76d4a3fd7f72" containerName="main"
Jul 23 00:58:59.768680 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:58:59.768657    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"
Jul 23 00:58:59.771107 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:58:59.771082    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-b90c57\"/\"kube-root-ca.crt\""
Jul 23 00:58:59.771729 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:58:59.771685    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-b90c57\"/\"default-dockercfg-5tkvb\""
Jul 23 00:58:59.771851 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:58:59.771734    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-b90c57\"/\"openshift-service-ca.crt\""
Jul 23 00:58:59.772007 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:58:59.771984    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-b90c57\"/\"auth-test-model-b90c57-kserve-self-signed-certs\""
Jul 23 00:58:59.778942 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:58:59.778894    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"]
Jul 23 00:58:59.918654 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:58:59.918616    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8e7fe1d-da49-454a-9c01-66324f89f6ef-tmp-dir\") pod \"auth-test-model-b90c57-kserve-744dcd486c-gk2rb\" (UID: \"f8e7fe1d-da49-454a-9c01-66324f89f6ef\") " pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"
Jul 23 00:58:59.918833 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:58:59.918699    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ttxt\" (UniqueName: \"kubernetes.io/projected/f8e7fe1d-da49-454a-9c01-66324f89f6ef-kube-api-access-9ttxt\") pod \"auth-test-model-b90c57-kserve-744dcd486c-gk2rb\" (UID: \"f8e7fe1d-da49-454a-9c01-66324f89f6ef\") " pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"
Jul 23 00:58:59.918833 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:58:59.918727    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8e7fe1d-da49-454a-9c01-66324f89f6ef-dshm\") pod \"auth-test-model-b90c57-kserve-744dcd486c-gk2rb\" (UID: \"f8e7fe1d-da49-454a-9c01-66324f89f6ef\") " pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"
Jul 23 00:58:59.918833 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:58:59.918754    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8e7fe1d-da49-454a-9c01-66324f89f6ef-model-cache\") pod \"auth-test-model-b90c57-kserve-744dcd486c-gk2rb\" (UID: \"f8e7fe1d-da49-454a-9c01-66324f89f6ef\") " pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"
Jul 23 00:58:59.918833 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:58:59.918796    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8e7fe1d-da49-454a-9c01-66324f89f6ef-tls-certs\") pod \"auth-test-model-b90c57-kserve-744dcd486c-gk2rb\" (UID: \"f8e7fe1d-da49-454a-9c01-66324f89f6ef\") " pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"
Jul 23 00:58:59.919025 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:58:59.918835    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8e7fe1d-da49-454a-9c01-66324f89f6ef-home\") pod \"auth-test-model-b90c57-kserve-744dcd486c-gk2rb\" (UID: \"f8e7fe1d-da49-454a-9c01-66324f89f6ef\") " pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"
Jul 23 00:59:00.020017 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:00.019929    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8e7fe1d-da49-454a-9c01-66324f89f6ef-home\") pod \"auth-test-model-b90c57-kserve-744dcd486c-gk2rb\" (UID: \"f8e7fe1d-da49-454a-9c01-66324f89f6ef\") " pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"
Jul 23 00:59:00.020017 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:00.019974    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8e7fe1d-da49-454a-9c01-66324f89f6ef-tmp-dir\") pod \"auth-test-model-b90c57-kserve-744dcd486c-gk2rb\" (UID: \"f8e7fe1d-da49-454a-9c01-66324f89f6ef\") " pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"
Jul 23 00:59:00.020258 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:00.020023    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ttxt\" (UniqueName: \"kubernetes.io/projected/f8e7fe1d-da49-454a-9c01-66324f89f6ef-kube-api-access-9ttxt\") pod \"auth-test-model-b90c57-kserve-744dcd486c-gk2rb\" (UID: \"f8e7fe1d-da49-454a-9c01-66324f89f6ef\") " pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"
Jul 23 00:59:00.020258 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:00.020051    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8e7fe1d-da49-454a-9c01-66324f89f6ef-dshm\") pod \"auth-test-model-b90c57-kserve-744dcd486c-gk2rb\" (UID: \"f8e7fe1d-da49-454a-9c01-66324f89f6ef\") " pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"
Jul 23 00:59:00.020258 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:00.020075    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8e7fe1d-da49-454a-9c01-66324f89f6ef-model-cache\") pod \"auth-test-model-b90c57-kserve-744dcd486c-gk2rb\" (UID: \"f8e7fe1d-da49-454a-9c01-66324f89f6ef\") " pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"
Jul 23 00:59:00.020258 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:00.020104    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8e7fe1d-da49-454a-9c01-66324f89f6ef-tls-certs\") pod \"auth-test-model-b90c57-kserve-744dcd486c-gk2rb\" (UID: \"f8e7fe1d-da49-454a-9c01-66324f89f6ef\") " pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"
Jul 23 00:59:00.020453 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:00.020301    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8e7fe1d-da49-454a-9c01-66324f89f6ef-home\") pod \"auth-test-model-b90c57-kserve-744dcd486c-gk2rb\" (UID: \"f8e7fe1d-da49-454a-9c01-66324f89f6ef\") " pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"
Jul 23 00:59:00.020453 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:00.020329    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8e7fe1d-da49-454a-9c01-66324f89f6ef-tmp-dir\") pod \"auth-test-model-b90c57-kserve-744dcd486c-gk2rb\" (UID: \"f8e7fe1d-da49-454a-9c01-66324f89f6ef\") " pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"
Jul 23 00:59:00.020540 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:00.020523    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8e7fe1d-da49-454a-9c01-66324f89f6ef-model-cache\") pod \"auth-test-model-b90c57-kserve-744dcd486c-gk2rb\" (UID: \"f8e7fe1d-da49-454a-9c01-66324f89f6ef\") " pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"
Jul 23 00:59:00.022504 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:00.022481    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8e7fe1d-da49-454a-9c01-66324f89f6ef-dshm\") pod \"auth-test-model-b90c57-kserve-744dcd486c-gk2rb\" (UID: \"f8e7fe1d-da49-454a-9c01-66324f89f6ef\") " pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"
Jul 23 00:59:00.022627 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:00.022598    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8e7fe1d-da49-454a-9c01-66324f89f6ef-tls-certs\") pod \"auth-test-model-b90c57-kserve-744dcd486c-gk2rb\" (UID: \"f8e7fe1d-da49-454a-9c01-66324f89f6ef\") " pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"
Jul 23 00:59:00.028132 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:00.028115    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ttxt\" (UniqueName: \"kubernetes.io/projected/f8e7fe1d-da49-454a-9c01-66324f89f6ef-kube-api-access-9ttxt\") pod \"auth-test-model-b90c57-kserve-744dcd486c-gk2rb\" (UID: \"f8e7fe1d-da49-454a-9c01-66324f89f6ef\") " pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"
Jul 23 00:59:00.078158 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:00.078123    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"
Jul 23 00:59:00.211336 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:00.211173    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"]
Jul 23 00:59:00.213539 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:59:00.213493    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8e7fe1d_da49_454a_9c01_66324f89f6ef.slice/crio-bc2b1bec0631ebe203f0f7a31944d5a32311f436002d7ccc5e3ff60fbc6c982f WatchSource:0}: Error finding container bc2b1bec0631ebe203f0f7a31944d5a32311f436002d7ccc5e3ff60fbc6c982f: Status 404 returned error can't find the container with id bc2b1bec0631ebe203f0f7a31944d5a32311f436002d7ccc5e3ff60fbc6c982f
Jul 23 00:59:00.293723 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:00.293688    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb" event={"ID":"f8e7fe1d-da49-454a-9c01-66324f89f6ef","Type":"ContainerStarted","Data":"9d8228c7914453f14029184ca45f74de9d028593a0b7769807e693100e3325d7"}
Jul 23 00:59:00.293875 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:00.293736    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb" event={"ID":"f8e7fe1d-da49-454a-9c01-66324f89f6ef","Type":"ContainerStarted","Data":"bc2b1bec0631ebe203f0f7a31944d5a32311f436002d7ccc5e3ff60fbc6c982f"}
Jul 23 00:59:00.311658 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:00.311611    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb" podStartSLOduration=1.311596777 podStartE2EDuration="1.311596777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:58:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:59:00.309461379 +0000 UTC m=+2328.713257840" watchObservedRunningTime="2026-07-23 00:59:00.311596777 +0000 UTC m=+2328.715393233"
Jul 23 00:59:05.356238 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:05.356161    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:59:10.079204 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:10.079159    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"
Jul 23 00:59:10.079204 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:10.079207    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"
Jul 23 00:59:10.091633 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:10.091609    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"
Jul 23 00:59:10.347209 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:10.347115    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"
Jul 23 00:59:25.444435 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:25.444391    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"]
Jul 23 00:59:25.447135 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:25.447116    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"
Jul 23 00:59:25.449753 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:25.449718    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-75b665\"/\"default-dockercfg-br5r5\""
Jul 23 00:59:25.449753 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:25.449720    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-75b665\"/\"kube-root-ca.crt\""
Jul 23 00:59:25.449753 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:25.449748    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-75b665\"/\"auth-test-model-75b665-kserve-self-signed-certs\""
Jul 23 00:59:25.450005 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:25.449720    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-75b665\"/\"openshift-service-ca.crt\""
Jul 23 00:59:25.458320 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:25.458299    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"]
Jul 23 00:59:25.556964 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:25.556936    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/960fbde2-eb49-4f52-87d5-e347350a973c-model-cache\") pod \"auth-test-model-75b665-kserve-666c546867-w5fhs\" (UID: \"960fbde2-eb49-4f52-87d5-e347350a973c\") " pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"
Jul 23 00:59:25.557149 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:25.556981    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/960fbde2-eb49-4f52-87d5-e347350a973c-home\") pod \"auth-test-model-75b665-kserve-666c546867-w5fhs\" (UID: \"960fbde2-eb49-4f52-87d5-e347350a973c\") " pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"
Jul 23 00:59:25.557149 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:25.557019    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/960fbde2-eb49-4f52-87d5-e347350a973c-tls-certs\") pod \"auth-test-model-75b665-kserve-666c546867-w5fhs\" (UID: \"960fbde2-eb49-4f52-87d5-e347350a973c\") " pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"
Jul 23 00:59:25.557149 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:25.557036    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/960fbde2-eb49-4f52-87d5-e347350a973c-tmp-dir\") pod \"auth-test-model-75b665-kserve-666c546867-w5fhs\" (UID: \"960fbde2-eb49-4f52-87d5-e347350a973c\") " pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"
Jul 23 00:59:25.557149 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:25.557067    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxwjp\" (UniqueName: \"kubernetes.io/projected/960fbde2-eb49-4f52-87d5-e347350a973c-kube-api-access-bxwjp\") pod \"auth-test-model-75b665-kserve-666c546867-w5fhs\" (UID: \"960fbde2-eb49-4f52-87d5-e347350a973c\") " pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"
Jul 23 00:59:25.557309 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:25.557172    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/960fbde2-eb49-4f52-87d5-e347350a973c-dshm\") pod \"auth-test-model-75b665-kserve-666c546867-w5fhs\" (UID: \"960fbde2-eb49-4f52-87d5-e347350a973c\") " pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"
Jul 23 00:59:25.657882 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:25.657844    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/960fbde2-eb49-4f52-87d5-e347350a973c-dshm\") pod \"auth-test-model-75b665-kserve-666c546867-w5fhs\" (UID: \"960fbde2-eb49-4f52-87d5-e347350a973c\") " pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"
Jul 23 00:59:25.658048 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:25.657894    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/960fbde2-eb49-4f52-87d5-e347350a973c-model-cache\") pod \"auth-test-model-75b665-kserve-666c546867-w5fhs\" (UID: \"960fbde2-eb49-4f52-87d5-e347350a973c\") " pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"
Jul 23 00:59:25.658048 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:25.657935    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/960fbde2-eb49-4f52-87d5-e347350a973c-home\") pod \"auth-test-model-75b665-kserve-666c546867-w5fhs\" (UID: \"960fbde2-eb49-4f52-87d5-e347350a973c\") " pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"
Jul 23 00:59:25.658048 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:25.657960    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/960fbde2-eb49-4f52-87d5-e347350a973c-tls-certs\") pod \"auth-test-model-75b665-kserve-666c546867-w5fhs\" (UID: \"960fbde2-eb49-4f52-87d5-e347350a973c\") " pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"
Jul 23 00:59:25.658048 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:25.657976    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/960fbde2-eb49-4f52-87d5-e347350a973c-tmp-dir\") pod \"auth-test-model-75b665-kserve-666c546867-w5fhs\" (UID: \"960fbde2-eb49-4f52-87d5-e347350a973c\") " pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"
Jul 23 00:59:25.658243 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:25.658057    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxwjp\" (UniqueName: \"kubernetes.io/projected/960fbde2-eb49-4f52-87d5-e347350a973c-kube-api-access-bxwjp\") pod \"auth-test-model-75b665-kserve-666c546867-w5fhs\" (UID: \"960fbde2-eb49-4f52-87d5-e347350a973c\") " pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"
Jul 23 00:59:25.658398 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:25.658357    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/960fbde2-eb49-4f52-87d5-e347350a973c-tmp-dir\") pod \"auth-test-model-75b665-kserve-666c546867-w5fhs\" (UID: \"960fbde2-eb49-4f52-87d5-e347350a973c\") " pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"
Jul 23 00:59:25.658398 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:25.658381    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/960fbde2-eb49-4f52-87d5-e347350a973c-model-cache\") pod \"auth-test-model-75b665-kserve-666c546867-w5fhs\" (UID: \"960fbde2-eb49-4f52-87d5-e347350a973c\") " pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"
Jul 23 00:59:25.658557 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:25.658428    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/960fbde2-eb49-4f52-87d5-e347350a973c-home\") pod \"auth-test-model-75b665-kserve-666c546867-w5fhs\" (UID: \"960fbde2-eb49-4f52-87d5-e347350a973c\") " pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"
Jul 23 00:59:25.660310 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:25.660287    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/960fbde2-eb49-4f52-87d5-e347350a973c-dshm\") pod \"auth-test-model-75b665-kserve-666c546867-w5fhs\" (UID: \"960fbde2-eb49-4f52-87d5-e347350a973c\") " pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"
Jul 23 00:59:25.660484 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:25.660467    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/960fbde2-eb49-4f52-87d5-e347350a973c-tls-certs\") pod \"auth-test-model-75b665-kserve-666c546867-w5fhs\" (UID: \"960fbde2-eb49-4f52-87d5-e347350a973c\") " pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"
Jul 23 00:59:25.666126 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:25.666104    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxwjp\" (UniqueName: \"kubernetes.io/projected/960fbde2-eb49-4f52-87d5-e347350a973c-kube-api-access-bxwjp\") pod \"auth-test-model-75b665-kserve-666c546867-w5fhs\" (UID: \"960fbde2-eb49-4f52-87d5-e347350a973c\") " pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"
Jul 23 00:59:25.757709 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:25.757627    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"
Jul 23 00:59:25.890428 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:25.890394    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"]
Jul 23 00:59:25.893483 ip-10-0-141-176 kubenswrapper[2575]: W0723 00:59:25.893459    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod960fbde2_eb49_4f52_87d5_e347350a973c.slice/crio-8b54519df3072abd5c7775188392d15242ecdf05a3d9d0c15e2b1ed760b80c3b WatchSource:0}: Error finding container 8b54519df3072abd5c7775188392d15242ecdf05a3d9d0c15e2b1ed760b80c3b: Status 404 returned error can't find the container with id 8b54519df3072abd5c7775188392d15242ecdf05a3d9d0c15e2b1ed760b80c3b
Jul 23 00:59:26.407029 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:26.406987    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs" event={"ID":"960fbde2-eb49-4f52-87d5-e347350a973c","Type":"ContainerStarted","Data":"5d13746dc6b7ea9c2df416a472b7ba05df42a9d15f7170c4872c01811628f84a"}
Jul 23 00:59:26.407029 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:26.407030    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs" event={"ID":"960fbde2-eb49-4f52-87d5-e347350a973c","Type":"ContainerStarted","Data":"8b54519df3072abd5c7775188392d15242ecdf05a3d9d0c15e2b1ed760b80c3b"}
Jul 23 00:59:26.424435 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:26.424378    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs" podStartSLOduration=1.424365555 podStartE2EDuration="1.424365555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:59:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:59:26.422658803 +0000 UTC m=+2354.826455252" watchObservedRunningTime="2026-07-23 00:59:26.424365555 +0000 UTC m=+2354.828162014"
Jul 23 00:59:28.968637 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:28.968604    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:59:35.758560 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:35.758521    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"
Jul 23 00:59:35.759013 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:35.758815    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"
Jul 23 00:59:35.771476 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:35.771453    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"
Jul 23 00:59:36.460065 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:36.460030    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"
Jul 23 00:59:44.464024 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:44.463989    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 00:59:58.965720 ip-10-0-141-176 kubenswrapper[2575]: I0723 00:59:58.965682    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 01:00:12.171931 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:00:12.171890    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhvxb_b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9/ovn-acl-logging/0.log"
Jul 23 01:00:12.174102 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:00:12.174082    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhvxb_b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9/ovn-acl-logging/0.log"
Jul 23 01:00:17.962219 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:00:17.962185    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 01:00:37.080491 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:00:37.080404    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 01:00:57.056665 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:00:57.056622    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 01:01:16.863544 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:16.863498    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 01:01:32.324824 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:32.324786    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"]
Jul 23 01:01:33.166445 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:33.166409    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"]
Jul 23 01:01:34.667843 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:34.667809    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 01:01:47.346546 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:47.346470    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb" podUID="f8e7fe1d-da49-454a-9c01-66324f89f6ef" containerName="main" containerID="cri-o://9d8228c7914453f14029184ca45f74de9d028593a0b7769807e693100e3325d7" gracePeriod=45
Jul 23 01:01:47.604701 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:47.604635    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"
Jul 23 01:01:47.703288 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:47.703251    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8e7fe1d-da49-454a-9c01-66324f89f6ef-model-cache\") pod \"f8e7fe1d-da49-454a-9c01-66324f89f6ef\" (UID: \"f8e7fe1d-da49-454a-9c01-66324f89f6ef\") "
Jul 23 01:01:47.703501 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:47.703300    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ttxt\" (UniqueName: \"kubernetes.io/projected/f8e7fe1d-da49-454a-9c01-66324f89f6ef-kube-api-access-9ttxt\") pod \"f8e7fe1d-da49-454a-9c01-66324f89f6ef\" (UID: \"f8e7fe1d-da49-454a-9c01-66324f89f6ef\") "
Jul 23 01:01:47.703501 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:47.703353    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8e7fe1d-da49-454a-9c01-66324f89f6ef-tls-certs\") pod \"f8e7fe1d-da49-454a-9c01-66324f89f6ef\" (UID: \"f8e7fe1d-da49-454a-9c01-66324f89f6ef\") "
Jul 23 01:01:47.703501 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:47.703383    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8e7fe1d-da49-454a-9c01-66324f89f6ef-dshm\") pod \"f8e7fe1d-da49-454a-9c01-66324f89f6ef\" (UID: \"f8e7fe1d-da49-454a-9c01-66324f89f6ef\") "
Jul 23 01:01:47.703501 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:47.703402    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8e7fe1d-da49-454a-9c01-66324f89f6ef-tmp-dir\") pod \"f8e7fe1d-da49-454a-9c01-66324f89f6ef\" (UID: \"f8e7fe1d-da49-454a-9c01-66324f89f6ef\") "
Jul 23 01:01:47.703501 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:47.703420    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8e7fe1d-da49-454a-9c01-66324f89f6ef-home\") pod \"f8e7fe1d-da49-454a-9c01-66324f89f6ef\" (UID: \"f8e7fe1d-da49-454a-9c01-66324f89f6ef\") "
Jul 23 01:01:47.703767 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:47.703595    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8e7fe1d-da49-454a-9c01-66324f89f6ef-model-cache" (OuterVolumeSpecName: "model-cache") pod "f8e7fe1d-da49-454a-9c01-66324f89f6ef" (UID: "f8e7fe1d-da49-454a-9c01-66324f89f6ef"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:01:47.703767 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:47.703704    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8e7fe1d-da49-454a-9c01-66324f89f6ef-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f8e7fe1d-da49-454a-9c01-66324f89f6ef" (UID: "f8e7fe1d-da49-454a-9c01-66324f89f6ef"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:01:47.703767 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:47.703730    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8e7fe1d-da49-454a-9c01-66324f89f6ef-model-cache\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 01:01:47.703767 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:47.703738    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8e7fe1d-da49-454a-9c01-66324f89f6ef-home" (OuterVolumeSpecName: "home") pod "f8e7fe1d-da49-454a-9c01-66324f89f6ef" (UID: "f8e7fe1d-da49-454a-9c01-66324f89f6ef"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:01:47.705790 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:47.705766    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8e7fe1d-da49-454a-9c01-66324f89f6ef-kube-api-access-9ttxt" (OuterVolumeSpecName: "kube-api-access-9ttxt") pod "f8e7fe1d-da49-454a-9c01-66324f89f6ef" (UID: "f8e7fe1d-da49-454a-9c01-66324f89f6ef"). InnerVolumeSpecName "kube-api-access-9ttxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 01:01:47.705880 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:47.705805    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8e7fe1d-da49-454a-9c01-66324f89f6ef-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f8e7fe1d-da49-454a-9c01-66324f89f6ef" (UID: "f8e7fe1d-da49-454a-9c01-66324f89f6ef"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 01:01:47.705880 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:47.705835    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8e7fe1d-da49-454a-9c01-66324f89f6ef-dshm" (OuterVolumeSpecName: "dshm") pod "f8e7fe1d-da49-454a-9c01-66324f89f6ef" (UID: "f8e7fe1d-da49-454a-9c01-66324f89f6ef"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:01:47.804661 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:47.804626    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ttxt\" (UniqueName: \"kubernetes.io/projected/f8e7fe1d-da49-454a-9c01-66324f89f6ef-kube-api-access-9ttxt\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 01:01:47.804661 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:47.804654    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8e7fe1d-da49-454a-9c01-66324f89f6ef-tls-certs\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 01:01:47.804661 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:47.804664    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8e7fe1d-da49-454a-9c01-66324f89f6ef-dshm\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 01:01:47.804661 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:47.804672    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8e7fe1d-da49-454a-9c01-66324f89f6ef-tmp-dir\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 01:01:47.804963 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:47.804681    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8e7fe1d-da49-454a-9c01-66324f89f6ef-home\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 01:01:48.052076 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:48.052037    2575 generic.go:356] "Generic (PLEG): container finished" podID="f8e7fe1d-da49-454a-9c01-66324f89f6ef" containerID="9d8228c7914453f14029184ca45f74de9d028593a0b7769807e693100e3325d7" exitCode=0
Jul 23 01:01:48.052277 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:48.052085    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"
Jul 23 01:01:48.052277 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:48.052127    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb" event={"ID":"f8e7fe1d-da49-454a-9c01-66324f89f6ef","Type":"ContainerDied","Data":"9d8228c7914453f14029184ca45f74de9d028593a0b7769807e693100e3325d7"}
Jul 23 01:01:48.052277 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:48.052170    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb" event={"ID":"f8e7fe1d-da49-454a-9c01-66324f89f6ef","Type":"ContainerDied","Data":"bc2b1bec0631ebe203f0f7a31944d5a32311f436002d7ccc5e3ff60fbc6c982f"}
Jul 23 01:01:48.052277 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:48.052187    2575 scope.go:117] "RemoveContainer" containerID="9d8228c7914453f14029184ca45f74de9d028593a0b7769807e693100e3325d7"
Jul 23 01:01:48.061379 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:48.061359    2575 scope.go:117] "RemoveContainer" containerID="9d8228c7914453f14029184ca45f74de9d028593a0b7769807e693100e3325d7"
Jul 23 01:01:48.061597 ip-10-0-141-176 kubenswrapper[2575]: E0723 01:01:48.061579    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d8228c7914453f14029184ca45f74de9d028593a0b7769807e693100e3325d7\": container with ID starting with 9d8228c7914453f14029184ca45f74de9d028593a0b7769807e693100e3325d7 not found: ID does not exist" containerID="9d8228c7914453f14029184ca45f74de9d028593a0b7769807e693100e3325d7"
Jul 23 01:01:48.061669 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:48.061604    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d8228c7914453f14029184ca45f74de9d028593a0b7769807e693100e3325d7"} err="failed to get container status \"9d8228c7914453f14029184ca45f74de9d028593a0b7769807e693100e3325d7\": rpc error: code = NotFound desc = could not find container \"9d8228c7914453f14029184ca45f74de9d028593a0b7769807e693100e3325d7\": container with ID starting with 9d8228c7914453f14029184ca45f74de9d028593a0b7769807e693100e3325d7 not found: ID does not exist"
Jul 23 01:01:48.072169 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:48.072130    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"]
Jul 23 01:01:48.077552 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:48.077528    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-b90c57/auth-test-model-b90c57-kserve-744dcd486c-gk2rb"]
Jul 23 01:01:48.128079 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:48.128046    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8e7fe1d-da49-454a-9c01-66324f89f6ef" path="/var/lib/kubelet/pods/f8e7fe1d-da49-454a-9c01-66324f89f6ef/volumes"
Jul 23 01:01:48.187125 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:48.187084    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs" podUID="960fbde2-eb49-4f52-87d5-e347350a973c" containerName="main" containerID="cri-o://5d13746dc6b7ea9c2df416a472b7ba05df42a9d15f7170c4872c01811628f84a" gracePeriod=45
Jul 23 01:01:48.445589 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:48.445561    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"
Jul 23 01:01:48.510894 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:48.510862    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxwjp\" (UniqueName: \"kubernetes.io/projected/960fbde2-eb49-4f52-87d5-e347350a973c-kube-api-access-bxwjp\") pod \"960fbde2-eb49-4f52-87d5-e347350a973c\" (UID: \"960fbde2-eb49-4f52-87d5-e347350a973c\") "
Jul 23 01:01:48.511095 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:48.510965    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/960fbde2-eb49-4f52-87d5-e347350a973c-tls-certs\") pod \"960fbde2-eb49-4f52-87d5-e347350a973c\" (UID: \"960fbde2-eb49-4f52-87d5-e347350a973c\") "
Jul 23 01:01:48.511149 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:48.511130    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/960fbde2-eb49-4f52-87d5-e347350a973c-dshm\") pod \"960fbde2-eb49-4f52-87d5-e347350a973c\" (UID: \"960fbde2-eb49-4f52-87d5-e347350a973c\") "
Jul 23 01:01:48.511229 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:48.511212    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/960fbde2-eb49-4f52-87d5-e347350a973c-model-cache\") pod \"960fbde2-eb49-4f52-87d5-e347350a973c\" (UID: \"960fbde2-eb49-4f52-87d5-e347350a973c\") "
Jul 23 01:01:48.511278 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:48.511248    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/960fbde2-eb49-4f52-87d5-e347350a973c-tmp-dir\") pod \"960fbde2-eb49-4f52-87d5-e347350a973c\" (UID: \"960fbde2-eb49-4f52-87d5-e347350a973c\") "
Jul 23 01:01:48.511333 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:48.511293    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/960fbde2-eb49-4f52-87d5-e347350a973c-home\") pod \"960fbde2-eb49-4f52-87d5-e347350a973c\" (UID: \"960fbde2-eb49-4f52-87d5-e347350a973c\") "
Jul 23 01:01:48.511589 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:48.511482    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/960fbde2-eb49-4f52-87d5-e347350a973c-model-cache" (OuterVolumeSpecName: "model-cache") pod "960fbde2-eb49-4f52-87d5-e347350a973c" (UID: "960fbde2-eb49-4f52-87d5-e347350a973c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:01:48.511752 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:48.511723    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/960fbde2-eb49-4f52-87d5-e347350a973c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "960fbde2-eb49-4f52-87d5-e347350a973c" (UID: "960fbde2-eb49-4f52-87d5-e347350a973c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:01:48.511752 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:48.511733    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/960fbde2-eb49-4f52-87d5-e347350a973c-home" (OuterVolumeSpecName: "home") pod "960fbde2-eb49-4f52-87d5-e347350a973c" (UID: "960fbde2-eb49-4f52-87d5-e347350a973c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:01:48.513277 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:48.513253    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/960fbde2-eb49-4f52-87d5-e347350a973c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "960fbde2-eb49-4f52-87d5-e347350a973c" (UID: "960fbde2-eb49-4f52-87d5-e347350a973c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 01:01:48.513277 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:48.513267    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/960fbde2-eb49-4f52-87d5-e347350a973c-kube-api-access-bxwjp" (OuterVolumeSpecName: "kube-api-access-bxwjp") pod "960fbde2-eb49-4f52-87d5-e347350a973c" (UID: "960fbde2-eb49-4f52-87d5-e347350a973c"). InnerVolumeSpecName "kube-api-access-bxwjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 01:01:48.513394 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:48.513339    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/960fbde2-eb49-4f52-87d5-e347350a973c-dshm" (OuterVolumeSpecName: "dshm") pod "960fbde2-eb49-4f52-87d5-e347350a973c" (UID: "960fbde2-eb49-4f52-87d5-e347350a973c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:01:48.612043 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:48.611961    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/960fbde2-eb49-4f52-87d5-e347350a973c-model-cache\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 01:01:48.612043 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:48.611989    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/960fbde2-eb49-4f52-87d5-e347350a973c-tmp-dir\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 01:01:48.612043 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:48.611997    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/960fbde2-eb49-4f52-87d5-e347350a973c-home\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 01:01:48.612043 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:48.612007    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxwjp\" (UniqueName: \"kubernetes.io/projected/960fbde2-eb49-4f52-87d5-e347350a973c-kube-api-access-bxwjp\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 01:01:48.612043 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:48.612015    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/960fbde2-eb49-4f52-87d5-e347350a973c-tls-certs\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 01:01:48.612043 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:48.612024    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/960fbde2-eb49-4f52-87d5-e347350a973c-dshm\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 01:01:49.057447 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:49.057408    2575 generic.go:356] "Generic (PLEG): container finished" podID="960fbde2-eb49-4f52-87d5-e347350a973c" containerID="5d13746dc6b7ea9c2df416a472b7ba05df42a9d15f7170c4872c01811628f84a" exitCode=0
Jul 23 01:01:49.057644 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:49.057451    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"
Jul 23 01:01:49.057644 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:49.057492    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs" event={"ID":"960fbde2-eb49-4f52-87d5-e347350a973c","Type":"ContainerDied","Data":"5d13746dc6b7ea9c2df416a472b7ba05df42a9d15f7170c4872c01811628f84a"}
Jul 23 01:01:49.057644 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:49.057530    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs" event={"ID":"960fbde2-eb49-4f52-87d5-e347350a973c","Type":"ContainerDied","Data":"8b54519df3072abd5c7775188392d15242ecdf05a3d9d0c15e2b1ed760b80c3b"}
Jul 23 01:01:49.057644 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:49.057547    2575 scope.go:117] "RemoveContainer" containerID="5d13746dc6b7ea9c2df416a472b7ba05df42a9d15f7170c4872c01811628f84a"
Jul 23 01:01:49.066343 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:49.066328    2575 scope.go:117] "RemoveContainer" containerID="5d13746dc6b7ea9c2df416a472b7ba05df42a9d15f7170c4872c01811628f84a"
Jul 23 01:01:49.066615 ip-10-0-141-176 kubenswrapper[2575]: E0723 01:01:49.066597    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d13746dc6b7ea9c2df416a472b7ba05df42a9d15f7170c4872c01811628f84a\": container with ID starting with 5d13746dc6b7ea9c2df416a472b7ba05df42a9d15f7170c4872c01811628f84a not found: ID does not exist" containerID="5d13746dc6b7ea9c2df416a472b7ba05df42a9d15f7170c4872c01811628f84a"
Jul 23 01:01:49.066651 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:49.066625    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d13746dc6b7ea9c2df416a472b7ba05df42a9d15f7170c4872c01811628f84a"} err="failed to get container status \"5d13746dc6b7ea9c2df416a472b7ba05df42a9d15f7170c4872c01811628f84a\": rpc error: code = NotFound desc = could not find container \"5d13746dc6b7ea9c2df416a472b7ba05df42a9d15f7170c4872c01811628f84a\": container with ID starting with 5d13746dc6b7ea9c2df416a472b7ba05df42a9d15f7170c4872c01811628f84a not found: ID does not exist"
Jul 23 01:01:49.079609 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:49.079582    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"]
Jul 23 01:01:49.083626 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:49.083601    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-75b665/auth-test-model-75b665-kserve-666c546867-w5fhs"]
Jul 23 01:01:49.959162 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:49.959125    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 01:01:50.128703 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:01:50.128673    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="960fbde2-eb49-4f52-87d5-e347350a973c" path="/var/lib/kubelet/pods/960fbde2-eb49-4f52-87d5-e347350a973c/volumes"
Jul 23 01:02:06.068530 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.068442    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"]
Jul 23 01:02:06.069051 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.069011    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="960fbde2-eb49-4f52-87d5-e347350a973c" containerName="main"
Jul 23 01:02:06.069051 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.069031    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="960fbde2-eb49-4f52-87d5-e347350a973c" containerName="main"
Jul 23 01:02:06.069172 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.069053    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8e7fe1d-da49-454a-9c01-66324f89f6ef" containerName="main"
Jul 23 01:02:06.069172 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.069062    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8e7fe1d-da49-454a-9c01-66324f89f6ef" containerName="main"
Jul 23 01:02:06.069172 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.069153    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="960fbde2-eb49-4f52-87d5-e347350a973c" containerName="main"
Jul 23 01:02:06.069371 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.069173    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8e7fe1d-da49-454a-9c01-66324f89f6ef" containerName="main"
Jul 23 01:02:06.073965 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.073939    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"
Jul 23 01:02:06.076106 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.076079    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-75b665\"/\"sub-test-model-75b665-kserve-self-signed-certs\""
Jul 23 01:02:06.076770 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.076748    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-75b665\"/\"openshift-service-ca.crt\""
Jul 23 01:02:06.076770 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.076766    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-75b665\"/\"kube-root-ca.crt\""
Jul 23 01:02:06.076953 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.076821    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-75b665\"/\"default-dockercfg-br5r5\""
Jul 23 01:02:06.082326 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.082303    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"]
Jul 23 01:02:06.161854 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.161812    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/411a02b8-48c9-439f-87ca-276e9f2aee94-tmp-dir\") pod \"sub-test-model-75b665-kserve-548ccd77fc-qdtfz\" (UID: \"411a02b8-48c9-439f-87ca-276e9f2aee94\") " pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"
Jul 23 01:02:06.161854 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.161858    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/411a02b8-48c9-439f-87ca-276e9f2aee94-home\") pod \"sub-test-model-75b665-kserve-548ccd77fc-qdtfz\" (UID: \"411a02b8-48c9-439f-87ca-276e9f2aee94\") " pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"
Jul 23 01:02:06.162154 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.161988    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/411a02b8-48c9-439f-87ca-276e9f2aee94-model-cache\") pod \"sub-test-model-75b665-kserve-548ccd77fc-qdtfz\" (UID: \"411a02b8-48c9-439f-87ca-276e9f2aee94\") " pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"
Jul 23 01:02:06.162154 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.162019    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/411a02b8-48c9-439f-87ca-276e9f2aee94-tls-certs\") pod \"sub-test-model-75b665-kserve-548ccd77fc-qdtfz\" (UID: \"411a02b8-48c9-439f-87ca-276e9f2aee94\") " pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"
Jul 23 01:02:06.162154 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.162044    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/411a02b8-48c9-439f-87ca-276e9f2aee94-dshm\") pod \"sub-test-model-75b665-kserve-548ccd77fc-qdtfz\" (UID: \"411a02b8-48c9-439f-87ca-276e9f2aee94\") " pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"
Jul 23 01:02:06.162154 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.162085    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87dbj\" (UniqueName: \"kubernetes.io/projected/411a02b8-48c9-439f-87ca-276e9f2aee94-kube-api-access-87dbj\") pod \"sub-test-model-75b665-kserve-548ccd77fc-qdtfz\" (UID: \"411a02b8-48c9-439f-87ca-276e9f2aee94\") " pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"
Jul 23 01:02:06.262938 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.262869    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/411a02b8-48c9-439f-87ca-276e9f2aee94-home\") pod \"sub-test-model-75b665-kserve-548ccd77fc-qdtfz\" (UID: \"411a02b8-48c9-439f-87ca-276e9f2aee94\") " pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"
Jul 23 01:02:06.263123 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.262970    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/411a02b8-48c9-439f-87ca-276e9f2aee94-model-cache\") pod \"sub-test-model-75b665-kserve-548ccd77fc-qdtfz\" (UID: \"411a02b8-48c9-439f-87ca-276e9f2aee94\") " pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"
Jul 23 01:02:06.263123 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.263013    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/411a02b8-48c9-439f-87ca-276e9f2aee94-tls-certs\") pod \"sub-test-model-75b665-kserve-548ccd77fc-qdtfz\" (UID: \"411a02b8-48c9-439f-87ca-276e9f2aee94\") " pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"
Jul 23 01:02:06.263123 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.263049    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/411a02b8-48c9-439f-87ca-276e9f2aee94-dshm\") pod \"sub-test-model-75b665-kserve-548ccd77fc-qdtfz\" (UID: \"411a02b8-48c9-439f-87ca-276e9f2aee94\") " pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"
Jul 23 01:02:06.263123 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.263099    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87dbj\" (UniqueName: \"kubernetes.io/projected/411a02b8-48c9-439f-87ca-276e9f2aee94-kube-api-access-87dbj\") pod \"sub-test-model-75b665-kserve-548ccd77fc-qdtfz\" (UID: \"411a02b8-48c9-439f-87ca-276e9f2aee94\") " pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"
Jul 23 01:02:06.263323 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.263158    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/411a02b8-48c9-439f-87ca-276e9f2aee94-tmp-dir\") pod \"sub-test-model-75b665-kserve-548ccd77fc-qdtfz\" (UID: \"411a02b8-48c9-439f-87ca-276e9f2aee94\") " pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"
Jul 23 01:02:06.263376 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.263338    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/411a02b8-48c9-439f-87ca-276e9f2aee94-home\") pod \"sub-test-model-75b665-kserve-548ccd77fc-qdtfz\" (UID: \"411a02b8-48c9-439f-87ca-276e9f2aee94\") " pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"
Jul 23 01:02:06.263465 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.263415    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/411a02b8-48c9-439f-87ca-276e9f2aee94-model-cache\") pod \"sub-test-model-75b665-kserve-548ccd77fc-qdtfz\" (UID: \"411a02b8-48c9-439f-87ca-276e9f2aee94\") " pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"
Jul 23 01:02:06.263622 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.263605    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/411a02b8-48c9-439f-87ca-276e9f2aee94-tmp-dir\") pod \"sub-test-model-75b665-kserve-548ccd77fc-qdtfz\" (UID: \"411a02b8-48c9-439f-87ca-276e9f2aee94\") " pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"
Jul 23 01:02:06.265490 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.265466    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/411a02b8-48c9-439f-87ca-276e9f2aee94-dshm\") pod \"sub-test-model-75b665-kserve-548ccd77fc-qdtfz\" (UID: \"411a02b8-48c9-439f-87ca-276e9f2aee94\") " pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"
Jul 23 01:02:06.265796 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.265781    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/411a02b8-48c9-439f-87ca-276e9f2aee94-tls-certs\") pod \"sub-test-model-75b665-kserve-548ccd77fc-qdtfz\" (UID: \"411a02b8-48c9-439f-87ca-276e9f2aee94\") " pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"
Jul 23 01:02:06.271441 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.271414    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87dbj\" (UniqueName: \"kubernetes.io/projected/411a02b8-48c9-439f-87ca-276e9f2aee94-kube-api-access-87dbj\") pod \"sub-test-model-75b665-kserve-548ccd77fc-qdtfz\" (UID: \"411a02b8-48c9-439f-87ca-276e9f2aee94\") " pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"
Jul 23 01:02:06.384938 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.384813    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"
Jul 23 01:02:06.521757 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:06.521668    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"]
Jul 23 01:02:06.525743 ip-10-0-141-176 kubenswrapper[2575]: W0723 01:02:06.525712    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod411a02b8_48c9_439f_87ca_276e9f2aee94.slice/crio-47d79510fec53175ba998d94c5fe2b2e35d83841e8ab0e5dabcd800012e7f5db WatchSource:0}: Error finding container 47d79510fec53175ba998d94c5fe2b2e35d83841e8ab0e5dabcd800012e7f5db: Status 404 returned error can't find the container with id 47d79510fec53175ba998d94c5fe2b2e35d83841e8ab0e5dabcd800012e7f5db
Jul 23 01:02:07.141478 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:07.141439    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz" event={"ID":"411a02b8-48c9-439f-87ca-276e9f2aee94","Type":"ContainerStarted","Data":"42e1c19a887b93b5bb6013df9553912965da4a09c25ece9e78d6092842f782ca"}
Jul 23 01:02:07.141478 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:07.141481    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz" event={"ID":"411a02b8-48c9-439f-87ca-276e9f2aee94","Type":"ContainerStarted","Data":"47d79510fec53175ba998d94c5fe2b2e35d83841e8ab0e5dabcd800012e7f5db"}
Jul 23 01:02:07.160145 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:07.160093    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz" podStartSLOduration=1.160076291 podStartE2EDuration="1.160076291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:02:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:02:07.15862848 +0000 UTC m=+2515.562424937" watchObservedRunningTime="2026-07-23 01:02:07.160076291 +0000 UTC m=+2515.563872747"
Jul 23 01:02:09.353194 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:09.353150    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 01:02:16.385866 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:16.385821    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"
Jul 23 01:02:16.385866 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:16.385876    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"
Jul 23 01:02:16.398296 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:16.398270    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"
Jul 23 01:02:17.195081 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:17.195050    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"
Jul 23 01:02:26.277281 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:26.277229    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 01:02:46.386619 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:46.386577    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 01:02:53.339810 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:02:53.339771    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"]
Jul 23 01:03:04.661598 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:04.661558    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 01:03:08.363177 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:08.363110    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz" podUID="411a02b8-48c9-439f-87ca-276e9f2aee94" containerName="main" containerID="cri-o://42e1c19a887b93b5bb6013df9553912965da4a09c25ece9e78d6092842f782ca" gracePeriod=45
Jul 23 01:03:08.609156 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:08.609131    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"
Jul 23 01:03:08.730936 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:08.730871    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/411a02b8-48c9-439f-87ca-276e9f2aee94-tls-certs\") pod \"411a02b8-48c9-439f-87ca-276e9f2aee94\" (UID: \"411a02b8-48c9-439f-87ca-276e9f2aee94\") "
Jul 23 01:03:08.731129 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:08.730946    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/411a02b8-48c9-439f-87ca-276e9f2aee94-home\") pod \"411a02b8-48c9-439f-87ca-276e9f2aee94\" (UID: \"411a02b8-48c9-439f-87ca-276e9f2aee94\") "
Jul 23 01:03:08.731129 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:08.730976    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/411a02b8-48c9-439f-87ca-276e9f2aee94-tmp-dir\") pod \"411a02b8-48c9-439f-87ca-276e9f2aee94\" (UID: \"411a02b8-48c9-439f-87ca-276e9f2aee94\") "
Jul 23 01:03:08.731129 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:08.731015    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/411a02b8-48c9-439f-87ca-276e9f2aee94-dshm\") pod \"411a02b8-48c9-439f-87ca-276e9f2aee94\" (UID: \"411a02b8-48c9-439f-87ca-276e9f2aee94\") "
Jul 23 01:03:08.731129 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:08.731063    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87dbj\" (UniqueName: \"kubernetes.io/projected/411a02b8-48c9-439f-87ca-276e9f2aee94-kube-api-access-87dbj\") pod \"411a02b8-48c9-439f-87ca-276e9f2aee94\" (UID: \"411a02b8-48c9-439f-87ca-276e9f2aee94\") "
Jul 23 01:03:08.731129 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:08.731082    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/411a02b8-48c9-439f-87ca-276e9f2aee94-model-cache\") pod \"411a02b8-48c9-439f-87ca-276e9f2aee94\" (UID: \"411a02b8-48c9-439f-87ca-276e9f2aee94\") "
Jul 23 01:03:08.731384 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:08.731226    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/411a02b8-48c9-439f-87ca-276e9f2aee94-home" (OuterVolumeSpecName: "home") pod "411a02b8-48c9-439f-87ca-276e9f2aee94" (UID: "411a02b8-48c9-439f-87ca-276e9f2aee94"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:03:08.731384 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:08.731277    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/411a02b8-48c9-439f-87ca-276e9f2aee94-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "411a02b8-48c9-439f-87ca-276e9f2aee94" (UID: "411a02b8-48c9-439f-87ca-276e9f2aee94"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:03:08.731501 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:08.731390    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/411a02b8-48c9-439f-87ca-276e9f2aee94-home\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 01:03:08.731501 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:08.731430    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/411a02b8-48c9-439f-87ca-276e9f2aee94-tmp-dir\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 01:03:08.731501 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:08.731422    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/411a02b8-48c9-439f-87ca-276e9f2aee94-model-cache" (OuterVolumeSpecName: "model-cache") pod "411a02b8-48c9-439f-87ca-276e9f2aee94" (UID: "411a02b8-48c9-439f-87ca-276e9f2aee94"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:03:08.733262 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:08.733240    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/411a02b8-48c9-439f-87ca-276e9f2aee94-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "411a02b8-48c9-439f-87ca-276e9f2aee94" (UID: "411a02b8-48c9-439f-87ca-276e9f2aee94"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 01:03:08.733262 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:08.733244    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/411a02b8-48c9-439f-87ca-276e9f2aee94-kube-api-access-87dbj" (OuterVolumeSpecName: "kube-api-access-87dbj") pod "411a02b8-48c9-439f-87ca-276e9f2aee94" (UID: "411a02b8-48c9-439f-87ca-276e9f2aee94"). InnerVolumeSpecName "kube-api-access-87dbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 01:03:08.733375 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:08.733293    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/411a02b8-48c9-439f-87ca-276e9f2aee94-dshm" (OuterVolumeSpecName: "dshm") pod "411a02b8-48c9-439f-87ca-276e9f2aee94" (UID: "411a02b8-48c9-439f-87ca-276e9f2aee94"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:03:08.832863 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:08.832824    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87dbj\" (UniqueName: \"kubernetes.io/projected/411a02b8-48c9-439f-87ca-276e9f2aee94-kube-api-access-87dbj\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 01:03:08.832863 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:08.832853    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/411a02b8-48c9-439f-87ca-276e9f2aee94-model-cache\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 01:03:08.832863 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:08.832864    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/411a02b8-48c9-439f-87ca-276e9f2aee94-tls-certs\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 01:03:08.832863 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:08.832871    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/411a02b8-48c9-439f-87ca-276e9f2aee94-dshm\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 01:03:09.422597 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:09.422560    2575 generic.go:356] "Generic (PLEG): container finished" podID="411a02b8-48c9-439f-87ca-276e9f2aee94" containerID="42e1c19a887b93b5bb6013df9553912965da4a09c25ece9e78d6092842f782ca" exitCode=0
Jul 23 01:03:09.423033 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:09.422604    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"
Jul 23 01:03:09.423033 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:09.422648    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz" event={"ID":"411a02b8-48c9-439f-87ca-276e9f2aee94","Type":"ContainerDied","Data":"42e1c19a887b93b5bb6013df9553912965da4a09c25ece9e78d6092842f782ca"}
Jul 23 01:03:09.423033 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:09.422689    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz" event={"ID":"411a02b8-48c9-439f-87ca-276e9f2aee94","Type":"ContainerDied","Data":"47d79510fec53175ba998d94c5fe2b2e35d83841e8ab0e5dabcd800012e7f5db"}
Jul 23 01:03:09.423033 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:09.422706    2575 scope.go:117] "RemoveContainer" containerID="42e1c19a887b93b5bb6013df9553912965da4a09c25ece9e78d6092842f782ca"
Jul 23 01:03:09.432463 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:09.432444    2575 scope.go:117] "RemoveContainer" containerID="42e1c19a887b93b5bb6013df9553912965da4a09c25ece9e78d6092842f782ca"
Jul 23 01:03:09.432805 ip-10-0-141-176 kubenswrapper[2575]: E0723 01:03:09.432787    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42e1c19a887b93b5bb6013df9553912965da4a09c25ece9e78d6092842f782ca\": container with ID starting with 42e1c19a887b93b5bb6013df9553912965da4a09c25ece9e78d6092842f782ca not found: ID does not exist" containerID="42e1c19a887b93b5bb6013df9553912965da4a09c25ece9e78d6092842f782ca"
Jul 23 01:03:09.432872 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:09.432817    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42e1c19a887b93b5bb6013df9553912965da4a09c25ece9e78d6092842f782ca"} err="failed to get container status \"42e1c19a887b93b5bb6013df9553912965da4a09c25ece9e78d6092842f782ca\": rpc error: code = NotFound desc = could not find container \"42e1c19a887b93b5bb6013df9553912965da4a09c25ece9e78d6092842f782ca\": container with ID starting with 42e1c19a887b93b5bb6013df9553912965da4a09c25ece9e78d6092842f782ca not found: ID does not exist"
Jul 23 01:03:09.443295 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:09.443262    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"]
Jul 23 01:03:09.448183 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:09.448156    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-75b665/sub-test-model-75b665-kserve-548ccd77fc-qdtfz"]
Jul 23 01:03:09.462780 ip-10-0-141-176 kubenswrapper[2575]: E0723 01:03:09.462743    2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod411a02b8_48c9_439f_87ca_276e9f2aee94.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod411a02b8_48c9_439f_87ca_276e9f2aee94.slice/crio-47d79510fec53175ba998d94c5fe2b2e35d83841e8ab0e5dabcd800012e7f5db\": RecentStats: unable to find data in memory cache]"
Jul 23 01:03:10.128441 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:10.128410    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="411a02b8-48c9-439f-87ca-276e9f2aee94" path="/var/lib/kubelet/pods/411a02b8-48c9-439f-87ca-276e9f2aee94/volumes"
Jul 23 01:03:12.668219 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:12.668178    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"]
Jul 23 01:03:12.668611 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:12.668542    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="411a02b8-48c9-439f-87ca-276e9f2aee94" containerName="main"
Jul 23 01:03:12.668611 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:12.668554    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="411a02b8-48c9-439f-87ca-276e9f2aee94" containerName="main"
Jul 23 01:03:12.668611 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:12.668605    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="411a02b8-48c9-439f-87ca-276e9f2aee94" containerName="main"
Jul 23 01:03:12.672752 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:12.672733    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"
Jul 23 01:03:12.675229 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:12.675205    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-b90c57\"/\"default-dockercfg-5tkvb\""
Jul 23 01:03:12.675352 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:12.675227    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-b90c57\"/\"openshift-service-ca.crt\""
Jul 23 01:03:12.675352 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:12.675205    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-b90c57\"/\"rate-test-model-b90c57-kserve-self-signed-certs\""
Jul 23 01:03:12.675352 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:12.675268    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-b90c57\"/\"kube-root-ca.crt\""
Jul 23 01:03:12.678771 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:12.678742    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"]
Jul 23 01:03:12.772043 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:12.772002    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87d256e0-d5f0-461e-86fe-ac1a5d64b605-model-cache\") pod \"rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62\" (UID: \"87d256e0-d5f0-461e-86fe-ac1a5d64b605\") " pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"
Jul 23 01:03:12.772043 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:12.772042    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87d256e0-d5f0-461e-86fe-ac1a5d64b605-dshm\") pod \"rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62\" (UID: \"87d256e0-d5f0-461e-86fe-ac1a5d64b605\") " pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"
Jul 23 01:03:12.772255 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:12.772136    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87d256e0-d5f0-461e-86fe-ac1a5d64b605-tls-certs\") pod \"rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62\" (UID: \"87d256e0-d5f0-461e-86fe-ac1a5d64b605\") " pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"
Jul 23 01:03:12.772255 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:12.772177    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87d256e0-d5f0-461e-86fe-ac1a5d64b605-tmp-dir\") pod \"rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62\" (UID: \"87d256e0-d5f0-461e-86fe-ac1a5d64b605\") " pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"
Jul 23 01:03:12.772255 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:12.772196    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87d256e0-d5f0-461e-86fe-ac1a5d64b605-home\") pod \"rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62\" (UID: \"87d256e0-d5f0-461e-86fe-ac1a5d64b605\") " pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"
Jul 23 01:03:12.772255 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:12.772246    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jxh4\" (UniqueName: \"kubernetes.io/projected/87d256e0-d5f0-461e-86fe-ac1a5d64b605-kube-api-access-2jxh4\") pod \"rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62\" (UID: \"87d256e0-d5f0-461e-86fe-ac1a5d64b605\") " pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"
Jul 23 01:03:12.873709 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:12.873668    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87d256e0-d5f0-461e-86fe-ac1a5d64b605-tmp-dir\") pod \"rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62\" (UID: \"87d256e0-d5f0-461e-86fe-ac1a5d64b605\") " pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"
Jul 23 01:03:12.873709 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:12.873707    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87d256e0-d5f0-461e-86fe-ac1a5d64b605-home\") pod \"rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62\" (UID: \"87d256e0-d5f0-461e-86fe-ac1a5d64b605\") " pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"
Jul 23 01:03:12.874013 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:12.873732    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jxh4\" (UniqueName: \"kubernetes.io/projected/87d256e0-d5f0-461e-86fe-ac1a5d64b605-kube-api-access-2jxh4\") pod \"rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62\" (UID: \"87d256e0-d5f0-461e-86fe-ac1a5d64b605\") " pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"
Jul 23 01:03:12.874013 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:12.873779    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87d256e0-d5f0-461e-86fe-ac1a5d64b605-model-cache\") pod \"rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62\" (UID: \"87d256e0-d5f0-461e-86fe-ac1a5d64b605\") " pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"
Jul 23 01:03:12.874013 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:12.873810    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87d256e0-d5f0-461e-86fe-ac1a5d64b605-dshm\") pod \"rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62\" (UID: \"87d256e0-d5f0-461e-86fe-ac1a5d64b605\") " pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"
Jul 23 01:03:12.874013 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:12.873870    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87d256e0-d5f0-461e-86fe-ac1a5d64b605-tls-certs\") pod \"rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62\" (UID: \"87d256e0-d5f0-461e-86fe-ac1a5d64b605\") " pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"
Jul 23 01:03:12.874210 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:12.874160    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87d256e0-d5f0-461e-86fe-ac1a5d64b605-model-cache\") pod \"rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62\" (UID: \"87d256e0-d5f0-461e-86fe-ac1a5d64b605\") " pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"
Jul 23 01:03:12.874210 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:12.874197    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87d256e0-d5f0-461e-86fe-ac1a5d64b605-tmp-dir\") pod \"rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62\" (UID: \"87d256e0-d5f0-461e-86fe-ac1a5d64b605\") " pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"
Jul 23 01:03:12.874279 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:12.874244    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87d256e0-d5f0-461e-86fe-ac1a5d64b605-home\") pod \"rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62\" (UID: \"87d256e0-d5f0-461e-86fe-ac1a5d64b605\") " pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"
Jul 23 01:03:12.876262 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:12.876232    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87d256e0-d5f0-461e-86fe-ac1a5d64b605-dshm\") pod \"rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62\" (UID: \"87d256e0-d5f0-461e-86fe-ac1a5d64b605\") " pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"
Jul 23 01:03:12.876588 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:12.876568    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87d256e0-d5f0-461e-86fe-ac1a5d64b605-tls-certs\") pod \"rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62\" (UID: \"87d256e0-d5f0-461e-86fe-ac1a5d64b605\") " pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"
Jul 23 01:03:12.881770 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:12.881745    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jxh4\" (UniqueName: \"kubernetes.io/projected/87d256e0-d5f0-461e-86fe-ac1a5d64b605-kube-api-access-2jxh4\") pod \"rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62\" (UID: \"87d256e0-d5f0-461e-86fe-ac1a5d64b605\") " pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"
Jul 23 01:03:12.984222 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:12.984124    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"
Jul 23 01:03:13.120258 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:13.120231    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"]
Jul 23 01:03:13.122602 ip-10-0-141-176 kubenswrapper[2575]: W0723 01:03:13.122568    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87d256e0_d5f0_461e_86fe_ac1a5d64b605.slice/crio-5ab9ed2f49adb4b8812b6dac947403336583856d7510f440a1b7b9d301e58683 WatchSource:0}: Error finding container 5ab9ed2f49adb4b8812b6dac947403336583856d7510f440a1b7b9d301e58683: Status 404 returned error can't find the container with id 5ab9ed2f49adb4b8812b6dac947403336583856d7510f440a1b7b9d301e58683
Jul 23 01:03:13.443342 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:13.443307    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62" event={"ID":"87d256e0-d5f0-461e-86fe-ac1a5d64b605","Type":"ContainerStarted","Data":"9d5baebbbef13dccaa142850ae6c92a685bdf19a90c255d569b7f249ac99b988"}
Jul 23 01:03:13.443342 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:13.443346    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62" event={"ID":"87d256e0-d5f0-461e-86fe-ac1a5d64b605","Type":"ContainerStarted","Data":"5ab9ed2f49adb4b8812b6dac947403336583856d7510f440a1b7b9d301e58683"}
Jul 23 01:03:13.460775 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:13.460731    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62" podStartSLOduration=1.460714882 podStartE2EDuration="1.460714882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:03:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:03:13.459679164 +0000 UTC m=+2581.863475622" watchObservedRunningTime="2026-07-23 01:03:13.460714882 +0000 UTC m=+2581.864511338"
Jul 23 01:03:18.151827 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:18.151791    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 01:03:22.984979 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:22.984928    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"
Jul 23 01:03:22.985486 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:22.985000    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"
Jul 23 01:03:22.997757 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:22.997722    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"
Jul 23 01:03:23.499793 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:23.499761    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"
Jul 23 01:03:52.144176 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:52.144100    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"]
Jul 23 01:03:52.147295 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:52.147275    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"
Jul 23 01:03:52.149976 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:52.149951    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-75b665\"/\"rate-test-model-75b665-kserve-self-signed-certs\""
Jul 23 01:03:52.149976 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:52.149965    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-75b665\"/\"openshift-service-ca.crt\""
Jul 23 01:03:52.149976 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:52.149951    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-75b665\"/\"kube-root-ca.crt\""
Jul 23 01:03:52.150208 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:52.150007    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-75b665\"/\"default-dockercfg-br5r5\""
Jul 23 01:03:52.159238 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:52.159215    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"]
Jul 23 01:03:52.217874 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:52.217841    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c9e49fe-5033-407a-a687-235ddee88cd7-model-cache\") pod \"rate-test-model-75b665-kserve-7b6fdcb48c-224jf\" (UID: \"9c9e49fe-5033-407a-a687-235ddee88cd7\") " pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"
Jul 23 01:03:52.217874 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:52.217878    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97r7k\" (UniqueName: \"kubernetes.io/projected/9c9e49fe-5033-407a-a687-235ddee88cd7-kube-api-access-97r7k\") pod \"rate-test-model-75b665-kserve-7b6fdcb48c-224jf\" (UID: \"9c9e49fe-5033-407a-a687-235ddee88cd7\") " pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"
Jul 23 01:03:52.218165 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:52.218006    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c9e49fe-5033-407a-a687-235ddee88cd7-dshm\") pod \"rate-test-model-75b665-kserve-7b6fdcb48c-224jf\" (UID: \"9c9e49fe-5033-407a-a687-235ddee88cd7\") " pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"
Jul 23 01:03:52.218165 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:52.218043    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c9e49fe-5033-407a-a687-235ddee88cd7-tmp-dir\") pod \"rate-test-model-75b665-kserve-7b6fdcb48c-224jf\" (UID: \"9c9e49fe-5033-407a-a687-235ddee88cd7\") " pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"
Jul 23 01:03:52.218299 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:52.218274    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c9e49fe-5033-407a-a687-235ddee88cd7-tls-certs\") pod \"rate-test-model-75b665-kserve-7b6fdcb48c-224jf\" (UID: \"9c9e49fe-5033-407a-a687-235ddee88cd7\") " pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"
Jul 23 01:03:52.218359 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:52.218342    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c9e49fe-5033-407a-a687-235ddee88cd7-home\") pod \"rate-test-model-75b665-kserve-7b6fdcb48c-224jf\" (UID: \"9c9e49fe-5033-407a-a687-235ddee88cd7\") " pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"
Jul 23 01:03:52.319079 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:52.319040    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c9e49fe-5033-407a-a687-235ddee88cd7-tls-certs\") pod \"rate-test-model-75b665-kserve-7b6fdcb48c-224jf\" (UID: \"9c9e49fe-5033-407a-a687-235ddee88cd7\") " pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"
Jul 23 01:03:52.319079 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:52.319083    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c9e49fe-5033-407a-a687-235ddee88cd7-home\") pod \"rate-test-model-75b665-kserve-7b6fdcb48c-224jf\" (UID: \"9c9e49fe-5033-407a-a687-235ddee88cd7\") " pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"
Jul 23 01:03:52.319334 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:52.319120    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c9e49fe-5033-407a-a687-235ddee88cd7-model-cache\") pod \"rate-test-model-75b665-kserve-7b6fdcb48c-224jf\" (UID: \"9c9e49fe-5033-407a-a687-235ddee88cd7\") " pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"
Jul 23 01:03:52.319334 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:52.319138    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97r7k\" (UniqueName: \"kubernetes.io/projected/9c9e49fe-5033-407a-a687-235ddee88cd7-kube-api-access-97r7k\") pod \"rate-test-model-75b665-kserve-7b6fdcb48c-224jf\" (UID: \"9c9e49fe-5033-407a-a687-235ddee88cd7\") " pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"
Jul 23 01:03:52.319334 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:52.319170    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c9e49fe-5033-407a-a687-235ddee88cd7-dshm\") pod \"rate-test-model-75b665-kserve-7b6fdcb48c-224jf\" (UID: \"9c9e49fe-5033-407a-a687-235ddee88cd7\") " pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"
Jul 23 01:03:52.319334 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:52.319195    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c9e49fe-5033-407a-a687-235ddee88cd7-tmp-dir\") pod \"rate-test-model-75b665-kserve-7b6fdcb48c-224jf\" (UID: \"9c9e49fe-5033-407a-a687-235ddee88cd7\") " pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"
Jul 23 01:03:52.319566 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:52.319540    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c9e49fe-5033-407a-a687-235ddee88cd7-model-cache\") pod \"rate-test-model-75b665-kserve-7b6fdcb48c-224jf\" (UID: \"9c9e49fe-5033-407a-a687-235ddee88cd7\") " pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"
Jul 23 01:03:52.319622 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:52.319565    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c9e49fe-5033-407a-a687-235ddee88cd7-home\") pod \"rate-test-model-75b665-kserve-7b6fdcb48c-224jf\" (UID: \"9c9e49fe-5033-407a-a687-235ddee88cd7\") " pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"
Jul 23 01:03:52.319622 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:52.319585    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c9e49fe-5033-407a-a687-235ddee88cd7-tmp-dir\") pod \"rate-test-model-75b665-kserve-7b6fdcb48c-224jf\" (UID: \"9c9e49fe-5033-407a-a687-235ddee88cd7\") " pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"
Jul 23 01:03:52.321519 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:52.321495    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c9e49fe-5033-407a-a687-235ddee88cd7-dshm\") pod \"rate-test-model-75b665-kserve-7b6fdcb48c-224jf\" (UID: \"9c9e49fe-5033-407a-a687-235ddee88cd7\") " pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"
Jul 23 01:03:52.321724 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:52.321705    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c9e49fe-5033-407a-a687-235ddee88cd7-tls-certs\") pod \"rate-test-model-75b665-kserve-7b6fdcb48c-224jf\" (UID: \"9c9e49fe-5033-407a-a687-235ddee88cd7\") " pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"
Jul 23 01:03:52.327139 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:52.327118    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97r7k\" (UniqueName: \"kubernetes.io/projected/9c9e49fe-5033-407a-a687-235ddee88cd7-kube-api-access-97r7k\") pod \"rate-test-model-75b665-kserve-7b6fdcb48c-224jf\" (UID: \"9c9e49fe-5033-407a-a687-235ddee88cd7\") " pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"
Jul 23 01:03:52.456902 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:52.456848    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"
Jul 23 01:03:52.590389 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:52.590353    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"]
Jul 23 01:03:52.592888 ip-10-0-141-176 kubenswrapper[2575]: W0723 01:03:52.592859    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c9e49fe_5033_407a_a687_235ddee88cd7.slice/crio-9184e47c790a65b8e44e36cc94f8a1d30c2c27a47f9ced05e946327a31c41c8d WatchSource:0}: Error finding container 9184e47c790a65b8e44e36cc94f8a1d30c2c27a47f9ced05e946327a31c41c8d: Status 404 returned error can't find the container with id 9184e47c790a65b8e44e36cc94f8a1d30c2c27a47f9ced05e946327a31c41c8d
Jul 23 01:03:52.616903 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:52.616876    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf" event={"ID":"9c9e49fe-5033-407a-a687-235ddee88cd7","Type":"ContainerStarted","Data":"9184e47c790a65b8e44e36cc94f8a1d30c2c27a47f9ced05e946327a31c41c8d"}
Jul 23 01:03:53.622046 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:53.622009    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf" event={"ID":"9c9e49fe-5033-407a-a687-235ddee88cd7","Type":"ContainerStarted","Data":"203a0d46067aa3e7d779844b07f9baf3daa7db77a285b14519b4de3083909286"}
Jul 23 01:03:53.644154 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:53.644105    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf" podStartSLOduration=1.644087125 podStartE2EDuration="1.644087125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:03:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:03:53.641571176 +0000 UTC m=+2622.045367632" watchObservedRunningTime="2026-07-23 01:03:53.644087125 +0000 UTC m=+2622.047883585"
Jul 23 01:03:55.565006 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:03:55.564972    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 01:04:02.457390 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:04:02.457358    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"
Jul 23 01:04:02.457796 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:04:02.457416    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"
Jul 23 01:04:02.469990 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:04:02.469963    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"
Jul 23 01:04:02.674132 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:04:02.674098    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"
Jul 23 01:04:31.273335 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:04:31.273297    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 01:04:53.259067 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:04:53.259031    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 01:04:57.248939 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:04:57.248886    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"]
Jul 23 01:04:58.180498 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:04:58.180454    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"]
Jul 23 01:05:10.453365 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:10.453282    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 01:05:12.198403 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:12.198376    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhvxb_b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9/ovn-acl-logging/0.log"
Jul 23 01:05:12.200975 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:12.200954    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhvxb_b9cdd5cd-7fdd-42d6-ba29-3f0d5e1f5db9/ovn-acl-logging/0.log"
Jul 23 01:05:12.269770 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:12.269710    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62" podUID="87d256e0-d5f0-461e-86fe-ac1a5d64b605" containerName="main" containerID="cri-o://9d5baebbbef13dccaa142850ae6c92a685bdf19a90c255d569b7f249ac99b988" gracePeriod=45
Jul 23 01:05:12.522745 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:12.522722    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"
Jul 23 01:05:12.615716 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:12.615687    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87d256e0-d5f0-461e-86fe-ac1a5d64b605-model-cache\") pod \"87d256e0-d5f0-461e-86fe-ac1a5d64b605\" (UID: \"87d256e0-d5f0-461e-86fe-ac1a5d64b605\") "
Jul 23 01:05:12.615716 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:12.615717    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87d256e0-d5f0-461e-86fe-ac1a5d64b605-dshm\") pod \"87d256e0-d5f0-461e-86fe-ac1a5d64b605\" (UID: \"87d256e0-d5f0-461e-86fe-ac1a5d64b605\") "
Jul 23 01:05:12.616023 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:12.615762    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jxh4\" (UniqueName: \"kubernetes.io/projected/87d256e0-d5f0-461e-86fe-ac1a5d64b605-kube-api-access-2jxh4\") pod \"87d256e0-d5f0-461e-86fe-ac1a5d64b605\" (UID: \"87d256e0-d5f0-461e-86fe-ac1a5d64b605\") "
Jul 23 01:05:12.616023 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:12.615823    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87d256e0-d5f0-461e-86fe-ac1a5d64b605-tls-certs\") pod \"87d256e0-d5f0-461e-86fe-ac1a5d64b605\" (UID: \"87d256e0-d5f0-461e-86fe-ac1a5d64b605\") "
Jul 23 01:05:12.616023 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:12.615837    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87d256e0-d5f0-461e-86fe-ac1a5d64b605-home\") pod \"87d256e0-d5f0-461e-86fe-ac1a5d64b605\" (UID: \"87d256e0-d5f0-461e-86fe-ac1a5d64b605\") "
Jul 23 01:05:12.616023 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:12.615856    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87d256e0-d5f0-461e-86fe-ac1a5d64b605-tmp-dir\") pod \"87d256e0-d5f0-461e-86fe-ac1a5d64b605\" (UID: \"87d256e0-d5f0-461e-86fe-ac1a5d64b605\") "
Jul 23 01:05:12.616023 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:12.616012    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87d256e0-d5f0-461e-86fe-ac1a5d64b605-model-cache" (OuterVolumeSpecName: "model-cache") pod "87d256e0-d5f0-461e-86fe-ac1a5d64b605" (UID: "87d256e0-d5f0-461e-86fe-ac1a5d64b605"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:05:12.616259 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:12.616089    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87d256e0-d5f0-461e-86fe-ac1a5d64b605-model-cache\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 01:05:12.616259 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:12.616165    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87d256e0-d5f0-461e-86fe-ac1a5d64b605-home" (OuterVolumeSpecName: "home") pod "87d256e0-d5f0-461e-86fe-ac1a5d64b605" (UID: "87d256e0-d5f0-461e-86fe-ac1a5d64b605"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:05:12.616259 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:12.616230    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87d256e0-d5f0-461e-86fe-ac1a5d64b605-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "87d256e0-d5f0-461e-86fe-ac1a5d64b605" (UID: "87d256e0-d5f0-461e-86fe-ac1a5d64b605"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:05:12.618148 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:12.618121    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87d256e0-d5f0-461e-86fe-ac1a5d64b605-dshm" (OuterVolumeSpecName: "dshm") pod "87d256e0-d5f0-461e-86fe-ac1a5d64b605" (UID: "87d256e0-d5f0-461e-86fe-ac1a5d64b605"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:05:12.618148 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:12.618122    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87d256e0-d5f0-461e-86fe-ac1a5d64b605-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "87d256e0-d5f0-461e-86fe-ac1a5d64b605" (UID: "87d256e0-d5f0-461e-86fe-ac1a5d64b605"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 01:05:12.618329 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:12.618173    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87d256e0-d5f0-461e-86fe-ac1a5d64b605-kube-api-access-2jxh4" (OuterVolumeSpecName: "kube-api-access-2jxh4") pod "87d256e0-d5f0-461e-86fe-ac1a5d64b605" (UID: "87d256e0-d5f0-461e-86fe-ac1a5d64b605"). InnerVolumeSpecName "kube-api-access-2jxh4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 01:05:12.716545 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:12.716515    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87d256e0-d5f0-461e-86fe-ac1a5d64b605-dshm\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 01:05:12.716545 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:12.716541    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jxh4\" (UniqueName: \"kubernetes.io/projected/87d256e0-d5f0-461e-86fe-ac1a5d64b605-kube-api-access-2jxh4\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 01:05:12.716805 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:12.716556    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87d256e0-d5f0-461e-86fe-ac1a5d64b605-tls-certs\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 01:05:12.716805 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:12.716570    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87d256e0-d5f0-461e-86fe-ac1a5d64b605-home\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 01:05:12.716805 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:12.716601    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87d256e0-d5f0-461e-86fe-ac1a5d64b605-tmp-dir\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 01:05:12.989090 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:12.989053    2575 generic.go:356] "Generic (PLEG): container finished" podID="87d256e0-d5f0-461e-86fe-ac1a5d64b605" containerID="9d5baebbbef13dccaa142850ae6c92a685bdf19a90c255d569b7f249ac99b988" exitCode=0
Jul 23 01:05:12.989090 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:12.989093    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"
Jul 23 01:05:12.989346 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:12.989140    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62" event={"ID":"87d256e0-d5f0-461e-86fe-ac1a5d64b605","Type":"ContainerDied","Data":"9d5baebbbef13dccaa142850ae6c92a685bdf19a90c255d569b7f249ac99b988"}
Jul 23 01:05:12.989346 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:12.989180    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62" event={"ID":"87d256e0-d5f0-461e-86fe-ac1a5d64b605","Type":"ContainerDied","Data":"5ab9ed2f49adb4b8812b6dac947403336583856d7510f440a1b7b9d301e58683"}
Jul 23 01:05:12.989346 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:12.989197    2575 scope.go:117] "RemoveContainer" containerID="9d5baebbbef13dccaa142850ae6c92a685bdf19a90c255d569b7f249ac99b988"
Jul 23 01:05:12.998237 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:12.998220    2575 scope.go:117] "RemoveContainer" containerID="9d5baebbbef13dccaa142850ae6c92a685bdf19a90c255d569b7f249ac99b988"
Jul 23 01:05:12.998469 ip-10-0-141-176 kubenswrapper[2575]: E0723 01:05:12.998453    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d5baebbbef13dccaa142850ae6c92a685bdf19a90c255d569b7f249ac99b988\": container with ID starting with 9d5baebbbef13dccaa142850ae6c92a685bdf19a90c255d569b7f249ac99b988 not found: ID does not exist" containerID="9d5baebbbef13dccaa142850ae6c92a685bdf19a90c255d569b7f249ac99b988"
Jul 23 01:05:12.998512 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:12.998478    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d5baebbbef13dccaa142850ae6c92a685bdf19a90c255d569b7f249ac99b988"} err="failed to get container status \"9d5baebbbef13dccaa142850ae6c92a685bdf19a90c255d569b7f249ac99b988\": rpc error: code = NotFound desc = could not find container \"9d5baebbbef13dccaa142850ae6c92a685bdf19a90c255d569b7f249ac99b988\": container with ID starting with 9d5baebbbef13dccaa142850ae6c92a685bdf19a90c255d569b7f249ac99b988 not found: ID does not exist"
Jul 23 01:05:13.008625 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:13.008602    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"]
Jul 23 01:05:13.012278 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:13.012258    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-b90c57/rate-test-model-b90c57-kserve-85cbbf6c5f-ptv62"]
Jul 23 01:05:13.202305 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:13.202263    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf" podUID="9c9e49fe-5033-407a-a687-235ddee88cd7" containerName="main" containerID="cri-o://203a0d46067aa3e7d779844b07f9baf3daa7db77a285b14519b4de3083909286" gracePeriod=45
Jul 23 01:05:13.453506 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:13.453475    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"
Jul 23 01:05:13.524248 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:13.524211    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c9e49fe-5033-407a-a687-235ddee88cd7-tmp-dir\") pod \"9c9e49fe-5033-407a-a687-235ddee88cd7\" (UID: \"9c9e49fe-5033-407a-a687-235ddee88cd7\") "
Jul 23 01:05:13.524441 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:13.524263    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97r7k\" (UniqueName: \"kubernetes.io/projected/9c9e49fe-5033-407a-a687-235ddee88cd7-kube-api-access-97r7k\") pod \"9c9e49fe-5033-407a-a687-235ddee88cd7\" (UID: \"9c9e49fe-5033-407a-a687-235ddee88cd7\") "
Jul 23 01:05:13.524441 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:13.524287    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c9e49fe-5033-407a-a687-235ddee88cd7-tls-certs\") pod \"9c9e49fe-5033-407a-a687-235ddee88cd7\" (UID: \"9c9e49fe-5033-407a-a687-235ddee88cd7\") "
Jul 23 01:05:13.524441 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:13.524355    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c9e49fe-5033-407a-a687-235ddee88cd7-home\") pod \"9c9e49fe-5033-407a-a687-235ddee88cd7\" (UID: \"9c9e49fe-5033-407a-a687-235ddee88cd7\") "
Jul 23 01:05:13.524441 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:13.524383    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c9e49fe-5033-407a-a687-235ddee88cd7-model-cache\") pod \"9c9e49fe-5033-407a-a687-235ddee88cd7\" (UID: \"9c9e49fe-5033-407a-a687-235ddee88cd7\") "
Jul 23 01:05:13.524441 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:13.524417    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c9e49fe-5033-407a-a687-235ddee88cd7-dshm\") pod \"9c9e49fe-5033-407a-a687-235ddee88cd7\" (UID: \"9c9e49fe-5033-407a-a687-235ddee88cd7\") "
Jul 23 01:05:13.524682 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:13.524518    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c9e49fe-5033-407a-a687-235ddee88cd7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9c9e49fe-5033-407a-a687-235ddee88cd7" (UID: "9c9e49fe-5033-407a-a687-235ddee88cd7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:05:13.524682 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:13.524605    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c9e49fe-5033-407a-a687-235ddee88cd7-home" (OuterVolumeSpecName: "home") pod "9c9e49fe-5033-407a-a687-235ddee88cd7" (UID: "9c9e49fe-5033-407a-a687-235ddee88cd7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:05:13.524682 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:13.524616    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c9e49fe-5033-407a-a687-235ddee88cd7-model-cache" (OuterVolumeSpecName: "model-cache") pod "9c9e49fe-5033-407a-a687-235ddee88cd7" (UID: "9c9e49fe-5033-407a-a687-235ddee88cd7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:05:13.524835 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:13.524711    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c9e49fe-5033-407a-a687-235ddee88cd7-tmp-dir\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 01:05:13.524835 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:13.524726    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c9e49fe-5033-407a-a687-235ddee88cd7-home\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 01:05:13.524835 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:13.524735    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c9e49fe-5033-407a-a687-235ddee88cd7-model-cache\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 01:05:13.526574 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:13.526552    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c9e49fe-5033-407a-a687-235ddee88cd7-dshm" (OuterVolumeSpecName: "dshm") pod "9c9e49fe-5033-407a-a687-235ddee88cd7" (UID: "9c9e49fe-5033-407a-a687-235ddee88cd7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:05:13.526574 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:13.526565    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c9e49fe-5033-407a-a687-235ddee88cd7-kube-api-access-97r7k" (OuterVolumeSpecName: "kube-api-access-97r7k") pod "9c9e49fe-5033-407a-a687-235ddee88cd7" (UID: "9c9e49fe-5033-407a-a687-235ddee88cd7"). InnerVolumeSpecName "kube-api-access-97r7k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 01:05:13.526685 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:13.526589    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c9e49fe-5033-407a-a687-235ddee88cd7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9c9e49fe-5033-407a-a687-235ddee88cd7" (UID: "9c9e49fe-5033-407a-a687-235ddee88cd7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 01:05:13.625584 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:13.625552    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97r7k\" (UniqueName: \"kubernetes.io/projected/9c9e49fe-5033-407a-a687-235ddee88cd7-kube-api-access-97r7k\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 01:05:13.625584 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:13.625579    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c9e49fe-5033-407a-a687-235ddee88cd7-tls-certs\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 01:05:13.625584 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:13.625588    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c9e49fe-5033-407a-a687-235ddee88cd7-dshm\") on node \"ip-10-0-141-176.ec2.internal\" DevicePath \"\""
Jul 23 01:05:13.996168 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:13.996131    2575 generic.go:356] "Generic (PLEG): container finished" podID="9c9e49fe-5033-407a-a687-235ddee88cd7" containerID="203a0d46067aa3e7d779844b07f9baf3daa7db77a285b14519b4de3083909286" exitCode=0
Jul 23 01:05:13.996377 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:13.996189    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf" event={"ID":"9c9e49fe-5033-407a-a687-235ddee88cd7","Type":"ContainerDied","Data":"203a0d46067aa3e7d779844b07f9baf3daa7db77a285b14519b4de3083909286"}
Jul 23 01:05:13.996377 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:13.996214    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"
Jul 23 01:05:13.996377 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:13.996233    2575 scope.go:117] "RemoveContainer" containerID="203a0d46067aa3e7d779844b07f9baf3daa7db77a285b14519b4de3083909286"
Jul 23 01:05:13.996377 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:13.996222    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf" event={"ID":"9c9e49fe-5033-407a-a687-235ddee88cd7","Type":"ContainerDied","Data":"9184e47c790a65b8e44e36cc94f8a1d30c2c27a47f9ced05e946327a31c41c8d"}
Jul 23 01:05:14.006703 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:14.006686    2575 scope.go:117] "RemoveContainer" containerID="203a0d46067aa3e7d779844b07f9baf3daa7db77a285b14519b4de3083909286"
Jul 23 01:05:14.006975 ip-10-0-141-176 kubenswrapper[2575]: E0723 01:05:14.006953    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"203a0d46067aa3e7d779844b07f9baf3daa7db77a285b14519b4de3083909286\": container with ID starting with 203a0d46067aa3e7d779844b07f9baf3daa7db77a285b14519b4de3083909286 not found: ID does not exist" containerID="203a0d46067aa3e7d779844b07f9baf3daa7db77a285b14519b4de3083909286"
Jul 23 01:05:14.007053 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:14.006985    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"203a0d46067aa3e7d779844b07f9baf3daa7db77a285b14519b4de3083909286"} err="failed to get container status \"203a0d46067aa3e7d779844b07f9baf3daa7db77a285b14519b4de3083909286\": rpc error: code = NotFound desc = could not find container \"203a0d46067aa3e7d779844b07f9baf3daa7db77a285b14519b4de3083909286\": container with ID starting with 203a0d46067aa3e7d779844b07f9baf3daa7db77a285b14519b4de3083909286 not found: ID does not exist"
Jul 23 01:05:14.016173 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:14.016151    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"]
Jul 23 01:05:14.020925 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:14.020890    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-75b665/rate-test-model-75b665-kserve-7b6fdcb48c-224jf"]
Jul 23 01:05:14.127854 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:14.127821    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87d256e0-d5f0-461e-86fe-ac1a5d64b605" path="/var/lib/kubelet/pods/87d256e0-d5f0-461e-86fe-ac1a5d64b605/volumes"
Jul 23 01:05:14.128222 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:14.128208    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c9e49fe-5033-407a-a687-235ddee88cd7" path="/var/lib/kubelet/pods/9c9e49fe-5033-407a-a687-235ddee88cd7/volumes"
Jul 23 01:05:30.156266 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:30.156232    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 01:05:52.868273 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:05:52.868236    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-24n2q"]
Jul 23 01:06:01.779005 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:01.778972    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-667c59d9d8-2w9jz_55f29927-2fbe-4289-b6ab-06decfe49a2d/authorino/0.log"
Jul 23 01:06:07.367331 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:07.367303    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-gbk9t_6f5ad1df-3fca-439e-a497-cfb2e9b5abd6/manager/0.log"
Jul 23 01:06:08.025305 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:08.025276    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8844c5db8-99wht_f40f44ec-ef17-4a08-bb43-0e97e404e012/copy-manifests/0.log"
Jul 23 01:06:08.033126 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:08.033102    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8844c5db8-99wht_f40f44ec-ef17-4a08-bb43-0e97e404e012/manager/0.log"
Jul 23 01:06:10.482212 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:10.482178    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-667c59d9d8-2w9jz_55f29927-2fbe-4289-b6ab-06decfe49a2d/authorino/0.log"
Jul 23 01:06:10.841104 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:10.841026    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-whwfd_5da15e12-dbb2-4333-bb81-bb4ba87ff4a1/kuadrant-console-plugin/0.log"
Jul 23 01:06:11.271779 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:11.271752    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-24n2q_bd87d66a-faf7-4a41-ba16-3a672ea8a7c2/limitador/0.log"
Jul 23 01:06:12.151028 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:12.150994    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c7d578648-f7ns9_49318c5f-cdb9-4ea0-b402-3bb49b67644f/kube-auth-proxy/0.log"
Jul 23 01:06:13.377445 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:13.377419    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f27xz7_abe7524a-b31f-43ff-84b7-4a73fd65288e/main/0.log"
Jul 23 01:06:13.618590 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:13.618565    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-dknz7_0a37524e-81e6-4dca-87e9-36b9a09f1e48/main/0.log"
Jul 23 01:06:22.492947 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:22.492901    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-sjjx7_18b6cfa7-6d8f-4934-b78c-789e54bdbac9/global-pull-secret-syncer/0.log"
Jul 23 01:06:22.622930 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:22.622896    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fw9dw_e2d0a009-a5ef-4d0e-a294-3e1f34647c9a/konnectivity-agent/0.log"
Jul 23 01:06:22.729240 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:22.729217    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-176.ec2.internal_4a00a11760339a8d98a59b9745057c66/haproxy/0.log"
Jul 23 01:06:27.796280 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:27.796191    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-667c59d9d8-2w9jz_55f29927-2fbe-4289-b6ab-06decfe49a2d/authorino/0.log"
Jul 23 01:06:27.903596 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:27.903566    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-whwfd_5da15e12-dbb2-4333-bb81-bb4ba87ff4a1/kuadrant-console-plugin/0.log"
Jul 23 01:06:28.181134 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:28.181103    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-24n2q_bd87d66a-faf7-4a41-ba16-3a672ea8a7c2/limitador/0.log"
Jul 23 01:06:30.005325 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:30.005299    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-2l2ld_a823e66e-cd38-4e40-a920-a0d75a158011/kube-state-metrics/0.log"
Jul 23 01:06:30.024630 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:30.024604    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-2l2ld_a823e66e-cd38-4e40-a920-a0d75a158011/kube-rbac-proxy-main/0.log"
Jul 23 01:06:30.048710 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:30.048683    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-2l2ld_a823e66e-cd38-4e40-a920-a0d75a158011/kube-rbac-proxy-self/0.log"
Jul 23 01:06:30.082897 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:30.082868    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5ffb48784-4fmw9_c8952341-5010-4da4-8713-7812a19701d5/metrics-server/0.log"
Jul 23 01:06:30.325979 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:30.325883    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zlrql_cffc3a24-6dbc-4704-be1a-5cc56ab9f522/node-exporter/0.log"
Jul 23 01:06:30.347134 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:30.347105    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zlrql_cffc3a24-6dbc-4704-be1a-5cc56ab9f522/kube-rbac-proxy/0.log"
Jul 23 01:06:30.368527 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:30.368505    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zlrql_cffc3a24-6dbc-4704-be1a-5cc56ab9f522/init-textfile/0.log"
Jul 23 01:06:30.496006 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:30.495979    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a094377-c795-429c-9bcf-096d0e0a8c93/prometheus/0.log"
Jul 23 01:06:30.518402 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:30.518375    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a094377-c795-429c-9bcf-096d0e0a8c93/config-reloader/0.log"
Jul 23 01:06:30.543377 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:30.543349    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a094377-c795-429c-9bcf-096d0e0a8c93/thanos-sidecar/0.log"
Jul 23 01:06:30.564785 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:30.564758    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a094377-c795-429c-9bcf-096d0e0a8c93/kube-rbac-proxy-web/0.log"
Jul 23 01:06:30.590529 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:30.590458    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a094377-c795-429c-9bcf-096d0e0a8c93/kube-rbac-proxy/0.log"
Jul 23 01:06:30.613501 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:30.613472    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a094377-c795-429c-9bcf-096d0e0a8c93/kube-rbac-proxy-thanos/0.log"
Jul 23 01:06:30.636101 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:30.636074    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a094377-c795-429c-9bcf-096d0e0a8c93/init-config-reloader/0.log"
Jul 23 01:06:30.666692 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:30.666658    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-vx6kl_daf53431-eab4-4429-8cc7-06ef23ca4ae6/prometheus-operator/0.log"
Jul 23 01:06:30.687589 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:30.687561    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-vx6kl_daf53431-eab4-4429-8cc7-06ef23ca4ae6/kube-rbac-proxy/0.log"
Jul 23 01:06:32.457569 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:32.457491    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rz22l/perf-node-gather-daemonset-fqcwn"]
Jul 23 01:06:32.457974 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:32.457803    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c9e49fe-5033-407a-a687-235ddee88cd7" containerName="main"
Jul 23 01:06:32.457974 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:32.457815    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c9e49fe-5033-407a-a687-235ddee88cd7" containerName="main"
Jul 23 01:06:32.457974 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:32.457833    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87d256e0-d5f0-461e-86fe-ac1a5d64b605" containerName="main"
Jul 23 01:06:32.457974 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:32.457839    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="87d256e0-d5f0-461e-86fe-ac1a5d64b605" containerName="main"
Jul 23 01:06:32.457974 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:32.457890    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="87d256e0-d5f0-461e-86fe-ac1a5d64b605" containerName="main"
Jul 23 01:06:32.457974 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:32.457898    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c9e49fe-5033-407a-a687-235ddee88cd7" containerName="main"
Jul 23 01:06:32.460948 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:32.460905    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rz22l/perf-node-gather-daemonset-fqcwn"
Jul 23 01:06:32.463116 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:32.463094    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rz22l\"/\"openshift-service-ca.crt\""
Jul 23 01:06:32.463223 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:32.463102    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rz22l\"/\"kube-root-ca.crt\""
Jul 23 01:06:32.463223 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:32.463102    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rz22l\"/\"default-dockercfg-htbdw\""
Jul 23 01:06:32.468366 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:32.468344    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rz22l/perf-node-gather-daemonset-fqcwn"]
Jul 23 01:06:32.603012 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:32.602974    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/52416ade-49f6-469e-8b19-659cc04a4112-proc\") pod \"perf-node-gather-daemonset-fqcwn\" (UID: \"52416ade-49f6-469e-8b19-659cc04a4112\") " pod="openshift-must-gather-rz22l/perf-node-gather-daemonset-fqcwn"
Jul 23 01:06:32.603192 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:32.603043    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52416ade-49f6-469e-8b19-659cc04a4112-sys\") pod \"perf-node-gather-daemonset-fqcwn\" (UID: \"52416ade-49f6-469e-8b19-659cc04a4112\") " pod="openshift-must-gather-rz22l/perf-node-gather-daemonset-fqcwn"
Jul 23 01:06:32.603192 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:32.603075    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nztk2\" (UniqueName: \"kubernetes.io/projected/52416ade-49f6-469e-8b19-659cc04a4112-kube-api-access-nztk2\") pod \"perf-node-gather-daemonset-fqcwn\" (UID: \"52416ade-49f6-469e-8b19-659cc04a4112\") " pod="openshift-must-gather-rz22l/perf-node-gather-daemonset-fqcwn"
Jul 23 01:06:32.603192 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:32.603113    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/52416ade-49f6-469e-8b19-659cc04a4112-podres\") pod \"perf-node-gather-daemonset-fqcwn\" (UID: \"52416ade-49f6-469e-8b19-659cc04a4112\") " pod="openshift-must-gather-rz22l/perf-node-gather-daemonset-fqcwn"
Jul 23 01:06:32.603192 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:32.603132    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/52416ade-49f6-469e-8b19-659cc04a4112-lib-modules\") pod \"perf-node-gather-daemonset-fqcwn\" (UID: \"52416ade-49f6-469e-8b19-659cc04a4112\") " pod="openshift-must-gather-rz22l/perf-node-gather-daemonset-fqcwn"
Jul 23 01:06:32.703981 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:32.703946    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/52416ade-49f6-469e-8b19-659cc04a4112-proc\") pod \"perf-node-gather-daemonset-fqcwn\" (UID: \"52416ade-49f6-469e-8b19-659cc04a4112\") " pod="openshift-must-gather-rz22l/perf-node-gather-daemonset-fqcwn"
Jul 23 01:06:32.704157 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:32.704012    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52416ade-49f6-469e-8b19-659cc04a4112-sys\") pod \"perf-node-gather-daemonset-fqcwn\" (UID: \"52416ade-49f6-469e-8b19-659cc04a4112\") " pod="openshift-must-gather-rz22l/perf-node-gather-daemonset-fqcwn"
Jul 23 01:06:32.704157 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:32.704038    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nztk2\" (UniqueName: \"kubernetes.io/projected/52416ade-49f6-469e-8b19-659cc04a4112-kube-api-access-nztk2\") pod \"perf-node-gather-daemonset-fqcwn\" (UID: \"52416ade-49f6-469e-8b19-659cc04a4112\") " pod="openshift-must-gather-rz22l/perf-node-gather-daemonset-fqcwn"
Jul 23 01:06:32.704157 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:32.704068    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/52416ade-49f6-469e-8b19-659cc04a4112-proc\") pod \"perf-node-gather-daemonset-fqcwn\" (UID: \"52416ade-49f6-469e-8b19-659cc04a4112\") " pod="openshift-must-gather-rz22l/perf-node-gather-daemonset-fqcwn"
Jul 23 01:06:32.704157 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:32.704089    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/52416ade-49f6-469e-8b19-659cc04a4112-podres\") pod \"perf-node-gather-daemonset-fqcwn\" (UID: \"52416ade-49f6-469e-8b19-659cc04a4112\") " pod="openshift-must-gather-rz22l/perf-node-gather-daemonset-fqcwn"
Jul 23 01:06:32.704157 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:32.704118    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/52416ade-49f6-469e-8b19-659cc04a4112-lib-modules\") pod \"perf-node-gather-daemonset-fqcwn\" (UID: \"52416ade-49f6-469e-8b19-659cc04a4112\") " pod="openshift-must-gather-rz22l/perf-node-gather-daemonset-fqcwn"
Jul 23 01:06:32.704157 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:32.704126    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52416ade-49f6-469e-8b19-659cc04a4112-sys\") pod \"perf-node-gather-daemonset-fqcwn\" (UID: \"52416ade-49f6-469e-8b19-659cc04a4112\") " pod="openshift-must-gather-rz22l/perf-node-gather-daemonset-fqcwn"
Jul 23 01:06:32.704367 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:32.704220    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/52416ade-49f6-469e-8b19-659cc04a4112-lib-modules\") pod \"perf-node-gather-daemonset-fqcwn\" (UID: \"52416ade-49f6-469e-8b19-659cc04a4112\") " pod="openshift-must-gather-rz22l/perf-node-gather-daemonset-fqcwn"
Jul 23 01:06:32.704367 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:32.704221    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/52416ade-49f6-469e-8b19-659cc04a4112-podres\") pod \"perf-node-gather-daemonset-fqcwn\" (UID: \"52416ade-49f6-469e-8b19-659cc04a4112\") " pod="openshift-must-gather-rz22l/perf-node-gather-daemonset-fqcwn"
Jul 23 01:06:32.711028 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:32.710964    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nztk2\" (UniqueName: \"kubernetes.io/projected/52416ade-49f6-469e-8b19-659cc04a4112-kube-api-access-nztk2\") pod \"perf-node-gather-daemonset-fqcwn\" (UID: \"52416ade-49f6-469e-8b19-659cc04a4112\") " pod="openshift-must-gather-rz22l/perf-node-gather-daemonset-fqcwn"
Jul 23 01:06:32.771526 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:32.771490    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rz22l/perf-node-gather-daemonset-fqcwn"
Jul 23 01:06:32.913033 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:32.912936    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rz22l/perf-node-gather-daemonset-fqcwn"]
Jul 23 01:06:32.915968 ip-10-0-141-176 kubenswrapper[2575]: W0723 01:06:32.915942    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod52416ade_49f6_469e_8b19_659cc04a4112.slice/crio-0891b38e2ff8133cc5d499240ed036991902408cc6188e6518dd781ebaec4749 WatchSource:0}: Error finding container 0891b38e2ff8133cc5d499240ed036991902408cc6188e6518dd781ebaec4749: Status 404 returned error can't find the container with id 0891b38e2ff8133cc5d499240ed036991902408cc6188e6518dd781ebaec4749
Jul 23 01:06:33.342731 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:33.342634    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rz22l/perf-node-gather-daemonset-fqcwn" event={"ID":"52416ade-49f6-469e-8b19-659cc04a4112","Type":"ContainerStarted","Data":"a5a384a7aeea5d9c66c33e296684b55f2e202b5ce02f43472aadb200eb1d336e"}
Jul 23 01:06:33.342731 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:33.342701    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rz22l/perf-node-gather-daemonset-fqcwn" event={"ID":"52416ade-49f6-469e-8b19-659cc04a4112","Type":"ContainerStarted","Data":"0891b38e2ff8133cc5d499240ed036991902408cc6188e6518dd781ebaec4749"}
Jul 23 01:06:33.342995 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:33.342741    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rz22l/perf-node-gather-daemonset-fqcwn"
Jul 23 01:06:33.357603 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:33.357027    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rz22l/perf-node-gather-daemonset-fqcwn" podStartSLOduration=1.357005997 podStartE2EDuration="1.357005997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 01:06:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:06:33.356550129 +0000 UTC m=+2781.760346588" watchObservedRunningTime="2026-07-23 01:06:33.357005997 +0000 UTC m=+2781.760802457"
Jul 23 01:06:35.255370 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:35.255341    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vj6tt_de945bad-e9e4-400d-9508-babe1303c5c8/dns/0.log"
Jul 23 01:06:35.282632 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:35.282606    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vj6tt_de945bad-e9e4-400d-9508-babe1303c5c8/kube-rbac-proxy/0.log"
Jul 23 01:06:35.309467 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:35.309439    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7wb6q_d20d0267-ce15-40ee-8f79-a24b8ef3016c/dns-node-resolver/0.log"
Jul 23 01:06:35.950214 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:35.950184    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rstk9_3c56952e-6052-40d6-ac90-f998ec05586a/node-ca/0.log"
Jul 23 01:06:37.114330 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:37.114301    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c7d578648-f7ns9_49318c5f-cdb9-4ea0-b402-3bb49b67644f/kube-auth-proxy/0.log"
Jul 23 01:06:37.956582 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:37.956554    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lttw5_5dbe765c-2934-40bd-97b9-75fc214b64a8/serve-healthcheck-canary/0.log"
Jul 23 01:06:38.546248 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:38.546212    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8mfn4_841648a1-4dc3-4f9b-8d9a-73ff42247e97/kube-rbac-proxy/0.log"
Jul 23 01:06:38.569364 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:38.569331    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8mfn4_841648a1-4dc3-4f9b-8d9a-73ff42247e97/exporter/0.log"
Jul 23 01:06:38.590701 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:38.590666    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8mfn4_841648a1-4dc3-4f9b-8d9a-73ff42247e97/extractor/0.log"
Jul 23 01:06:39.356490 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:39.356460    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rz22l/perf-node-gather-daemonset-fqcwn"
Jul 23 01:06:40.724539 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:40.724513    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-gbk9t_6f5ad1df-3fca-439e-a497-cfb2e9b5abd6/manager/0.log"
Jul 23 01:06:41.280255 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:41.280224    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8844c5db8-99wht_f40f44ec-ef17-4a08-bb43-0e97e404e012/manager/0.log"
Jul 23 01:06:41.305772 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:41.305745    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8844c5db8-99wht_f40f44ec-ef17-4a08-bb43-0e97e404e012/copy-manifests/0.log"
Jul 23 01:06:42.915587 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:42.915557    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6958b76574-n6hh7_157f0e77-d450-47cb-bca0-cfc72b993919/manager/0.log"
Jul 23 01:06:42.971183 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:42.971152    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-h4llq_3a8833d9-ec42-4088-866e-1120e9ba922b/openshift-lws-operator/0.log"
Jul 23 01:06:43.302322 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:43.302246    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c7d578648-f7ns9_49318c5f-cdb9-4ea0-b402-3bb49b67644f/kube-auth-proxy/0.log"
Jul 23 01:06:44.762493 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:44.762459    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c7d578648-f7ns9_49318c5f-cdb9-4ea0-b402-3bb49b67644f/kube-auth-proxy/0.log"
Jul 23 01:06:49.335240 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:49.335203    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8hpmj_17093c98-5d84-4987-a1d7-d480d4f3bc29/kube-multus/0.log"
Jul 23 01:06:49.527095 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:49.527066    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-45m4m_5354d283-a176-4db3-89b3-59b7d2081668/kube-multus-additional-cni-plugins/0.log"
Jul 23 01:06:49.552590 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:49.552563    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-45m4m_5354d283-a176-4db3-89b3-59b7d2081668/egress-router-binary-copy/0.log"
Jul 23 01:06:49.575114 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:49.575086    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-45m4m_5354d283-a176-4db3-89b3-59b7d2081668/cni-plugins/0.log"
Jul 23 01:06:49.596344 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:49.596275    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-45m4m_5354d283-a176-4db3-89b3-59b7d2081668/bond-cni-plugin/0.log"
Jul 23 01:06:49.617272 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:49.617243    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-45m4m_5354d283-a176-4db3-89b3-59b7d2081668/routeoverride-cni/0.log"
Jul 23 01:06:49.642881 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:49.642858    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-45m4m_5354d283-a176-4db3-89b3-59b7d2081668/whereabouts-cni-bincopy/0.log"
Jul 23 01:06:49.669551 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:49.669519    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-45m4m_5354d283-a176-4db3-89b3-59b7d2081668/whereabouts-cni/0.log"
Jul 23 01:06:49.973260 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:49.973234    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5bdx2_a594d680-4ddd-4df4-9130-0a4e075dd19a/network-metrics-daemon/0.log"
Jul 23 01:06:49.993718 ip-10-0-141-176 kubenswrapper[2575]: I0723 01:06:49.993696    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5bdx2_a594d680-4ddd-4df4-9130-0a4e075dd19a/kube-rbac-proxy/0.log"