Sep 08 13:56:43.649509 ip-10-0-130-125 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 08 13:56:43.649518 ip-10-0-130-125 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 08 13:56:43.649525 ip-10-0-130-125 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 08 13:56:43.649737 ip-10-0-130-125 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 08 13:56:53.762695 ip-10-0-130-125 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 08 13:56:53.762715 ip-10-0-130-125 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 2fde6ddef6cf430ca9c04e0303f2ff8d --
Sep 08 13:58:44.386304 ip-10-0-130-125 systemd[1]: Starting Kubernetes Kubelet...
Sep 08 13:58:44.780256 ip-10-0-130-125 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 13:58:44.780256 ip-10-0-130-125 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 08 13:58:44.780256 ip-10-0-130-125 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 13:58:44.780256 ip-10-0-130-125 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 08 13:58:44.780256 ip-10-0-130-125 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 13:58:44.782378 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.782296    2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 08 13:58:44.789234 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789219    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 13:58:44.789234 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789233    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 13:58:44.789306 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789237    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 13:58:44.789306 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789240    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 13:58:44.789306 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789244    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 13:58:44.789306 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789247    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 13:58:44.789306 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789250    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 13:58:44.789306 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789253    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 13:58:44.789306 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789256    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 13:58:44.789306 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789260    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 13:58:44.789306 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789264    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 13:58:44.789306 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789267    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 13:58:44.789306 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789270    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 13:58:44.789306 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789273    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 13:58:44.789306 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789276    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 13:58:44.789306 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789279    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 13:58:44.789306 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789282    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 13:58:44.789306 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789284    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 13:58:44.789306 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789287    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 13:58:44.789306 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789289    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 13:58:44.789306 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789292    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 13:58:44.789750 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789294    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 13:58:44.789750 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789297    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 13:58:44.789750 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789299    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 13:58:44.789750 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789302    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 13:58:44.789750 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789305    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 13:58:44.789750 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789307    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 13:58:44.789750 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789310    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 13:58:44.789750 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789313    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 13:58:44.789750 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789315    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 13:58:44.789750 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789318    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 13:58:44.789750 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789321    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 13:58:44.789750 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789324    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 13:58:44.789750 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789326    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 13:58:44.789750 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789329    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 13:58:44.789750 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789331    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 13:58:44.789750 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789334    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 13:58:44.789750 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789336    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 13:58:44.789750 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789339    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 13:58:44.789750 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789341    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 13:58:44.790214 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789344    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 13:58:44.790214 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789346    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 13:58:44.790214 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789349    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 13:58:44.790214 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789352    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 13:58:44.790214 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789354    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 13:58:44.790214 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789356    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 13:58:44.790214 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789359    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 13:58:44.790214 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789361    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 13:58:44.790214 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789365    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 13:58:44.790214 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789369    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 13:58:44.790214 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789371    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 13:58:44.790214 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789374    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 13:58:44.790214 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789377    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 13:58:44.790214 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789380    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 13:58:44.790214 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789383    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 13:58:44.790214 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789387    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 13:58:44.790214 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789390    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 13:58:44.790214 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789392    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 13:58:44.790214 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789395    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 13:58:44.790214 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789398    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 13:58:44.790681 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789400    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 13:58:44.790681 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789403    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 13:58:44.790681 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789406    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 13:58:44.790681 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789408    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 13:58:44.790681 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789411    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 13:58:44.790681 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789413    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 13:58:44.790681 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789416    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 13:58:44.790681 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789418    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 13:58:44.790681 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789421    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 13:58:44.790681 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789423    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 13:58:44.790681 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789427    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 13:58:44.790681 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789429    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 13:58:44.790681 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789432    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 13:58:44.790681 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789435    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 13:58:44.790681 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789438    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 13:58:44.790681 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789440    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 13:58:44.790681 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789443    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 13:58:44.790681 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789447    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 13:58:44.790681 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789450    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 13:58:44.790681 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789454    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 13:58:44.791209 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789457    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 13:58:44.791209 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789459    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 13:58:44.791209 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789462    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 13:58:44.791209 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789464    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 13:58:44.791209 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789467    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 13:58:44.791209 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789469    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 13:58:44.791209 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789472    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 13:58:44.791209 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789474    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 13:58:44.791209 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789477    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 13:58:44.791209 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789479    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 13:58:44.791209 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789482    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 13:58:44.791209 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789484    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 13:58:44.791209 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789487    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 13:58:44.791209 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789489    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 13:58:44.791209 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789492    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 13:58:44.791209 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789494    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 13:58:44.791209 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789496    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 13:58:44.791209 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789499    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 13:58:44.791209 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.789501    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 13:58:44.791209 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790792    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 13:58:44.791684 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790800    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 13:58:44.791684 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790804    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 13:58:44.791684 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790807    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 13:58:44.791684 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790810    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 13:58:44.791684 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790813    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 13:58:44.791684 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790816    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 13:58:44.791684 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790819    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 13:58:44.791684 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790821    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 13:58:44.791684 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790823    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 13:58:44.791684 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790826    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 13:58:44.791684 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790829    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 13:58:44.791684 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790831    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 13:58:44.791684 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790834    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 13:58:44.791684 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790836    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 13:58:44.791684 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790839    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 13:58:44.791684 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790842    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 13:58:44.791684 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790844    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 13:58:44.791684 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790847    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 13:58:44.791684 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790850    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 13:58:44.791684 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790853    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 13:58:44.792324 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790855    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 13:58:44.792324 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790858    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 13:58:44.792324 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790860    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 13:58:44.792324 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790863    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 13:58:44.792324 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790865    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 13:58:44.792324 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790868    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 13:58:44.792324 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790870    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 13:58:44.792324 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790873    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 13:58:44.792324 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790875    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 13:58:44.792324 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790878    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 13:58:44.792324 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790881    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 13:58:44.792324 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790886    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 13:58:44.792324 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790889    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 13:58:44.792324 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790891    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 13:58:44.792324 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790894    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 13:58:44.792324 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790896    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 13:58:44.792324 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790899    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 13:58:44.792324 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790902    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 13:58:44.792324 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790905    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 13:58:44.792324 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790908    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 13:58:44.792809 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790910    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 13:58:44.792809 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790913    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 13:58:44.792809 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790915    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 13:58:44.792809 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790918    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 13:58:44.792809 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790920    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 13:58:44.792809 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790923    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 13:58:44.792809 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790925    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 13:58:44.792809 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790928    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 13:58:44.792809 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790930    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 13:58:44.792809 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790933    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 13:58:44.792809 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790935    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 13:58:44.792809 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790938    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 13:58:44.792809 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790940    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 13:58:44.792809 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790943    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 13:58:44.792809 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790945    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 13:58:44.792809 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790948    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 13:58:44.792809 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790951    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 13:58:44.792809 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790953    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 13:58:44.792809 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790956    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 13:58:44.792809 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790958    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 13:58:44.793302 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790960    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 13:58:44.793302 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790963    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 13:58:44.793302 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790965    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 13:58:44.793302 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790968    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 13:58:44.793302 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790970    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 13:58:44.793302 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790973    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 13:58:44.793302 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790975    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 13:58:44.793302 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790977    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 13:58:44.793302 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790980    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 13:58:44.793302 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790984    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 13:58:44.793302 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790987    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 13:58:44.793302 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790990    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 13:58:44.793302 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790993    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 13:58:44.793302 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.790996    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 13:58:44.793302 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791000    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 13:58:44.793302 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791003    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 13:58:44.793302 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791006    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 13:58:44.793302 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791008    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 13:58:44.793302 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791011    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 13:58:44.793763 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791013    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 13:58:44.793763 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791016    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 13:58:44.793763 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791018    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 13:58:44.793763 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791021    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 13:58:44.793763 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791024    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 13:58:44.793763 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791026    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 13:58:44.793763 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791028    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 13:58:44.793763 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791031    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 13:58:44.793763 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791033    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 13:58:44.793763 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791036    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 13:58:44.793763 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791039    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 13:58:44.793763 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791043    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 13:58:44.793763 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791046    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 13:58:44.793763 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791048    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 13:58:44.793763 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791066    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 13:58:44.793763 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791069    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 13:58:44.793763 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791072    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 13:58:44.793763 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791074    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 13:58:44.793763 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791077    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 13:58:44.794229 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791417    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 13:58:44.794229 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791422    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 13:58:44.794229 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791424    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 13:58:44.794229 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791428    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 13:58:44.794229 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791431    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 13:58:44.794229 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791433    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 13:58:44.794229 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791438    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 13:58:44.794229 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791442    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 13:58:44.794229 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791445    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 13:58:44.794229 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791449    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 13:58:44.794229 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791453    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 13:58:44.794229 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791456    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 13:58:44.794229 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791459    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 13:58:44.794229 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791462    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 13:58:44.794229 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791465    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 13:58:44.794229 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791467    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 13:58:44.794229 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791470    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 13:58:44.794229 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791473    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 13:58:44.794229 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791476    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 13:58:44.794690 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791478    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 13:58:44.794690 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791489    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 13:58:44.794690 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791493    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 13:58:44.794690 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791497    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 13:58:44.794690 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791500    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 13:58:44.794690 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791503    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 13:58:44.794690 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791505    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 13:58:44.794690 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791508    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 13:58:44.794690 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791510    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 13:58:44.794690 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791513    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 13:58:44.794690 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791515    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 13:58:44.794690 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791518    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 13:58:44.794690 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791521    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 13:58:44.794690 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791525    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 13:58:44.794690 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791528    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 13:58:44.794690 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791530    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 13:58:44.794690 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791533    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 13:58:44.794690 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791537    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 13:58:44.794690 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791541    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 13:58:44.795160 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791543    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 13:58:44.795160 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791546    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 13:58:44.795160 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791548    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 13:58:44.795160 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791551    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 13:58:44.795160 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791553    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 13:58:44.795160 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791555    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 13:58:44.795160 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791558    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 13:58:44.795160 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791560    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 13:58:44.795160 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791563    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 13:58:44.795160 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791565    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 13:58:44.795160 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791567    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 13:58:44.795160 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791570    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 13:58:44.795160 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791572    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 13:58:44.795160 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791575    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 13:58:44.795160 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791577    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 13:58:44.795160 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791580    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 13:58:44.795160 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791582    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 13:58:44.795160 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791585    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 13:58:44.795160 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791587    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 13:58:44.795160 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791590    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 13:58:44.795688 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791592    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 13:58:44.795688 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791595    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 13:58:44.795688 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791598    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 13:58:44.795688 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791600    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 13:58:44.795688 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791603    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 13:58:44.795688 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791605    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 13:58:44.795688 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791609    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 13:58:44.795688 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791612    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 13:58:44.795688 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791614    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 13:58:44.795688 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791616    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 13:58:44.795688 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791619    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 13:58:44.795688 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791621    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 13:58:44.795688 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791624    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 13:58:44.795688 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791627    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 13:58:44.795688 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791629    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 13:58:44.795688 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791632    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 13:58:44.795688 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791634    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 13:58:44.795688 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791636    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 13:58:44.795688 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791639    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 13:58:44.795688 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791641    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 13:58:44.796200 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791644    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 13:58:44.796200 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791646    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 13:58:44.796200 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791649    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 13:58:44.796200 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791652    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 13:58:44.796200 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791654    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 13:58:44.796200 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791657    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 13:58:44.796200 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791659    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 13:58:44.796200 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791661    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 13:58:44.796200 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791663    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 13:58:44.796200 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791666    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 13:58:44.796200 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791668    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 13:58:44.796200 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791671    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 13:58:44.796200 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791673    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 13:58:44.796200 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791676    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 13:58:44.796200 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791678    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 13:58:44.796200 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791681    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 13:58:44.796200 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791683    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 13:58:44.796200 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791686    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 13:58:44.796200 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791690    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 13:58:44.796200 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791692    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 13:58:44.796684 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.791695    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 13:58:44.796684 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791770    2575 flags.go:64] FLAG: --address="0.0.0.0"
Sep 08 13:58:44.796684 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791803    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 08 13:58:44.796684 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791809    2575 flags.go:64] FLAG: --anonymous-auth="true"
Sep 08 13:58:44.796684 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791812    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 08 13:58:44.796684 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791817    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 08 13:58:44.796684 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791820    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 08 13:58:44.796684 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791824    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 08 13:58:44.796684 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791828    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 08 13:58:44.796684 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791831    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 08 13:58:44.796684 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791834    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 08 13:58:44.796684 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791837    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 08 13:58:44.796684 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791840    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 08 13:58:44.796684 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791843    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 08 13:58:44.796684 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791846    2575 flags.go:64] FLAG: --cgroup-root=""
Sep 08 13:58:44.796684 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791848    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 08 13:58:44.796684 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791851    2575 flags.go:64] FLAG: --client-ca-file=""
Sep 08 13:58:44.796684 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791854    2575 flags.go:64] FLAG: --cloud-provider="external"
Sep 08 13:58:44.796684 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791857    2575 flags.go:64] FLAG: --cluster-dns="[]"
Sep 08 13:58:44.796684 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791861    2575 flags.go:64] FLAG: --cluster-domain=""
Sep 08 13:58:44.796684 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791864    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 08 13:58:44.796684 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791867    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 08 13:58:44.796684 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791870    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 08 13:58:44.796684 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791875    2575 flags.go:64] FLAG: --container-log-max-files="5"
Sep 08 13:58:44.797268 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791878    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 08 13:58:44.797268 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791881    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 08 13:58:44.797268 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791884    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 08 13:58:44.797268 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791888    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 08 13:58:44.797268 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791891    2575 flags.go:64] FLAG: --contention-profiling="false"
Sep 08 13:58:44.797268 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791893    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 08 13:58:44.797268 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791897    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 08 13:58:44.797268 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791899    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 08 13:58:44.797268 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791902    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 08 13:58:44.797268 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791906    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 08 13:58:44.797268 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791909    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 08 13:58:44.797268 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791912    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 08 13:58:44.797268 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791915    2575 flags.go:64] FLAG: --enable-load-reader="false"
Sep 08 13:58:44.797268 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791918    2575 flags.go:64] FLAG: --enable-server="true"
Sep 08 13:58:44.797268 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791921    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 08 13:58:44.797268 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791925    2575 flags.go:64] FLAG: --event-burst="100"
Sep 08 13:58:44.797268 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791928    2575 flags.go:64] FLAG: --event-qps="50"
Sep 08 13:58:44.797268 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791931    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 08 13:58:44.797268 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791934    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 08 13:58:44.797268 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791936    2575 flags.go:64] FLAG: --eviction-hard=""
Sep 08 13:58:44.797268 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791940    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 08 13:58:44.797268 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791942    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 08 13:58:44.797268 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791945    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 08 13:58:44.797268 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791948    2575 flags.go:64] FLAG: --eviction-soft=""
Sep 08 13:58:44.797268 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791951    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 08 13:58:44.797870 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791953    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 08 13:58:44.797870 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791956    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 08 13:58:44.797870 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791959    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 08 13:58:44.797870 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791962    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 08 13:58:44.797870 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791964    2575 flags.go:64] FLAG: --fail-swap-on="true"
Sep 08 13:58:44.797870 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791967    2575 flags.go:64] FLAG: --feature-gates=""
Sep 08 13:58:44.797870 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791972    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 08 13:58:44.797870 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791975    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 08 13:58:44.797870 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791978    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 08 13:58:44.797870 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791981    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 08 13:58:44.797870 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791984    2575 flags.go:64] FLAG: --healthz-port="10248"
Sep 08 13:58:44.797870 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791987    2575 flags.go:64] FLAG: --help="false"
Sep 08 13:58:44.797870 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791989    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-130-125.ec2.internal"
Sep 08 13:58:44.797870 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791993    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 08 13:58:44.797870 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791996    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 08 13:58:44.797870 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.791999    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 08 13:58:44.797870 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792003    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 08 13:58:44.797870 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792006    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 08 13:58:44.797870 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792009    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 08 13:58:44.797870 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792012    2575 flags.go:64] FLAG: --image-service-endpoint=""
Sep 08 13:58:44.797870 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792014    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 08 13:58:44.797870 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792017    2575 flags.go:64] FLAG: --kube-api-burst="100"
Sep 08 13:58:44.797870 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792021    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 08 13:58:44.798467 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792024    2575 flags.go:64] FLAG: --kube-api-qps="50"
Sep 08 13:58:44.798467 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792026    2575 flags.go:64] FLAG: --kube-reserved=""
Sep 08 13:58:44.798467 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792029    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 08 13:58:44.798467 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792032    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 08 13:58:44.798467 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792035    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 08 13:58:44.798467 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792038    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 08 13:58:44.798467 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792041    2575 flags.go:64] FLAG: --lock-file=""
Sep 08 13:58:44.798467 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792043    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 08 13:58:44.798467 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792046    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 08 13:58:44.798467 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792049    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 08 13:58:44.798467 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792070    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 08 13:58:44.798467 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792072    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 08 13:58:44.798467 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792076    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 08 13:58:44.798467 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792078    2575 flags.go:64] FLAG: --logging-format="text"
Sep 08 13:58:44.798467 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792081    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 08 13:58:44.798467 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792086    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 08 13:58:44.798467 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792089    2575 flags.go:64] FLAG: --manifest-url=""
Sep 08 13:58:44.798467 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792091    2575 flags.go:64] FLAG: --manifest-url-header=""
Sep 08 13:58:44.798467 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792095    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 08 13:58:44.798467 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792099    2575 flags.go:64] FLAG: --max-open-files="1000000"
Sep 08 13:58:44.798467 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792103    2575 flags.go:64] FLAG: --max-pods="110"
Sep 08 13:58:44.798467 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792105    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 08 13:58:44.798467 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792108    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 08 13:58:44.798467 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792111    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 08 13:58:44.798467 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792114    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 08 13:58:44.799099 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792117    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 08 13:58:44.799099 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792120    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 08 13:58:44.799099 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792123    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 08 13:58:44.799099 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792129    2575 flags.go:64] FLAG: --node-status-max-images="50"
Sep 08 13:58:44.799099 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792132    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 08 13:58:44.799099 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792135    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 08 13:58:44.799099 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792138    2575 flags.go:64] FLAG: --pod-cidr=""
Sep 08 13:58:44.799099 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792141    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 08 13:58:44.799099 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792146    2575 flags.go:64] FLAG: --pod-manifest-path=""
Sep 08 13:58:44.799099 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792149    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 08 13:58:44.799099 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792151    2575 flags.go:64] FLAG: --pods-per-core="0"
Sep 08 13:58:44.799099 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792154    2575 flags.go:64] FLAG: --port="10250"
Sep 08 13:58:44.799099 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792157    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 08 13:58:44.799099 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792160    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02f3a32eed2c6ab4a"
Sep 08 13:58:44.799099 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792163    2575 flags.go:64] FLAG: --qos-reserved=""
Sep 08 13:58:44.799099 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792166    2575 flags.go:64] FLAG: --read-only-port="10255"
Sep 08 13:58:44.799099 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792169    2575 flags.go:64] FLAG: --register-node="true"
Sep 08 13:58:44.799099 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792171    2575 flags.go:64] FLAG: --register-with-taints=""
Sep 08 13:58:44.799099 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792175    2575 flags.go:64] FLAG: --registry-burst="10"
Sep 08 13:58:44.799099 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792178    2575 flags.go:64] FLAG: --registry-qps="5"
Sep 08 13:58:44.799099 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792180    2575 flags.go:64] FLAG: --reserved-cpus=""
Sep 08 13:58:44.799099 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792183    2575 flags.go:64] FLAG: --reserved-memory=""
Sep 08 13:58:44.799099 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792186    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 08 13:58:44.799099 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792190    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 08 13:58:44.799099 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792193    2575 flags.go:64] FLAG: --rotate-certificates="false"
Sep 08 13:58:44.799778 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792196    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 08 13:58:44.799778 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792199    2575 flags.go:64] FLAG: --runonce="false"
Sep 08 13:58:44.799778 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792201    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 08 13:58:44.799778 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792204    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 08 13:58:44.799778 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792207    2575 flags.go:64] FLAG: --seccomp-default="false"
Sep 08 13:58:44.799778 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792210    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 08 13:58:44.799778 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792212    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 08 13:58:44.799778 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792215    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 08 13:58:44.799778 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792218    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 08 13:58:44.799778 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792221    2575 flags.go:64] FLAG: --storage-driver-password="root"
Sep 08 13:58:44.799778 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792224    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 08 13:58:44.799778 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792227    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 08 13:58:44.799778 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792229    2575 flags.go:64] FLAG: --storage-driver-user="root"
Sep 08 13:58:44.799778 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792232    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 08 13:58:44.799778 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792235    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 08 13:58:44.799778 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792238    2575 flags.go:64] FLAG: --system-cgroups=""
Sep 08 13:58:44.799778 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792241    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 08 13:58:44.799778 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792246    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 08 13:58:44.799778 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792249    2575 flags.go:64] FLAG: --tls-cert-file=""
Sep 08 13:58:44.799778 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792251    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 08 13:58:44.799778 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792255    2575 flags.go:64] FLAG: --tls-min-version=""
Sep 08 13:58:44.799778 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792258    2575 flags.go:64] FLAG: --tls-private-key-file=""
Sep 08 13:58:44.799778 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792260    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 08 13:58:44.799778 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792263    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 08 13:58:44.799778 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792266    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 08 13:58:44.800402 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792268    2575 flags.go:64] FLAG: --v="2"
Sep 08 13:58:44.800402 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792272    2575 flags.go:64] FLAG: --version="false"
Sep 08 13:58:44.800402 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792276    2575 flags.go:64] FLAG: --vmodule=""
Sep 08 13:58:44.800402 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792279    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 08 13:58:44.800402 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.792282    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 08 13:58:44.800402 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792390    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 13:58:44.800402 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792394    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 13:58:44.800402 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792397    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 13:58:44.800402 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792400    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 13:58:44.800402 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792403    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 13:58:44.800402 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792406    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 13:58:44.800402 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792410    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 13:58:44.800402 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792413    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 13:58:44.800402 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792415    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 13:58:44.800402 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792418    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 13:58:44.800402 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792421    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 13:58:44.800402 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792424    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 13:58:44.800402 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792426    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 13:58:44.800402 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792429    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 13:58:44.800402 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792431    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 13:58:44.800402 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792434    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 13:58:44.800402 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792437    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 13:58:44.800934 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792439    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 13:58:44.800934 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792442    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 13:58:44.800934 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792445    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 13:58:44.800934 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792448    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 13:58:44.800934 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792450    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 13:58:44.800934 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792452    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 13:58:44.800934 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792456    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 13:58:44.800934 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792460    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 13:58:44.800934 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792463    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 13:58:44.800934 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792466    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 13:58:44.800934 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792469    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 13:58:44.800934 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792472    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 13:58:44.800934 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792474    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 13:58:44.800934 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792477    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 13:58:44.800934 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792480    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 13:58:44.800934 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792483    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 13:58:44.800934 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792486    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 13:58:44.800934 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792488    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 13:58:44.800934 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792492    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 13:58:44.801405 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792496    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 13:58:44.801405 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792498    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 13:58:44.801405 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792502    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 13:58:44.801405 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792504    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 13:58:44.801405 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792507    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 13:58:44.801405 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792509    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 13:58:44.801405 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792512    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 13:58:44.801405 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792514    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 13:58:44.801405 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792517    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 13:58:44.801405 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792519    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 13:58:44.801405 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792522    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 13:58:44.801405 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792525    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 13:58:44.801405 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792527    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 13:58:44.801405 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792530    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 13:58:44.801405 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792532    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 13:58:44.801405 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792536    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 13:58:44.801405 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792538    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 13:58:44.801405 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792541    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 13:58:44.801405 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792543    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 13:58:44.801405 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792546    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 13:58:44.801904 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792548    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 13:58:44.801904 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792551    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 13:58:44.801904 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792553    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 13:58:44.801904 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792556    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 13:58:44.801904 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792558    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 13:58:44.801904 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792561    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 13:58:44.801904 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792563    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 13:58:44.801904 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792566    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 13:58:44.801904 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792570    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 13:58:44.801904 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792572    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 13:58:44.801904 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792576    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 13:58:44.801904 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792579    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 13:58:44.801904 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792582    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 13:58:44.801904 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792585    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 13:58:44.801904 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792589    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 13:58:44.801904 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792591    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 13:58:44.801904 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792594    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 13:58:44.801904 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792596    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 13:58:44.801904 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792599    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 13:58:44.801904 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792602    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 13:58:44.802426 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792604    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 13:58:44.802426 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792607    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 13:58:44.802426 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792610    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 13:58:44.802426 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792613    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 13:58:44.802426 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792615    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 13:58:44.802426 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792617    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 13:58:44.802426 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792620    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 13:58:44.802426 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792623    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 13:58:44.802426 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792626    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 13:58:44.802426 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792628    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 13:58:44.802426 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792630    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 13:58:44.802426 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792633    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 13:58:44.802426 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792635    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 13:58:44.802426 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792638    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 13:58:44.802426 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792640    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 13:58:44.802426 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792643    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 13:58:44.802426 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792645    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 13:58:44.802426 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792648    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 13:58:44.802426 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792650    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 13:58:44.802920 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792653    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 13:58:44.802920 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792657    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 13:58:44.802920 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792659    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 13:58:44.802920 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.792662    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 13:58:44.802920 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.793408    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 13:58:44.802920 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.800756    2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 08 13:58:44.802920 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.800770    2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 08 13:58:44.802920 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.800792    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 08 13:58:44.802920 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.800797    2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 08 13:58:44.802920 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800848    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 13:58:44.802920 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800854    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 13:58:44.802920 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800859    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 13:58:44.802920 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800863    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 13:58:44.802920 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800867    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 13:58:44.803318 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800870    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 13:58:44.803318 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800873    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 13:58:44.803318 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800876    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 13:58:44.803318 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800879    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 13:58:44.803318 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800882    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 13:58:44.803318 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800885    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 13:58:44.803318 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800888    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 13:58:44.803318 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800891    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 13:58:44.803318 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800894    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 13:58:44.803318 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800897    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 13:58:44.803318 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800899    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 13:58:44.803318 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800902    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 13:58:44.803318 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800904    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 13:58:44.803318 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800907    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 13:58:44.803318 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800909    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 13:58:44.803318 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800912    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 13:58:44.803318 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800914    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 13:58:44.803318 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800917    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 13:58:44.803318 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800919    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 13:58:44.803773 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800922    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 13:58:44.803773 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800924    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 13:58:44.803773 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800927    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 13:58:44.803773 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800929    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 13:58:44.803773 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800932    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 13:58:44.803773 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800935    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 13:58:44.803773 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800938    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 13:58:44.803773 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800941    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 13:58:44.803773 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800943    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 13:58:44.803773 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800947    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 13:58:44.803773 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800949    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 13:58:44.803773 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800952    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 13:58:44.803773 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800954    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 13:58:44.803773 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800957    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 13:58:44.803773 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800959    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 13:58:44.803773 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800962    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 13:58:44.803773 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800964    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 13:58:44.803773 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800966    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 13:58:44.803773 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800969    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 13:58:44.803773 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800971    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 13:58:44.804260 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800974    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 13:58:44.804260 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800977    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 13:58:44.804260 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800979    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 13:58:44.804260 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800982    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 13:58:44.804260 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800985    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 13:58:44.804260 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800987    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 13:58:44.804260 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800989    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 13:58:44.804260 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800992    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 13:58:44.804260 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800994    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 13:58:44.804260 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.800997    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 13:58:44.804260 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801000    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 13:58:44.804260 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801002    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 13:58:44.804260 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801005    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 13:58:44.804260 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801007    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 13:58:44.804260 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801009    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 13:58:44.804260 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801012    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 13:58:44.804260 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801014    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 13:58:44.804260 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801017    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 13:58:44.804260 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801020    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 13:58:44.804260 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801022    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 13:58:44.804791 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801025    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 13:58:44.804791 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801027    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 13:58:44.804791 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801030    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 13:58:44.804791 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801032    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 13:58:44.804791 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801035    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 13:58:44.804791 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801037    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 13:58:44.804791 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801040    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 13:58:44.804791 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801042    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 13:58:44.804791 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801045    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 13:58:44.804791 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801048    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 13:58:44.804791 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801050    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 13:58:44.804791 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801071    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 13:58:44.804791 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801075    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 13:58:44.804791 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801078    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 13:58:44.804791 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801082    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 13:58:44.804791 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801084    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 13:58:44.804791 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801087    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 13:58:44.804791 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801089    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 13:58:44.804791 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801092    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 13:58:44.804791 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801095    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 13:58:44.805281 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801099    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 13:58:44.805281 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801103    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 13:58:44.805281 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801106    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 13:58:44.805281 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801108    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 13:58:44.805281 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801111    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 13:58:44.805281 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801113    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 13:58:44.805281 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801116    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 13:58:44.805281 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801118    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 13:58:44.805281 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801120    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 13:58:44.805281 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801123    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 13:58:44.805281 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801126    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 13:58:44.805281 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801128    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 13:58:44.805281 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801131    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 13:58:44.805281 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801133    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 13:58:44.805281 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801136    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 13:58:44.805639 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.801141    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 13:58:44.805639 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801248    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 13:58:44.805639 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801252    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 13:58:44.805639 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801255    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 13:58:44.805639 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801258    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 13:58:44.805639 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801261    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 13:58:44.805639 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801264    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 13:58:44.805639 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801267    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 13:58:44.805639 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801269    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 13:58:44.805639 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801272    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 13:58:44.805639 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801275    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 13:58:44.805639 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801277    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 13:58:44.805639 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801280    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 13:58:44.805639 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801282    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 13:58:44.805639 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801285    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 13:58:44.805997 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801287    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 13:58:44.805997 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801290    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 13:58:44.805997 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801292    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 13:58:44.805997 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801295    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 13:58:44.805997 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801297    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 13:58:44.805997 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801299    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 13:58:44.805997 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801302    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 13:58:44.805997 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801305    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 13:58:44.805997 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801307    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 13:58:44.805997 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801309    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 13:58:44.805997 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801312    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 13:58:44.805997 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801314    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 13:58:44.805997 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801317    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 13:58:44.805997 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801319    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 13:58:44.805997 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801322    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 13:58:44.805997 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801324    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 13:58:44.805997 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801327    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 13:58:44.805997 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801330    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 13:58:44.805997 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801332    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 13:58:44.805997 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801334    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 13:58:44.806500 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801337    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 13:58:44.806500 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801339    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 13:58:44.806500 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801342    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 13:58:44.806500 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801344    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 13:58:44.806500 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801347    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 13:58:44.806500 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801349    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 13:58:44.806500 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801351    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 13:58:44.806500 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801354    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 13:58:44.806500 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801356    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 13:58:44.806500 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801359    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 13:58:44.806500 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801362    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 13:58:44.806500 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801364    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 13:58:44.806500 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801367    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 13:58:44.806500 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801369    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 13:58:44.806500 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801371    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 13:58:44.806500 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801374    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 13:58:44.806500 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801376    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 13:58:44.806500 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801378    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 13:58:44.806500 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801382    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 13:58:44.806500 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801385    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 13:58:44.806976 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801388    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 13:58:44.806976 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801390    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 13:58:44.806976 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801392    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 13:58:44.806976 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801395    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 13:58:44.806976 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801397    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 13:58:44.806976 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801400    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 13:58:44.806976 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801402    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 13:58:44.806976 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801404    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 13:58:44.806976 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801407    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 13:58:44.806976 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801409    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 13:58:44.806976 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801412    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 13:58:44.806976 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801414    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 13:58:44.806976 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801417    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 13:58:44.806976 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801420    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 13:58:44.806976 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801422    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 13:58:44.806976 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801424    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 13:58:44.806976 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801427    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 13:58:44.806976 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801429    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 13:58:44.806976 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801432    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 13:58:44.806976 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801435    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 13:58:44.807581 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801437    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 13:58:44.807581 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801439    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 13:58:44.807581 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801442    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 13:58:44.807581 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801445    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 13:58:44.807581 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801447    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 13:58:44.807581 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801449    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 13:58:44.807581 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801452    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 13:58:44.807581 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801456    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 13:58:44.807581 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801459    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 13:58:44.807581 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801461    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 13:58:44.807581 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801464    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 13:58:44.807581 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801467    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 13:58:44.807581 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801469    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 13:58:44.807581 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801471    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 13:58:44.807581 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801475    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 13:58:44.807581 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801478    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 13:58:44.807581 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801481    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 13:58:44.807581 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801484    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 13:58:44.807581 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801486    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 13:58:44.808076 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801489    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 13:58:44.808076 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801492    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 13:58:44.808076 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801494    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 13:58:44.808076 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801497    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 13:58:44.808076 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801500    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 13:58:44.808076 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:44.801502    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 13:58:44.808076 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.801507    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 13:58:44.808076 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.801599    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 08 13:58:44.808076 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.804526    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 08 13:58:44.808076 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.805356    2575 server.go:1019] "Starting client certificate rotation"
Sep 08 13:58:44.808076 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.805452    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 13:58:44.808076 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.805481    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 13:58:44.808076 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.807652    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 13:58:44.812764 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.812743    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 13:58:44.824087 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.824070    2575 log.go:25] "Validated CRI v1 runtime API"
Sep 08 13:58:44.826902 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.826890    2575 log.go:25] "Validated CRI v1 image API"
Sep 08 13:58:44.828561 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.828545    2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 08 13:58:44.830745 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.830717    2575 fs.go:135] Filesystem UUIDs: map[21a9f469-1f28-404c-a633-738af696349c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e735decf-bb5f-4043-ae90-2073af93889b:/dev/nvme0n1p4]
Sep 08 13:58:44.830815 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.830745    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 08 13:58:44.834315 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.834295    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 13:58:44.835008 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.834905    2575 manager.go:216] Machine: {Timestamp:2026-09-08 13:58:44.834452591 +0000 UTC m=+0.324169635 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099762 MemoryCapacity:32812150784 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cce9b5e51d73ea855e5faeea3ba38 SystemUUID:ec2cce9b-5e51-d73e-a855-e5faeea3ba38 BootID:2fde6dde-f6cf-430c-a9c0-4e0303f2ff8d Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406073344 Type:vfs Inodes:4005389 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:58:80:3d:49:37 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:58:80:3d:49:37 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:bd:79:7d:53:84 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812150784 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 08 13:58:44.835008 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.834998    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 08 13:58:44.835178 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.835115    2575 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 08 13:58:44.838134 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.838108    2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 08 13:58:44.838293 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.838138    2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-125.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 08 13:58:44.839331 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.839318    2575 topology_manager.go:138] "Creating topology manager with none policy"
Sep 08 13:58:44.839385 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.839336    2575 container_manager_linux.go:309] "Creating device plugin manager"
Sep 08 13:58:44.839385 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.839346    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 13:58:44.840080 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.840048    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 13:58:44.841319 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.841308    2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 08 13:58:44.845966 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.845952    2575 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 13:58:44.846114 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.846103    2575 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 08 13:58:44.846172 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.846141    2575 kubelet.go:486] "Attempting to sync node with API server"
Sep 08 13:58:44.846172 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.846156    2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 08 13:58:44.846263 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.846176    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 08 13:58:44.846263 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.846190    2575 kubelet.go:398] "Adding apiserver pod source"
Sep 08 13:58:44.846263 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.846202    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 08 13:58:44.846559 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.846545    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 13:58:44.846619 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.846568    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 13:58:44.848345 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.848325    2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 08 13:58:44.850481 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.850469    2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 08 13:58:44.850522 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.850499    2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 08 13:58:44.850666 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.850656    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 08 13:58:44.850709 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.850671    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 08 13:58:44.850709 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.850677    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 08 13:58:44.850709 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.850682    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 08 13:58:44.850709 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.850690    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 08 13:58:44.850709 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.850696    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 08 13:58:44.851245 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.851237    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 08 13:58:44.851286 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.851246    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 08 13:58:44.851286 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.851252    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 08 13:58:44.851286 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.851258    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 08 13:58:44.851286 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.851270    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 08 13:58:44.851286 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.851278    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 08 13:58:44.851404 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.851301    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 08 13:58:44.851404 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.851309    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 08 13:58:44.855031 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.855017    2575 server.go:1268] "Started kubelet"
Sep 08 13:58:44.855175 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.855127    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 08 13:58:44.855532 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.855122    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 08 13:58:44.855602 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.855559    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 08 13:58:44.855856 ip-10-0-130-125 systemd[1]: Started Kubernetes Kubelet.
Sep 08 13:58:44.860400 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.860376    2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 08 13:58:44.862297 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.862280    2575 server.go:310] "Adding debug handlers to kubelet server"
Sep 08 13:58:44.862498 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:44.862469    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 08 13:58:44.862498 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:44.862475    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-125.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 08 13:58:44.862664 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.862606    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-125.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 08 13:58:44.862924 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:44.862906    2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 08 13:58:44.866100 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.865938    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 08 13:58:44.866175 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.865956    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 08 13:58:44.866332 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:44.866295    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-125.ec2.internal\" not found"
Sep 08 13:58:44.866873 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.866852    2575 factory.go:55] Registering systemd factory
Sep 08 13:58:44.866967 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.866876    2575 factory.go:223] Registration of the systemd container factory successfully
Sep 08 13:58:44.867042 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.867024    2575 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 08 13:58:44.867042 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.867039    2575 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 08 13:58:44.867151 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.867107    2575 factory.go:153] Registering CRI-O factory
Sep 08 13:58:44.867151 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.867122    2575 factory.go:223] Registration of the crio container factory successfully
Sep 08 13:58:44.867235 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.867175    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 08 13:58:44.867235 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.867178    2575 reconstruct.go:97] "Volume reconstruction finished"
Sep 08 13:58:44.867235 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.867187    2575 reconciler.go:29] "Reconciler: start to sync state"
Sep 08 13:58:44.867235 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.867194    2575 factory.go:103] Registering Raw factory
Sep 08 13:58:44.867235 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.867209    2575 manager.go:1196] Started watching for new ooms in manager
Sep 08 13:58:44.867464 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.867292    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 08 13:58:44.867587 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.867569    2575 manager.go:349] Starting recovery of all containers
Sep 08 13:58:44.868892 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:44.867930    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-125.ec2.internal.18d35d2d003ae98c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-125.ec2.internal,UID:ip-10-0-130-125.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-125.ec2.internal,},FirstTimestamp:2026-09-08 13:58:44.854991244 +0000 UTC m=+0.344708286,LastTimestamp:2026-09-08 13:58:44.854991244 +0000 UTC m=+0.344708286,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-125.ec2.internal,}"
Sep 08 13:58:44.869145 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:44.869121    2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-125.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 08 13:58:44.869242 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:44.869228    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 08 13:58:44.877141 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.877125    2575 manager.go:354] Recovery completed
Sep 08 13:58:44.881472 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.881459    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 13:58:44.883424 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.883400    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-125.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 13:58:44.883531 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.883439    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-125.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 13:58:44.883531 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.883454    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-125.ec2.internal" event="NodeHasSufficientPID"
Sep 08 13:58:44.883969 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.883958    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 08 13:58:44.884030 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.883969    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 08 13:58:44.884030 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.883972    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 13:58:44.884030 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.883985    2575 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 13:58:44.884714 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.884700    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-125.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 13:58:44.884762 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.884726    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-125.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 13:58:44.884762 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.884736    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-125.ec2.internal" event="NodeHasSufficientPID"
Sep 08 13:58:44.885809 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:44.885731    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-125.ec2.internal.18d35d2d01ecc099  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-125.ec2.internal,UID:ip-10-0-130-125.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-125.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-125.ec2.internal,},FirstTimestamp:2026-09-08 13:58:44.883423385 +0000 UTC m=+0.373140430,LastTimestamp:2026-09-08 13:58:44.883423385 +0000 UTC m=+0.373140430,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-125.ec2.internal,}"
Sep 08 13:58:44.886120 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.886109    2575 policy_none.go:49] "None policy: Start"
Sep 08 13:58:44.886161 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.886124    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 08 13:58:44.886161 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.886134    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 08 13:58:44.888079 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.888066    2575 policy_none.go:47] "Start"
Sep 08 13:58:44.901244 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.901223    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f2hk5"
Sep 08 13:58:44.901244 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:44.901192    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-125.ec2.internal.18d35d2d01ed183f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-125.ec2.internal,UID:ip-10-0-130-125.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-125.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-125.ec2.internal,},FirstTimestamp:2026-09-08 13:58:44.883445823 +0000 UTC m=+0.373162872,LastTimestamp:2026-09-08 13:58:44.883445823 +0000 UTC m=+0.373162872,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-125.ec2.internal,}"
Sep 08 13:58:44.913604 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.913213    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f2hk5"
Sep 08 13:58:44.913928 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:44.913854    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-125.ec2.internal.18d35d2d01ed5119  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-125.ec2.internal,UID:ip-10-0-130-125.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-130-125.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-130-125.ec2.internal,},FirstTimestamp:2026-09-08 13:58:44.883460377 +0000 UTC m=+0.373177420,LastTimestamp:2026-09-08 13:58:44.883460377 +0000 UTC m=+0.373177420,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-125.ec2.internal,}"
Sep 08 13:58:44.946622 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.923636    2575 manager.go:337] "Starting Device Plugin manager"
Sep 08 13:58:44.946622 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:44.923674    2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 08 13:58:44.946622 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.923688    2575 server.go:87] "Starting device plugin registration server"
Sep 08 13:58:44.946622 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.924017    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 08 13:58:44.946622 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.924027    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 08 13:58:44.946622 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.924123    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 08 13:58:44.946622 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.924200    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 08 13:58:44.946622 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.924208    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 08 13:58:44.946622 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:44.924686    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 08 13:58:44.946622 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:44.924725    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-125.ec2.internal\" not found"
Sep 08 13:58:44.965988 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.965966    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 08 13:58:44.967249 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.967233    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 08 13:58:44.967331 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.967303    2575 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 08 13:58:44.967331 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.967326    2575 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 08 13:58:44.967403 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:44.967366    2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 08 13:58:44.969492 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:44.969470    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 13:58:45.024524 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.024498    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 13:58:45.025351 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.025334    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-125.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 13:58:45.025424 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.025366    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-125.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 13:58:45.025424 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.025377    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-125.ec2.internal" event="NodeHasSufficientPID"
Sep 08 13:58:45.025424 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.025398    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-125.ec2.internal"
Sep 08 13:58:45.034686 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.034613    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-125.ec2.internal"
Sep 08 13:58:45.034686 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:45.034634    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-125.ec2.internal\": node \"ip-10-0-130-125.ec2.internal\" not found"
Sep 08 13:58:45.066528 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:45.066503    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-125.ec2.internal\" not found"
Sep 08 13:58:45.067492 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.067460    2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-125.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-125.ec2.internal"]
Sep 08 13:58:45.067556 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.067540    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 13:58:45.068862 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.068846    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-125.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 13:58:45.068952 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.068875    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-125.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 13:58:45.068952 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.068890    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-125.ec2.internal" event="NodeHasSufficientPID"
Sep 08 13:58:45.071194 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.071179    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 13:58:45.071290 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.071276    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-125.ec2.internal"
Sep 08 13:58:45.071290 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.071300    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 13:58:45.071823 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.071807    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-125.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 13:58:45.071929 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.071832    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-125.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 13:58:45.071929 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.071842    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-125.ec2.internal" event="NodeHasSufficientPID"
Sep 08 13:58:45.071929 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.071918    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-125.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 13:58:45.072099 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.071948    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-125.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 13:58:45.072099 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.071966    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-125.ec2.internal" event="NodeHasSufficientPID"
Sep 08 13:58:45.073989 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.073977    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-125.ec2.internal"
Sep 08 13:58:45.074036 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.074000    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 13:58:45.077232 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.077207    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-125.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 13:58:45.077232 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.077232    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-125.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 13:58:45.077368 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.077246    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-125.ec2.internal" event="NodeHasSufficientPID"
Sep 08 13:58:45.085626 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:45.085605    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-125.ec2.internal\" not found" node="ip-10-0-130-125.ec2.internal"
Sep 08 13:58:45.090245 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:45.090229    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-125.ec2.internal\" not found" node="ip-10-0-130-125.ec2.internal"
Sep 08 13:58:45.167388 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:45.167356    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-125.ec2.internal\" not found"
Sep 08 13:58:45.168505 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.168490    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/24de9fdd7d5b7b48cef3659e9d7d2f6f-config\") pod \"kube-apiserver-proxy-ip-10-0-130-125.ec2.internal\" (UID: \"24de9fdd7d5b7b48cef3659e9d7d2f6f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-125.ec2.internal"
Sep 08 13:58:45.168558 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.168511    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/87fdf172fcae69fc2b256986afbb501b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-125.ec2.internal\" (UID: \"87fdf172fcae69fc2b256986afbb501b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-125.ec2.internal"
Sep 08 13:58:45.168558 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.168528    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87fdf172fcae69fc2b256986afbb501b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-125.ec2.internal\" (UID: \"87fdf172fcae69fc2b256986afbb501b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-125.ec2.internal"
Sep 08 13:58:45.268125 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:45.268092    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-125.ec2.internal\" not found"
Sep 08 13:58:45.268829 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.268814    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87fdf172fcae69fc2b256986afbb501b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-125.ec2.internal\" (UID: \"87fdf172fcae69fc2b256986afbb501b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-125.ec2.internal"
Sep 08 13:58:45.268899 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.268851    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/24de9fdd7d5b7b48cef3659e9d7d2f6f-config\") pod \"kube-apiserver-proxy-ip-10-0-130-125.ec2.internal\" (UID: \"24de9fdd7d5b7b48cef3659e9d7d2f6f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-125.ec2.internal"
Sep 08 13:58:45.268899 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.268875    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/87fdf172fcae69fc2b256986afbb501b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-125.ec2.internal\" (UID: \"87fdf172fcae69fc2b256986afbb501b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-125.ec2.internal"
Sep 08 13:58:45.268985 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.268920    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87fdf172fcae69fc2b256986afbb501b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-125.ec2.internal\" (UID: \"87fdf172fcae69fc2b256986afbb501b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-125.ec2.internal"
Sep 08 13:58:45.268985 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.268922    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/24de9fdd7d5b7b48cef3659e9d7d2f6f-config\") pod \"kube-apiserver-proxy-ip-10-0-130-125.ec2.internal\" (UID: \"24de9fdd7d5b7b48cef3659e9d7d2f6f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-125.ec2.internal"
Sep 08 13:58:45.269044 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.268985    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/87fdf172fcae69fc2b256986afbb501b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-125.ec2.internal\" (UID: \"87fdf172fcae69fc2b256986afbb501b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-125.ec2.internal"
Sep 08 13:58:45.369029 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:45.369009    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-125.ec2.internal\" not found"
Sep 08 13:58:45.388206 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.388184    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-125.ec2.internal"
Sep 08 13:58:45.392893 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.392780    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-125.ec2.internal"
Sep 08 13:58:45.469302 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:45.469274    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-125.ec2.internal\" not found"
Sep 08 13:58:45.569721 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:45.569691    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-125.ec2.internal\" not found"
Sep 08 13:58:45.670435 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:45.670377    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-125.ec2.internal\" not found"
Sep 08 13:58:45.670530 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.670445    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 13:58:45.737494 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.737474    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 13:58:45.767000 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.766985    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-125.ec2.internal"
Sep 08 13:58:45.778891 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.778872    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 13:58:45.780430 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.780418    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-125.ec2.internal"
Sep 08 13:58:45.792496 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.792476    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 13:58:45.805641 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.805620    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 08 13:58:45.805755 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.805735    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 13:58:45.805820 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.805769    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 13:58:45.805820 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.805794    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 13:58:45.846860 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.846840    2575 apiserver.go:52] "Watching apiserver"
Sep 08 13:58:45.864627 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.864607    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 08 13:58:45.866193 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.866168    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-svxwv","openshift-network-operator/iptables-alerter-q75kl","openshift-ovn-kubernetes/ovnkube-node-ncn7g","kube-system/global-pull-secret-syncer-wsgdv","kube-system/kube-apiserver-proxy-ip-10-0-130-125.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l8zx","openshift-cluster-node-tuning-operator/tuned-7w4m8","openshift-dns/node-resolver-qzvvn","openshift-multus/multus-additional-cni-plugins-8zb5t","openshift-multus/network-metrics-daemon-2qkhb","openshift-network-diagnostics/network-check-target-vlc72","kube-system/konnectivity-agent-g7btk","openshift-image-registry/node-ca-lw6kq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-125.ec2.internal"]
Sep 08 13:58:45.866290 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.866201    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 08 13:58:45.868797 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.868773    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.870736 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.870717    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 13:58:45.870817 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:45.870797    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlc72" podUID="4768adf0-964c-415f-bd1f-94c1d50ad6f7"
Sep 08 13:58:45.871258 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.871220    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-etc-modprobe-d\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.871327 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.871271    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-etc-kubernetes\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.871327 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.871293    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e9785b03-cd05-426a-8b34-f59cbe5ce454-etc-tuned\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.871327 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.871319    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-etc-sysconfig\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.871473 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.871340    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-etc-sysctl-d\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.871473 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.871363    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-etc-sysctl-conf\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.871473 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.871383    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-etc-systemd\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.871473 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.871407    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-host\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.871473 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.871429    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txqnz\" (UniqueName: \"kubernetes.io/projected/e9785b03-cd05-426a-8b34-f59cbe5ce454-kube-api-access-txqnz\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.871473 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.871460    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-run\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.871701 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.871492    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-lib-modules\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.871701 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.871515    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-var-lib-kubelet\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.871701 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.871546    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-sys\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.871701 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.871583    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9785b03-cd05-426a-8b34-f59cbe5ce454-tmp\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.872980 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.872964    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:45.874076 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.873848    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 08 13:58:45.874076 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.873882    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 08 13:58:45.874254 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.874229    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mjvrl\""
Sep 08 13:58:45.876312 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.876294    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:58:45.876407 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:45.876386    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsgdv" podUID="a9c2a97a-5054-4839-b0ea-ff5bfa366afc"
Sep 08 13:58:45.878407 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.878393    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qzvvn"
Sep 08 13:58:45.880491 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.880477    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l8zx"
Sep 08 13:58:45.881211 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.881185    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 08 13:58:45.881308 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.881290    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 08 13:58:45.881477 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.881463    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 08 13:58:45.881538 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.881524    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 08 13:58:45.881580 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.881539    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 08 13:58:45.881580 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.881549    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 08 13:58:45.881580 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.881563    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ggthf\""
Sep 08 13:58:45.882762 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.882747    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8zb5t"
Sep 08 13:58:45.884731 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.884713    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-s44md\""
Sep 08 13:58:45.884822 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.884713    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 08 13:58:45.885302 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.885282    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lw6kq"
Sep 08 13:58:45.885436 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.885418    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p42l8\""
Sep 08 13:58:45.886111 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.886090    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 08 13:58:45.886330 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.886311    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 08 13:58:45.886881 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.886865    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 08 13:58:45.887762 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.887391    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 08 13:58:45.887762 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.887682    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q75kl"
Sep 08 13:58:45.888887 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.888873    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 08 13:58:45.889277 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.889265    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 08 13:58:45.889591 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.889579    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 08 13:58:45.889818 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.889789    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 08 13:58:45.889916 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.889791    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zcl99\""
Sep 08 13:58:45.889916 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.889844    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 13:58:45.889916 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:45.889886    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qkhb" podUID="b0323060-7649-4e6c-b078-dbe218838e63"
Sep 08 13:58:45.892426 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.892407    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-svxwv"
Sep 08 13:58:45.894703 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.894685    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g7btk"
Sep 08 13:58:45.895302 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.895285    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 08 13:58:45.895498 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.895473    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 08 13:58:45.895561 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.895520    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 08 13:58:45.895922 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.895899    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 08 13:58:45.895922 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.895917    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 08 13:58:45.896072 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.895931    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z68pw\""
Sep 08 13:58:45.896072 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.895966    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 08 13:58:45.896072 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.895965    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-k2ww8\""
Sep 08 13:58:45.896072 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.896010    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 08 13:58:45.896437 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.896425    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 08 13:58:45.896437 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.896433    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rjtfm\""
Sep 08 13:58:45.897106 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.897088    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 08 13:58:45.897178 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.897123    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qhlqm\""
Sep 08 13:58:45.900689 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.900675    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 08 13:58:45.900879 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.900866    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 13:58:45.915760 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.915718    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 13:53:45 +0000 UTC" deadline="2028-06-12 14:16:05.352776328 +0000 UTC"
Sep 08 13:58:45.915760 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.915758    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15432h17m19.43702185s"
Sep 08 13:58:45.931506 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.931456    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qnnz2"
Sep 08 13:58:45.944566 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.944548    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qnnz2"
Sep 08 13:58:45.960651 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:45.960625    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87fdf172fcae69fc2b256986afbb501b.slice/crio-40411b3640ac93937a95ca3e15dbffdad5705e82441ac6d01042d8688e7bb74f WatchSource:0}: Error finding container 40411b3640ac93937a95ca3e15dbffdad5705e82441ac6d01042d8688e7bb74f: Status 404 returned error can't find the container with id 40411b3640ac93937a95ca3e15dbffdad5705e82441ac6d01042d8688e7bb74f
Sep 08 13:58:45.964987 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.964973    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 13:58:45.968028 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.968012    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 08 13:58:45.971290 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.971260    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-125.ec2.internal" event={"ID":"87fdf172fcae69fc2b256986afbb501b","Type":"ContainerStarted","Data":"40411b3640ac93937a95ca3e15dbffdad5705e82441ac6d01042d8688e7bb74f"}
Sep 08 13:58:45.971852 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.971832    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ca279b18-1c16-44e5-a5ee-07abf9c51ffd-registration-dir\") pod \"aws-ebs-csi-driver-node-5l8zx\" (UID: \"ca279b18-1c16-44e5-a5ee-07abf9c51ffd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l8zx"
Sep 08 13:58:45.971927 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.971859    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3f39a078-1a89-436d-bc9a-2f0a8296462c-iptables-alerter-script\") pod \"iptables-alerter-q75kl\" (UID: \"3f39a078-1a89-436d-bc9a-2f0a8296462c\") " pod="openshift-network-operator/iptables-alerter-q75kl"
Sep 08 13:58:45.971927 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.971875    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f39a078-1a89-436d-bc9a-2f0a8296462c-host-slash\") pod \"iptables-alerter-q75kl\" (UID: \"3f39a078-1a89-436d-bc9a-2f0a8296462c\") " pod="openshift-network-operator/iptables-alerter-q75kl"
Sep 08 13:58:45.971927 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.971897    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe124193-60d2-4e5d-adb3-760fe3f0e92a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8zb5t\" (UID: \"fe124193-60d2-4e5d-adb3-760fe3f0e92a\") " pod="openshift-multus/multus-additional-cni-plugins-8zb5t"
Sep 08 13:58:45.971927 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.971918    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-host-run-netns\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:45.972147 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.971936    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe124193-60d2-4e5d-adb3-760fe3f0e92a-cnibin\") pod \"multus-additional-cni-plugins-8zb5t\" (UID: \"fe124193-60d2-4e5d-adb3-760fe3f0e92a\") " pod="openshift-multus/multus-additional-cni-plugins-8zb5t"
Sep 08 13:58:45.972147 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.971948    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-host-cni-netd\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:45.972147 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.971962    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dflj8\" (UniqueName: \"kubernetes.io/projected/ca279b18-1c16-44e5-a5ee-07abf9c51ffd-kube-api-access-dflj8\") pod \"aws-ebs-csi-driver-node-5l8zx\" (UID: \"ca279b18-1c16-44e5-a5ee-07abf9c51ffd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l8zx"
Sep 08 13:58:45.972147 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.971981    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-run\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.972147 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972001    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-var-lib-kubelet\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.972147 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972018    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d47cfde2-6162-4179-97d5-985a6b27ca33-cni-binary-copy\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:45.972147 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972031    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-run-systemd\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:45.972147 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972040    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-run\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.972147 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972045    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-sys\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.972147 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972044    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-var-lib-kubelet\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.972147 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972081    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a94658b0-bc07-44bc-a7c8-92d1c7804987-tmp-dir\") pod \"node-resolver-qzvvn\" (UID: \"a94658b0-bc07-44bc-a7c8-92d1c7804987\") " pod="openshift-dns/node-resolver-qzvvn"
Sep 08 13:58:45.972147 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972104    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe124193-60d2-4e5d-adb3-760fe3f0e92a-system-cni-dir\") pod \"multus-additional-cni-plugins-8zb5t\" (UID: \"fe124193-60d2-4e5d-adb3-760fe3f0e92a\") " pod="openshift-multus/multus-additional-cni-plugins-8zb5t"
Sep 08 13:58:45.972147 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972127    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-sys\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.972147 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972129    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-host-run-ovn-kubernetes\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:45.972830 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972166    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9c2a97a-5054-4839-b0ea-ff5bfa366afc-original-pull-secret\") pod \"global-pull-secret-syncer-wsgdv\" (UID: \"a9c2a97a-5054-4839-b0ea-ff5bfa366afc\") " pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:58:45.972830 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972189    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ca279b18-1c16-44e5-a5ee-07abf9c51ffd-socket-dir\") pod \"aws-ebs-csi-driver-node-5l8zx\" (UID: \"ca279b18-1c16-44e5-a5ee-07abf9c51ffd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l8zx"
Sep 08 13:58:45.972830 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972203    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ca279b18-1c16-44e5-a5ee-07abf9c51ffd-sys-fs\") pod \"aws-ebs-csi-driver-node-5l8zx\" (UID: \"ca279b18-1c16-44e5-a5ee-07abf9c51ffd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l8zx"
Sep 08 13:58:45.972830 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972224    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-etc-kubernetes\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.972830 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972241    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1f1133bf-01cf-46b7-be8d-1272be6dd0da-serviceca\") pod \"node-ca-lw6kq\" (UID: \"1f1133bf-01cf-46b7-be8d-1272be6dd0da\") " pod="openshift-image-registry/node-ca-lw6kq"
Sep 08 13:58:45.972830 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972255    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-host-run-netns\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:45.972830 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972267    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-log-socket\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:45.972830 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972286    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-env-overrides\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:45.972830 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972314    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhkjw\" (UniqueName: \"kubernetes.io/projected/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-kube-api-access-xhkjw\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:45.972830 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972331    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kl9x\" (UniqueName: \"kubernetes.io/projected/4768adf0-964c-415f-bd1f-94c1d50ad6f7-kube-api-access-9kl9x\") pod \"network-check-target-vlc72\" (UID: \"4768adf0-964c-415f-bd1f-94c1d50ad6f7\") " pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 13:58:45.972830 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972340    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-etc-kubernetes\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.972830 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972344    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-host-kubelet\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:45.972830 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972376    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-etc-sysconfig\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.972830 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972391    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-etc-sysctl-d\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.972830 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972400    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-etc-sysconfig\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.972830 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972405    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-etc-sysctl-conf\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.972830 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972446    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txqnz\" (UniqueName: \"kubernetes.io/projected/e9785b03-cd05-426a-8b34-f59cbe5ce454-kube-api-access-txqnz\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.973584 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972476    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-etc-sysctl-d\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.973584 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972479    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-etc-sysctl-conf\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.973584 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972476    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-system-cni-dir\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:45.973584 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972510    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v84ds\" (UniqueName: \"kubernetes.io/projected/3f39a078-1a89-436d-bc9a-2f0a8296462c-kube-api-access-v84ds\") pod \"iptables-alerter-q75kl\" (UID: \"3f39a078-1a89-436d-bc9a-2f0a8296462c\") " pod="openshift-network-operator/iptables-alerter-q75kl"
Sep 08 13:58:45.973584 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972527    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-multus-socket-dir-parent\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:45.973584 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972540    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-multus-conf-dir\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:45.973584 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972556    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d47cfde2-6162-4179-97d5-985a6b27ca33-multus-daemon-config\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:45.973584 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972578    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a94658b0-bc07-44bc-a7c8-92d1c7804987-hosts-file\") pod \"node-resolver-qzvvn\" (UID: \"a94658b0-bc07-44bc-a7c8-92d1c7804987\") " pod="openshift-dns/node-resolver-qzvvn"
Sep 08 13:58:45.973584 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972593    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fe124193-60d2-4e5d-adb3-760fe3f0e92a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8zb5t\" (UID: \"fe124193-60d2-4e5d-adb3-760fe3f0e92a\") " pod="openshift-multus/multus-additional-cni-plugins-8zb5t"
Sep 08 13:58:45.973584 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972607    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-host-slash\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:45.973584 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972626    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-host-run-k8s-cni-cncf-io\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:45.973584 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972648    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzfcp\" (UniqueName: \"kubernetes.io/projected/d47cfde2-6162-4179-97d5-985a6b27ca33-kube-api-access-pzfcp\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:45.973584 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972668    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f1133bf-01cf-46b7-be8d-1272be6dd0da-host\") pod \"node-ca-lw6kq\" (UID: \"1f1133bf-01cf-46b7-be8d-1272be6dd0da\") " pod="openshift-image-registry/node-ca-lw6kq"
Sep 08 13:58:45.973584 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972704    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-etc-openvswitch\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:45.973584 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972723    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-run-ovn\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:45.973584 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972740    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-node-log\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:45.973584 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972753    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ca279b18-1c16-44e5-a5ee-07abf9c51ffd-etc-selinux\") pod \"aws-ebs-csi-driver-node-5l8zx\" (UID: \"ca279b18-1c16-44e5-a5ee-07abf9c51ffd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l8zx"
Sep 08 13:58:45.974242 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972786    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-etc-modprobe-d\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.974242 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972810    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e9785b03-cd05-426a-8b34-f59cbe5ce454-etc-tuned\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.974242 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972824    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-host-var-lib-kubelet\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:45.974242 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972839    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj4p9\" (UniqueName: \"kubernetes.io/projected/b0323060-7649-4e6c-b078-dbe218838e63-kube-api-access-fj4p9\") pod \"network-metrics-daemon-2qkhb\" (UID: \"b0323060-7649-4e6c-b078-dbe218838e63\") " pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 13:58:45.974242 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972859    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-run-openvswitch\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:45.974242 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972886    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-host-cni-bin\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:45.974242 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972898    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-etc-modprobe-d\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.974242 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972905    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-ovnkube-config\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:45.974242 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972920    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-ovn-node-metrics-cert\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:45.974242 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972944    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-host-var-lib-cni-bin\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:45.974242 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972969    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-etc-systemd\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.974242 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.972992    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b680f42a-aaf7-415e-8045-ea5fccc2ebea-agent-certs\") pod \"konnectivity-agent-g7btk\" (UID: \"b680f42a-aaf7-415e-8045-ea5fccc2ebea\") " pod="kube-system/konnectivity-agent-g7btk"
Sep 08 13:58:45.974242 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.973018    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnqfp\" (UniqueName: \"kubernetes.io/projected/fe124193-60d2-4e5d-adb3-760fe3f0e92a-kube-api-access-tnqfp\") pod \"multus-additional-cni-plugins-8zb5t\" (UID: \"fe124193-60d2-4e5d-adb3-760fe3f0e92a\") " pod="openshift-multus/multus-additional-cni-plugins-8zb5t"
Sep 08 13:58:45.974242 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.973036    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ca279b18-1c16-44e5-a5ee-07abf9c51ffd-device-dir\") pod \"aws-ebs-csi-driver-node-5l8zx\" (UID: \"ca279b18-1c16-44e5-a5ee-07abf9c51ffd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l8zx"
Sep 08 13:58:45.974242 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.973044    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-etc-systemd\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.974242 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.973078    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-host-run-multus-certs\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:45.974242 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.973100    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe124193-60d2-4e5d-adb3-760fe3f0e92a-cni-binary-copy\") pod \"multus-additional-cni-plugins-8zb5t\" (UID: \"fe124193-60d2-4e5d-adb3-760fe3f0e92a\") " pod="openshift-multus/multus-additional-cni-plugins-8zb5t"
Sep 08 13:58:45.975022 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.973115    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fe124193-60d2-4e5d-adb3-760fe3f0e92a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8zb5t\" (UID: \"fe124193-60d2-4e5d-adb3-760fe3f0e92a\") " pod="openshift-multus/multus-additional-cni-plugins-8zb5t"
Sep 08 13:58:45.975022 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.973133    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-systemd-units\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:45.975022 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.973165    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-ovnkube-script-lib\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:45.975022 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.973191    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-multus-cni-dir\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:45.975022 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.973212    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-cnibin\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:45.975022 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.973233    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7bmf\" (UniqueName: \"kubernetes.io/projected/1f1133bf-01cf-46b7-be8d-1272be6dd0da-kube-api-access-n7bmf\") pod \"node-ca-lw6kq\" (UID: \"1f1133bf-01cf-46b7-be8d-1272be6dd0da\") " pod="openshift-image-registry/node-ca-lw6kq"
Sep 08 13:58:45.975022 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.973256    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a9c2a97a-5054-4839-b0ea-ff5bfa366afc-dbus\") pod \"global-pull-secret-syncer-wsgdv\" (UID: \"a9c2a97a-5054-4839-b0ea-ff5bfa366afc\") " pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:58:45.975022 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.973276    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ca279b18-1c16-44e5-a5ee-07abf9c51ffd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5l8zx\" (UID: \"ca279b18-1c16-44e5-a5ee-07abf9c51ffd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l8zx"
Sep 08 13:58:45.975022 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.973291    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b680f42a-aaf7-415e-8045-ea5fccc2ebea-konnectivity-ca\") pod \"konnectivity-agent-g7btk\" (UID: \"b680f42a-aaf7-415e-8045-ea5fccc2ebea\") " pod="kube-system/konnectivity-agent-g7btk"
Sep 08 13:58:45.975022 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.973295    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 08 13:58:45.975022 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.973305    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh9jp\" (UniqueName: \"kubernetes.io/projected/a94658b0-bc07-44bc-a7c8-92d1c7804987-kube-api-access-mh9jp\") pod \"node-resolver-qzvvn\" (UID: \"a94658b0-bc07-44bc-a7c8-92d1c7804987\") " pod="openshift-dns/node-resolver-qzvvn"
Sep 08 13:58:45.975022 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.973381    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-host\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.975022 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.973420    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-host\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.975022 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.973422    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-hostroot\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:45.975022 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.973448    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:45.975022 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.973474    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-lib-modules\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.975022 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.973497    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-host-var-lib-cni-multus\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:45.975846 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.973520    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-etc-kubernetes\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:45.975846 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.973543    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0323060-7649-4e6c-b078-dbe218838e63-metrics-certs\") pod \"network-metrics-daemon-2qkhb\" (UID: \"b0323060-7649-4e6c-b078-dbe218838e63\") " pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 13:58:45.975846 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.973566    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-var-lib-openvswitch\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:45.975846 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.973589    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a9c2a97a-5054-4839-b0ea-ff5bfa366afc-kubelet-config\") pod \"global-pull-secret-syncer-wsgdv\" (UID: \"a9c2a97a-5054-4839-b0ea-ff5bfa366afc\") " pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:58:45.975846 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.973613    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9785b03-cd05-426a-8b34-f59cbe5ce454-tmp\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.975846 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.973618    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e9785b03-cd05-426a-8b34-f59cbe5ce454-lib-modules\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.976961 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.976857    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e9785b03-cd05-426a-8b34-f59cbe5ce454-etc-tuned\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.977028 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.976962    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9785b03-cd05-426a-8b34-f59cbe5ce454-tmp\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:45.977125 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.977107    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 13:58:45.982006 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:45.981987    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txqnz\" (UniqueName: \"kubernetes.io/projected/e9785b03-cd05-426a-8b34-f59cbe5ce454-kube-api-access-txqnz\") pod \"tuned-7w4m8\" (UID: \"e9785b03-cd05-426a-8b34-f59cbe5ce454\") " pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:46.074240 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074219    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3f39a078-1a89-436d-bc9a-2f0a8296462c-iptables-alerter-script\") pod \"iptables-alerter-q75kl\" (UID: \"3f39a078-1a89-436d-bc9a-2f0a8296462c\") " pod="openshift-network-operator/iptables-alerter-q75kl"
Sep 08 13:58:46.074375 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074250    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f39a078-1a89-436d-bc9a-2f0a8296462c-host-slash\") pod \"iptables-alerter-q75kl\" (UID: \"3f39a078-1a89-436d-bc9a-2f0a8296462c\") " pod="openshift-network-operator/iptables-alerter-q75kl"
Sep 08 13:58:46.074375 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074272    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe124193-60d2-4e5d-adb3-760fe3f0e92a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8zb5t\" (UID: \"fe124193-60d2-4e5d-adb3-760fe3f0e92a\") " pod="openshift-multus/multus-additional-cni-plugins-8zb5t"
Sep 08 13:58:46.074375 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074293    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-host-run-netns\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.074375 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074313    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe124193-60d2-4e5d-adb3-760fe3f0e92a-cnibin\") pod \"multus-additional-cni-plugins-8zb5t\" (UID: \"fe124193-60d2-4e5d-adb3-760fe3f0e92a\") " pod="openshift-multus/multus-additional-cni-plugins-8zb5t"
Sep 08 13:58:46.074375 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074335    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-host-cni-netd\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.074375 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074341    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f39a078-1a89-436d-bc9a-2f0a8296462c-host-slash\") pod \"iptables-alerter-q75kl\" (UID: \"3f39a078-1a89-436d-bc9a-2f0a8296462c\") " pod="openshift-network-operator/iptables-alerter-q75kl"
Sep 08 13:58:46.074375 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074358    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dflj8\" (UniqueName: \"kubernetes.io/projected/ca279b18-1c16-44e5-a5ee-07abf9c51ffd-kube-api-access-dflj8\") pod \"aws-ebs-csi-driver-node-5l8zx\" (UID: \"ca279b18-1c16-44e5-a5ee-07abf9c51ffd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l8zx"
Sep 08 13:58:46.074375 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074364    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-host-run-netns\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.074735 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074382    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d47cfde2-6162-4179-97d5-985a6b27ca33-cni-binary-copy\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.074735 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074389    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe124193-60d2-4e5d-adb3-760fe3f0e92a-cnibin\") pod \"multus-additional-cni-plugins-8zb5t\" (UID: \"fe124193-60d2-4e5d-adb3-760fe3f0e92a\") " pod="openshift-multus/multus-additional-cni-plugins-8zb5t"
Sep 08 13:58:46.074735 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074400    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-host-cni-netd\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.074735 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074406    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-run-systemd\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.074735 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074449    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe124193-60d2-4e5d-adb3-760fe3f0e92a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8zb5t\" (UID: \"fe124193-60d2-4e5d-adb3-760fe3f0e92a\") " pod="openshift-multus/multus-additional-cni-plugins-8zb5t"
Sep 08 13:58:46.074735 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074469    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a94658b0-bc07-44bc-a7c8-92d1c7804987-tmp-dir\") pod \"node-resolver-qzvvn\" (UID: \"a94658b0-bc07-44bc-a7c8-92d1c7804987\") " pod="openshift-dns/node-resolver-qzvvn"
Sep 08 13:58:46.074735 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074484    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-run-systemd\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.074735 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074502    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe124193-60d2-4e5d-adb3-760fe3f0e92a-system-cni-dir\") pod \"multus-additional-cni-plugins-8zb5t\" (UID: \"fe124193-60d2-4e5d-adb3-760fe3f0e92a\") " pod="openshift-multus/multus-additional-cni-plugins-8zb5t"
Sep 08 13:58:46.074735 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074535    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-host-run-ovn-kubernetes\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.074735 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074545    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe124193-60d2-4e5d-adb3-760fe3f0e92a-system-cni-dir\") pod \"multus-additional-cni-plugins-8zb5t\" (UID: \"fe124193-60d2-4e5d-adb3-760fe3f0e92a\") " pod="openshift-multus/multus-additional-cni-plugins-8zb5t"
Sep 08 13:58:46.074735 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074570    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9c2a97a-5054-4839-b0ea-ff5bfa366afc-original-pull-secret\") pod \"global-pull-secret-syncer-wsgdv\" (UID: \"a9c2a97a-5054-4839-b0ea-ff5bfa366afc\") " pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:58:46.074735 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074591    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-host-run-ovn-kubernetes\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.074735 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074595    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ca279b18-1c16-44e5-a5ee-07abf9c51ffd-socket-dir\") pod \"aws-ebs-csi-driver-node-5l8zx\" (UID: \"ca279b18-1c16-44e5-a5ee-07abf9c51ffd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l8zx"
Sep 08 13:58:46.074735 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074618    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ca279b18-1c16-44e5-a5ee-07abf9c51ffd-sys-fs\") pod \"aws-ebs-csi-driver-node-5l8zx\" (UID: \"ca279b18-1c16-44e5-a5ee-07abf9c51ffd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l8zx"
Sep 08 13:58:46.074735 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074641    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1f1133bf-01cf-46b7-be8d-1272be6dd0da-serviceca\") pod \"node-ca-lw6kq\" (UID: \"1f1133bf-01cf-46b7-be8d-1272be6dd0da\") " pod="openshift-image-registry/node-ca-lw6kq"
Sep 08 13:58:46.074735 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074665    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-host-run-netns\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.074735 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:46.074670    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 13:58:46.074735 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074689    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-log-socket\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.075517 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074688    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ca279b18-1c16-44e5-a5ee-07abf9c51ffd-sys-fs\") pod \"aws-ebs-csi-driver-node-5l8zx\" (UID: \"ca279b18-1c16-44e5-a5ee-07abf9c51ffd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l8zx"
Sep 08 13:58:46.075517 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:46.074721    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9c2a97a-5054-4839-b0ea-ff5bfa366afc-original-pull-secret podName:a9c2a97a-5054-4839-b0ea-ff5bfa366afc nodeName:}" failed. No retries permitted until 2026-09-08 13:58:46.57470278 +0000 UTC m=+2.064419809 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9c2a97a-5054-4839-b0ea-ff5bfa366afc-original-pull-secret") pod "global-pull-secret-syncer-wsgdv" (UID: "a9c2a97a-5054-4839-b0ea-ff5bfa366afc") : object "kube-system"/"original-pull-secret" not registered
Sep 08 13:58:46.075517 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074741    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ca279b18-1c16-44e5-a5ee-07abf9c51ffd-socket-dir\") pod \"aws-ebs-csi-driver-node-5l8zx\" (UID: \"ca279b18-1c16-44e5-a5ee-07abf9c51ffd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l8zx"
Sep 08 13:58:46.075517 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074751    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-host-run-netns\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.075517 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074742    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-env-overrides\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.075517 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074763    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-log-socket\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.075517 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074789    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhkjw\" (UniqueName: \"kubernetes.io/projected/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-kube-api-access-xhkjw\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.075517 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074792    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a94658b0-bc07-44bc-a7c8-92d1c7804987-tmp-dir\") pod \"node-resolver-qzvvn\" (UID: \"a94658b0-bc07-44bc-a7c8-92d1c7804987\") " pod="openshift-dns/node-resolver-qzvvn"
Sep 08 13:58:46.075517 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074915    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kl9x\" (UniqueName: \"kubernetes.io/projected/4768adf0-964c-415f-bd1f-94c1d50ad6f7-kube-api-access-9kl9x\") pod \"network-check-target-vlc72\" (UID: \"4768adf0-964c-415f-bd1f-94c1d50ad6f7\") " pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 13:58:46.075517 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074953    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-host-kubelet\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.075517 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074955    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d47cfde2-6162-4179-97d5-985a6b27ca33-cni-binary-copy\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.075517 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074985    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-system-cni-dir\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.075517 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.074992    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-host-kubelet\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.075517 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075032    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v84ds\" (UniqueName: \"kubernetes.io/projected/3f39a078-1a89-436d-bc9a-2f0a8296462c-kube-api-access-v84ds\") pod \"iptables-alerter-q75kl\" (UID: \"3f39a078-1a89-436d-bc9a-2f0a8296462c\") " pod="openshift-network-operator/iptables-alerter-q75kl"
Sep 08 13:58:46.075517 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075069    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-system-cni-dir\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.075517 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075081    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-multus-socket-dir-parent\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.075517 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075105    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-multus-conf-dir\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.076475 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075114    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1f1133bf-01cf-46b7-be8d-1272be6dd0da-serviceca\") pod \"node-ca-lw6kq\" (UID: \"1f1133bf-01cf-46b7-be8d-1272be6dd0da\") " pod="openshift-image-registry/node-ca-lw6kq"
Sep 08 13:58:46.076475 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075128    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d47cfde2-6162-4179-97d5-985a6b27ca33-multus-daemon-config\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.076475 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075151    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a94658b0-bc07-44bc-a7c8-92d1c7804987-hosts-file\") pod \"node-resolver-qzvvn\" (UID: \"a94658b0-bc07-44bc-a7c8-92d1c7804987\") " pod="openshift-dns/node-resolver-qzvvn"
Sep 08 13:58:46.076475 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075175    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fe124193-60d2-4e5d-adb3-760fe3f0e92a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8zb5t\" (UID: \"fe124193-60d2-4e5d-adb3-760fe3f0e92a\") " pod="openshift-multus/multus-additional-cni-plugins-8zb5t"
Sep 08 13:58:46.076475 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075182    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-multus-socket-dir-parent\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.076475 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075168    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-multus-conf-dir\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.076475 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075190    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-env-overrides\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.076475 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075218    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-host-slash\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.076475 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075233    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a94658b0-bc07-44bc-a7c8-92d1c7804987-hosts-file\") pod \"node-resolver-qzvvn\" (UID: \"a94658b0-bc07-44bc-a7c8-92d1c7804987\") " pod="openshift-dns/node-resolver-qzvvn"
Sep 08 13:58:46.076475 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075241    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-host-run-k8s-cni-cncf-io\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.076475 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075265    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-host-slash\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.076475 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075266    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzfcp\" (UniqueName: \"kubernetes.io/projected/d47cfde2-6162-4179-97d5-985a6b27ca33-kube-api-access-pzfcp\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.076475 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075294    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f1133bf-01cf-46b7-be8d-1272be6dd0da-host\") pod \"node-ca-lw6kq\" (UID: \"1f1133bf-01cf-46b7-be8d-1272be6dd0da\") " pod="openshift-image-registry/node-ca-lw6kq"
Sep 08 13:58:46.076475 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075295    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-host-run-k8s-cni-cncf-io\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.076475 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075313    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-etc-openvswitch\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.076475 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075328    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-run-ovn\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.076475 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075336    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f1133bf-01cf-46b7-be8d-1272be6dd0da-host\") pod \"node-ca-lw6kq\" (UID: \"1f1133bf-01cf-46b7-be8d-1272be6dd0da\") " pod="openshift-image-registry/node-ca-lw6kq"
Sep 08 13:58:46.076475 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075346    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-node-log\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.077434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075373    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ca279b18-1c16-44e5-a5ee-07abf9c51ffd-etc-selinux\") pod \"aws-ebs-csi-driver-node-5l8zx\" (UID: \"ca279b18-1c16-44e5-a5ee-07abf9c51ffd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l8zx"
Sep 08 13:58:46.077434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075391    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-run-ovn\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.077434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075401    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-host-var-lib-kubelet\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.077434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075411    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-node-log\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.077434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075375    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-etc-openvswitch\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.077434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075460    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj4p9\" (UniqueName: \"kubernetes.io/projected/b0323060-7649-4e6c-b078-dbe218838e63-kube-api-access-fj4p9\") pod \"network-metrics-daemon-2qkhb\" (UID: \"b0323060-7649-4e6c-b078-dbe218838e63\") " pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 13:58:46.077434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075473    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-host-var-lib-kubelet\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.077434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075500    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-run-openvswitch\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.077434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075519    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ca279b18-1c16-44e5-a5ee-07abf9c51ffd-etc-selinux\") pod \"aws-ebs-csi-driver-node-5l8zx\" (UID: \"ca279b18-1c16-44e5-a5ee-07abf9c51ffd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l8zx"
Sep 08 13:58:46.077434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075525    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-host-cni-bin\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.077434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075550    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-ovnkube-config\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.077434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075569    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-run-openvswitch\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.077434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075599    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-host-cni-bin\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.077434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075623    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-ovn-node-metrics-cert\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.077434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075646    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-host-var-lib-cni-bin\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.077434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075651    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d47cfde2-6162-4179-97d5-985a6b27ca33-multus-daemon-config\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.077434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075685    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-host-var-lib-cni-bin\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.077905 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075704    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fe124193-60d2-4e5d-adb3-760fe3f0e92a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8zb5t\" (UID: \"fe124193-60d2-4e5d-adb3-760fe3f0e92a\") " pod="openshift-multus/multus-additional-cni-plugins-8zb5t"
Sep 08 13:58:46.077905 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075747    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b680f42a-aaf7-415e-8045-ea5fccc2ebea-agent-certs\") pod \"konnectivity-agent-g7btk\" (UID: \"b680f42a-aaf7-415e-8045-ea5fccc2ebea\") " pod="kube-system/konnectivity-agent-g7btk"
Sep 08 13:58:46.077905 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075776    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnqfp\" (UniqueName: \"kubernetes.io/projected/fe124193-60d2-4e5d-adb3-760fe3f0e92a-kube-api-access-tnqfp\") pod \"multus-additional-cni-plugins-8zb5t\" (UID: \"fe124193-60d2-4e5d-adb3-760fe3f0e92a\") " pod="openshift-multus/multus-additional-cni-plugins-8zb5t"
Sep 08 13:58:46.077905 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075801    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ca279b18-1c16-44e5-a5ee-07abf9c51ffd-device-dir\") pod \"aws-ebs-csi-driver-node-5l8zx\" (UID: \"ca279b18-1c16-44e5-a5ee-07abf9c51ffd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l8zx"
Sep 08 13:58:46.077905 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075825    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-host-run-multus-certs\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.077905 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075889    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe124193-60d2-4e5d-adb3-760fe3f0e92a-cni-binary-copy\") pod \"multus-additional-cni-plugins-8zb5t\" (UID: \"fe124193-60d2-4e5d-adb3-760fe3f0e92a\") " pod="openshift-multus/multus-additional-cni-plugins-8zb5t"
Sep 08 13:58:46.077905 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075907    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ca279b18-1c16-44e5-a5ee-07abf9c51ffd-device-dir\") pod \"aws-ebs-csi-driver-node-5l8zx\" (UID: \"ca279b18-1c16-44e5-a5ee-07abf9c51ffd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l8zx"
Sep 08 13:58:46.077905 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075917    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fe124193-60d2-4e5d-adb3-760fe3f0e92a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8zb5t\" (UID: \"fe124193-60d2-4e5d-adb3-760fe3f0e92a\") " pod="openshift-multus/multus-additional-cni-plugins-8zb5t"
Sep 08 13:58:46.077905 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075955    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-systemd-units\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.077905 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.075991    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-ovnkube-config\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.077905 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.076007    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-ovnkube-script-lib\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.077905 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.076034    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-multus-cni-dir\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.077905 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.076092    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-systemd-units\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.077905 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.076109    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-cnibin\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.077905 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.076137    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7bmf\" (UniqueName: \"kubernetes.io/projected/1f1133bf-01cf-46b7-be8d-1272be6dd0da-kube-api-access-n7bmf\") pod \"node-ca-lw6kq\" (UID: \"1f1133bf-01cf-46b7-be8d-1272be6dd0da\") " pod="openshift-image-registry/node-ca-lw6kq"
Sep 08 13:58:46.077905 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.076181    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a9c2a97a-5054-4839-b0ea-ff5bfa366afc-dbus\") pod \"global-pull-secret-syncer-wsgdv\" (UID: \"a9c2a97a-5054-4839-b0ea-ff5bfa366afc\") " pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:58:46.077905 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.076205    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ca279b18-1c16-44e5-a5ee-07abf9c51ffd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5l8zx\" (UID: \"ca279b18-1c16-44e5-a5ee-07abf9c51ffd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l8zx"
Sep 08 13:58:46.078434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.076093    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-host-run-multus-certs\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.078434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.076217    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-multus-cni-dir\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.078434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.076247    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b680f42a-aaf7-415e-8045-ea5fccc2ebea-konnectivity-ca\") pod \"konnectivity-agent-g7btk\" (UID: \"b680f42a-aaf7-415e-8045-ea5fccc2ebea\") " pod="kube-system/konnectivity-agent-g7btk"
Sep 08 13:58:46.078434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.076319    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-cnibin\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.078434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.076326    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a9c2a97a-5054-4839-b0ea-ff5bfa366afc-dbus\") pod \"global-pull-secret-syncer-wsgdv\" (UID: \"a9c2a97a-5054-4839-b0ea-ff5bfa366afc\") " pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:58:46.078434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.076335    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh9jp\" (UniqueName: \"kubernetes.io/projected/a94658b0-bc07-44bc-a7c8-92d1c7804987-kube-api-access-mh9jp\") pod \"node-resolver-qzvvn\" (UID: \"a94658b0-bc07-44bc-a7c8-92d1c7804987\") " pod="openshift-dns/node-resolver-qzvvn"
Sep 08 13:58:46.078434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.076381    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3f39a078-1a89-436d-bc9a-2f0a8296462c-iptables-alerter-script\") pod \"iptables-alerter-q75kl\" (UID: \"3f39a078-1a89-436d-bc9a-2f0a8296462c\") " pod="openshift-network-operator/iptables-alerter-q75kl"
Sep 08 13:58:46.078434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.076373    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ca279b18-1c16-44e5-a5ee-07abf9c51ffd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5l8zx\" (UID: \"ca279b18-1c16-44e5-a5ee-07abf9c51ffd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l8zx"
Sep 08 13:58:46.078434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.076917    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-ovnkube-script-lib\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.078434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.076943    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b680f42a-aaf7-415e-8045-ea5fccc2ebea-konnectivity-ca\") pod \"konnectivity-agent-g7btk\" (UID: \"b680f42a-aaf7-415e-8045-ea5fccc2ebea\") " pod="kube-system/konnectivity-agent-g7btk"
Sep 08 13:58:46.078434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.077005    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-hostroot\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.078434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.077068    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.078434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.077038    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fe124193-60d2-4e5d-adb3-760fe3f0e92a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8zb5t\" (UID: \"fe124193-60d2-4e5d-adb3-760fe3f0e92a\") " pod="openshift-multus/multus-additional-cni-plugins-8zb5t"
Sep 08 13:58:46.078434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.077119    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-host-var-lib-cni-multus\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.078434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.077134    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-hostroot\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.078434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.077144    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-etc-kubernetes\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.078434 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.077167    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0323060-7649-4e6c-b078-dbe218838e63-metrics-certs\") pod \"network-metrics-daemon-2qkhb\" (UID: \"b0323060-7649-4e6c-b078-dbe218838e63\") " pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 13:58:46.078900 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.077190    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-var-lib-openvswitch\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.078900 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.077207    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-host-var-lib-cni-multus\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.078900 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.077213    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a9c2a97a-5054-4839-b0ea-ff5bfa366afc-kubelet-config\") pod \"global-pull-secret-syncer-wsgdv\" (UID: \"a9c2a97a-5054-4839-b0ea-ff5bfa366afc\") " pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:58:46.078900 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.077209    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.078900 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.077252    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d47cfde2-6162-4179-97d5-985a6b27ca33-etc-kubernetes\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.078900 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.077272    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a9c2a97a-5054-4839-b0ea-ff5bfa366afc-kubelet-config\") pod \"global-pull-secret-syncer-wsgdv\" (UID: \"a9c2a97a-5054-4839-b0ea-ff5bfa366afc\") " pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:58:46.078900 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.077278    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ca279b18-1c16-44e5-a5ee-07abf9c51ffd-registration-dir\") pod \"aws-ebs-csi-driver-node-5l8zx\" (UID: \"ca279b18-1c16-44e5-a5ee-07abf9c51ffd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l8zx"
Sep 08 13:58:46.078900 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:46.077289    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:58:46.078900 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.077311    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe124193-60d2-4e5d-adb3-760fe3f0e92a-cni-binary-copy\") pod \"multus-additional-cni-plugins-8zb5t\" (UID: \"fe124193-60d2-4e5d-adb3-760fe3f0e92a\") " pod="openshift-multus/multus-additional-cni-plugins-8zb5t"
Sep 08 13:58:46.078900 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.077352    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ca279b18-1c16-44e5-a5ee-07abf9c51ffd-registration-dir\") pod \"aws-ebs-csi-driver-node-5l8zx\" (UID: \"ca279b18-1c16-44e5-a5ee-07abf9c51ffd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l8zx"
Sep 08 13:58:46.078900 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.077367    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-var-lib-openvswitch\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.078900 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:46.077399    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0323060-7649-4e6c-b078-dbe218838e63-metrics-certs podName:b0323060-7649-4e6c-b078-dbe218838e63 nodeName:}" failed. No retries permitted until 2026-09-08 13:58:46.577381525 +0000 UTC m=+2.067098555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0323060-7649-4e6c-b078-dbe218838e63-metrics-certs") pod "network-metrics-daemon-2qkhb" (UID: "b0323060-7649-4e6c-b078-dbe218838e63") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:58:46.078900 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.078325    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-ovn-node-metrics-cert\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.078900 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.078495    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b680f42a-aaf7-415e-8045-ea5fccc2ebea-agent-certs\") pod \"konnectivity-agent-g7btk\" (UID: \"b680f42a-aaf7-415e-8045-ea5fccc2ebea\") " pod="kube-system/konnectivity-agent-g7btk"
Sep 08 13:58:46.093247 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.093231    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dflj8\" (UniqueName: \"kubernetes.io/projected/ca279b18-1c16-44e5-a5ee-07abf9c51ffd-kube-api-access-dflj8\") pod \"aws-ebs-csi-driver-node-5l8zx\" (UID: \"ca279b18-1c16-44e5-a5ee-07abf9c51ffd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l8zx"
Sep 08 13:58:46.098840 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:46.098823    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 13:58:46.098934 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:46.098843    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 13:58:46.098934 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:46.098855    2575 projected.go:196] Error preparing data for projected volume kube-api-access-9kl9x for pod openshift-network-diagnostics/network-check-target-vlc72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:58:46.099031 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:46.098913    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4768adf0-964c-415f-bd1f-94c1d50ad6f7-kube-api-access-9kl9x podName:4768adf0-964c-415f-bd1f-94c1d50ad6f7 nodeName:}" failed. No retries permitted until 2026-09-08 13:58:46.598895542 +0000 UTC m=+2.088612593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9kl9x" (UniqueName: "kubernetes.io/projected/4768adf0-964c-415f-bd1f-94c1d50ad6f7-kube-api-access-9kl9x") pod "network-check-target-vlc72" (UID: "4768adf0-964c-415f-bd1f-94c1d50ad6f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:58:46.100840 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.100820    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnqfp\" (UniqueName: \"kubernetes.io/projected/fe124193-60d2-4e5d-adb3-760fe3f0e92a-kube-api-access-tnqfp\") pod \"multus-additional-cni-plugins-8zb5t\" (UID: \"fe124193-60d2-4e5d-adb3-760fe3f0e92a\") " pod="openshift-multus/multus-additional-cni-plugins-8zb5t"
Sep 08 13:58:46.101084 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.101044    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj4p9\" (UniqueName: \"kubernetes.io/projected/b0323060-7649-4e6c-b078-dbe218838e63-kube-api-access-fj4p9\") pod \"network-metrics-daemon-2qkhb\" (UID: \"b0323060-7649-4e6c-b078-dbe218838e63\") " pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 13:58:46.101237 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.101219    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh9jp\" (UniqueName: \"kubernetes.io/projected/a94658b0-bc07-44bc-a7c8-92d1c7804987-kube-api-access-mh9jp\") pod \"node-resolver-qzvvn\" (UID: \"a94658b0-bc07-44bc-a7c8-92d1c7804987\") " pod="openshift-dns/node-resolver-qzvvn"
Sep 08 13:58:46.103866 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.103837    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7bmf\" (UniqueName: \"kubernetes.io/projected/1f1133bf-01cf-46b7-be8d-1272be6dd0da-kube-api-access-n7bmf\") pod \"node-ca-lw6kq\" (UID: \"1f1133bf-01cf-46b7-be8d-1272be6dd0da\") " pod="openshift-image-registry/node-ca-lw6kq"
Sep 08 13:58:46.104001 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.103844    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v84ds\" (UniqueName: \"kubernetes.io/projected/3f39a078-1a89-436d-bc9a-2f0a8296462c-kube-api-access-v84ds\") pod \"iptables-alerter-q75kl\" (UID: \"3f39a078-1a89-436d-bc9a-2f0a8296462c\") " pod="openshift-network-operator/iptables-alerter-q75kl"
Sep 08 13:58:46.106421 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.106397    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzfcp\" (UniqueName: \"kubernetes.io/projected/d47cfde2-6162-4179-97d5-985a6b27ca33-kube-api-access-pzfcp\") pod \"multus-svxwv\" (UID: \"d47cfde2-6162-4179-97d5-985a6b27ca33\") " pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.106421 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.106411    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhkjw\" (UniqueName: \"kubernetes.io/projected/2d773614-9d8a-4a7d-9a65-bbd560ba1ae7-kube-api-access-xhkjw\") pod \"ovnkube-node-ncn7g\" (UID: \"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.200575 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.200526    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7w4m8"
Sep 08 13:58:46.210192 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:46.210173    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9785b03_cd05_426a_8b34_f59cbe5ce454.slice/crio-fca2b40b280708897ef4b4b22ef13e304e3dbf595cc5a833d91a93b7cc470cd1 WatchSource:0}: Error finding container fca2b40b280708897ef4b4b22ef13e304e3dbf595cc5a833d91a93b7cc470cd1: Status 404 returned error can't find the container with id fca2b40b280708897ef4b4b22ef13e304e3dbf595cc5a833d91a93b7cc470cd1
Sep 08 13:58:46.213304 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.213293    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:58:46.221404 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:46.221380    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d773614_9d8a_4a7d_9a65_bbd560ba1ae7.slice/crio-b0b0997654272e4e95d5618b62bda34554d989fe538a5c9d609e3a73d3a2e62d WatchSource:0}: Error finding container b0b0997654272e4e95d5618b62bda34554d989fe538a5c9d609e3a73d3a2e62d: Status 404 returned error can't find the container with id b0b0997654272e4e95d5618b62bda34554d989fe538a5c9d609e3a73d3a2e62d
Sep 08 13:58:46.231147 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.231132    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qzvvn"
Sep 08 13:58:46.238822 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:46.238803    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda94658b0_bc07_44bc_a7c8_92d1c7804987.slice/crio-e0916a7ce45c6f4511ad89da91a7b2af256e93f61abef84ed405fb3d7bb1951e WatchSource:0}: Error finding container e0916a7ce45c6f4511ad89da91a7b2af256e93f61abef84ed405fb3d7bb1951e: Status 404 returned error can't find the container with id e0916a7ce45c6f4511ad89da91a7b2af256e93f61abef84ed405fb3d7bb1951e
Sep 08 13:58:46.249325 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.249308    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l8zx"
Sep 08 13:58:46.257336 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:46.257319    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca279b18_1c16_44e5_a5ee_07abf9c51ffd.slice/crio-312693c9d39c7758f75e29fee6b3ece4466e170ebf15de3c12dcd8be07c0e677 WatchSource:0}: Error finding container 312693c9d39c7758f75e29fee6b3ece4466e170ebf15de3c12dcd8be07c0e677: Status 404 returned error can't find the container with id 312693c9d39c7758f75e29fee6b3ece4466e170ebf15de3c12dcd8be07c0e677
Sep 08 13:58:46.260227 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.260211    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8zb5t"
Sep 08 13:58:46.263729 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.263715    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lw6kq"
Sep 08 13:58:46.267399 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:46.267381    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe124193_60d2_4e5d_adb3_760fe3f0e92a.slice/crio-7d8c1a9aaec9119d3188757effe68b8c20f9debf6f9261abd66fe2ae6bdae802 WatchSource:0}: Error finding container 7d8c1a9aaec9119d3188757effe68b8c20f9debf6f9261abd66fe2ae6bdae802: Status 404 returned error can't find the container with id 7d8c1a9aaec9119d3188757effe68b8c20f9debf6f9261abd66fe2ae6bdae802
Sep 08 13:58:46.270659 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.270640    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q75kl"
Sep 08 13:58:46.273240 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:46.273207    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f1133bf_01cf_46b7_be8d_1272be6dd0da.slice/crio-cb47be9e49d5f57323bb3d18ea148c74440369795f53d67d8522f80f28ec4930 WatchSource:0}: Error finding container cb47be9e49d5f57323bb3d18ea148c74440369795f53d67d8522f80f28ec4930: Status 404 returned error can't find the container with id cb47be9e49d5f57323bb3d18ea148c74440369795f53d67d8522f80f28ec4930
Sep 08 13:58:46.278393 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:46.278376    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f39a078_1a89_436d_bc9a_2f0a8296462c.slice/crio-96310cb98749ea17542e633e49082fb29738afd185702bbf01be6fa506115107 WatchSource:0}: Error finding container 96310cb98749ea17542e633e49082fb29738afd185702bbf01be6fa506115107: Status 404 returned error can't find the container with id 96310cb98749ea17542e633e49082fb29738afd185702bbf01be6fa506115107
Sep 08 13:58:46.286008 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.285993    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-svxwv"
Sep 08 13:58:46.290510 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.290490    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g7btk"
Sep 08 13:58:46.294519 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:46.294499    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd47cfde2_6162_4179_97d5_985a6b27ca33.slice/crio-0e38bc65a8fbe70dd04e6add71c5bbec91a87ea70443b9117ba083424e8b825d WatchSource:0}: Error finding container 0e38bc65a8fbe70dd04e6add71c5bbec91a87ea70443b9117ba083424e8b825d: Status 404 returned error can't find the container with id 0e38bc65a8fbe70dd04e6add71c5bbec91a87ea70443b9117ba083424e8b825d
Sep 08 13:58:46.298894 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:58:46.298877    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb680f42a_aaf7_415e_8045_ea5fccc2ebea.slice/crio-38ba1a23d279f50374ff871d80a17909a26fbe35ea74c3259734cc32effbb444 WatchSource:0}: Error finding container 38ba1a23d279f50374ff871d80a17909a26fbe35ea74c3259734cc32effbb444: Status 404 returned error can't find the container with id 38ba1a23d279f50374ff871d80a17909a26fbe35ea74c3259734cc32effbb444
Sep 08 13:58:46.580841 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.580804    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0323060-7649-4e6c-b078-dbe218838e63-metrics-certs\") pod \"network-metrics-daemon-2qkhb\" (UID: \"b0323060-7649-4e6c-b078-dbe218838e63\") " pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 13:58:46.581013 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.580858    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9c2a97a-5054-4839-b0ea-ff5bfa366afc-original-pull-secret\") pod \"global-pull-secret-syncer-wsgdv\" (UID: \"a9c2a97a-5054-4839-b0ea-ff5bfa366afc\") " pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:58:46.581013 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:46.580955    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:58:46.581013 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:46.580997    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 13:58:46.581192 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:46.581029    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0323060-7649-4e6c-b078-dbe218838e63-metrics-certs podName:b0323060-7649-4e6c-b078-dbe218838e63 nodeName:}" failed. No retries permitted until 2026-09-08 13:58:47.581012646 +0000 UTC m=+3.070729684 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0323060-7649-4e6c-b078-dbe218838e63-metrics-certs") pod "network-metrics-daemon-2qkhb" (UID: "b0323060-7649-4e6c-b078-dbe218838e63") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:58:46.581192 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:46.581099    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9c2a97a-5054-4839-b0ea-ff5bfa366afc-original-pull-secret podName:a9c2a97a-5054-4839-b0ea-ff5bfa366afc nodeName:}" failed. No retries permitted until 2026-09-08 13:58:47.581081869 +0000 UTC m=+3.070798901 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9c2a97a-5054-4839-b0ea-ff5bfa366afc-original-pull-secret") pod "global-pull-secret-syncer-wsgdv" (UID: "a9c2a97a-5054-4839-b0ea-ff5bfa366afc") : object "kube-system"/"original-pull-secret" not registered
Sep 08 13:58:46.681809 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.681777    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kl9x\" (UniqueName: \"kubernetes.io/projected/4768adf0-964c-415f-bd1f-94c1d50ad6f7-kube-api-access-9kl9x\") pod \"network-check-target-vlc72\" (UID: \"4768adf0-964c-415f-bd1f-94c1d50ad6f7\") " pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 13:58:46.682005 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:46.681982    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 13:58:46.682066 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:46.682015    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 13:58:46.682066 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:46.682030    2575 projected.go:196] Error preparing data for projected volume kube-api-access-9kl9x for pod openshift-network-diagnostics/network-check-target-vlc72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:58:46.682150 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:46.682111    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4768adf0-964c-415f-bd1f-94c1d50ad6f7-kube-api-access-9kl9x podName:4768adf0-964c-415f-bd1f-94c1d50ad6f7 nodeName:}" failed. No retries permitted until 2026-09-08 13:58:47.682090293 +0000 UTC m=+3.171807341 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9kl9x" (UniqueName: "kubernetes.io/projected/4768adf0-964c-415f-bd1f-94c1d50ad6f7-kube-api-access-9kl9x") pod "network-check-target-vlc72" (UID: "4768adf0-964c-415f-bd1f-94c1d50ad6f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:58:46.717179 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.717082    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 13:58:46.947388 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.947206    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 13:53:46 +0000 UTC" deadline="2028-02-27 04:19:22.814758051 +0000 UTC"
Sep 08 13:58:46.947388 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.947272    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12878h20m35.867490728s"
Sep 08 13:58:46.977292 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.977261    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 13:58:46.977465 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:46.977422    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlc72" podUID="4768adf0-964c-415f-bd1f-94c1d50ad6f7"
Sep 08 13:58:46.977898 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.977839    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:58:46.977980 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:46.977958    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsgdv" podUID="a9c2a97a-5054-4839-b0ea-ff5bfa366afc"
Sep 08 13:58:46.988301 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.988207    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g7btk" event={"ID":"b680f42a-aaf7-415e-8045-ea5fccc2ebea","Type":"ContainerStarted","Data":"38ba1a23d279f50374ff871d80a17909a26fbe35ea74c3259734cc32effbb444"}
Sep 08 13:58:46.990761 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.990734    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-svxwv" event={"ID":"d47cfde2-6162-4179-97d5-985a6b27ca33","Type":"ContainerStarted","Data":"0e38bc65a8fbe70dd04e6add71c5bbec91a87ea70443b9117ba083424e8b825d"}
Sep 08 13:58:46.999927 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:46.999901    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l8zx" event={"ID":"ca279b18-1c16-44e5-a5ee-07abf9c51ffd","Type":"ContainerStarted","Data":"312693c9d39c7758f75e29fee6b3ece4466e170ebf15de3c12dcd8be07c0e677"}
Sep 08 13:58:47.018878 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:47.018851    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qzvvn" event={"ID":"a94658b0-bc07-44bc-a7c8-92d1c7804987","Type":"ContainerStarted","Data":"e0916a7ce45c6f4511ad89da91a7b2af256e93f61abef84ed405fb3d7bb1951e"}
Sep 08 13:58:47.021830 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:47.021804    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g" event={"ID":"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7","Type":"ContainerStarted","Data":"b0b0997654272e4e95d5618b62bda34554d989fe538a5c9d609e3a73d3a2e62d"}
Sep 08 13:58:47.032150 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:47.032125    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7w4m8" event={"ID":"e9785b03-cd05-426a-8b34-f59cbe5ce454","Type":"ContainerStarted","Data":"fca2b40b280708897ef4b4b22ef13e304e3dbf595cc5a833d91a93b7cc470cd1"}
Sep 08 13:58:47.038098 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:47.038045    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q75kl" event={"ID":"3f39a078-1a89-436d-bc9a-2f0a8296462c","Type":"ContainerStarted","Data":"96310cb98749ea17542e633e49082fb29738afd185702bbf01be6fa506115107"}
Sep 08 13:58:47.042193 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:47.042169    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lw6kq" event={"ID":"1f1133bf-01cf-46b7-be8d-1272be6dd0da","Type":"ContainerStarted","Data":"cb47be9e49d5f57323bb3d18ea148c74440369795f53d67d8522f80f28ec4930"}
Sep 08 13:58:47.051988 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:47.051953    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zb5t" event={"ID":"fe124193-60d2-4e5d-adb3-760fe3f0e92a","Type":"ContainerStarted","Data":"7d8c1a9aaec9119d3188757effe68b8c20f9debf6f9261abd66fe2ae6bdae802"}
Sep 08 13:58:47.591564 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:47.590803    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9c2a97a-5054-4839-b0ea-ff5bfa366afc-original-pull-secret\") pod \"global-pull-secret-syncer-wsgdv\" (UID: \"a9c2a97a-5054-4839-b0ea-ff5bfa366afc\") " pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:58:47.591564 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:47.590903    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0323060-7649-4e6c-b078-dbe218838e63-metrics-certs\") pod \"network-metrics-daemon-2qkhb\" (UID: \"b0323060-7649-4e6c-b078-dbe218838e63\") " pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 13:58:47.591564 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:47.591031    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:58:47.591564 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:47.591090    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0323060-7649-4e6c-b078-dbe218838e63-metrics-certs podName:b0323060-7649-4e6c-b078-dbe218838e63 nodeName:}" failed. No retries permitted until 2026-09-08 13:58:49.59107135 +0000 UTC m=+5.080788385 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0323060-7649-4e6c-b078-dbe218838e63-metrics-certs") pod "network-metrics-daemon-2qkhb" (UID: "b0323060-7649-4e6c-b078-dbe218838e63") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:58:47.591564 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:47.591529    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 13:58:47.591982 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:47.591580    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9c2a97a-5054-4839-b0ea-ff5bfa366afc-original-pull-secret podName:a9c2a97a-5054-4839-b0ea-ff5bfa366afc nodeName:}" failed. No retries permitted until 2026-09-08 13:58:49.591565239 +0000 UTC m=+5.081282273 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9c2a97a-5054-4839-b0ea-ff5bfa366afc-original-pull-secret") pod "global-pull-secret-syncer-wsgdv" (UID: "a9c2a97a-5054-4839-b0ea-ff5bfa366afc") : object "kube-system"/"original-pull-secret" not registered
Sep 08 13:58:47.692070 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:47.692030    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kl9x\" (UniqueName: \"kubernetes.io/projected/4768adf0-964c-415f-bd1f-94c1d50ad6f7-kube-api-access-9kl9x\") pod \"network-check-target-vlc72\" (UID: \"4768adf0-964c-415f-bd1f-94c1d50ad6f7\") " pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 13:58:47.692281 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:47.692263    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 13:58:47.692351 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:47.692287    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 13:58:47.692351 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:47.692301    2575 projected.go:196] Error preparing data for projected volume kube-api-access-9kl9x for pod openshift-network-diagnostics/network-check-target-vlc72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:58:47.692462 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:47.692358    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4768adf0-964c-415f-bd1f-94c1d50ad6f7-kube-api-access-9kl9x podName:4768adf0-964c-415f-bd1f-94c1d50ad6f7 nodeName:}" failed. No retries permitted until 2026-09-08 13:58:49.692338508 +0000 UTC m=+5.182055547 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9kl9x" (UniqueName: "kubernetes.io/projected/4768adf0-964c-415f-bd1f-94c1d50ad6f7-kube-api-access-9kl9x") pod "network-check-target-vlc72" (UID: "4768adf0-964c-415f-bd1f-94c1d50ad6f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:58:47.947816 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:47.947691    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 13:53:46 +0000 UTC" deadline="2028-03-08 21:54:29.219481114 +0000 UTC"
Sep 08 13:58:47.947816 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:47.947757    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13135h55m41.271728544s"
Sep 08 13:58:47.968337 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:47.968302    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 13:58:47.968517 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:47.968450    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qkhb" podUID="b0323060-7649-4e6c-b078-dbe218838e63"
Sep 08 13:58:48.246517 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:48.246435    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 13:58:48.674415 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:48.674383    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 13:58:48.975249 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:48.975157    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 13:58:48.975974 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:48.975291    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlc72" podUID="4768adf0-964c-415f-bd1f-94c1d50ad6f7"
Sep 08 13:58:48.975974 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:48.975369    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:58:48.975974 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:48.975448    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsgdv" podUID="a9c2a97a-5054-4839-b0ea-ff5bfa366afc"
Sep 08 13:58:49.612126 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:49.611317    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9c2a97a-5054-4839-b0ea-ff5bfa366afc-original-pull-secret\") pod \"global-pull-secret-syncer-wsgdv\" (UID: \"a9c2a97a-5054-4839-b0ea-ff5bfa366afc\") " pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:58:49.612126 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:49.611412    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0323060-7649-4e6c-b078-dbe218838e63-metrics-certs\") pod \"network-metrics-daemon-2qkhb\" (UID: \"b0323060-7649-4e6c-b078-dbe218838e63\") " pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 13:58:49.612126 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:49.611554    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:58:49.612126 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:49.611617    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0323060-7649-4e6c-b078-dbe218838e63-metrics-certs podName:b0323060-7649-4e6c-b078-dbe218838e63 nodeName:}" failed. No retries permitted until 2026-09-08 13:58:53.611596436 +0000 UTC m=+9.101313475 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0323060-7649-4e6c-b078-dbe218838e63-metrics-certs") pod "network-metrics-daemon-2qkhb" (UID: "b0323060-7649-4e6c-b078-dbe218838e63") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:58:49.612126 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:49.612035    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 13:58:49.612126 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:49.612087    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9c2a97a-5054-4839-b0ea-ff5bfa366afc-original-pull-secret podName:a9c2a97a-5054-4839-b0ea-ff5bfa366afc nodeName:}" failed. No retries permitted until 2026-09-08 13:58:53.612070469 +0000 UTC m=+9.101787500 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9c2a97a-5054-4839-b0ea-ff5bfa366afc-original-pull-secret") pod "global-pull-secret-syncer-wsgdv" (UID: "a9c2a97a-5054-4839-b0ea-ff5bfa366afc") : object "kube-system"/"original-pull-secret" not registered
Sep 08 13:58:49.712952 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:49.712268    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kl9x\" (UniqueName: \"kubernetes.io/projected/4768adf0-964c-415f-bd1f-94c1d50ad6f7-kube-api-access-9kl9x\") pod \"network-check-target-vlc72\" (UID: \"4768adf0-964c-415f-bd1f-94c1d50ad6f7\") " pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 13:58:49.712952 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:49.712476    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 13:58:49.712952 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:49.712502    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 13:58:49.712952 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:49.712517    2575 projected.go:196] Error preparing data for projected volume kube-api-access-9kl9x for pod openshift-network-diagnostics/network-check-target-vlc72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:58:49.712952 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:49.712575    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4768adf0-964c-415f-bd1f-94c1d50ad6f7-kube-api-access-9kl9x podName:4768adf0-964c-415f-bd1f-94c1d50ad6f7 nodeName:}" failed. No retries permitted until 2026-09-08 13:58:53.712556123 +0000 UTC m=+9.202273156 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9kl9x" (UniqueName: "kubernetes.io/projected/4768adf0-964c-415f-bd1f-94c1d50ad6f7-kube-api-access-9kl9x") pod "network-check-target-vlc72" (UID: "4768adf0-964c-415f-bd1f-94c1d50ad6f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:58:49.967885 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:49.967803    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 13:58:49.968040 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:49.967945    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qkhb" podUID="b0323060-7649-4e6c-b078-dbe218838e63"
Sep 08 13:58:50.971815 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:50.971778    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:58:50.972316 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:50.971928    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsgdv" podUID="a9c2a97a-5054-4839-b0ea-ff5bfa366afc"
Sep 08 13:58:50.972316 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:50.972252    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 13:58:50.972434 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:50.972362    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlc72" podUID="4768adf0-964c-415f-bd1f-94c1d50ad6f7"
Sep 08 13:58:51.968512 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:51.968326    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 13:58:51.968512 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:51.968465    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qkhb" podUID="b0323060-7649-4e6c-b078-dbe218838e63"
Sep 08 13:58:52.972677 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:52.971961    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:58:52.972677 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:52.972134    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsgdv" podUID="a9c2a97a-5054-4839-b0ea-ff5bfa366afc"
Sep 08 13:58:52.972677 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:52.972527    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 13:58:52.972677 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:52.972628    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlc72" podUID="4768adf0-964c-415f-bd1f-94c1d50ad6f7"
Sep 08 13:58:53.647864 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:53.647833    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0323060-7649-4e6c-b078-dbe218838e63-metrics-certs\") pod \"network-metrics-daemon-2qkhb\" (UID: \"b0323060-7649-4e6c-b078-dbe218838e63\") " pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 13:58:53.648029 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:53.647882    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9c2a97a-5054-4839-b0ea-ff5bfa366afc-original-pull-secret\") pod \"global-pull-secret-syncer-wsgdv\" (UID: \"a9c2a97a-5054-4839-b0ea-ff5bfa366afc\") " pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:58:53.648029 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:53.647996    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:58:53.648029 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:53.648015    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 13:58:53.648218 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:53.648081    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0323060-7649-4e6c-b078-dbe218838e63-metrics-certs podName:b0323060-7649-4e6c-b078-dbe218838e63 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:01.648044084 +0000 UTC m=+17.137761130 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0323060-7649-4e6c-b078-dbe218838e63-metrics-certs") pod "network-metrics-daemon-2qkhb" (UID: "b0323060-7649-4e6c-b078-dbe218838e63") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:58:53.648218 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:53.648103    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9c2a97a-5054-4839-b0ea-ff5bfa366afc-original-pull-secret podName:a9c2a97a-5054-4839-b0ea-ff5bfa366afc nodeName:}" failed. No retries permitted until 2026-09-08 13:59:01.648092054 +0000 UTC m=+17.137809089 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9c2a97a-5054-4839-b0ea-ff5bfa366afc-original-pull-secret") pod "global-pull-secret-syncer-wsgdv" (UID: "a9c2a97a-5054-4839-b0ea-ff5bfa366afc") : object "kube-system"/"original-pull-secret" not registered
Sep 08 13:58:53.748394 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:53.748367    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kl9x\" (UniqueName: \"kubernetes.io/projected/4768adf0-964c-415f-bd1f-94c1d50ad6f7-kube-api-access-9kl9x\") pod \"network-check-target-vlc72\" (UID: \"4768adf0-964c-415f-bd1f-94c1d50ad6f7\") " pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 13:58:53.748548 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:53.748532    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 13:58:53.748624 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:53.748552    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 13:58:53.748624 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:53.748564    2575 projected.go:196] Error preparing data for projected volume kube-api-access-9kl9x for pod openshift-network-diagnostics/network-check-target-vlc72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:58:53.748730 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:53.748679    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4768adf0-964c-415f-bd1f-94c1d50ad6f7-kube-api-access-9kl9x podName:4768adf0-964c-415f-bd1f-94c1d50ad6f7 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:01.748659608 +0000 UTC m=+17.238376652 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9kl9x" (UniqueName: "kubernetes.io/projected/4768adf0-964c-415f-bd1f-94c1d50ad6f7-kube-api-access-9kl9x") pod "network-check-target-vlc72" (UID: "4768adf0-964c-415f-bd1f-94c1d50ad6f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:58:53.967927 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:53.967894    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 13:58:53.968098 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:53.968005    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qkhb" podUID="b0323060-7649-4e6c-b078-dbe218838e63"
Sep 08 13:58:54.970162 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:54.969178    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 13:58:54.970162 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:54.969284    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlc72" podUID="4768adf0-964c-415f-bd1f-94c1d50ad6f7"
Sep 08 13:58:54.970162 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:54.969783    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:58:54.970162 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:54.969879    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsgdv" podUID="a9c2a97a-5054-4839-b0ea-ff5bfa366afc"
Sep 08 13:58:55.968209 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:55.968172    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 13:58:55.968382 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:55.968302    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qkhb" podUID="b0323060-7649-4e6c-b078-dbe218838e63"
Sep 08 13:58:56.968261 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:56.968232    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:58:56.968734 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:56.968269    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 13:58:56.968734 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:56.968359    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsgdv" podUID="a9c2a97a-5054-4839-b0ea-ff5bfa366afc"
Sep 08 13:58:56.968734 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:56.968480    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlc72" podUID="4768adf0-964c-415f-bd1f-94c1d50ad6f7"
Sep 08 13:58:57.968314 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:57.968277    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 13:58:57.968754 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:57.968417    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qkhb" podUID="b0323060-7649-4e6c-b078-dbe218838e63"
Sep 08 13:58:58.968292 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:58.968257    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 13:58:58.968477 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:58.968376    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlc72" podUID="4768adf0-964c-415f-bd1f-94c1d50ad6f7"
Sep 08 13:58:58.968879 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:58.968858    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:58:58.968994 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:58.968967    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsgdv" podUID="a9c2a97a-5054-4839-b0ea-ff5bfa366afc"
Sep 08 13:58:59.967461 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:58:59.967427    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 13:58:59.967629 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:58:59.967544    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qkhb" podUID="b0323060-7649-4e6c-b078-dbe218838e63"
Sep 08 13:59:00.968503 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:00.968472    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 13:59:00.969003 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:00.968602    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlc72" podUID="4768adf0-964c-415f-bd1f-94c1d50ad6f7"
Sep 08 13:59:00.969003 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:00.968648    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:59:00.969003 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:00.968766    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsgdv" podUID="a9c2a97a-5054-4839-b0ea-ff5bfa366afc"
Sep 08 13:59:01.707299 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:01.707264    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0323060-7649-4e6c-b078-dbe218838e63-metrics-certs\") pod \"network-metrics-daemon-2qkhb\" (UID: \"b0323060-7649-4e6c-b078-dbe218838e63\") " pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 13:59:01.708282 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:01.707313    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9c2a97a-5054-4839-b0ea-ff5bfa366afc-original-pull-secret\") pod \"global-pull-secret-syncer-wsgdv\" (UID: \"a9c2a97a-5054-4839-b0ea-ff5bfa366afc\") " pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:59:01.708282 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:01.707417    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 13:59:01.708282 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:01.707417    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:59:01.708282 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:01.707481    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9c2a97a-5054-4839-b0ea-ff5bfa366afc-original-pull-secret podName:a9c2a97a-5054-4839-b0ea-ff5bfa366afc nodeName:}" failed. No retries permitted until 2026-09-08 13:59:17.707464375 +0000 UTC m=+33.197181405 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9c2a97a-5054-4839-b0ea-ff5bfa366afc-original-pull-secret") pod "global-pull-secret-syncer-wsgdv" (UID: "a9c2a97a-5054-4839-b0ea-ff5bfa366afc") : object "kube-system"/"original-pull-secret" not registered
Sep 08 13:59:01.708282 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:01.707500    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0323060-7649-4e6c-b078-dbe218838e63-metrics-certs podName:b0323060-7649-4e6c-b078-dbe218838e63 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:17.707491814 +0000 UTC m=+33.197208844 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0323060-7649-4e6c-b078-dbe218838e63-metrics-certs") pod "network-metrics-daemon-2qkhb" (UID: "b0323060-7649-4e6c-b078-dbe218838e63") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:59:01.808186 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:01.808152    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kl9x\" (UniqueName: \"kubernetes.io/projected/4768adf0-964c-415f-bd1f-94c1d50ad6f7-kube-api-access-9kl9x\") pod \"network-check-target-vlc72\" (UID: \"4768adf0-964c-415f-bd1f-94c1d50ad6f7\") " pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 13:59:01.808378 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:01.808342    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 13:59:01.808378 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:01.808369    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 13:59:01.808475 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:01.808382    2575 projected.go:196] Error preparing data for projected volume kube-api-access-9kl9x for pod openshift-network-diagnostics/network-check-target-vlc72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:59:01.808475 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:01.808438    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4768adf0-964c-415f-bd1f-94c1d50ad6f7-kube-api-access-9kl9x podName:4768adf0-964c-415f-bd1f-94c1d50ad6f7 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:17.808419057 +0000 UTC m=+33.298136111 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9kl9x" (UniqueName: "kubernetes.io/projected/4768adf0-964c-415f-bd1f-94c1d50ad6f7-kube-api-access-9kl9x") pod "network-check-target-vlc72" (UID: "4768adf0-964c-415f-bd1f-94c1d50ad6f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:59:01.968258 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:01.968187    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 13:59:01.968452 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:01.968319    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qkhb" podUID="b0323060-7649-4e6c-b078-dbe218838e63"
Sep 08 13:59:02.968521 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:02.968486    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:59:02.968979 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:02.968496    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 13:59:02.968979 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:02.968613    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsgdv" podUID="a9c2a97a-5054-4839-b0ea-ff5bfa366afc"
Sep 08 13:59:02.968979 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:02.968732    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlc72" podUID="4768adf0-964c-415f-bd1f-94c1d50ad6f7"
Sep 08 13:59:03.967973 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:03.967938    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 13:59:03.968175 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:03.968085    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qkhb" podUID="b0323060-7649-4e6c-b078-dbe218838e63"
Sep 08 13:59:04.968550 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:04.968527    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:59:04.968939 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:04.968605    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsgdv" podUID="a9c2a97a-5054-4839-b0ea-ff5bfa366afc"
Sep 08 13:59:04.968939 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:04.968647    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 13:59:04.968939 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:04.968758    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlc72" podUID="4768adf0-964c-415f-bd1f-94c1d50ad6f7"
Sep 08 13:59:05.104511 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:05.104482    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-125.ec2.internal" event={"ID":"24de9fdd7d5b7b48cef3659e9d7d2f6f","Type":"ContainerStarted","Data":"39cadac75d6dab9d344d866742fe6c46c92c91241244e57c50134a88bfa6c88a"}
Sep 08 13:59:05.968041 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:05.968013    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 13:59:05.968184 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:05.968165    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qkhb" podUID="b0323060-7649-4e6c-b078-dbe218838e63"
Sep 08 13:59:06.109511 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:06.109418    2575 generic.go:356] "Generic (PLEG): container finished" podID="87fdf172fcae69fc2b256986afbb501b" containerID="7b1813efa75364044e2eada01134bd390bc8e48c1e9526d42518653c52ebcd01" exitCode=0
Sep 08 13:59:06.110260 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:06.109508    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-125.ec2.internal" event={"ID":"87fdf172fcae69fc2b256986afbb501b","Type":"ContainerDied","Data":"7b1813efa75364044e2eada01134bd390bc8e48c1e9526d42518653c52ebcd01"}
Sep 08 13:59:06.111347 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:06.111321    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g7btk" event={"ID":"b680f42a-aaf7-415e-8045-ea5fccc2ebea","Type":"ContainerStarted","Data":"f84cdecb1a0e588ea2b8f1501f1b3f4e5953f9bd6ffa1f02bb4e1e03e4546076"}
Sep 08 13:59:06.113488 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:06.113462    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-svxwv" event={"ID":"d47cfde2-6162-4179-97d5-985a6b27ca33","Type":"ContainerStarted","Data":"078073e0894008eb47c4201ea2b32439f7f9db05dedc713c1510d574ea5b0607"}
Sep 08 13:59:06.115429 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:06.115391    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l8zx" event={"ID":"ca279b18-1c16-44e5-a5ee-07abf9c51ffd","Type":"ContainerStarted","Data":"08dc29b348372b2a7501191cf1579922a44407f9604a7cfa1ac2797a92651079"}
Sep 08 13:59:06.117105 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:06.117082    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qzvvn" event={"ID":"a94658b0-bc07-44bc-a7c8-92d1c7804987","Type":"ContainerStarted","Data":"a6dea96bb599eb1652d92e997fab2b673996c1c2ac3cb73add34277d5b4c3450"}
Sep 08 13:59:06.121167 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:06.120871    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g" event={"ID":"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7","Type":"ContainerStarted","Data":"f5cc7afb6690da825f6dbc08f7c20d8efb9899020529e798807bd02fd1c85549"}
Sep 08 13:59:06.121167 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:06.120942    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g" event={"ID":"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7","Type":"ContainerStarted","Data":"30b63db5bc26e9e7b730dd7c5ddf3d49b67480ef38a63d0c796b03459ca90603"}
Sep 08 13:59:06.121167 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:06.120987    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g" event={"ID":"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7","Type":"ContainerStarted","Data":"7a158f4639bdf60cd072563641ce1c399c2f700431ce2637d330a6e3f21e69f1"}
Sep 08 13:59:06.121167 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:06.121022    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g" event={"ID":"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7","Type":"ContainerStarted","Data":"70fc8319b9e2018053ff128eef0cbeb424bea66db8389c2bbfd6c07af5d92a6c"}
Sep 08 13:59:06.121167 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:06.121073    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g" event={"ID":"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7","Type":"ContainerStarted","Data":"be94bdcd968bc0238c4abffd40b4db7fe58e7b2ea8ced370623b0a123d916849"}
Sep 08 13:59:06.121167 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:06.121117    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g" event={"ID":"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7","Type":"ContainerStarted","Data":"f34feb6f933d45d7f2bf9a69291c4c12f4827f7e1ce694e6edc8d91f288b5e0b"}
Sep 08 13:59:06.122709 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:06.122612    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7w4m8" event={"ID":"e9785b03-cd05-426a-8b34-f59cbe5ce454","Type":"ContainerStarted","Data":"0849cb7f4c2f0069d4aae68a6dc8b543a44cea7972a3c92cae36da28711f08e8"}
Sep 08 13:59:06.124208 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:06.124188    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lw6kq" event={"ID":"1f1133bf-01cf-46b7-be8d-1272be6dd0da","Type":"ContainerStarted","Data":"acd7c8b422c7c5f98c8cbb85fcedafb99844acb4194ccb9d55473fcdd540be99"}
Sep 08 13:59:06.126389 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:06.126365    2575 generic.go:356] "Generic (PLEG): container finished" podID="fe124193-60d2-4e5d-adb3-760fe3f0e92a" containerID="576a7719bb7e0b7306485e47f4cb006a8e8f79e2ae0b7ae1fabceabbf4d3f5f0" exitCode=0
Sep 08 13:59:06.126481 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:06.126402    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zb5t" event={"ID":"fe124193-60d2-4e5d-adb3-760fe3f0e92a","Type":"ContainerDied","Data":"576a7719bb7e0b7306485e47f4cb006a8e8f79e2ae0b7ae1fabceabbf4d3f5f0"}
Sep 08 13:59:06.164859 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:06.164812    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7w4m8" podStartSLOduration=2.468690797 podStartE2EDuration="21.164792556s" totalImagesPullingTime="18.696101759s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:59:06.164322019 +0000 UTC m=+21.654039072" watchObservedRunningTime="2026-09-08 13:59:06.164792556 +0000 UTC m=+21.654509609"
Sep 08 13:59:06.189223 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:06.189173    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qzvvn" podStartSLOduration=2.499795803 podStartE2EDuration="21.189151925s" totalImagesPullingTime="18.689356122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:59:06.188918999 +0000 UTC m=+21.678636054" watchObservedRunningTime="2026-09-08 13:59:06.189151925 +0000 UTC m=+21.678868979"
Sep 08 13:59:06.261263 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:06.261217    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lw6kq" podStartSLOduration=2.842147737 podStartE2EDuration="21.261202694s" totalImagesPullingTime="18.419054957s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:59:06.234999885 +0000 UTC m=+21.724716940" watchObservedRunningTime="2026-09-08 13:59:06.261202694 +0000 UTC m=+21.750919793"
Sep 08 13:59:06.261439 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:06.261308    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-svxwv" podStartSLOduration=2.571966443 podStartE2EDuration="21.26130369s" totalImagesPullingTime="18.689337247s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:59:06.261295776 +0000 UTC m=+21.751012831" watchObservedRunningTime="2026-09-08 13:59:06.26130369 +0000 UTC m=+21.751020739"
Sep 08 13:59:06.969510 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:06.969482    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 13:59:06.969693 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:06.969591    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlc72" podUID="4768adf0-964c-415f-bd1f-94c1d50ad6f7"
Sep 08 13:59:06.969996 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:06.969976    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:59:06.970127 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:06.970094    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsgdv" podUID="a9c2a97a-5054-4839-b0ea-ff5bfa366afc"
Sep 08 13:59:07.131983 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:07.131948    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-125.ec2.internal" event={"ID":"87fdf172fcae69fc2b256986afbb501b","Type":"ContainerStarted","Data":"7bcede1bff5937997b6ff15ed1fe3a3c49b69f2780da13fd05c9aac90b4f69fc"}
Sep 08 13:59:07.133600 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:07.133574    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q75kl" event={"ID":"3f39a078-1a89-436d-bc9a-2f0a8296462c","Type":"ContainerStarted","Data":"a4388c06173b87f45ae6d54bdace71d0a8d43eafe745d173b81502c3f833b055"}
Sep 08 13:59:07.137201 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:07.137174    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-125.ec2.internal" event={"ID":"24de9fdd7d5b7b48cef3659e9d7d2f6f","Type":"ContainerStarted","Data":"81949ad4d4fe271c0030dd63fb1e05a746927a95de85a020f03456a11ba578dd"}
Sep 08 13:59:07.160561 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:07.160521    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-g7btk" podStartSLOduration=3.5067698800000002 podStartE2EDuration="22.160507872s" totalImagesPullingTime="18.653737992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:59:06.29111074 +0000 UTC m=+21.780827791" watchObservedRunningTime="2026-09-08 13:59:07.160507872 +0000 UTC m=+22.650224924"
Sep 08 13:59:07.160657 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:07.160637    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-125.ec2.internal" podStartSLOduration=21.160629982 podStartE2EDuration="21.160629982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:58:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:59:07.159819786 +0000 UTC m=+22.649536838" watchObservedRunningTime="2026-09-08 13:59:07.160629982 +0000 UTC m=+22.650347034"
Sep 08 13:59:07.181479 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:07.181460    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 08 13:59:07.183811 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:07.183774    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-q75kl" podStartSLOduration=3.769011941 podStartE2EDuration="22.183761168s" totalImagesPullingTime="18.414749227s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:59:07.181548063 +0000 UTC m=+22.671265116" watchObservedRunningTime="2026-09-08 13:59:07.183761168 +0000 UTC m=+22.673478220"
Sep 08 13:59:07.194957 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:07.194928    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-g7btk"
Sep 08 13:59:07.195449 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:07.195430    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-g7btk"
Sep 08 13:59:07.206666 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:07.206632    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-125.ec2.internal" podStartSLOduration=21.206619273 podStartE2EDuration="21.206619273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:58:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:59:07.206146418 +0000 UTC m=+22.695863469" watchObservedRunningTime="2026-09-08 13:59:07.206619273 +0000 UTC m=+22.696336326"
Sep 08 13:59:07.943928 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:07.943671    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T13:59:07.181475296Z","UUID":"bebd3ce9-a947-4320-b522-3c23bec2ac7b","Handler":null,"Name":"","Endpoint":""}
Sep 08 13:59:07.945201 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:07.945182    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 08 13:59:07.945304 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:07.945216    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 08 13:59:07.968322 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:07.968301    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 13:59:07.968425 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:07.968410    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qkhb" podUID="b0323060-7649-4e6c-b078-dbe218838e63"
Sep 08 13:59:08.141466 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:08.141418    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l8zx" event={"ID":"ca279b18-1c16-44e5-a5ee-07abf9c51ffd","Type":"ContainerStarted","Data":"6d79bad83d1cad4e154e7fd4cd788a06adf8a846ac67383e5a906d7e1123244e"}
Sep 08 13:59:08.145502 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:08.145476    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g" event={"ID":"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7","Type":"ContainerStarted","Data":"df8ca86b627b1f1613e9b127dd83fcb2f91e21b5870f31e019f5373389c57da3"}
Sep 08 13:59:08.967727 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:08.967694    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:59:08.967727 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:08.967716    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 13:59:08.967999 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:08.967830    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsgdv" podUID="a9c2a97a-5054-4839-b0ea-ff5bfa366afc"
Sep 08 13:59:08.967999 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:08.967955    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlc72" podUID="4768adf0-964c-415f-bd1f-94c1d50ad6f7"
Sep 08 13:59:09.147477 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:09.147451    2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 08 13:59:09.968465 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:09.968434    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 13:59:09.968616 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:09.968549    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qkhb" podUID="b0323060-7649-4e6c-b078-dbe218838e63"
Sep 08 13:59:10.967770 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:10.967632    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:59:10.968126 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:10.967694    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 13:59:10.968126 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:10.967872    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsgdv" podUID="a9c2a97a-5054-4839-b0ea-ff5bfa366afc"
Sep 08 13:59:10.968126 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:10.967961    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlc72" podUID="4768adf0-964c-415f-bd1f-94c1d50ad6f7"
Sep 08 13:59:11.154809 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:11.154736    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g" event={"ID":"2d773614-9d8a-4a7d-9a65-bbd560ba1ae7","Type":"ContainerStarted","Data":"ce1763c0e11f2eb22d6e76abb4e89e510a7277c1cea8316369c9fef9d8fb7389"}
Sep 08 13:59:11.155112 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:11.155092    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:59:11.157195 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:11.157163    2575 generic.go:356] "Generic (PLEG): container finished" podID="fe124193-60d2-4e5d-adb3-760fe3f0e92a" containerID="278e716b3e56e0100ca6ff46ee6e2871510d961d175ba4a986c48cff8bb5f91d" exitCode=0
Sep 08 13:59:11.157281 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:11.157213    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zb5t" event={"ID":"fe124193-60d2-4e5d-adb3-760fe3f0e92a","Type":"ContainerDied","Data":"278e716b3e56e0100ca6ff46ee6e2871510d961d175ba4a986c48cff8bb5f91d"}
Sep 08 13:59:11.170184 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:11.170164    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:59:11.245946 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:11.245896    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g" podStartSLOduration=7.248297432 podStartE2EDuration="26.245881753s" totalImagesPullingTime="18.997584321s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:59:11.208370515 +0000 UTC m=+26.698087567" watchObservedRunningTime="2026-09-08 13:59:11.245881753 +0000 UTC m=+26.735598805"
Sep 08 13:59:11.968354 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:11.968309    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 13:59:11.969118 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:11.968448    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qkhb" podUID="b0323060-7649-4e6c-b078-dbe218838e63"
Sep 08 13:59:12.162668 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:12.162636    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l8zx" event={"ID":"ca279b18-1c16-44e5-a5ee-07abf9c51ffd","Type":"ContainerStarted","Data":"2afe6476521eabb23872fc4c1eaeedb706abd6961547e19a8a3aa608dd2285b4"}
Sep 08 13:59:12.164942 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:12.164916    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zb5t" event={"ID":"fe124193-60d2-4e5d-adb3-760fe3f0e92a","Type":"ContainerStarted","Data":"ae9a5fdb4ff602a1893497af787a6570b8b621a11c2295297679e3b73d5c4fd2"}
Sep 08 13:59:12.165072 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:12.165009    2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 08 13:59:12.165623 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:12.165603    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:59:12.179262 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:12.179243    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:59:12.215549 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:12.215504    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l8zx" podStartSLOduration=2.755267801 podStartE2EDuration="27.215487917s" totalImagesPullingTime="24.460220116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:58:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:59:12.185948306 +0000 UTC m=+27.675665357" watchObservedRunningTime="2026-09-08 13:59:12.215487917 +0000 UTC m=+27.705204968"
Sep 08 13:59:12.690305 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:12.690270    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wsgdv"]
Sep 08 13:59:12.690433 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:12.690383    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:59:12.690483 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:12.690466    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsgdv" podUID="a9c2a97a-5054-4839-b0ea-ff5bfa366afc"
Sep 08 13:59:12.692852 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:12.692831    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vlc72"]
Sep 08 13:59:12.692956 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:12.692911    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 13:59:12.693116 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:12.693095    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlc72" podUID="4768adf0-964c-415f-bd1f-94c1d50ad6f7"
Sep 08 13:59:12.707362 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:12.707293    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2qkhb"]
Sep 08 13:59:12.707455 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:12.707384    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 13:59:12.707521 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:12.707462    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qkhb" podUID="b0323060-7649-4e6c-b078-dbe218838e63"
Sep 08 13:59:13.169002 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:13.168971    2575 generic.go:356] "Generic (PLEG): container finished" podID="fe124193-60d2-4e5d-adb3-760fe3f0e92a" containerID="ae9a5fdb4ff602a1893497af787a6570b8b621a11c2295297679e3b73d5c4fd2" exitCode=0
Sep 08 13:59:13.169561 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:13.169076    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zb5t" event={"ID":"fe124193-60d2-4e5d-adb3-760fe3f0e92a","Type":"ContainerDied","Data":"ae9a5fdb4ff602a1893497af787a6570b8b621a11c2295297679e3b73d5c4fd2"}
Sep 08 13:59:13.169561 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:13.169142    2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 08 13:59:13.967940 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:13.967777    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 13:59:13.968088 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:13.967794    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:59:13.968088 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:13.968017    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qkhb" podUID="b0323060-7649-4e6c-b078-dbe218838e63"
Sep 08 13:59:13.968208 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:13.968132    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsgdv" podUID="a9c2a97a-5054-4839-b0ea-ff5bfa366afc"
Sep 08 13:59:13.968208 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:13.967822    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 13:59:13.968296 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:13.968231    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlc72" podUID="4768adf0-964c-415f-bd1f-94c1d50ad6f7"
Sep 08 13:59:14.174568 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:14.174537    2575 generic.go:356] "Generic (PLEG): container finished" podID="fe124193-60d2-4e5d-adb3-760fe3f0e92a" containerID="780bc92e9759606787fb26941ae38d9c8e12a58563235428ec44ecd321fc71aa" exitCode=0
Sep 08 13:59:14.174950 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:14.174636    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zb5t" event={"ID":"fe124193-60d2-4e5d-adb3-760fe3f0e92a","Type":"ContainerDied","Data":"780bc92e9759606787fb26941ae38d9c8e12a58563235428ec44ecd321fc71aa"}
Sep 08 13:59:14.174950 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:14.174681    2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 08 13:59:14.478990 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:14.478922    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:59:15.188616 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:15.188535    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g" podUID="2d773614-9d8a-4a7d-9a65-bbd560ba1ae7" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 08 13:59:15.968551 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:15.968522    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:59:15.968708 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:15.968626    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 13:59:15.968708 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:15.968635    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsgdv" podUID="a9c2a97a-5054-4839-b0ea-ff5bfa366afc"
Sep 08 13:59:15.968708 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:15.968650    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 13:59:15.968848 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:15.968709    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlc72" podUID="4768adf0-964c-415f-bd1f-94c1d50ad6f7"
Sep 08 13:59:15.968848 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:15.968791    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qkhb" podUID="b0323060-7649-4e6c-b078-dbe218838e63"
Sep 08 13:59:16.126451 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:16.126406    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-g7btk"
Sep 08 13:59:16.126622 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:16.126547    2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 08 13:59:16.127143 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:16.127120    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-g7btk"
Sep 08 13:59:17.730297 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:17.730263    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0323060-7649-4e6c-b078-dbe218838e63-metrics-certs\") pod \"network-metrics-daemon-2qkhb\" (UID: \"b0323060-7649-4e6c-b078-dbe218838e63\") " pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 13:59:17.730695 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:17.730322    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9c2a97a-5054-4839-b0ea-ff5bfa366afc-original-pull-secret\") pod \"global-pull-secret-syncer-wsgdv\" (UID: \"a9c2a97a-5054-4839-b0ea-ff5bfa366afc\") " pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:59:17.730695 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:17.730426    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 13:59:17.730695 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:17.730430    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:59:17.730695 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:17.730494    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9c2a97a-5054-4839-b0ea-ff5bfa366afc-original-pull-secret podName:a9c2a97a-5054-4839-b0ea-ff5bfa366afc nodeName:}" failed. No retries permitted until 2026-09-08 13:59:49.730476697 +0000 UTC m=+65.220193730 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9c2a97a-5054-4839-b0ea-ff5bfa366afc-original-pull-secret") pod "global-pull-secret-syncer-wsgdv" (UID: "a9c2a97a-5054-4839-b0ea-ff5bfa366afc") : object "kube-system"/"original-pull-secret" not registered
Sep 08 13:59:17.730695 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:17.730512    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0323060-7649-4e6c-b078-dbe218838e63-metrics-certs podName:b0323060-7649-4e6c-b078-dbe218838e63 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:49.730505724 +0000 UTC m=+65.220222753 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0323060-7649-4e6c-b078-dbe218838e63-metrics-certs") pod "network-metrics-daemon-2qkhb" (UID: "b0323060-7649-4e6c-b078-dbe218838e63") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:59:17.831272 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:17.831233    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kl9x\" (UniqueName: \"kubernetes.io/projected/4768adf0-964c-415f-bd1f-94c1d50ad6f7-kube-api-access-9kl9x\") pod \"network-check-target-vlc72\" (UID: \"4768adf0-964c-415f-bd1f-94c1d50ad6f7\") " pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 13:59:17.831467 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:17.831445    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 13:59:17.831559 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:17.831475    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 13:59:17.831559 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:17.831488    2575 projected.go:196] Error preparing data for projected volume kube-api-access-9kl9x for pod openshift-network-diagnostics/network-check-target-vlc72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:59:17.831559 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:17.831551    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4768adf0-964c-415f-bd1f-94c1d50ad6f7-kube-api-access-9kl9x podName:4768adf0-964c-415f-bd1f-94c1d50ad6f7 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:49.831532588 +0000 UTC m=+65.321249623 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9kl9x" (UniqueName: "kubernetes.io/projected/4768adf0-964c-415f-bd1f-94c1d50ad6f7-kube-api-access-9kl9x") pod "network-check-target-vlc72" (UID: "4768adf0-964c-415f-bd1f-94c1d50ad6f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:59:17.853811 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:17.853786    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-125.ec2.internal" event="NodeReady"
Sep 08 13:59:17.853932 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:17.853927    2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 08 13:59:17.930454 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:17.930394    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8ds62"]
Sep 08 13:59:17.955994 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:17.955970    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-d5h6j"]
Sep 08 13:59:17.956134 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:17.956117    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8ds62"
Sep 08 13:59:17.959108 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:17.959087    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 08 13:59:17.959218 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:17.959145    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b4mdc\""
Sep 08 13:59:17.959453 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:17.959435    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 08 13:59:17.969505 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:17.969485    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8ds62"]
Sep 08 13:59:17.969607 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:17.969523    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d5h6j"]
Sep 08 13:59:17.969607 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:17.969587    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:59:17.969692 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:17.969593    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 13:59:17.969779 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:17.969592    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d5h6j"
Sep 08 13:59:17.970183 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:17.969898    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 13:59:17.973885 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:17.973870    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 13:59:17.974587 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:17.974567    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7mkjh\""
Sep 08 13:59:17.974840 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:17.974825    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 13:59:17.975205 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:17.975184    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r4t74\""
Sep 08 13:59:17.975412 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:17.975394    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 08 13:59:17.975902 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:17.975884    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9cmv8\""
Sep 08 13:59:17.976121 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:17.976106    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 13:59:17.976411 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:17.976327    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 08 13:59:17.976582 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:17.976565    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 08 13:59:17.976796 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:17.976578    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 13:59:18.033078 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:18.033034    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c-tmp-dir\") pod \"dns-default-8ds62\" (UID: \"7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c\") " pod="openshift-dns/dns-default-8ds62"
Sep 08 13:59:18.033211 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:18.033098    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c-metrics-tls\") pod \"dns-default-8ds62\" (UID: \"7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c\") " pod="openshift-dns/dns-default-8ds62"
Sep 08 13:59:18.033211 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:18.033189    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c-config-volume\") pod \"dns-default-8ds62\" (UID: \"7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c\") " pod="openshift-dns/dns-default-8ds62"
Sep 08 13:59:18.033290 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:18.033222    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgmlc\" (UniqueName: \"kubernetes.io/projected/7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c-kube-api-access-zgmlc\") pod \"dns-default-8ds62\" (UID: \"7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c\") " pod="openshift-dns/dns-default-8ds62"
Sep 08 13:59:18.133933 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:18.133908    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c2eb712-1aa9-4d8b-adb5-521fde6a5169-cert\") pod \"ingress-canary-d5h6j\" (UID: \"7c2eb712-1aa9-4d8b-adb5-521fde6a5169\") " pod="openshift-ingress-canary/ingress-canary-d5h6j"
Sep 08 13:59:18.133933 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:18.133940    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c-config-volume\") pod \"dns-default-8ds62\" (UID: \"7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c\") " pod="openshift-dns/dns-default-8ds62"
Sep 08 13:59:18.134163 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:18.133962    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgmlc\" (UniqueName: \"kubernetes.io/projected/7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c-kube-api-access-zgmlc\") pod \"dns-default-8ds62\" (UID: \"7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c\") " pod="openshift-dns/dns-default-8ds62"
Sep 08 13:59:18.134163 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:18.134026    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfs4x\" (UniqueName: \"kubernetes.io/projected/7c2eb712-1aa9-4d8b-adb5-521fde6a5169-kube-api-access-kfs4x\") pod \"ingress-canary-d5h6j\" (UID: \"7c2eb712-1aa9-4d8b-adb5-521fde6a5169\") " pod="openshift-ingress-canary/ingress-canary-d5h6j"
Sep 08 13:59:18.134163 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:18.134079    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c-tmp-dir\") pod \"dns-default-8ds62\" (UID: \"7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c\") " pod="openshift-dns/dns-default-8ds62"
Sep 08 13:59:18.134163 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:18.134120    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c-metrics-tls\") pod \"dns-default-8ds62\" (UID: \"7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c\") " pod="openshift-dns/dns-default-8ds62"
Sep 08 13:59:18.134331 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:18.134278    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 13:59:18.134385 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:18.134376    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c-metrics-tls podName:7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c nodeName:}" failed. No retries permitted until 2026-09-08 13:59:18.634354849 +0000 UTC m=+34.124071887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c-metrics-tls") pod "dns-default-8ds62" (UID: "7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c") : secret "dns-default-metrics-tls" not found
Sep 08 13:59:18.134452 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:18.134404    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c-tmp-dir\") pod \"dns-default-8ds62\" (UID: \"7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c\") " pod="openshift-dns/dns-default-8ds62"
Sep 08 13:59:18.134623 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:18.134598    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c-config-volume\") pod \"dns-default-8ds62\" (UID: \"7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c\") " pod="openshift-dns/dns-default-8ds62"
Sep 08 13:59:18.149372 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:18.149348    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgmlc\" (UniqueName: \"kubernetes.io/projected/7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c-kube-api-access-zgmlc\") pod \"dns-default-8ds62\" (UID: \"7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c\") " pod="openshift-dns/dns-default-8ds62"
Sep 08 13:59:18.235269 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:18.235012    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfs4x\" (UniqueName: \"kubernetes.io/projected/7c2eb712-1aa9-4d8b-adb5-521fde6a5169-kube-api-access-kfs4x\") pod \"ingress-canary-d5h6j\" (UID: \"7c2eb712-1aa9-4d8b-adb5-521fde6a5169\") " pod="openshift-ingress-canary/ingress-canary-d5h6j"
Sep 08 13:59:18.235422 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:18.235317    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c2eb712-1aa9-4d8b-adb5-521fde6a5169-cert\") pod \"ingress-canary-d5h6j\" (UID: \"7c2eb712-1aa9-4d8b-adb5-521fde6a5169\") " pod="openshift-ingress-canary/ingress-canary-d5h6j"
Sep 08 13:59:18.237990 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:18.237969    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c2eb712-1aa9-4d8b-adb5-521fde6a5169-cert\") pod \"ingress-canary-d5h6j\" (UID: \"7c2eb712-1aa9-4d8b-adb5-521fde6a5169\") " pod="openshift-ingress-canary/ingress-canary-d5h6j"
Sep 08 13:59:18.244606 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:18.244585    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfs4x\" (UniqueName: \"kubernetes.io/projected/7c2eb712-1aa9-4d8b-adb5-521fde6a5169-kube-api-access-kfs4x\") pod \"ingress-canary-d5h6j\" (UID: \"7c2eb712-1aa9-4d8b-adb5-521fde6a5169\") " pod="openshift-ingress-canary/ingress-canary-d5h6j"
Sep 08 13:59:18.292951 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:18.292922    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d5h6j"
Sep 08 13:59:18.639294 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:18.639268    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c-metrics-tls\") pod \"dns-default-8ds62\" (UID: \"7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c\") " pod="openshift-dns/dns-default-8ds62"
Sep 08 13:59:18.639433 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:18.639373    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 13:59:18.639433 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:18.639413    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c-metrics-tls podName:7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c nodeName:}" failed. No retries permitted until 2026-09-08 13:59:19.639400935 +0000 UTC m=+35.129117966 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c-metrics-tls") pod "dns-default-8ds62" (UID: "7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c") : secret "dns-default-metrics-tls" not found
Sep 08 13:59:18.693205 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:18.693185    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d5h6j"]
Sep 08 13:59:18.696791 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:59:18.696766    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c2eb712_1aa9_4d8b_adb5_521fde6a5169.slice/crio-d395d153cad45772f8eb37010a89f20c2229e6ab8f827030f70e6451de9989db WatchSource:0}: Error finding container d395d153cad45772f8eb37010a89f20c2229e6ab8f827030f70e6451de9989db: Status 404 returned error can't find the container with id d395d153cad45772f8eb37010a89f20c2229e6ab8f827030f70e6451de9989db
Sep 08 13:59:19.187804 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:19.187767    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d5h6j" event={"ID":"7c2eb712-1aa9-4d8b-adb5-521fde6a5169","Type":"ContainerStarted","Data":"d395d153cad45772f8eb37010a89f20c2229e6ab8f827030f70e6451de9989db"}
Sep 08 13:59:19.190473 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:19.190449    2575 generic.go:356] "Generic (PLEG): container finished" podID="fe124193-60d2-4e5d-adb3-760fe3f0e92a" containerID="37b812a2ef1699bfcbfa02b00dcd9dfe6e4af45c30d253dfa2c7db35ca081689" exitCode=0
Sep 08 13:59:19.190593 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:19.190481    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zb5t" event={"ID":"fe124193-60d2-4e5d-adb3-760fe3f0e92a","Type":"ContainerDied","Data":"37b812a2ef1699bfcbfa02b00dcd9dfe6e4af45c30d253dfa2c7db35ca081689"}
Sep 08 13:59:19.645695 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:19.645666    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c-metrics-tls\") pod \"dns-default-8ds62\" (UID: \"7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c\") " pod="openshift-dns/dns-default-8ds62"
Sep 08 13:59:19.645920 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:19.645810    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 13:59:19.645920 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:19.645869    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c-metrics-tls podName:7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c nodeName:}" failed. No retries permitted until 2026-09-08 13:59:21.64585427 +0000 UTC m=+37.135571317 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c-metrics-tls") pod "dns-default-8ds62" (UID: "7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c") : secret "dns-default-metrics-tls" not found
Sep 08 13:59:20.195657 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:20.195628    2575 generic.go:356] "Generic (PLEG): container finished" podID="fe124193-60d2-4e5d-adb3-760fe3f0e92a" containerID="ebcc7451cc6875053047c0cfae7aef719243130f049a46b23b336fe33d616ff8" exitCode=0
Sep 08 13:59:20.196097 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:20.195667    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zb5t" event={"ID":"fe124193-60d2-4e5d-adb3-760fe3f0e92a","Type":"ContainerDied","Data":"ebcc7451cc6875053047c0cfae7aef719243130f049a46b23b336fe33d616ff8"}
Sep 08 13:59:21.202188 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:21.202148    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zb5t" event={"ID":"fe124193-60d2-4e5d-adb3-760fe3f0e92a","Type":"ContainerStarted","Data":"302342b92fa360f2c269d43c87f9728d1408055005ed8d2a11e21639b1bb1fef"}
Sep 08 13:59:21.227807 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:21.227761    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8zb5t" podStartSLOduration=6.680405775 podStartE2EDuration="36.227747325s" totalImagesPullingTime="29.54734155s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:58:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:59:21.226390826 +0000 UTC m=+36.716107877" watchObservedRunningTime="2026-09-08 13:59:21.227747325 +0000 UTC m=+36.717464423"
Sep 08 13:59:21.660186 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:21.660148    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c-metrics-tls\") pod \"dns-default-8ds62\" (UID: \"7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c\") " pod="openshift-dns/dns-default-8ds62"
Sep 08 13:59:21.660362 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:21.660318    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 13:59:21.660431 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:21.660390    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c-metrics-tls podName:7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c nodeName:}" failed. No retries permitted until 2026-09-08 13:59:25.660370946 +0000 UTC m=+41.150087975 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c-metrics-tls") pod "dns-default-8ds62" (UID: "7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c") : secret "dns-default-metrics-tls" not found
Sep 08 13:59:24.211638 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:24.211455    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d5h6j" event={"ID":"7c2eb712-1aa9-4d8b-adb5-521fde6a5169","Type":"ContainerStarted","Data":"1775d2bdbb7130c39d1276d0fc659fb50983c0f703f26e55b6051e3688cf41b5"}
Sep 08 13:59:24.233705 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:24.233656    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-d5h6j" podStartSLOduration=2.215164824 podStartE2EDuration="7.23364234s" totalImagesPullingTime="5.018477516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:59:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:59:24.232126264 +0000 UTC m=+39.721843316" watchObservedRunningTime="2026-09-08 13:59:24.23364234 +0000 UTC m=+39.723359392"
Sep 08 13:59:25.690821 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:25.690787    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c-metrics-tls\") pod \"dns-default-8ds62\" (UID: \"7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c\") " pod="openshift-dns/dns-default-8ds62"
Sep 08 13:59:25.691191 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:25.690928    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 13:59:25.691191 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:25.690988    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c-metrics-tls podName:7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c nodeName:}" failed. No retries permitted until 2026-09-08 13:59:33.690969775 +0000 UTC m=+49.180686807 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c-metrics-tls") pod "dns-default-8ds62" (UID: "7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c") : secret "dns-default-metrics-tls" not found
Sep 08 13:59:33.742756 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:33.742715    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c-metrics-tls\") pod \"dns-default-8ds62\" (UID: \"7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c\") " pod="openshift-dns/dns-default-8ds62"
Sep 08 13:59:33.743228 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:33.742845    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 13:59:33.743228 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:33.742929    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c-metrics-tls podName:7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c nodeName:}" failed. No retries permitted until 2026-09-08 13:59:49.742909317 +0000 UTC m=+65.232626349 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c-metrics-tls") pod "dns-default-8ds62" (UID: "7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c") : secret "dns-default-metrics-tls" not found
Sep 08 13:59:34.206736 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.206699    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2kqn8"]
Sep 08 13:59:34.241506 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.241476    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2kqn8"]
Sep 08 13:59:34.241649 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.241567    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2kqn8"
Sep 08 13:59:34.244528 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.244507    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-h29pq\""
Sep 08 13:59:34.245348 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.245330    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 08 13:59:34.245438 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.245339    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 08 13:59:34.339358 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.339323    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-67dfcbc96b-kwbqv"]
Sep 08 13:59:34.346648 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.346622    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t8f5\" (UniqueName: \"kubernetes.io/projected/5a0c4143-3450-44ed-b48b-be0c9a76e6fe-kube-api-access-4t8f5\") pod \"volume-data-source-validator-695c895bd6-2kqn8\" (UID: \"5a0c4143-3450-44ed-b48b-be0c9a76e6fe\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2kqn8"
Sep 08 13:59:34.363934 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.363917    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-xnk8k"]
Sep 08 13:59:34.364043 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.364001    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 13:59:34.366744 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.366723    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 08 13:59:34.367079 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.367039    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 08 13:59:34.367170 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.367039    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cl44g\""
Sep 08 13:59:34.367170 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.367160    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 08 13:59:34.367414 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.367395    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 08 13:59:34.367537 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.367400    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 08 13:59:34.367537 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.367416    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 08 13:59:34.384106 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.384050    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-67dfcbc96b-kwbqv"]
Sep 08 13:59:34.384205 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.384113    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-xnk8k"]
Sep 08 13:59:34.384205 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.384137    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-xnk8k"
Sep 08 13:59:34.387333 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.387312    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 08 13:59:34.387437 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.387396    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-7gt8n\""
Sep 08 13:59:34.387911 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.387889    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 08 13:59:34.388169 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.388151    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 08 13:59:34.388421 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.388401    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 08 13:59:34.392037 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.392021    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 08 13:59:34.422966 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.422940    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-wndrq"]
Sep 08 13:59:34.443843 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.443822    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wndrq"
Sep 08 13:59:34.445887 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.445866    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-wndrq"]
Sep 08 13:59:34.446442 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.446422    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 08 13:59:34.446522 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.446440    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 08 13:59:34.446794 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.446778    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 08 13:59:34.446948 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.446925    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t8f5\" (UniqueName: \"kubernetes.io/projected/5a0c4143-3450-44ed-b48b-be0c9a76e6fe-kube-api-access-4t8f5\") pod \"volume-data-source-validator-695c895bd6-2kqn8\" (UID: \"5a0c4143-3450-44ed-b48b-be0c9a76e6fe\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2kqn8"
Sep 08 13:59:34.447011 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.446945    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 08 13:59:34.447138 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.447118    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-jcxxq\""
Sep 08 13:59:34.465386 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.465336    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t8f5\" (UniqueName: \"kubernetes.io/projected/5a0c4143-3450-44ed-b48b-be0c9a76e6fe-kube-api-access-4t8f5\") pod \"volume-data-source-validator-695c895bd6-2kqn8\" (UID: \"5a0c4143-3450-44ed-b48b-be0c9a76e6fe\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2kqn8"
Sep 08 13:59:34.547867 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.547841    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9569fb9-c094-4484-945f-ff275f85fd61-tmp\") pod \"insights-operator-76bcd6ccf5-xnk8k\" (UID: \"b9569fb9-c094-4484-945f-ff275f85fd61\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xnk8k"
Sep 08 13:59:34.547993 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.547875    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-service-ca-bundle\") pod \"router-default-67dfcbc96b-kwbqv\" (UID: \"d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5\") " pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 13:59:34.547993 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.547892    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zz88\" (UniqueName: \"kubernetes.io/projected/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-kube-api-access-8zz88\") pod \"router-default-67dfcbc96b-kwbqv\" (UID: \"d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5\") " pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 13:59:34.547993 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.547914    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/01796da0-49e5-4cde-b7fd-65daca0cb46d-config\") pod \"service-ca-operator-859f94c4b-wndrq\" (UID: \"01796da0-49e5-4cde-b7fd-65daca0cb46d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wndrq"
Sep 08 13:59:34.547993 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.547969    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89jdj\" (UniqueName: \"kubernetes.io/projected/01796da0-49e5-4cde-b7fd-65daca0cb46d-kube-api-access-89jdj\") pod \"service-ca-operator-859f94c4b-wndrq\" (UID: \"01796da0-49e5-4cde-b7fd-65daca0cb46d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wndrq"
Sep 08 13:59:34.548236 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.548000    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9569fb9-c094-4484-945f-ff275f85fd61-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-xnk8k\" (UID: \"b9569fb9-c094-4484-945f-ff275f85fd61\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xnk8k"
Sep 08 13:59:34.548236 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.548028    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-stats-auth\") pod \"router-default-67dfcbc96b-kwbqv\" (UID: \"d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5\") " pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 13:59:34.548236 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.548081    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjr5c\" (UniqueName: \"kubernetes.io/projected/b9569fb9-c094-4484-945f-ff275f85fd61-kube-api-access-jjr5c\") pod \"insights-operator-76bcd6ccf5-xnk8k\" (UID: \"b9569fb9-c094-4484-945f-ff275f85fd61\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xnk8k"
Sep 08 13:59:34.548236 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.548108    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-default-certificate\") pod \"router-default-67dfcbc96b-kwbqv\" (UID: \"d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5\") " pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 13:59:34.548236 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.548149    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/01796da0-49e5-4cde-b7fd-65daca0cb46d-serving-cert\") pod \"service-ca-operator-859f94c4b-wndrq\" (UID: \"01796da0-49e5-4cde-b7fd-65daca0cb46d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wndrq"
Sep 08 13:59:34.548236 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.548175    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9569fb9-c094-4484-945f-ff275f85fd61-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-xnk8k\" (UID: \"b9569fb9-c094-4484-945f-ff275f85fd61\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xnk8k"
Sep 08 13:59:34.548236 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.548200    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b9569fb9-c094-4484-945f-ff275f85fd61-serving-cert\") pod \"insights-operator-76bcd6ccf5-xnk8k\" (UID: \"b9569fb9-c094-4484-945f-ff275f85fd61\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xnk8k"
Sep 08 13:59:34.548442 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.548250    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-metrics-certs\") pod \"router-default-67dfcbc96b-kwbqv\" (UID: \"d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5\") " pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 13:59:34.548442 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.548327    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b9569fb9-c094-4484-945f-ff275f85fd61-snapshots\") pod \"insights-operator-76bcd6ccf5-xnk8k\" (UID: \"b9569fb9-c094-4484-945f-ff275f85fd61\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xnk8k"
Sep 08 13:59:34.550863 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.550849    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2kqn8"
Sep 08 13:59:34.649505 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.649475    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b9569fb9-c094-4484-945f-ff275f85fd61-snapshots\") pod \"insights-operator-76bcd6ccf5-xnk8k\" (UID: \"b9569fb9-c094-4484-945f-ff275f85fd61\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xnk8k"
Sep 08 13:59:34.649643 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.649518    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9569fb9-c094-4484-945f-ff275f85fd61-tmp\") pod \"insights-operator-76bcd6ccf5-xnk8k\" (UID: \"b9569fb9-c094-4484-945f-ff275f85fd61\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xnk8k"
Sep 08 13:59:34.649643 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.649541    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-service-ca-bundle\") pod \"router-default-67dfcbc96b-kwbqv\" (UID: \"d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5\") " pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 13:59:34.649810 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:34.649651    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-service-ca-bundle podName:d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:35.149636582 +0000 UTC m=+50.639353612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-service-ca-bundle") pod "router-default-67dfcbc96b-kwbqv" (UID: "d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5") : configmap references non-existent config key: service-ca.crt
Sep 08 13:59:34.649810 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.649665    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zz88\" (UniqueName: \"kubernetes.io/projected/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-kube-api-access-8zz88\") pod \"router-default-67dfcbc96b-kwbqv\" (UID: \"d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5\") " pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 13:59:34.649810 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.649685    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/01796da0-49e5-4cde-b7fd-65daca0cb46d-config\") pod \"service-ca-operator-859f94c4b-wndrq\" (UID: \"01796da0-49e5-4cde-b7fd-65daca0cb46d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wndrq"
Sep 08 13:59:34.649810 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.649706    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89jdj\" (UniqueName: \"kubernetes.io/projected/01796da0-49e5-4cde-b7fd-65daca0cb46d-kube-api-access-89jdj\") pod \"service-ca-operator-859f94c4b-wndrq\" (UID: \"01796da0-49e5-4cde-b7fd-65daca0cb46d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wndrq"
Sep 08 13:59:34.649810 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.649727    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9569fb9-c094-4484-945f-ff275f85fd61-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-xnk8k\" (UID: \"b9569fb9-c094-4484-945f-ff275f85fd61\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xnk8k"
Sep 08 13:59:34.649810 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.649749    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-stats-auth\") pod \"router-default-67dfcbc96b-kwbqv\" (UID: \"d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5\") " pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 13:59:34.649810 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.649778    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjr5c\" (UniqueName: \"kubernetes.io/projected/b9569fb9-c094-4484-945f-ff275f85fd61-kube-api-access-jjr5c\") pod \"insights-operator-76bcd6ccf5-xnk8k\" (UID: \"b9569fb9-c094-4484-945f-ff275f85fd61\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xnk8k"
Sep 08 13:59:34.649810 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.649802    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-default-certificate\") pod \"router-default-67dfcbc96b-kwbqv\" (UID: \"d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5\") " pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 13:59:34.650267 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.649838    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/01796da0-49e5-4cde-b7fd-65daca0cb46d-serving-cert\") pod \"service-ca-operator-859f94c4b-wndrq\" (UID: \"01796da0-49e5-4cde-b7fd-65daca0cb46d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wndrq"
Sep 08 13:59:34.650267 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.649866    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9569fb9-c094-4484-945f-ff275f85fd61-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-xnk8k\" (UID: \"b9569fb9-c094-4484-945f-ff275f85fd61\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xnk8k"
Sep 08 13:59:34.650267 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.650097    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9569fb9-c094-4484-945f-ff275f85fd61-tmp\") pod \"insights-operator-76bcd6ccf5-xnk8k\" (UID: \"b9569fb9-c094-4484-945f-ff275f85fd61\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xnk8k"
Sep 08 13:59:34.650267 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.650181    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b9569fb9-c094-4484-945f-ff275f85fd61-snapshots\") pod \"insights-operator-76bcd6ccf5-xnk8k\" (UID: \"b9569fb9-c094-4484-945f-ff275f85fd61\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xnk8k"
Sep 08 13:59:34.650267 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.650231    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b9569fb9-c094-4484-945f-ff275f85fd61-serving-cert\") pod \"insights-operator-76bcd6ccf5-xnk8k\" (UID: \"b9569fb9-c094-4484-945f-ff275f85fd61\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xnk8k"
Sep 08 13:59:34.650267 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.650266    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-metrics-certs\") pod \"router-default-67dfcbc96b-kwbqv\" (UID: \"d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5\") " pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 13:59:34.650545 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.650285    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/01796da0-49e5-4cde-b7fd-65daca0cb46d-config\") pod \"service-ca-operator-859f94c4b-wndrq\" (UID: \"01796da0-49e5-4cde-b7fd-65daca0cb46d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wndrq"
Sep 08 13:59:34.650545 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:34.650401    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 13:59:34.650545 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.650465    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9569fb9-c094-4484-945f-ff275f85fd61-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-xnk8k\" (UID: \"b9569fb9-c094-4484-945f-ff275f85fd61\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xnk8k"
Sep 08 13:59:34.650545 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:34.650501    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-metrics-certs podName:d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:35.15048427 +0000 UTC m=+50.640201314 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-metrics-certs") pod "router-default-67dfcbc96b-kwbqv" (UID: "d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5") : secret "router-metrics-certs-default" not found
Sep 08 13:59:34.650991 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.650966    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9569fb9-c094-4484-945f-ff275f85fd61-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-xnk8k\" (UID: \"b9569fb9-c094-4484-945f-ff275f85fd61\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xnk8k"
Sep 08 13:59:34.652607 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.652587    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-stats-auth\") pod \"router-default-67dfcbc96b-kwbqv\" (UID: \"d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5\") " pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 13:59:34.652702 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.652641    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-default-certificate\") pod \"router-default-67dfcbc96b-kwbqv\" (UID: \"d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5\") " pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 13:59:34.653029 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.653006    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/01796da0-49e5-4cde-b7fd-65daca0cb46d-serving-cert\") pod \"service-ca-operator-859f94c4b-wndrq\" (UID: \"01796da0-49e5-4cde-b7fd-65daca0cb46d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wndrq"
Sep 08 13:59:34.653029 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.653020    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b9569fb9-c094-4484-945f-ff275f85fd61-serving-cert\") pod \"insights-operator-76bcd6ccf5-xnk8k\" (UID: \"b9569fb9-c094-4484-945f-ff275f85fd61\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xnk8k"
Sep 08 13:59:34.659775 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.659757    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjr5c\" (UniqueName: \"kubernetes.io/projected/b9569fb9-c094-4484-945f-ff275f85fd61-kube-api-access-jjr5c\") pod \"insights-operator-76bcd6ccf5-xnk8k\" (UID: \"b9569fb9-c094-4484-945f-ff275f85fd61\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xnk8k"
Sep 08 13:59:34.659948 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.659933    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89jdj\" (UniqueName: \"kubernetes.io/projected/01796da0-49e5-4cde-b7fd-65daca0cb46d-kube-api-access-89jdj\") pod \"service-ca-operator-859f94c4b-wndrq\" (UID: \"01796da0-49e5-4cde-b7fd-65daca0cb46d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wndrq"
Sep 08 13:59:34.660858 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.660835    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zz88\" (UniqueName: \"kubernetes.io/projected/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-kube-api-access-8zz88\") pod \"router-default-67dfcbc96b-kwbqv\" (UID: \"d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5\") " pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 13:59:34.692792 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.692761    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-xnk8k"
Sep 08 13:59:34.752735 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.752708    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wndrq"
Sep 08 13:59:34.829112 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.829087    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2kqn8"]
Sep 08 13:59:34.833964 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:59:34.833941    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a0c4143_3450_44ed_b48b_be0c9a76e6fe.slice/crio-e6e676d82c3c55fcf399d8a88f1aee921f181faa5b42890b6796d9b55dba9f0f WatchSource:0}: Error finding container e6e676d82c3c55fcf399d8a88f1aee921f181faa5b42890b6796d9b55dba9f0f: Status 404 returned error can't find the container with id e6e676d82c3c55fcf399d8a88f1aee921f181faa5b42890b6796d9b55dba9f0f
Sep 08 13:59:34.985345 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:34.985160    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-xnk8k"]
Sep 08 13:59:34.987513 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:59:34.987488    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9569fb9_c094_4484_945f_ff275f85fd61.slice/crio-dadad16b7d4553e6449c55c7837a86c51ec7ef7de9ecb95be591e88ca23f0f7e WatchSource:0}: Error finding container dadad16b7d4553e6449c55c7837a86c51ec7ef7de9ecb95be591e88ca23f0f7e: Status 404 returned error can't find the container with id dadad16b7d4553e6449c55c7837a86c51ec7ef7de9ecb95be591e88ca23f0f7e
Sep 08 13:59:35.052043 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:35.052016    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-wndrq"]
Sep 08 13:59:35.054560 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:59:35.054533    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01796da0_49e5_4cde_b7fd_65daca0cb46d.slice/crio-df8dd47aa2188fa920c72c0a946df62d9483576a3236555b1e44071b98862cef WatchSource:0}: Error finding container df8dd47aa2188fa920c72c0a946df62d9483576a3236555b1e44071b98862cef: Status 404 returned error can't find the container with id df8dd47aa2188fa920c72c0a946df62d9483576a3236555b1e44071b98862cef
Sep 08 13:59:35.154783 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:35.154754    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-metrics-certs\") pod \"router-default-67dfcbc96b-kwbqv\" (UID: \"d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5\") " pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 13:59:35.154900 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:35.154821    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-service-ca-bundle\") pod \"router-default-67dfcbc96b-kwbqv\" (UID: \"d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5\") " pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 13:59:35.154940 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:35.154908    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 13:59:35.154973 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:35.154939    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-service-ca-bundle podName:d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:36.15492621 +0000 UTC m=+51.644643240 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-service-ca-bundle") pod "router-default-67dfcbc96b-kwbqv" (UID: "d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5") : configmap references non-existent config key: service-ca.crt
Sep 08 13:59:35.154973 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:35.154962    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-metrics-certs podName:d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:36.154949157 +0000 UTC m=+51.644666187 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-metrics-certs") pod "router-default-67dfcbc96b-kwbqv" (UID: "d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5") : secret "router-metrics-certs-default" not found
Sep 08 13:59:35.237393 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:35.237322    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2kqn8" event={"ID":"5a0c4143-3450-44ed-b48b-be0c9a76e6fe","Type":"ContainerStarted","Data":"e6e676d82c3c55fcf399d8a88f1aee921f181faa5b42890b6796d9b55dba9f0f"}
Sep 08 13:59:35.238430 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:35.238406    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wndrq" event={"ID":"01796da0-49e5-4cde-b7fd-65daca0cb46d","Type":"ContainerStarted","Data":"df8dd47aa2188fa920c72c0a946df62d9483576a3236555b1e44071b98862cef"}
Sep 08 13:59:35.239394 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:35.239374    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-xnk8k" event={"ID":"b9569fb9-c094-4484-945f-ff275f85fd61","Type":"ContainerStarted","Data":"dadad16b7d4553e6449c55c7837a86c51ec7ef7de9ecb95be591e88ca23f0f7e"}
Sep 08 13:59:36.164840 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:36.164810    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-service-ca-bundle\") pod \"router-default-67dfcbc96b-kwbqv\" (UID: \"d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5\") " pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 13:59:36.165347 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:36.164892    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-metrics-certs\") pod \"router-default-67dfcbc96b-kwbqv\" (UID: \"d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5\") " pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 13:59:36.165347 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:36.165040    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-service-ca-bundle podName:d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:38.165017081 +0000 UTC m=+53.654734134 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-service-ca-bundle") pod "router-default-67dfcbc96b-kwbqv" (UID: "d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5") : configmap references non-existent config key: service-ca.crt
Sep 08 13:59:36.165347 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:36.165124    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 13:59:36.165347 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:36.165180    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-metrics-certs podName:d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:38.165161067 +0000 UTC m=+53.654878097 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-metrics-certs") pod "router-default-67dfcbc96b-kwbqv" (UID: "d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5") : secret "router-metrics-certs-default" not found
Sep 08 13:59:36.243469 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:36.243411    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2kqn8" event={"ID":"5a0c4143-3450-44ed-b48b-be0c9a76e6fe","Type":"ContainerStarted","Data":"8ab7a54e9d1f452c10851256bf0acc40426a843a330d9ee2c377a350ad43443d"}
Sep 08 13:59:36.258504 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:36.258457    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2kqn8" podStartSLOduration=0.947934157 podStartE2EDuration="2.258441274s" totalImagesPullingTime="1.310507117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:59:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:59:36.257986239 +0000 UTC m=+51.747703291" watchObservedRunningTime="2026-09-08 13:59:36.258441274 +0000 UTC m=+51.748158326"
Sep 08 13:59:38.180423 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:38.180376    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-metrics-certs\") pod \"router-default-67dfcbc96b-kwbqv\" (UID: \"d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5\") " pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 13:59:38.180896 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:38.180478    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-service-ca-bundle\") pod \"router-default-67dfcbc96b-kwbqv\" (UID: \"d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5\") " pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 13:59:38.180896 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:38.180524    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 13:59:38.180896 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:38.180583    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-metrics-certs podName:d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:42.180568842 +0000 UTC m=+57.670285895 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-metrics-certs") pod "router-default-67dfcbc96b-kwbqv" (UID: "d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5") : secret "router-metrics-certs-default" not found
Sep 08 13:59:38.180896 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:38.180651    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-service-ca-bundle podName:d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:42.180632639 +0000 UTC m=+57.670349674 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-service-ca-bundle") pod "router-default-67dfcbc96b-kwbqv" (UID: "d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5") : configmap references non-existent config key: service-ca.crt
Sep 08 13:59:38.250311 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:38.250276    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wndrq" event={"ID":"01796da0-49e5-4cde-b7fd-65daca0cb46d","Type":"ContainerStarted","Data":"ff04c52ecb571738b91c7f4fec78664bb020df7c4055209bbe156c30384466cd"}
Sep 08 13:59:38.251966 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:38.251936    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-xnk8k" event={"ID":"b9569fb9-c094-4484-945f-ff275f85fd61","Type":"ContainerStarted","Data":"cbb3f14c58b49ff291ec1e7f6561eaec34ae812226317eebad8151b63b3987d8"}
Sep 08 13:59:38.267890 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:38.267844    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wndrq" podStartSLOduration=1.871100537 podStartE2EDuration="4.267827668s" totalImagesPullingTime="2.396727131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:59:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:59:38.267743561 +0000 UTC m=+53.757460615" watchObservedRunningTime="2026-09-08 13:59:38.267827668 +0000 UTC m=+53.757544719"
Sep 08 13:59:38.289822 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:38.289774    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-xnk8k" podStartSLOduration=1.827392502 podStartE2EDuration="4.289757292s" totalImagesPullingTime="2.46236479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:59:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:59:38.28906828 +0000 UTC m=+53.778785338" watchObservedRunningTime="2026-09-08 13:59:38.289757292 +0000 UTC m=+53.779474371"
Sep 08 13:59:39.356873 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:39.356839    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gf86m"]
Sep 08 13:59:39.359327 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:39.359295    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gf86m"
Sep 08 13:59:39.362952 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:39.362245    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 08 13:59:39.362952 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:39.362530    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 08 13:59:39.370257 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:39.370239    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8q4kl\""
Sep 08 13:59:39.387749 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:39.387725    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gf86m"]
Sep 08 13:59:39.390959 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:39.390929    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-crio-socket\") pod \"insights-runtime-extractor-gf86m\" (UID: \"56b92c3b-d5b7-401b-b0e5-ae2cb458af12\") " pod="openshift-insights/insights-runtime-extractor-gf86m"
Sep 08 13:59:39.391084 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:39.391049    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gf86m\" (UID: \"56b92c3b-d5b7-401b-b0e5-ae2cb458af12\") " pod="openshift-insights/insights-runtime-extractor-gf86m"
Sep 08 13:59:39.391140 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:39.391104    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gf86m\" (UID: \"56b92c3b-d5b7-401b-b0e5-ae2cb458af12\") " pod="openshift-insights/insights-runtime-extractor-gf86m"
Sep 08 13:59:39.391140 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:39.391135    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl2wk\" (UniqueName: \"kubernetes.io/projected/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-kube-api-access-gl2wk\") pod \"insights-runtime-extractor-gf86m\" (UID: \"56b92c3b-d5b7-401b-b0e5-ae2cb458af12\") " pod="openshift-insights/insights-runtime-extractor-gf86m"
Sep 08 13:59:39.391219 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:39.391165    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-data-volume\") pod \"insights-runtime-extractor-gf86m\" (UID: \"56b92c3b-d5b7-401b-b0e5-ae2cb458af12\") " pod="openshift-insights/insights-runtime-extractor-gf86m"
Sep 08 13:59:39.491737 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:39.491702    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gf86m\" (UID: \"56b92c3b-d5b7-401b-b0e5-ae2cb458af12\") " pod="openshift-insights/insights-runtime-extractor-gf86m"
Sep 08 13:59:39.491871 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:39.491744    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gf86m\" (UID: \"56b92c3b-d5b7-401b-b0e5-ae2cb458af12\") " pod="openshift-insights/insights-runtime-extractor-gf86m"
Sep 08 13:59:39.491871 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:39.491819    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 13:59:39.491871 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:39.491846    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 13:59:39.491871 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:39.491847    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl2wk\" (UniqueName: \"kubernetes.io/projected/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-kube-api-access-gl2wk\") pod \"insights-runtime-extractor-gf86m\" (UID: \"56b92c3b-d5b7-401b-b0e5-ae2cb458af12\") " pod="openshift-insights/insights-runtime-extractor-gf86m"
Sep 08 13:59:39.491871 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:39.491873    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-kube-rbac-proxy-cm podName:56b92c3b-d5b7-401b-b0e5-ae2cb458af12 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:39.991858396 +0000 UTC m=+55.481575427 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gf86m" (UID: "56b92c3b-d5b7-401b-b0e5-ae2cb458af12") : configmap "kube-rbac-proxy" not found
Sep 08 13:59:39.492175 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:39.491890    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-insights-runtime-extractor-tls podName:56b92c3b-d5b7-401b-b0e5-ae2cb458af12 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:39.991883668 +0000 UTC m=+55.481600699 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gf86m" (UID: "56b92c3b-d5b7-401b-b0e5-ae2cb458af12") : secret "insights-runtime-extractor-tls" not found
Sep 08 13:59:39.492175 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:39.491918    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-data-volume\") pod \"insights-runtime-extractor-gf86m\" (UID: \"56b92c3b-d5b7-401b-b0e5-ae2cb458af12\") " pod="openshift-insights/insights-runtime-extractor-gf86m"
Sep 08 13:59:39.492175 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:39.491978    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-crio-socket\") pod \"insights-runtime-extractor-gf86m\" (UID: \"56b92c3b-d5b7-401b-b0e5-ae2cb458af12\") " pod="openshift-insights/insights-runtime-extractor-gf86m"
Sep 08 13:59:39.492175 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:39.492049    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-crio-socket\") pod \"insights-runtime-extractor-gf86m\" (UID: \"56b92c3b-d5b7-401b-b0e5-ae2cb458af12\") " pod="openshift-insights/insights-runtime-extractor-gf86m"
Sep 08 13:59:39.492358 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:39.492281    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-data-volume\") pod \"insights-runtime-extractor-gf86m\" (UID: \"56b92c3b-d5b7-401b-b0e5-ae2cb458af12\") " pod="openshift-insights/insights-runtime-extractor-gf86m"
Sep 08 13:59:39.501420 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:39.501398    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl2wk\" (UniqueName: \"kubernetes.io/projected/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-kube-api-access-gl2wk\") pod \"insights-runtime-extractor-gf86m\" (UID: \"56b92c3b-d5b7-401b-b0e5-ae2cb458af12\") " pod="openshift-insights/insights-runtime-extractor-gf86m"
Sep 08 13:59:39.714482 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:39.714411    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-8zk7g"]
Sep 08 13:59:39.716664 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:39.716647    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-8zk7g"
Sep 08 13:59:39.719612 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:39.719591    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 08 13:59:39.719753 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:39.719738    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-57lxl\""
Sep 08 13:59:39.720113 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:39.720096    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 08 13:59:39.728381 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:39.728363    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-8zk7g"]
Sep 08 13:59:39.793625 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:39.793600    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5blsq\" (UniqueName: \"kubernetes.io/projected/10271d13-25a3-4280-95b8-19d200846611-kube-api-access-5blsq\") pod \"migrator-fdbb8fdff-8zk7g\" (UID: \"10271d13-25a3-4280-95b8-19d200846611\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-8zk7g"
Sep 08 13:59:39.894379 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:39.894355    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5blsq\" (UniqueName: \"kubernetes.io/projected/10271d13-25a3-4280-95b8-19d200846611-kube-api-access-5blsq\") pod \"migrator-fdbb8fdff-8zk7g\" (UID: \"10271d13-25a3-4280-95b8-19d200846611\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-8zk7g"
Sep 08 13:59:39.902665 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:39.902639    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5blsq\" (UniqueName: \"kubernetes.io/projected/10271d13-25a3-4280-95b8-19d200846611-kube-api-access-5blsq\") pod \"migrator-fdbb8fdff-8zk7g\" (UID: \"10271d13-25a3-4280-95b8-19d200846611\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-8zk7g"
Sep 08 13:59:39.994964 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:39.994901    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gf86m\" (UID: \"56b92c3b-d5b7-401b-b0e5-ae2cb458af12\") " pod="openshift-insights/insights-runtime-extractor-gf86m"
Sep 08 13:59:39.994964 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:39.994930    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gf86m\" (UID: \"56b92c3b-d5b7-401b-b0e5-ae2cb458af12\") " pod="openshift-insights/insights-runtime-extractor-gf86m"
Sep 08 13:59:39.995121 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:39.995025    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 13:59:39.995121 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:39.995089    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 13:59:39.995121 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:39.995108    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-kube-rbac-proxy-cm podName:56b92c3b-d5b7-401b-b0e5-ae2cb458af12 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:40.995090376 +0000 UTC m=+56.484807423 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gf86m" (UID: "56b92c3b-d5b7-401b-b0e5-ae2cb458af12") : configmap "kube-rbac-proxy" not found
Sep 08 13:59:39.995225 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:39.995133    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-insights-runtime-extractor-tls podName:56b92c3b-d5b7-401b-b0e5-ae2cb458af12 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:40.995121839 +0000 UTC m=+56.484838869 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gf86m" (UID: "56b92c3b-d5b7-401b-b0e5-ae2cb458af12") : secret "insights-runtime-extractor-tls" not found
Sep 08 13:59:40.025721 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:40.025697    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-8zk7g"
Sep 08 13:59:40.292036 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:40.291967    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-8zk7g"]
Sep 08 13:59:40.295436 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:59:40.295407    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10271d13_25a3_4280_95b8_19d200846611.slice/crio-3a95e8780fb62f14c42dbbaa4041be402aa4ae3f817ff6d60290f8f73b7deeff WatchSource:0}: Error finding container 3a95e8780fb62f14c42dbbaa4041be402aa4ae3f817ff6d60290f8f73b7deeff: Status 404 returned error can't find the container with id 3a95e8780fb62f14c42dbbaa4041be402aa4ae3f817ff6d60290f8f73b7deeff
Sep 08 13:59:41.002484 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:41.002454    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gf86m\" (UID: \"56b92c3b-d5b7-401b-b0e5-ae2cb458af12\") " pod="openshift-insights/insights-runtime-extractor-gf86m"
Sep 08 13:59:41.002484 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:41.002489    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gf86m\" (UID: \"56b92c3b-d5b7-401b-b0e5-ae2cb458af12\") " pod="openshift-insights/insights-runtime-extractor-gf86m"
Sep 08 13:59:41.003108 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:41.003048    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 13:59:41.003248 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:41.003111    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 13:59:41.003248 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:41.003171    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-insights-runtime-extractor-tls podName:56b92c3b-d5b7-401b-b0e5-ae2cb458af12 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:43.003148472 +0000 UTC m=+58.492865522 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gf86m" (UID: "56b92c3b-d5b7-401b-b0e5-ae2cb458af12") : secret "insights-runtime-extractor-tls" not found
Sep 08 13:59:41.003248 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:41.003193    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-kube-rbac-proxy-cm podName:56b92c3b-d5b7-401b-b0e5-ae2cb458af12 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:43.003182248 +0000 UTC m=+58.492899278 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gf86m" (UID: "56b92c3b-d5b7-401b-b0e5-ae2cb458af12") : configmap "kube-rbac-proxy" not found
Sep 08 13:59:41.262626 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:41.262543    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-8zk7g" event={"ID":"10271d13-25a3-4280-95b8-19d200846611","Type":"ContainerStarted","Data":"3a95e8780fb62f14c42dbbaa4041be402aa4ae3f817ff6d60290f8f73b7deeff"}
Sep 08 13:59:41.266588 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:41.266567    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qzvvn_a94658b0-bc07-44bc-a7c8-92d1c7804987/dns-node-resolver/0.log"
Sep 08 13:59:42.212926 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:42.212901    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-service-ca-bundle\") pod \"router-default-67dfcbc96b-kwbqv\" (UID: \"d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5\") " pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 13:59:42.213209 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:42.212971    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-metrics-certs\") pod \"router-default-67dfcbc96b-kwbqv\" (UID: \"d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5\") " pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 13:59:42.213209 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:42.213108    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-service-ca-bundle podName:d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:50.21303845 +0000 UTC m=+65.702755483 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-service-ca-bundle") pod "router-default-67dfcbc96b-kwbqv" (UID: "d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5") : configmap references non-existent config key: service-ca.crt
Sep 08 13:59:42.213209 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:42.213111    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 13:59:42.213209 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:42.213157    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-metrics-certs podName:d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:50.21314661 +0000 UTC m=+65.702863641 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-metrics-certs") pod "router-default-67dfcbc96b-kwbqv" (UID: "d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5") : secret "router-metrics-certs-default" not found
Sep 08 13:59:42.267795 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:42.267771    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-8zk7g" event={"ID":"10271d13-25a3-4280-95b8-19d200846611","Type":"ContainerStarted","Data":"37e3dff48fc84dd736e33a840677cea3fbc1465b51a75827402b7fd1d6e82628"}
Sep 08 13:59:42.271677 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:42.271658    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lw6kq_1f1133bf-01cf-46b7-be8d-1272be6dd0da/node-ca/0.log"
Sep 08 13:59:42.867197 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:42.867166    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d5h6j_7c2eb712-1aa9-4d8b-adb5-521fde6a5169/serve-healthcheck-canary/0.log"
Sep 08 13:59:43.017496 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:43.017456    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gf86m\" (UID: \"56b92c3b-d5b7-401b-b0e5-ae2cb458af12\") " pod="openshift-insights/insights-runtime-extractor-gf86m"
Sep 08 13:59:43.017496 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:43.017500    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gf86m\" (UID: \"56b92c3b-d5b7-401b-b0e5-ae2cb458af12\") " pod="openshift-insights/insights-runtime-extractor-gf86m"
Sep 08 13:59:43.017687 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:43.017566    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 13:59:43.017687 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:43.017622    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 13:59:43.017687 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:43.017628    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-kube-rbac-proxy-cm podName:56b92c3b-d5b7-401b-b0e5-ae2cb458af12 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:47.017612597 +0000 UTC m=+62.507329628 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gf86m" (UID: "56b92c3b-d5b7-401b-b0e5-ae2cb458af12") : configmap "kube-rbac-proxy" not found
Sep 08 13:59:43.017687 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:43.017666    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-insights-runtime-extractor-tls podName:56b92c3b-d5b7-401b-b0e5-ae2cb458af12 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:47.017656197 +0000 UTC m=+62.507373244 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gf86m" (UID: "56b92c3b-d5b7-401b-b0e5-ae2cb458af12") : secret "insights-runtime-extractor-tls" not found
Sep 08 13:59:43.272164 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:43.272089    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-8zk7g" event={"ID":"10271d13-25a3-4280-95b8-19d200846611","Type":"ContainerStarted","Data":"fbf79394b0e16f7ff60b4aa92501a1364f7aeb3f26bd743cae513db54aa1cf8d"}
Sep 08 13:59:43.288423 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:43.288382    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-8zk7g" podStartSLOduration=2.541614698 podStartE2EDuration="4.288368022s" totalImagesPullingTime="1.746753324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:59:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:59:43.286907943 +0000 UTC m=+58.776624994" watchObservedRunningTime="2026-09-08 13:59:43.288368022 +0000 UTC m=+58.778085075"
Sep 08 13:59:45.187341 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:45.187314    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ncn7g"
Sep 08 13:59:47.046722 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:47.046685    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gf86m\" (UID: \"56b92c3b-d5b7-401b-b0e5-ae2cb458af12\") " pod="openshift-insights/insights-runtime-extractor-gf86m"
Sep 08 13:59:47.046722 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:47.046723    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gf86m\" (UID: \"56b92c3b-d5b7-401b-b0e5-ae2cb458af12\") " pod="openshift-insights/insights-runtime-extractor-gf86m"
Sep 08 13:59:47.047333 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:47.046803    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 13:59:47.047333 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:47.046819    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 13:59:47.047333 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:47.046857    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-kube-rbac-proxy-cm podName:56b92c3b-d5b7-401b-b0e5-ae2cb458af12 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:55.046842562 +0000 UTC m=+70.536559592 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gf86m" (UID: "56b92c3b-d5b7-401b-b0e5-ae2cb458af12") : configmap "kube-rbac-proxy" not found
Sep 08 13:59:47.047333 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:47.046871    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-insights-runtime-extractor-tls podName:56b92c3b-d5b7-401b-b0e5-ae2cb458af12 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:55.046864869 +0000 UTC m=+70.536581899 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gf86m" (UID: "56b92c3b-d5b7-401b-b0e5-ae2cb458af12") : secret "insights-runtime-extractor-tls" not found
Sep 08 13:59:49.767102 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:49.767045    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c-metrics-tls\") pod \"dns-default-8ds62\" (UID: \"7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c\") " pod="openshift-dns/dns-default-8ds62"
Sep 08 13:59:49.767573 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:49.767147    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0323060-7649-4e6c-b078-dbe218838e63-metrics-certs\") pod \"network-metrics-daemon-2qkhb\" (UID: \"b0323060-7649-4e6c-b078-dbe218838e63\") " pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 13:59:49.767573 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:49.767196    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9c2a97a-5054-4839-b0ea-ff5bfa366afc-original-pull-secret\") pod \"global-pull-secret-syncer-wsgdv\" (UID: \"a9c2a97a-5054-4839-b0ea-ff5bfa366afc\") " pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:59:49.769658 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:49.769627    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c-metrics-tls\") pod \"dns-default-8ds62\" (UID: \"7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c\") " pod="openshift-dns/dns-default-8ds62"
Sep 08 13:59:49.770089 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:49.770072    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 13:59:49.770487 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:49.770472    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 13:59:49.777542 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:49.777520    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 08 13:59:49.777635 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:49.777572    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0323060-7649-4e6c-b078-dbe218838e63-metrics-certs podName:b0323060-7649-4e6c-b078-dbe218838e63 nodeName:}" failed. No retries permitted until 2026-09-08 14:00:53.777557562 +0000 UTC m=+129.267274592 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0323060-7649-4e6c-b078-dbe218838e63-metrics-certs") pod "network-metrics-daemon-2qkhb" (UID: "b0323060-7649-4e6c-b078-dbe218838e63") : secret "metrics-daemon-secret" not found
Sep 08 13:59:49.779431 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:49.779412    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9c2a97a-5054-4839-b0ea-ff5bfa366afc-original-pull-secret\") pod \"global-pull-secret-syncer-wsgdv\" (UID: \"a9c2a97a-5054-4839-b0ea-ff5bfa366afc\") " pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:59:49.779506 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:49.779493    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsgdv"
Sep 08 13:59:49.867695 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:49.867657    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kl9x\" (UniqueName: \"kubernetes.io/projected/4768adf0-964c-415f-bd1f-94c1d50ad6f7-kube-api-access-9kl9x\") pod \"network-check-target-vlc72\" (UID: \"4768adf0-964c-415f-bd1f-94c1d50ad6f7\") " pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 13:59:49.870965 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:49.870949    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 13:59:49.881152 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:49.881133    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 13:59:49.891542 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:49.891523    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kl9x\" (UniqueName: \"kubernetes.io/projected/4768adf0-964c-415f-bd1f-94c1d50ad6f7-kube-api-access-9kl9x\") pod \"network-check-target-vlc72\" (UID: \"4768adf0-964c-415f-bd1f-94c1d50ad6f7\") " pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 13:59:50.045946 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:50.045875    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wsgdv"]
Sep 08 13:59:50.048727 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:59:50.048706    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9c2a97a_5054_4839_b0ea_ff5bfa366afc.slice/crio-248c3b489a532997a4e8e27cbe3fc7fb1768dcd3987166f77e0a115c8189b532 WatchSource:0}: Error finding container 248c3b489a532997a4e8e27cbe3fc7fb1768dcd3987166f77e0a115c8189b532: Status 404 returned error can't find the container with id 248c3b489a532997a4e8e27cbe3fc7fb1768dcd3987166f77e0a115c8189b532
Sep 08 13:59:50.070911 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:50.070890    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b4mdc\""
Sep 08 13:59:50.078985 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:50.078971    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8ds62"
Sep 08 13:59:50.101817 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:50.101790    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9cmv8\""
Sep 08 13:59:50.109848 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:50.109832    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 13:59:50.271892 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:50.271862    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-service-ca-bundle\") pod \"router-default-67dfcbc96b-kwbqv\" (UID: \"d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5\") " pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 13:59:50.272033 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:50.271946    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-metrics-certs\") pod \"router-default-67dfcbc96b-kwbqv\" (UID: \"d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5\") " pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 13:59:50.272133 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:50.272045    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-service-ca-bundle podName:d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5 nodeName:}" failed. No retries permitted until 2026-09-08 14:00:06.272025186 +0000 UTC m=+81.761742243 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-service-ca-bundle") pod "router-default-67dfcbc96b-kwbqv" (UID: "d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5") : configmap references non-existent config key: service-ca.crt
Sep 08 13:59:50.274337 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:50.274319    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-metrics-certs\") pod \"router-default-67dfcbc96b-kwbqv\" (UID: \"d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5\") " pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 13:59:50.296430 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:50.296379    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wsgdv" event={"ID":"a9c2a97a-5054-4839-b0ea-ff5bfa366afc","Type":"ContainerStarted","Data":"248c3b489a532997a4e8e27cbe3fc7fb1768dcd3987166f77e0a115c8189b532"}
Sep 08 13:59:50.347598 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:50.347574    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8ds62"]
Sep 08 13:59:50.349975 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:59:50.349954    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bc7d6ad_c6f2_4614_aeb3_71aaeb3e7f7c.slice/crio-5cb6db21fae1074a5dd6553e329d57fd66b37691a143a4cb5e5d960ef7857d02 WatchSource:0}: Error finding container 5cb6db21fae1074a5dd6553e329d57fd66b37691a143a4cb5e5d960ef7857d02: Status 404 returned error can't find the container with id 5cb6db21fae1074a5dd6553e329d57fd66b37691a143a4cb5e5d960ef7857d02
Sep 08 13:59:50.379629 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:50.379611    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vlc72"]
Sep 08 13:59:50.382526 ip-10-0-130-125 kubenswrapper[2575]: W0908 13:59:50.382501    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4768adf0_964c_415f_bd1f_94c1d50ad6f7.slice/crio-7f466a03673abc50a63a7e780d7fa445e1610da4759b84ebff79df62ff3ac70d WatchSource:0}: Error finding container 7f466a03673abc50a63a7e780d7fa445e1610da4759b84ebff79df62ff3ac70d: Status 404 returned error can't find the container with id 7f466a03673abc50a63a7e780d7fa445e1610da4759b84ebff79df62ff3ac70d
Sep 08 13:59:51.301782 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:51.301709    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vlc72" event={"ID":"4768adf0-964c-415f-bd1f-94c1d50ad6f7","Type":"ContainerStarted","Data":"7f466a03673abc50a63a7e780d7fa445e1610da4759b84ebff79df62ff3ac70d"}
Sep 08 13:59:51.303907 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:51.303878    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8ds62" event={"ID":"7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c","Type":"ContainerStarted","Data":"5cb6db21fae1074a5dd6553e329d57fd66b37691a143a4cb5e5d960ef7857d02"}
Sep 08 13:59:53.313336 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:53.313301    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8ds62" event={"ID":"7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c","Type":"ContainerStarted","Data":"7b7f3b633e318ed4e73f551e994044334a61cf340b7d2e6e117c586694bcb40a"}
Sep 08 13:59:53.313781 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:53.313364    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8ds62" event={"ID":"7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c","Type":"ContainerStarted","Data":"b41f6679368dde31d3f0498f90e07feeff8e2ff0a994b37db90e1edc34f4ebd4"}
Sep 08 13:59:53.313781 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:53.313497    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8ds62"
Sep 08 13:59:53.331279 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:53.331235    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8ds62" podStartSLOduration=34.249787665 podStartE2EDuration="36.331219042s" totalImagesPullingTime="2.081431377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:59:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:59:53.329806501 +0000 UTC m=+68.819523553" watchObservedRunningTime="2026-09-08 13:59:53.331219042 +0000 UTC m=+68.820936087"
Sep 08 13:59:55.110220 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:55.110192    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gf86m\" (UID: \"56b92c3b-d5b7-401b-b0e5-ae2cb458af12\") " pod="openshift-insights/insights-runtime-extractor-gf86m"
Sep 08 13:59:55.110541 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:55.110235    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gf86m\" (UID: \"56b92c3b-d5b7-401b-b0e5-ae2cb458af12\") " pod="openshift-insights/insights-runtime-extractor-gf86m"
Sep 08 13:59:55.110541 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:55.110392    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 13:59:55.110541 ip-10-0-130-125 kubenswrapper[2575]: E0908 13:59:55.110448    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-insights-runtime-extractor-tls podName:56b92c3b-d5b7-401b-b0e5-ae2cb458af12 nodeName:}" failed. No retries permitted until 2026-09-08 14:00:11.110433158 +0000 UTC m=+86.600150191 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gf86m" (UID: "56b92c3b-d5b7-401b-b0e5-ae2cb458af12") : secret "insights-runtime-extractor-tls" not found
Sep 08 13:59:55.110711 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:55.110644    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gf86m\" (UID: \"56b92c3b-d5b7-401b-b0e5-ae2cb458af12\") " pod="openshift-insights/insights-runtime-extractor-gf86m"
Sep 08 13:59:55.322539 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:55.322489    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vlc72" event={"ID":"4768adf0-964c-415f-bd1f-94c1d50ad6f7","Type":"ContainerStarted","Data":"8c0382e0479039d963b01695b5dc5bd7e517db159141e77dca868dad099ec757"}
Sep 08 13:59:55.322726 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:55.322577    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 13:59:55.324035 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:55.324013    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wsgdv" event={"ID":"a9c2a97a-5054-4839-b0ea-ff5bfa366afc","Type":"ContainerStarted","Data":"270e2ba09d3de027dd9f904ef1d526a52cde99209fa5c55a7979bb969f7a8c79"}
Sep 08 13:59:55.337200 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:55.337153    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vlc72" podStartSLOduration=65.704789104 podStartE2EDuration="1m10.337138033s" totalImagesPullingTime="4.632348929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:59:55.336560979 +0000 UTC m=+70.826278030" watchObservedRunningTime="2026-09-08 13:59:55.337138033 +0000 UTC m=+70.826855082"
Sep 08 13:59:55.351706 ip-10-0-130-125 kubenswrapper[2575]: I0908 13:59:55.351667    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wsgdv" podStartSLOduration=65.382655658 podStartE2EDuration="1m10.351656854s" totalImagesPullingTime="4.969001196s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:59:55.350879744 +0000 UTC m=+70.840596797" watchObservedRunningTime="2026-09-08 13:59:55.351656854 +0000 UTC m=+70.841373905"
Sep 08 14:00:02.828481 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:02.828373    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7884d946cb-d6ffc"]
Sep 08 14:00:02.831809 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:02.831787    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7884d946cb-d6ffc"
Sep 08 14:00:02.835114 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:02.835094    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 08 14:00:02.835224 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:02.835135    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 08 14:00:02.835224 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:02.835095    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 08 14:00:02.835224 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:02.835188    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 08 14:00:02.848359 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:02.848331    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7884d946cb-d6ffc"]
Sep 08 14:00:02.935965 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:02.935932    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"]
Sep 08 14:00:02.938965 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:02.938942    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"
Sep 08 14:00:02.944621 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:02.944591    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-j2pct\""
Sep 08 14:00:02.944895 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:02.944661    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 08 14:00:02.944895 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:02.944614    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 08 14:00:02.944895 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:02.944731    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 08 14:00:02.947288 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:02.947267    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 08 14:00:02.955865 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:02.955841    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"]
Sep 08 14:00:02.966962 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:02.966939    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/de01a2fd-fbd9-47ff-9791-1b05fcceb04b-klusterlet-config\") pod \"klusterlet-addon-workmgr-7884d946cb-d6ffc\" (UID: \"de01a2fd-fbd9-47ff-9791-1b05fcceb04b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7884d946cb-d6ffc"
Sep 08 14:00:02.967096 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:02.966967    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f56xt\" (UniqueName: \"kubernetes.io/projected/de01a2fd-fbd9-47ff-9791-1b05fcceb04b-kube-api-access-f56xt\") pod \"klusterlet-addon-workmgr-7884d946cb-d6ffc\" (UID: \"de01a2fd-fbd9-47ff-9791-1b05fcceb04b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7884d946cb-d6ffc"
Sep 08 14:00:02.967096 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:02.967013    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de01a2fd-fbd9-47ff-9791-1b05fcceb04b-tmp\") pod \"klusterlet-addon-workmgr-7884d946cb-d6ffc\" (UID: \"de01a2fd-fbd9-47ff-9791-1b05fcceb04b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7884d946cb-d6ffc"
Sep 08 14:00:03.067802 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.067768    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8fe6b9fa-cbcd-41be-8acf-6134156d7d48-bound-sa-token\") pod \"image-registry-7d68f4f4fc-jjp8z\" (UID: \"8fe6b9fa-cbcd-41be-8acf-6134156d7d48\") " pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"
Sep 08 14:00:03.067978 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.067808    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/de01a2fd-fbd9-47ff-9791-1b05fcceb04b-klusterlet-config\") pod \"klusterlet-addon-workmgr-7884d946cb-d6ffc\" (UID: \"de01a2fd-fbd9-47ff-9791-1b05fcceb04b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7884d946cb-d6ffc"
Sep 08 14:00:03.067978 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.067826    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f56xt\" (UniqueName: \"kubernetes.io/projected/de01a2fd-fbd9-47ff-9791-1b05fcceb04b-kube-api-access-f56xt\") pod \"klusterlet-addon-workmgr-7884d946cb-d6ffc\" (UID: \"de01a2fd-fbd9-47ff-9791-1b05fcceb04b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7884d946cb-d6ffc"
Sep 08 14:00:03.067978 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.067867    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8fe6b9fa-cbcd-41be-8acf-6134156d7d48-image-registry-private-configuration\") pod \"image-registry-7d68f4f4fc-jjp8z\" (UID: \"8fe6b9fa-cbcd-41be-8acf-6134156d7d48\") " pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"
Sep 08 14:00:03.067978 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.067903    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8fe6b9fa-cbcd-41be-8acf-6134156d7d48-ca-trust-extracted\") pod \"image-registry-7d68f4f4fc-jjp8z\" (UID: \"8fe6b9fa-cbcd-41be-8acf-6134156d7d48\") " pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"
Sep 08 14:00:03.067978 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.067933    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb2r5\" (UniqueName: \"kubernetes.io/projected/8fe6b9fa-cbcd-41be-8acf-6134156d7d48-kube-api-access-wb2r5\") pod \"image-registry-7d68f4f4fc-jjp8z\" (UID: \"8fe6b9fa-cbcd-41be-8acf-6134156d7d48\") " pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"
Sep 08 14:00:03.067978 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.067958    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de01a2fd-fbd9-47ff-9791-1b05fcceb04b-tmp\") pod \"klusterlet-addon-workmgr-7884d946cb-d6ffc\" (UID: \"de01a2fd-fbd9-47ff-9791-1b05fcceb04b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7884d946cb-d6ffc"
Sep 08 14:00:03.068245 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.067996    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8fe6b9fa-cbcd-41be-8acf-6134156d7d48-trusted-ca\") pod \"image-registry-7d68f4f4fc-jjp8z\" (UID: \"8fe6b9fa-cbcd-41be-8acf-6134156d7d48\") " pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"
Sep 08 14:00:03.068245 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.068021    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8fe6b9fa-cbcd-41be-8acf-6134156d7d48-installation-pull-secrets\") pod \"image-registry-7d68f4f4fc-jjp8z\" (UID: \"8fe6b9fa-cbcd-41be-8acf-6134156d7d48\") " pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"
Sep 08 14:00:03.068245 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.068098    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8fe6b9fa-cbcd-41be-8acf-6134156d7d48-registry-tls\") pod \"image-registry-7d68f4f4fc-jjp8z\" (UID: \"8fe6b9fa-cbcd-41be-8acf-6134156d7d48\") " pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"
Sep 08 14:00:03.068245 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.068127    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8fe6b9fa-cbcd-41be-8acf-6134156d7d48-registry-certificates\") pod \"image-registry-7d68f4f4fc-jjp8z\" (UID: \"8fe6b9fa-cbcd-41be-8acf-6134156d7d48\") " pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"
Sep 08 14:00:03.068377 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.068360    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de01a2fd-fbd9-47ff-9791-1b05fcceb04b-tmp\") pod \"klusterlet-addon-workmgr-7884d946cb-d6ffc\" (UID: \"de01a2fd-fbd9-47ff-9791-1b05fcceb04b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7884d946cb-d6ffc"
Sep 08 14:00:03.070614 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.070592    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/de01a2fd-fbd9-47ff-9791-1b05fcceb04b-klusterlet-config\") pod \"klusterlet-addon-workmgr-7884d946cb-d6ffc\" (UID: \"de01a2fd-fbd9-47ff-9791-1b05fcceb04b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7884d946cb-d6ffc"
Sep 08 14:00:03.077845 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.077817    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f56xt\" (UniqueName: \"kubernetes.io/projected/de01a2fd-fbd9-47ff-9791-1b05fcceb04b-kube-api-access-f56xt\") pod \"klusterlet-addon-workmgr-7884d946cb-d6ffc\" (UID: \"de01a2fd-fbd9-47ff-9791-1b05fcceb04b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7884d946cb-d6ffc"
Sep 08 14:00:03.141032 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.140947    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7884d946cb-d6ffc"
Sep 08 14:00:03.169329 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.169300    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8fe6b9fa-cbcd-41be-8acf-6134156d7d48-trusted-ca\") pod \"image-registry-7d68f4f4fc-jjp8z\" (UID: \"8fe6b9fa-cbcd-41be-8acf-6134156d7d48\") " pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"
Sep 08 14:00:03.169329 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.169334    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8fe6b9fa-cbcd-41be-8acf-6134156d7d48-installation-pull-secrets\") pod \"image-registry-7d68f4f4fc-jjp8z\" (UID: \"8fe6b9fa-cbcd-41be-8acf-6134156d7d48\") " pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"
Sep 08 14:00:03.169590 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.169366    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8fe6b9fa-cbcd-41be-8acf-6134156d7d48-registry-tls\") pod \"image-registry-7d68f4f4fc-jjp8z\" (UID: \"8fe6b9fa-cbcd-41be-8acf-6134156d7d48\") " pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"
Sep 08 14:00:03.169590 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.169403    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8fe6b9fa-cbcd-41be-8acf-6134156d7d48-registry-certificates\") pod \"image-registry-7d68f4f4fc-jjp8z\" (UID: \"8fe6b9fa-cbcd-41be-8acf-6134156d7d48\") " pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"
Sep 08 14:00:03.169590 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.169434    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8fe6b9fa-cbcd-41be-8acf-6134156d7d48-bound-sa-token\") pod \"image-registry-7d68f4f4fc-jjp8z\" (UID: \"8fe6b9fa-cbcd-41be-8acf-6134156d7d48\") " pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"
Sep 08 14:00:03.169590 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.169494    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8fe6b9fa-cbcd-41be-8acf-6134156d7d48-image-registry-private-configuration\") pod \"image-registry-7d68f4f4fc-jjp8z\" (UID: \"8fe6b9fa-cbcd-41be-8acf-6134156d7d48\") " pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"
Sep 08 14:00:03.169774 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.169607    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8fe6b9fa-cbcd-41be-8acf-6134156d7d48-ca-trust-extracted\") pod \"image-registry-7d68f4f4fc-jjp8z\" (UID: \"8fe6b9fa-cbcd-41be-8acf-6134156d7d48\") " pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"
Sep 08 14:00:03.169774 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.169644    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb2r5\" (UniqueName: \"kubernetes.io/projected/8fe6b9fa-cbcd-41be-8acf-6134156d7d48-kube-api-access-wb2r5\") pod \"image-registry-7d68f4f4fc-jjp8z\" (UID: \"8fe6b9fa-cbcd-41be-8acf-6134156d7d48\") " pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"
Sep 08 14:00:03.170200 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.170174    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8fe6b9fa-cbcd-41be-8acf-6134156d7d48-ca-trust-extracted\") pod \"image-registry-7d68f4f4fc-jjp8z\" (UID: \"8fe6b9fa-cbcd-41be-8acf-6134156d7d48\") " pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"
Sep 08 14:00:03.170639 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.170612    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8fe6b9fa-cbcd-41be-8acf-6134156d7d48-registry-certificates\") pod \"image-registry-7d68f4f4fc-jjp8z\" (UID: \"8fe6b9fa-cbcd-41be-8acf-6134156d7d48\") " pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"
Sep 08 14:00:03.170729 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.170683    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8fe6b9fa-cbcd-41be-8acf-6134156d7d48-trusted-ca\") pod \"image-registry-7d68f4f4fc-jjp8z\" (UID: \"8fe6b9fa-cbcd-41be-8acf-6134156d7d48\") " pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"
Sep 08 14:00:03.172410 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.172386    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8fe6b9fa-cbcd-41be-8acf-6134156d7d48-registry-tls\") pod \"image-registry-7d68f4f4fc-jjp8z\" (UID: \"8fe6b9fa-cbcd-41be-8acf-6134156d7d48\") " pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"
Sep 08 14:00:03.172643 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.172622    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8fe6b9fa-cbcd-41be-8acf-6134156d7d48-installation-pull-secrets\") pod \"image-registry-7d68f4f4fc-jjp8z\" (UID: \"8fe6b9fa-cbcd-41be-8acf-6134156d7d48\") " pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"
Sep 08 14:00:03.172704 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.172688    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8fe6b9fa-cbcd-41be-8acf-6134156d7d48-image-registry-private-configuration\") pod \"image-registry-7d68f4f4fc-jjp8z\" (UID: \"8fe6b9fa-cbcd-41be-8acf-6134156d7d48\") " pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"
Sep 08 14:00:03.180714 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.180683    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8fe6b9fa-cbcd-41be-8acf-6134156d7d48-bound-sa-token\") pod \"image-registry-7d68f4f4fc-jjp8z\" (UID: \"8fe6b9fa-cbcd-41be-8acf-6134156d7d48\") " pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"
Sep 08 14:00:03.180843 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.180768    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb2r5\" (UniqueName: \"kubernetes.io/projected/8fe6b9fa-cbcd-41be-8acf-6134156d7d48-kube-api-access-wb2r5\") pod \"image-registry-7d68f4f4fc-jjp8z\" (UID: \"8fe6b9fa-cbcd-41be-8acf-6134156d7d48\") " pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"
Sep 08 14:00:03.247489 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.247447    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"
Sep 08 14:00:03.319984 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.319959    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8ds62"
Sep 08 14:00:03.437580 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.437372    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7884d946cb-d6ffc"]
Sep 08 14:00:03.440862 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:00:03.440835    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde01a2fd_fbd9_47ff_9791_1b05fcceb04b.slice/crio-9dd58b487f6ed3a64d880e868e7c80a6688d56c930ecd84d9af0a0b9edf9adf4 WatchSource:0}: Error finding container 9dd58b487f6ed3a64d880e868e7c80a6688d56c930ecd84d9af0a0b9edf9adf4: Status 404 returned error can't find the container with id 9dd58b487f6ed3a64d880e868e7c80a6688d56c930ecd84d9af0a0b9edf9adf4
Sep 08 14:00:03.520828 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:03.520796    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"]
Sep 08 14:00:03.523622 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:00:03.523599    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fe6b9fa_cbcd_41be_8acf_6134156d7d48.slice/crio-e8473444081b76697dd26940024b48095c626262735af7174ee9bed2d20cb0eb WatchSource:0}: Error finding container e8473444081b76697dd26940024b48095c626262735af7174ee9bed2d20cb0eb: Status 404 returned error can't find the container with id e8473444081b76697dd26940024b48095c626262735af7174ee9bed2d20cb0eb
Sep 08 14:00:04.352598 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:04.352563    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7884d946cb-d6ffc" event={"ID":"de01a2fd-fbd9-47ff-9791-1b05fcceb04b","Type":"ContainerStarted","Data":"9dd58b487f6ed3a64d880e868e7c80a6688d56c930ecd84d9af0a0b9edf9adf4"}
Sep 08 14:00:04.354002 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:04.353973    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z" event={"ID":"8fe6b9fa-cbcd-41be-8acf-6134156d7d48","Type":"ContainerStarted","Data":"8789582a75b7142430aed479b877f40282df25cad23c0d2ebcdbfb5babafc7b8"}
Sep 08 14:00:04.354233 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:04.354017    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z" event={"ID":"8fe6b9fa-cbcd-41be-8acf-6134156d7d48","Type":"ContainerStarted","Data":"e8473444081b76697dd26940024b48095c626262735af7174ee9bed2d20cb0eb"}
Sep 08 14:00:04.354233 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:04.354119    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"
Sep 08 14:00:04.386598 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:04.386545    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z" podStartSLOduration=2.386526018 podStartE2EDuration="2.386526018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:00:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:00:04.385591219 +0000 UTC m=+79.875308271" watchObservedRunningTime="2026-09-08 14:00:04.386526018 +0000 UTC m=+79.876243062"
Sep 08 14:00:06.295596 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:06.295460    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-service-ca-bundle\") pod \"router-default-67dfcbc96b-kwbqv\" (UID: \"d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5\") " pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 14:00:06.296120 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:06.296096    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5-service-ca-bundle\") pod \"router-default-67dfcbc96b-kwbqv\" (UID: \"d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5\") " pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 14:00:06.476482 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:06.476440    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cl44g\""
Sep 08 14:00:06.484010 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:06.483945    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 14:00:07.371282 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:07.371210    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-67dfcbc96b-kwbqv"]
Sep 08 14:00:07.374873 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:00:07.374843    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd66fa991_e7aa_4f6b_b9d1_ce161b88bdf5.slice/crio-3fee1e6663832eb0c1b67a2f8fdf422503352f4539e7dd6f69fa8603ed89c32c WatchSource:0}: Error finding container 3fee1e6663832eb0c1b67a2f8fdf422503352f4539e7dd6f69fa8603ed89c32c: Status 404 returned error can't find the container with id 3fee1e6663832eb0c1b67a2f8fdf422503352f4539e7dd6f69fa8603ed89c32c
Sep 08 14:00:08.373101 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:08.373040    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-67dfcbc96b-kwbqv" event={"ID":"d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5","Type":"ContainerStarted","Data":"64cd9134d72f04432d8e68c6ef032c1b9bef34694a68805d3e8ff578a0930f81"}
Sep 08 14:00:08.373563 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:08.373158    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-67dfcbc96b-kwbqv" event={"ID":"d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5","Type":"ContainerStarted","Data":"3fee1e6663832eb0c1b67a2f8fdf422503352f4539e7dd6f69fa8603ed89c32c"}
Sep 08 14:00:08.393874 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:08.393812    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-67dfcbc96b-kwbqv" podStartSLOduration=34.393796047 podStartE2EDuration="34.393796047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:59:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:00:08.393483656 +0000 UTC m=+83.883200710" watchObservedRunningTime="2026-09-08 14:00:08.393796047 +0000 UTC m=+83.883513098"
Sep 08 14:00:08.484570 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:08.484520    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 14:00:08.487367 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:08.487344    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 14:00:09.378092 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:09.378032    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7884d946cb-d6ffc" event={"ID":"de01a2fd-fbd9-47ff-9791-1b05fcceb04b","Type":"ContainerStarted","Data":"500f882fd28546025e0e73f83bd98a0c1d4577357162bf45171a639360094898"}
Sep 08 14:00:09.378524 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:09.378260    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 14:00:09.379430 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:09.379409    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-67dfcbc96b-kwbqv"
Sep 08 14:00:09.397734 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:09.397687    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7884d946cb-d6ffc" podStartSLOduration=2.194199989 podStartE2EDuration="7.397674092s" totalImagesPullingTime="5.203474103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:00:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:00:09.396184526 +0000 UTC m=+84.885901578" watchObservedRunningTime="2026-09-08 14:00:09.397674092 +0000 UTC m=+84.887391144"
Sep 08 14:00:10.382004 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:10.381973    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7884d946cb-d6ffc"
Sep 08 14:00:10.383690 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:10.383668    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7884d946cb-d6ffc"
Sep 08 14:00:11.134776 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:11.134738    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gf86m\" (UID: \"56b92c3b-d5b7-401b-b0e5-ae2cb458af12\") " pod="openshift-insights/insights-runtime-extractor-gf86m"
Sep 08 14:00:11.137179 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:11.137149    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56b92c3b-d5b7-401b-b0e5-ae2cb458af12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gf86m\" (UID: \"56b92c3b-d5b7-401b-b0e5-ae2cb458af12\") " pod="openshift-insights/insights-runtime-extractor-gf86m"
Sep 08 14:00:11.172950 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:11.172922    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8q4kl\""
Sep 08 14:00:11.181421 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:11.181402    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gf86m"
Sep 08 14:00:11.478498 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:11.478420    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gf86m"]
Sep 08 14:00:11.481883 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:00:11.481860    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56b92c3b_d5b7_401b_b0e5_ae2cb458af12.slice/crio-ff81272965a4a7e3292ccaa801a2bc44303c34082aeb993cddeb4be84896900e WatchSource:0}: Error finding container ff81272965a4a7e3292ccaa801a2bc44303c34082aeb993cddeb4be84896900e: Status 404 returned error can't find the container with id ff81272965a4a7e3292ccaa801a2bc44303c34082aeb993cddeb4be84896900e
Sep 08 14:00:12.390242 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:12.390211    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gf86m" event={"ID":"56b92c3b-d5b7-401b-b0e5-ae2cb458af12","Type":"ContainerStarted","Data":"1a2b4300d0844b9e58d099115117d000a91647cb2047275e7d6adec189277778"}
Sep 08 14:00:12.390416 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:12.390265    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gf86m" event={"ID":"56b92c3b-d5b7-401b-b0e5-ae2cb458af12","Type":"ContainerStarted","Data":"ff81272965a4a7e3292ccaa801a2bc44303c34082aeb993cddeb4be84896900e"}
Sep 08 14:00:14.400312 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:14.400266    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gf86m" event={"ID":"56b92c3b-d5b7-401b-b0e5-ae2cb458af12","Type":"ContainerStarted","Data":"9c991db61eab6469f25657b17795c0217a03bf1455b2c20fec14fb46c8cb3248"}
Sep 08 14:00:15.405878 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:15.405836    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gf86m" event={"ID":"56b92c3b-d5b7-401b-b0e5-ae2cb458af12","Type":"ContainerStarted","Data":"e6140afea918d6ee246aae8f824efb4ebc2ccb688952d657bec69ed4d0954891"}
Sep 08 14:00:15.425459 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:15.425407    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gf86m" podStartSLOduration=32.907197447 podStartE2EDuration="36.425390973s" totalImagesPullingTime="3.518193526s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:59:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:00:15.424823537 +0000 UTC m=+90.914540589" watchObservedRunningTime="2026-09-08 14:00:15.425390973 +0000 UTC m=+90.915108025"
Sep 08 14:00:18.438524 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.438491    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d9f898499-g4ph7"]
Sep 08 14:00:18.441775 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.441758    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d9f898499-g4ph7"
Sep 08 14:00:18.444207 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.444185    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 08 14:00:18.444320 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.444242    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 14:00:18.444320 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.444255    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 08 14:00:18.445381 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.445357    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 08 14:00:18.445494 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.445381    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6cln7\""
Sep 08 14:00:18.445494 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.445381    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 08 14:00:18.445494 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.445413    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 08 14:00:18.446409 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.446393    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 14:00:18.449188 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.449170    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 08 14:00:18.452340 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.452319    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d9f898499-g4ph7"]
Sep 08 14:00:18.594735 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.594686    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4809da89-f589-40e2-9221-eca185183eca-console-config\") pod \"console-7d9f898499-g4ph7\" (UID: \"4809da89-f589-40e2-9221-eca185183eca\") " pod="openshift-console/console-7d9f898499-g4ph7"
Sep 08 14:00:18.594921 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.594799    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4809da89-f589-40e2-9221-eca185183eca-console-oauth-config\") pod \"console-7d9f898499-g4ph7\" (UID: \"4809da89-f589-40e2-9221-eca185183eca\") " pod="openshift-console/console-7d9f898499-g4ph7"
Sep 08 14:00:18.594921 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.594850    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6d2c\" (UniqueName: \"kubernetes.io/projected/4809da89-f589-40e2-9221-eca185183eca-kube-api-access-q6d2c\") pod \"console-7d9f898499-g4ph7\" (UID: \"4809da89-f589-40e2-9221-eca185183eca\") " pod="openshift-console/console-7d9f898499-g4ph7"
Sep 08 14:00:18.594921 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.594871    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4809da89-f589-40e2-9221-eca185183eca-trusted-ca-bundle\") pod \"console-7d9f898499-g4ph7\" (UID: \"4809da89-f589-40e2-9221-eca185183eca\") " pod="openshift-console/console-7d9f898499-g4ph7"
Sep 08 14:00:18.594921 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.594897    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4809da89-f589-40e2-9221-eca185183eca-console-serving-cert\") pod \"console-7d9f898499-g4ph7\" (UID: \"4809da89-f589-40e2-9221-eca185183eca\") " pod="openshift-console/console-7d9f898499-g4ph7"
Sep 08 14:00:18.594921 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.594913    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4809da89-f589-40e2-9221-eca185183eca-oauth-serving-cert\") pod \"console-7d9f898499-g4ph7\" (UID: \"4809da89-f589-40e2-9221-eca185183eca\") " pod="openshift-console/console-7d9f898499-g4ph7"
Sep 08 14:00:18.595128 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.594934    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4809da89-f589-40e2-9221-eca185183eca-service-ca\") pod \"console-7d9f898499-g4ph7\" (UID: \"4809da89-f589-40e2-9221-eca185183eca\") " pod="openshift-console/console-7d9f898499-g4ph7"
Sep 08 14:00:18.695621 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.695526    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4809da89-f589-40e2-9221-eca185183eca-console-serving-cert\") pod \"console-7d9f898499-g4ph7\" (UID: \"4809da89-f589-40e2-9221-eca185183eca\") " pod="openshift-console/console-7d9f898499-g4ph7"
Sep 08 14:00:18.695621 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.695571    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4809da89-f589-40e2-9221-eca185183eca-oauth-serving-cert\") pod \"console-7d9f898499-g4ph7\" (UID: \"4809da89-f589-40e2-9221-eca185183eca\") " pod="openshift-console/console-7d9f898499-g4ph7"
Sep 08 14:00:18.695621 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.695590    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4809da89-f589-40e2-9221-eca185183eca-service-ca\") pod \"console-7d9f898499-g4ph7\" (UID: \"4809da89-f589-40e2-9221-eca185183eca\") " pod="openshift-console/console-7d9f898499-g4ph7"
Sep 08 14:00:18.695621 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.695618    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4809da89-f589-40e2-9221-eca185183eca-console-config\") pod \"console-7d9f898499-g4ph7\" (UID: \"4809da89-f589-40e2-9221-eca185183eca\") " pod="openshift-console/console-7d9f898499-g4ph7"
Sep 08 14:00:18.695943 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.695786    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4809da89-f589-40e2-9221-eca185183eca-console-oauth-config\") pod \"console-7d9f898499-g4ph7\" (UID: \"4809da89-f589-40e2-9221-eca185183eca\") " pod="openshift-console/console-7d9f898499-g4ph7"
Sep 08 14:00:18.695943 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.695842    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6d2c\" (UniqueName: \"kubernetes.io/projected/4809da89-f589-40e2-9221-eca185183eca-kube-api-access-q6d2c\") pod \"console-7d9f898499-g4ph7\" (UID: \"4809da89-f589-40e2-9221-eca185183eca\") " pod="openshift-console/console-7d9f898499-g4ph7"
Sep 08 14:00:18.695943 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.695867    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4809da89-f589-40e2-9221-eca185183eca-trusted-ca-bundle\") pod \"console-7d9f898499-g4ph7\" (UID: \"4809da89-f589-40e2-9221-eca185183eca\") " pod="openshift-console/console-7d9f898499-g4ph7"
Sep 08 14:00:18.696421 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.696399    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4809da89-f589-40e2-9221-eca185183eca-service-ca\") pod \"console-7d9f898499-g4ph7\" (UID: \"4809da89-f589-40e2-9221-eca185183eca\") " pod="openshift-console/console-7d9f898499-g4ph7"
Sep 08 14:00:18.696506 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.696473    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4809da89-f589-40e2-9221-eca185183eca-console-config\") pod \"console-7d9f898499-g4ph7\" (UID: \"4809da89-f589-40e2-9221-eca185183eca\") " pod="openshift-console/console-7d9f898499-g4ph7"
Sep 08 14:00:18.696542 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.696501    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4809da89-f589-40e2-9221-eca185183eca-oauth-serving-cert\") pod \"console-7d9f898499-g4ph7\" (UID: \"4809da89-f589-40e2-9221-eca185183eca\") " pod="openshift-console/console-7d9f898499-g4ph7"
Sep 08 14:00:18.696648 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.696630    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4809da89-f589-40e2-9221-eca185183eca-trusted-ca-bundle\") pod \"console-7d9f898499-g4ph7\" (UID: \"4809da89-f589-40e2-9221-eca185183eca\") " pod="openshift-console/console-7d9f898499-g4ph7"
Sep 08 14:00:18.698862 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.698838    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4809da89-f589-40e2-9221-eca185183eca-console-serving-cert\") pod \"console-7d9f898499-g4ph7\" (UID: \"4809da89-f589-40e2-9221-eca185183eca\") " pod="openshift-console/console-7d9f898499-g4ph7"
Sep 08 14:00:18.698947 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.698848    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4809da89-f589-40e2-9221-eca185183eca-console-oauth-config\") pod \"console-7d9f898499-g4ph7\" (UID: \"4809da89-f589-40e2-9221-eca185183eca\") " pod="openshift-console/console-7d9f898499-g4ph7"
Sep 08 14:00:18.704357 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.704332    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6d2c\" (UniqueName: \"kubernetes.io/projected/4809da89-f589-40e2-9221-eca185183eca-kube-api-access-q6d2c\") pod \"console-7d9f898499-g4ph7\" (UID: \"4809da89-f589-40e2-9221-eca185183eca\") " pod="openshift-console/console-7d9f898499-g4ph7"
Sep 08 14:00:18.751170 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:18.751143    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d9f898499-g4ph7"
Sep 08 14:00:19.023611 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:19.023552    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d9f898499-g4ph7"]
Sep 08 14:00:19.026126 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:00:19.026100    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4809da89_f589_40e2_9221_eca185183eca.slice/crio-8f083e989e24841bd10229b34c2731b3b7e4bd5713d99aeaf14d5e61bb0d18fc WatchSource:0}: Error finding container 8f083e989e24841bd10229b34c2731b3b7e4bd5713d99aeaf14d5e61bb0d18fc: Status 404 returned error can't find the container with id 8f083e989e24841bd10229b34c2731b3b7e4bd5713d99aeaf14d5e61bb0d18fc
Sep 08 14:00:19.421736 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:19.421703    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d9f898499-g4ph7" event={"ID":"4809da89-f589-40e2-9221-eca185183eca","Type":"ContainerStarted","Data":"8f083e989e24841bd10229b34c2731b3b7e4bd5713d99aeaf14d5e61bb0d18fc"}
Sep 08 14:00:22.434611 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:22.434578    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d9f898499-g4ph7" event={"ID":"4809da89-f589-40e2-9221-eca185183eca","Type":"ContainerStarted","Data":"522b2bf5b7aa0b15f7c3d57f33638598c47451c97e90b2e1565967c0f6cfe318"}
Sep 08 14:00:22.453274 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:22.453231    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d9f898499-g4ph7" podStartSLOduration=1.7751600459999999 podStartE2EDuration="4.453217403s" totalImagesPullingTime="2.678057357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:00:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:00:22.452223462 +0000 UTC m=+97.941940527" watchObservedRunningTime="2026-09-08 14:00:22.453217403 +0000 UTC m=+97.942934454"
Sep 08 14:00:25.362218 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:25.362191    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7d68f4f4fc-jjp8z"
Sep 08 14:00:26.330183 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:26.330150    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vlc72"
Sep 08 14:00:28.694842 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.694808    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-h75cb"]
Sep 08 14:00:28.698229 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.698211    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h75cb"
Sep 08 14:00:28.700873 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.700848    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 08 14:00:28.701049 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.701032    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 08 14:00:28.701901 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.701881    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 08 14:00:28.702013 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.701917    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 08 14:00:28.702013 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.701966    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 08 14:00:28.702013 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.701951    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 08 14:00:28.702013 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.701917    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-phh7g\""
Sep 08 14:00:28.751371 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.751338    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d9f898499-g4ph7"
Sep 08 14:00:28.751493 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.751415    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d9f898499-g4ph7"
Sep 08 14:00:28.756391 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.756372    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d9f898499-g4ph7"
Sep 08 14:00:28.876571 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.876544    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7ckw\" (UniqueName: \"kubernetes.io/projected/8ae0feb5-dc9a-4555-9713-d1f0b2b9498e-kube-api-access-b7ckw\") pod \"node-exporter-h75cb\" (UID: \"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e\") " pod="openshift-monitoring/node-exporter-h75cb"
Sep 08 14:00:28.876835 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.876588    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8ae0feb5-dc9a-4555-9713-d1f0b2b9498e-root\") pod \"node-exporter-h75cb\" (UID: \"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e\") " pod="openshift-monitoring/node-exporter-h75cb"
Sep 08 14:00:28.876835 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.876616    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ae0feb5-dc9a-4555-9713-d1f0b2b9498e-sys\") pod \"node-exporter-h75cb\" (UID: \"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e\") " pod="openshift-monitoring/node-exporter-h75cb"
Sep 08 14:00:28.876835 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.876725    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ae0feb5-dc9a-4555-9713-d1f0b2b9498e-metrics-client-ca\") pod \"node-exporter-h75cb\" (UID: \"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e\") " pod="openshift-monitoring/node-exporter-h75cb"
Sep 08 14:00:28.876835 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.876789    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8ae0feb5-dc9a-4555-9713-d1f0b2b9498e-node-exporter-wtmp\") pod \"node-exporter-h75cb\" (UID: \"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e\") " pod="openshift-monitoring/node-exporter-h75cb"
Sep 08 14:00:28.877049 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.876861    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8ae0feb5-dc9a-4555-9713-d1f0b2b9498e-node-exporter-accelerators-collector-config\") pod \"node-exporter-h75cb\" (UID: \"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e\") " pod="openshift-monitoring/node-exporter-h75cb"
Sep 08 14:00:28.877049 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.876903    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8ae0feb5-dc9a-4555-9713-d1f0b2b9498e-node-exporter-textfile\") pod \"node-exporter-h75cb\" (UID: \"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e\") " pod="openshift-monitoring/node-exporter-h75cb"
Sep 08 14:00:28.877049 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.876941    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ae0feb5-dc9a-4555-9713-d1f0b2b9498e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h75cb\" (UID: \"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e\") " pod="openshift-monitoring/node-exporter-h75cb"
Sep 08 14:00:28.877049 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.876984    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8ae0feb5-dc9a-4555-9713-d1f0b2b9498e-node-exporter-tls\") pod \"node-exporter-h75cb\" (UID: \"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e\") " pod="openshift-monitoring/node-exporter-h75cb"
Sep 08 14:00:28.977576 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.977497    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7ckw\" (UniqueName: \"kubernetes.io/projected/8ae0feb5-dc9a-4555-9713-d1f0b2b9498e-kube-api-access-b7ckw\") pod \"node-exporter-h75cb\" (UID: \"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e\") " pod="openshift-monitoring/node-exporter-h75cb"
Sep 08 14:00:28.977576 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.977530    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8ae0feb5-dc9a-4555-9713-d1f0b2b9498e-root\") pod \"node-exporter-h75cb\" (UID: \"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e\") " pod="openshift-monitoring/node-exporter-h75cb"
Sep 08 14:00:28.977576 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.977556    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ae0feb5-dc9a-4555-9713-d1f0b2b9498e-sys\") pod \"node-exporter-h75cb\" (UID: \"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e\") " pod="openshift-monitoring/node-exporter-h75cb"
Sep 08 14:00:28.977834 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.977583    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ae0feb5-dc9a-4555-9713-d1f0b2b9498e-metrics-client-ca\") pod \"node-exporter-h75cb\" (UID: \"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e\") " pod="openshift-monitoring/node-exporter-h75cb"
Sep 08 14:00:28.977834 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.977641    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ae0feb5-dc9a-4555-9713-d1f0b2b9498e-sys\") pod \"node-exporter-h75cb\" (UID: \"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e\") " pod="openshift-monitoring/node-exporter-h75cb"
Sep 08 14:00:28.977834 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.977641    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8ae0feb5-dc9a-4555-9713-d1f0b2b9498e-root\") pod \"node-exporter-h75cb\" (UID: \"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e\") " pod="openshift-monitoring/node-exporter-h75cb"
Sep 08 14:00:28.977834 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.977666    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8ae0feb5-dc9a-4555-9713-d1f0b2b9498e-node-exporter-wtmp\") pod \"node-exporter-h75cb\" (UID: \"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e\") " pod="openshift-monitoring/node-exporter-h75cb"
Sep 08 14:00:28.977834 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.977725    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8ae0feb5-dc9a-4555-9713-d1f0b2b9498e-node-exporter-accelerators-collector-config\") pod \"node-exporter-h75cb\" (UID: \"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e\") " pod="openshift-monitoring/node-exporter-h75cb"
Sep 08 14:00:28.977834 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.977763    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8ae0feb5-dc9a-4555-9713-d1f0b2b9498e-node-exporter-textfile\") pod \"node-exporter-h75cb\" (UID: \"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e\") " pod="openshift-monitoring/node-exporter-h75cb"
Sep 08 14:00:28.977834 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.977790    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ae0feb5-dc9a-4555-9713-d1f0b2b9498e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h75cb\" (UID: \"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e\") " pod="openshift-monitoring/node-exporter-h75cb"
Sep 08 14:00:28.978183 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.977846    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8ae0feb5-dc9a-4555-9713-d1f0b2b9498e-node-exporter-wtmp\") pod \"node-exporter-h75cb\" (UID: \"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e\") " pod="openshift-monitoring/node-exporter-h75cb"
Sep 08 14:00:28.978183 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.977888    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8ae0feb5-dc9a-4555-9713-d1f0b2b9498e-node-exporter-tls\") pod \"node-exporter-h75cb\" (UID: \"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e\") " pod="openshift-monitoring/node-exporter-h75cb"
Sep 08 14:00:28.978183 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.978088    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ae0feb5-dc9a-4555-9713-d1f0b2b9498e-metrics-client-ca\") pod \"node-exporter-h75cb\" (UID: \"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e\") " pod="openshift-monitoring/node-exporter-h75cb"
Sep 08 14:00:28.978183 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.978106    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8ae0feb5-dc9a-4555-9713-d1f0b2b9498e-node-exporter-textfile\") pod \"node-exporter-h75cb\" (UID: \"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e\") " pod="openshift-monitoring/node-exporter-h75cb"
Sep 08 14:00:28.978350 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.978266    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8ae0feb5-dc9a-4555-9713-d1f0b2b9498e-node-exporter-accelerators-collector-config\") pod \"node-exporter-h75cb\" (UID: \"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e\") " pod="openshift-monitoring/node-exporter-h75cb"
Sep 08 14:00:28.980251 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.980229    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ae0feb5-dc9a-4555-9713-d1f0b2b9498e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h75cb\" (UID: \"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e\") " pod="openshift-monitoring/node-exporter-h75cb"
Sep 08 14:00:28.980422 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.980402    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8ae0feb5-dc9a-4555-9713-d1f0b2b9498e-node-exporter-tls\") pod \"node-exporter-h75cb\" (UID: \"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e\") " pod="openshift-monitoring/node-exporter-h75cb"
Sep 08 14:00:28.986361 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:28.986341    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7ckw\" (UniqueName: \"kubernetes.io/projected/8ae0feb5-dc9a-4555-9713-d1f0b2b9498e-kube-api-access-b7ckw\") pod \"node-exporter-h75cb\" (UID: \"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e\") " pod="openshift-monitoring/node-exporter-h75cb"
Sep 08 14:00:29.007536 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:29.007514    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h75cb"
Sep 08 14:00:29.018114 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:00:29.018094    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ae0feb5_dc9a_4555_9713_d1f0b2b9498e.slice/crio-84e758d45ebbaf857ecdbc30de19dd1ea3bdea360372dd5f562252ece68e1cb0 WatchSource:0}: Error finding container 84e758d45ebbaf857ecdbc30de19dd1ea3bdea360372dd5f562252ece68e1cb0: Status 404 returned error can't find the container with id 84e758d45ebbaf857ecdbc30de19dd1ea3bdea360372dd5f562252ece68e1cb0
Sep 08 14:00:29.458330 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:29.458297    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h75cb" event={"ID":"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e","Type":"ContainerStarted","Data":"84e758d45ebbaf857ecdbc30de19dd1ea3bdea360372dd5f562252ece68e1cb0"}
Sep 08 14:00:29.462018 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:29.461997    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d9f898499-g4ph7"
Sep 08 14:00:30.465146 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:30.465114    2575 generic.go:356] "Generic (PLEG): container finished" podID="8ae0feb5-dc9a-4555-9713-d1f0b2b9498e" containerID="0238d733fdeb8bdce0879c8ced182214644363eb5a4f7b00816667af8e088764" exitCode=0
Sep 08 14:00:30.465555 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:30.465207    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h75cb" event={"ID":"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e","Type":"ContainerDied","Data":"0238d733fdeb8bdce0879c8ced182214644363eb5a4f7b00816667af8e088764"}
Sep 08 14:00:30.798592 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:30.798514    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"]
Sep 08 14:00:30.801034 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:30.801018    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"
Sep 08 14:00:30.803828 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:30.803800    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 08 14:00:30.803973 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:30.803951    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9iohe29geonhk\""
Sep 08 14:00:30.804044 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:30.803972    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 08 14:00:30.804175 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:30.804147    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 08 14:00:30.804175 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:30.804167    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 08 14:00:30.804307 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:30.804291    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 08 14:00:30.804415 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:30.804400    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-95nng\""
Sep 08 14:00:30.817652 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:30.817628    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"]
Sep 08 14:00:30.995234 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:30.995204    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/57a8279f-b611-46c4-b760-97eba0216597-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58bfcf7878-bwgpd\" (UID: \"57a8279f-b611-46c4-b760-97eba0216597\") " pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"
Sep 08 14:00:30.995387 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:30.995250    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/57a8279f-b611-46c4-b760-97eba0216597-secret-grpc-tls\") pod \"thanos-querier-58bfcf7878-bwgpd\" (UID: \"57a8279f-b611-46c4-b760-97eba0216597\") " pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"
Sep 08 14:00:30.995387 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:30.995279    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57a8279f-b611-46c4-b760-97eba0216597-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58bfcf7878-bwgpd\" (UID: \"57a8279f-b611-46c4-b760-97eba0216597\") " pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"
Sep 08 14:00:30.995387 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:30.995307    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57a8279f-b611-46c4-b760-97eba0216597-metrics-client-ca\") pod \"thanos-querier-58bfcf7878-bwgpd\" (UID: \"57a8279f-b611-46c4-b760-97eba0216597\") " pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"
Sep 08 14:00:30.995387 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:30.995334    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/57a8279f-b611-46c4-b760-97eba0216597-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58bfcf7878-bwgpd\" (UID: \"57a8279f-b611-46c4-b760-97eba0216597\") " pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"
Sep 08 14:00:30.995387 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:30.995349    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmchv\" (UniqueName: \"kubernetes.io/projected/57a8279f-b611-46c4-b760-97eba0216597-kube-api-access-zmchv\") pod \"thanos-querier-58bfcf7878-bwgpd\" (UID: \"57a8279f-b611-46c4-b760-97eba0216597\") " pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"
Sep 08 14:00:30.995387 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:30.995371    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57a8279f-b611-46c4-b760-97eba0216597-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58bfcf7878-bwgpd\" (UID: \"57a8279f-b611-46c4-b760-97eba0216597\") " pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"
Sep 08 14:00:30.995569 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:30.995413    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/57a8279f-b611-46c4-b760-97eba0216597-secret-thanos-querier-tls\") pod \"thanos-querier-58bfcf7878-bwgpd\" (UID: \"57a8279f-b611-46c4-b760-97eba0216597\") " pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"
Sep 08 14:00:31.096517 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:31.096492    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/57a8279f-b611-46c4-b760-97eba0216597-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58bfcf7878-bwgpd\" (UID: \"57a8279f-b611-46c4-b760-97eba0216597\") " pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"
Sep 08 14:00:31.096611 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:31.096537    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/57a8279f-b611-46c4-b760-97eba0216597-secret-grpc-tls\") pod \"thanos-querier-58bfcf7878-bwgpd\" (UID: \"57a8279f-b611-46c4-b760-97eba0216597\") " pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"
Sep 08 14:00:31.096664 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:31.096644    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57a8279f-b611-46c4-b760-97eba0216597-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58bfcf7878-bwgpd\" (UID: \"57a8279f-b611-46c4-b760-97eba0216597\") " pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"
Sep 08 14:00:31.096697 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:31.096679    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57a8279f-b611-46c4-b760-97eba0216597-metrics-client-ca\") pod \"thanos-querier-58bfcf7878-bwgpd\" (UID: \"57a8279f-b611-46c4-b760-97eba0216597\") " pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"
Sep 08 14:00:31.096730 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:31.096707    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/57a8279f-b611-46c4-b760-97eba0216597-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58bfcf7878-bwgpd\" (UID: \"57a8279f-b611-46c4-b760-97eba0216597\") " pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"
Sep 08 14:00:31.096730 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:31.096723    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmchv\" (UniqueName: \"kubernetes.io/projected/57a8279f-b611-46c4-b760-97eba0216597-kube-api-access-zmchv\") pod \"thanos-querier-58bfcf7878-bwgpd\" (UID: \"57a8279f-b611-46c4-b760-97eba0216597\") " pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"
Sep 08 14:00:31.096807 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:31.096748    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57a8279f-b611-46c4-b760-97eba0216597-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58bfcf7878-bwgpd\" (UID: \"57a8279f-b611-46c4-b760-97eba0216597\") " pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"
Sep 08 14:00:31.096807 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:31.096778    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/57a8279f-b611-46c4-b760-97eba0216597-secret-thanos-querier-tls\") pod \"thanos-querier-58bfcf7878-bwgpd\" (UID: \"57a8279f-b611-46c4-b760-97eba0216597\") " pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"
Sep 08 14:00:31.097658 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:31.097633    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57a8279f-b611-46c4-b760-97eba0216597-metrics-client-ca\") pod \"thanos-querier-58bfcf7878-bwgpd\" (UID: \"57a8279f-b611-46c4-b760-97eba0216597\") " pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"
Sep 08 14:00:31.099415 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:31.099391    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/57a8279f-b611-46c4-b760-97eba0216597-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58bfcf7878-bwgpd\" (UID: \"57a8279f-b611-46c4-b760-97eba0216597\") " pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"
Sep 08 14:00:31.099506 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:31.099492    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57a8279f-b611-46c4-b760-97eba0216597-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58bfcf7878-bwgpd\" (UID: \"57a8279f-b611-46c4-b760-97eba0216597\") " pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"
Sep 08 14:00:31.099673 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:31.099655    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/57a8279f-b611-46c4-b760-97eba0216597-secret-grpc-tls\") pod \"thanos-querier-58bfcf7878-bwgpd\" (UID: \"57a8279f-b611-46c4-b760-97eba0216597\") " pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"
Sep 08 14:00:31.099757 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:31.099682    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/57a8279f-b611-46c4-b760-97eba0216597-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58bfcf7878-bwgpd\" (UID: \"57a8279f-b611-46c4-b760-97eba0216597\") " pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"
Sep 08 14:00:31.099916 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:31.099885    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57a8279f-b611-46c4-b760-97eba0216597-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58bfcf7878-bwgpd\" (UID: \"57a8279f-b611-46c4-b760-97eba0216597\") " pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"
Sep 08 14:00:31.100205 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:31.100187    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/57a8279f-b611-46c4-b760-97eba0216597-secret-thanos-querier-tls\") pod \"thanos-querier-58bfcf7878-bwgpd\" (UID: \"57a8279f-b611-46c4-b760-97eba0216597\") " pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"
Sep 08 14:00:31.110722 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:31.110702    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmchv\" (UniqueName: \"kubernetes.io/projected/57a8279f-b611-46c4-b760-97eba0216597-kube-api-access-zmchv\") pod \"thanos-querier-58bfcf7878-bwgpd\" (UID: \"57a8279f-b611-46c4-b760-97eba0216597\") " pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"
Sep 08 14:00:31.410315 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:31.410201    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"
Sep 08 14:00:31.473381 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:31.473351    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h75cb" event={"ID":"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e","Type":"ContainerStarted","Data":"801a3f25c0629d40fe6de24c145eb33b16f0fc44f54096a303b85dddd3d0005e"}
Sep 08 14:00:31.473686 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:31.473405    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h75cb" event={"ID":"8ae0feb5-dc9a-4555-9713-d1f0b2b9498e","Type":"ContainerStarted","Data":"c59d1a6960fa9181d8bd61737cfca04c319554ae5bbbcaf7de16e7bd2a50ac11"}
Sep 08 14:00:31.496711 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:31.496660    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-h75cb" podStartSLOduration=2.378665189 podStartE2EDuration="3.496643677s" totalImagesPullingTime="1.04689254s" totalInitContainerRuntime="71.085948ms" isStatefulPod=true podCreationTimestamp="2026-09-08 14:00:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:00:31.495499616 +0000 UTC m=+106.985216669" watchObservedRunningTime="2026-09-08 14:00:31.496643677 +0000 UTC m=+106.986360729"
Sep 08 14:00:31.690617 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:31.690549    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"]
Sep 08 14:00:31.693399 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:00:31.693378    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57a8279f_b611_46c4_b760_97eba0216597.slice/crio-9b9263b2d8deecc075970f81f8a89e04bab13fe86fbb2cd607de867491b695e2 WatchSource:0}: Error finding container 9b9263b2d8deecc075970f81f8a89e04bab13fe86fbb2cd607de867491b695e2: Status 404 returned error can't find the container with id 9b9263b2d8deecc075970f81f8a89e04bab13fe86fbb2cd607de867491b695e2
Sep 08 14:00:32.478113 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:32.478080    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd" event={"ID":"57a8279f-b611-46c4-b760-97eba0216597","Type":"ContainerStarted","Data":"9b9263b2d8deecc075970f81f8a89e04bab13fe86fbb2cd607de867491b695e2"}
Sep 08 14:00:33.452263 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:33.452233    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-qxlpn"]
Sep 08 14:00:33.455193 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:33.455177    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-qxlpn"
Sep 08 14:00:33.459767 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:33.459749    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jwjjh\""
Sep 08 14:00:33.463181 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:33.463161    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 08 14:00:33.466967 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:33.466945    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-qxlpn"]
Sep 08 14:00:33.513866 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:33.513841    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/92ea9d31-0c61-4d57-a8ea-cbca2b70b0ad-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-qxlpn\" (UID: \"92ea9d31-0c61-4d57-a8ea-cbca2b70b0ad\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-qxlpn"
Sep 08 14:00:33.514191 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:33.513876    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvntq\" (UniqueName: \"kubernetes.io/projected/92ea9d31-0c61-4d57-a8ea-cbca2b70b0ad-kube-api-access-dvntq\") pod \"monitoring-plugin-85bbbbbf4-qxlpn\" (UID: \"92ea9d31-0c61-4d57-a8ea-cbca2b70b0ad\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-qxlpn"
Sep 08 14:00:33.614720 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:33.614693    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/92ea9d31-0c61-4d57-a8ea-cbca2b70b0ad-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-qxlpn\" (UID: \"92ea9d31-0c61-4d57-a8ea-cbca2b70b0ad\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-qxlpn"
Sep 08 14:00:33.614822 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:33.614729    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvntq\" (UniqueName: \"kubernetes.io/projected/92ea9d31-0c61-4d57-a8ea-cbca2b70b0ad-kube-api-access-dvntq\") pod \"monitoring-plugin-85bbbbbf4-qxlpn\" (UID: \"92ea9d31-0c61-4d57-a8ea-cbca2b70b0ad\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-qxlpn"
Sep 08 14:00:33.617194 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:33.617174    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/92ea9d31-0c61-4d57-a8ea-cbca2b70b0ad-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-qxlpn\" (UID: \"92ea9d31-0c61-4d57-a8ea-cbca2b70b0ad\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-qxlpn"
Sep 08 14:00:33.624363 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:33.624344    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvntq\" (UniqueName: \"kubernetes.io/projected/92ea9d31-0c61-4d57-a8ea-cbca2b70b0ad-kube-api-access-dvntq\") pod \"monitoring-plugin-85bbbbbf4-qxlpn\" (UID: \"92ea9d31-0c61-4d57-a8ea-cbca2b70b0ad\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-qxlpn"
Sep 08 14:00:33.763555 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:33.763484    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-qxlpn"
Sep 08 14:00:34.034687 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:34.034618    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-qxlpn"]
Sep 08 14:00:34.037210 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:00:34.037182    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92ea9d31_0c61_4d57_a8ea_cbca2b70b0ad.slice/crio-6fea0bce9eb35f9f25370a01a0efc18b19bcf84998b1a9216c964ed7d38ef16d WatchSource:0}: Error finding container 6fea0bce9eb35f9f25370a01a0efc18b19bcf84998b1a9216c964ed7d38ef16d: Status 404 returned error can't find the container with id 6fea0bce9eb35f9f25370a01a0efc18b19bcf84998b1a9216c964ed7d38ef16d
Sep 08 14:00:34.488780 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:34.488746    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-qxlpn" event={"ID":"92ea9d31-0c61-4d57-a8ea-cbca2b70b0ad","Type":"ContainerStarted","Data":"6fea0bce9eb35f9f25370a01a0efc18b19bcf84998b1a9216c964ed7d38ef16d"}
Sep 08 14:00:35.494904 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:35.494864    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-qxlpn" event={"ID":"92ea9d31-0c61-4d57-a8ea-cbca2b70b0ad","Type":"ContainerStarted","Data":"521adc46f6e42e233d7c7f5de3cac83a9ab21ee93900dc93db7fc1aa3c1e48aa"}
Sep 08 14:00:35.495382 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:35.495098    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-qxlpn"
Sep 08 14:00:35.500709 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:35.500689    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-qxlpn"
Sep 08 14:00:35.519726 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:35.519679    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-qxlpn" podStartSLOduration=1.269319431 podStartE2EDuration="2.519666311s" totalImagesPullingTime="1.25034688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:00:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:00:35.51790396 +0000 UTC m=+111.007621013" watchObservedRunningTime="2026-09-08 14:00:35.519666311 +0000 UTC m=+111.009383363"
Sep 08 14:00:36.500575 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:36.500547    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd" event={"ID":"57a8279f-b611-46c4-b760-97eba0216597","Type":"ContainerStarted","Data":"ed0f877f39d6e587374590e3d00a62dde1faa400e18d3fa38912aa2375abba5c"}
Sep 08 14:00:36.500961 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:36.500617    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd" event={"ID":"57a8279f-b611-46c4-b760-97eba0216597","Type":"ContainerStarted","Data":"bbf9f51611840289955860b8e295db2aaa19c458e21b162acdf9b9c229781512"}
Sep 08 14:00:36.500961 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:36.500643    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd" event={"ID":"57a8279f-b611-46c4-b760-97eba0216597","Type":"ContainerStarted","Data":"508afb76bb822cc75d043015539612e74410906766c03e79d529c44a29f913f9"}
Sep 08 14:00:40.517775 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:40.517736    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd" event={"ID":"57a8279f-b611-46c4-b760-97eba0216597","Type":"ContainerStarted","Data":"33581502e4cbf8d69a0b26abbfdb7b7920bf942e58772994c4e4099e9c769262"}
Sep 08 14:00:40.518234 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:40.517800    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd" event={"ID":"57a8279f-b611-46c4-b760-97eba0216597","Type":"ContainerStarted","Data":"7381d988302ef9d898f1ccbbda7b7d22f6d95afd13a785667355e45c4af1e684"}
Sep 08 14:00:40.518234 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:40.517827    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd" event={"ID":"57a8279f-b611-46c4-b760-97eba0216597","Type":"ContainerStarted","Data":"cda6392d84cb5b9eabd0584541e635164d363aaff911ee711d9f0149d7c26193"}
Sep 08 14:00:40.518234 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:40.517858    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"
Sep 08 14:00:40.548203 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:40.548155    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd" podStartSLOduration=2.988576939 podStartE2EDuration="10.548140841s" totalImagesPullingTime="7.559563902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:00:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:00:40.547939169 +0000 UTC m=+116.037656225" watchObservedRunningTime="2026-09-08 14:00:40.548140841 +0000 UTC m=+116.037857889"
Sep 08 14:00:41.530102 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:41.530042    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-58bfcf7878-bwgpd"
Sep 08 14:00:43.532607 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:43.532573    2575 generic.go:356] "Generic (PLEG): container finished" podID="01796da0-49e5-4cde-b7fd-65daca0cb46d" containerID="ff04c52ecb571738b91c7f4fec78664bb020df7c4055209bbe156c30384466cd" exitCode=0
Sep 08 14:00:43.533109 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:43.532613    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wndrq" event={"ID":"01796da0-49e5-4cde-b7fd-65daca0cb46d","Type":"ContainerDied","Data":"ff04c52ecb571738b91c7f4fec78664bb020df7c4055209bbe156c30384466cd"}
Sep 08 14:00:43.533109 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:43.532987    2575 scope.go:117] "RemoveContainer" containerID="ff04c52ecb571738b91c7f4fec78664bb020df7c4055209bbe156c30384466cd"
Sep 08 14:00:44.538237 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:44.538199    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wndrq" event={"ID":"01796da0-49e5-4cde-b7fd-65daca0cb46d","Type":"ContainerStarted","Data":"30faac8196a3db0360e81370bb3e8a7c004d4fc1b54bc5d93dd70a7d3751ff2c"}
Sep 08 14:00:49.319882 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:49.319849    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d9f898499-g4ph7"]
Sep 08 14:00:53.778096 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:53.778038    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0323060-7649-4e6c-b078-dbe218838e63-metrics-certs\") pod \"network-metrics-daemon-2qkhb\" (UID: \"b0323060-7649-4e6c-b078-dbe218838e63\") " pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 14:00:53.780489 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:53.780465    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0323060-7649-4e6c-b078-dbe218838e63-metrics-certs\") pod \"network-metrics-daemon-2qkhb\" (UID: \"b0323060-7649-4e6c-b078-dbe218838e63\") " pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 14:00:53.989907 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:53.989823    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r4t74\""
Sep 08 14:00:53.997902 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:53.997884    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qkhb"
Sep 08 14:00:54.265275 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:54.265189    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2qkhb"]
Sep 08 14:00:54.268932 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:00:54.268908    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0323060_7649_4e6c_b078_dbe218838e63.slice/crio-3116a4d4fbdf165e7964681dbade81e5d517980efa878b9a3fb02a9833affce4 WatchSource:0}: Error finding container 3116a4d4fbdf165e7964681dbade81e5d517980efa878b9a3fb02a9833affce4: Status 404 returned error can't find the container with id 3116a4d4fbdf165e7964681dbade81e5d517980efa878b9a3fb02a9833affce4
Sep 08 14:00:54.576437 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:54.576397    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2qkhb" event={"ID":"b0323060-7649-4e6c-b078-dbe218838e63","Type":"ContainerStarted","Data":"3116a4d4fbdf165e7964681dbade81e5d517980efa878b9a3fb02a9833affce4"}
Sep 08 14:00:54.577780 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:54.577757    2575 generic.go:356] "Generic (PLEG): container finished" podID="b9569fb9-c094-4484-945f-ff275f85fd61" containerID="cbb3f14c58b49ff291ec1e7f6561eaec34ae812226317eebad8151b63b3987d8" exitCode=0
Sep 08 14:00:54.577875 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:54.577814    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-xnk8k" event={"ID":"b9569fb9-c094-4484-945f-ff275f85fd61","Type":"ContainerDied","Data":"cbb3f14c58b49ff291ec1e7f6561eaec34ae812226317eebad8151b63b3987d8"}
Sep 08 14:00:54.578172 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:54.578152    2575 scope.go:117] "RemoveContainer" containerID="cbb3f14c58b49ff291ec1e7f6561eaec34ae812226317eebad8151b63b3987d8"
Sep 08 14:00:55.509604 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:55.509580    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67dfcbc96b-kwbqv_d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5/router/0.log"
Sep 08 14:00:55.530193 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:55.530170    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d5h6j_7c2eb712-1aa9-4d8b-adb5-521fde6a5169/serve-healthcheck-canary/0.log"
Sep 08 14:00:55.584953 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:55.584418    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-xnk8k" event={"ID":"b9569fb9-c094-4484-945f-ff275f85fd61","Type":"ContainerStarted","Data":"08e287d403d1c35c029a06722ae9f4b10e4f6af4c565ae8a27bd81e21eee7f43"}
Sep 08 14:00:55.586198 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:55.586166    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2qkhb" event={"ID":"b0323060-7649-4e6c-b078-dbe218838e63","Type":"ContainerStarted","Data":"a61c9692b41b3461a18e12a4bf0ebe6c9d8b2327c85cea0ce128d5ab962d0789"}
Sep 08 14:00:56.591726 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:56.591685    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2qkhb" event={"ID":"b0323060-7649-4e6c-b078-dbe218838e63","Type":"ContainerStarted","Data":"486b1728f7ea1db66bf29a15aec1d3bb7b15dfbe7acf03c59aa0391ef011f1a3"}
Sep 08 14:00:56.609520 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:00:56.609474    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2qkhb" podStartSLOduration=130.432956295 podStartE2EDuration="2m11.609459622s" totalImagesPullingTime="1.176503327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:00:56.608751994 +0000 UTC m=+132.098469050" watchObservedRunningTime="2026-09-08 14:00:56.609459622 +0000 UTC m=+132.099176850"
Sep 08 14:01:14.339555 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.339493    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d9f898499-g4ph7" podUID="4809da89-f589-40e2-9221-eca185183eca" containerName="console" containerID="cri-o://522b2bf5b7aa0b15f7c3d57f33638598c47451c97e90b2e1565967c0f6cfe318" gracePeriod=15
Sep 08 14:01:14.579853 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.579828    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d9f898499-g4ph7"
Sep 08 14:01:14.664175 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.664088    2575 generic.go:356] "Generic (PLEG): container finished" podID="4809da89-f589-40e2-9221-eca185183eca" containerID="522b2bf5b7aa0b15f7c3d57f33638598c47451c97e90b2e1565967c0f6cfe318" exitCode=0
Sep 08 14:01:14.664175 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.664141    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d9f898499-g4ph7"
Sep 08 14:01:14.664175 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.664166    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d9f898499-g4ph7" event={"ID":"4809da89-f589-40e2-9221-eca185183eca","Type":"ContainerDied","Data":"522b2bf5b7aa0b15f7c3d57f33638598c47451c97e90b2e1565967c0f6cfe318"}
Sep 08 14:01:14.664433 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.664219    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d9f898499-g4ph7" event={"ID":"4809da89-f589-40e2-9221-eca185183eca","Type":"ContainerDied","Data":"8f083e989e24841bd10229b34c2731b3b7e4bd5713d99aeaf14d5e61bb0d18fc"}
Sep 08 14:01:14.664433 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.664244    2575 scope.go:117] "RemoveContainer" containerID="522b2bf5b7aa0b15f7c3d57f33638598c47451c97e90b2e1565967c0f6cfe318"
Sep 08 14:01:14.672366 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.672349    2575 scope.go:117] "RemoveContainer" containerID="522b2bf5b7aa0b15f7c3d57f33638598c47451c97e90b2e1565967c0f6cfe318"
Sep 08 14:01:14.672633 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:01:14.672616    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"522b2bf5b7aa0b15f7c3d57f33638598c47451c97e90b2e1565967c0f6cfe318\": container with ID starting with 522b2bf5b7aa0b15f7c3d57f33638598c47451c97e90b2e1565967c0f6cfe318 not found: ID does not exist" containerID="522b2bf5b7aa0b15f7c3d57f33638598c47451c97e90b2e1565967c0f6cfe318"
Sep 08 14:01:14.672683 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.672643    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"522b2bf5b7aa0b15f7c3d57f33638598c47451c97e90b2e1565967c0f6cfe318"} err="failed to get container status \"522b2bf5b7aa0b15f7c3d57f33638598c47451c97e90b2e1565967c0f6cfe318\": rpc error: code = NotFound desc = could not find container \"522b2bf5b7aa0b15f7c3d57f33638598c47451c97e90b2e1565967c0f6cfe318\": container with ID starting with 522b2bf5b7aa0b15f7c3d57f33638598c47451c97e90b2e1565967c0f6cfe318 not found: ID does not exist"
Sep 08 14:01:14.739479 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.739454    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4809da89-f589-40e2-9221-eca185183eca-console-oauth-config\") pod \"4809da89-f589-40e2-9221-eca185183eca\" (UID: \"4809da89-f589-40e2-9221-eca185183eca\") "
Sep 08 14:01:14.739598 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.739483    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6d2c\" (UniqueName: \"kubernetes.io/projected/4809da89-f589-40e2-9221-eca185183eca-kube-api-access-q6d2c\") pod \"4809da89-f589-40e2-9221-eca185183eca\" (UID: \"4809da89-f589-40e2-9221-eca185183eca\") "
Sep 08 14:01:14.739598 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.739513    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4809da89-f589-40e2-9221-eca185183eca-console-config\") pod \"4809da89-f589-40e2-9221-eca185183eca\" (UID: \"4809da89-f589-40e2-9221-eca185183eca\") "
Sep 08 14:01:14.739706 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.739634    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4809da89-f589-40e2-9221-eca185183eca-oauth-serving-cert\") pod \"4809da89-f589-40e2-9221-eca185183eca\" (UID: \"4809da89-f589-40e2-9221-eca185183eca\") "
Sep 08 14:01:14.739706 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.739673    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4809da89-f589-40e2-9221-eca185183eca-service-ca\") pod \"4809da89-f589-40e2-9221-eca185183eca\" (UID: \"4809da89-f589-40e2-9221-eca185183eca\") "
Sep 08 14:01:14.739706 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.739697    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4809da89-f589-40e2-9221-eca185183eca-trusted-ca-bundle\") pod \"4809da89-f589-40e2-9221-eca185183eca\" (UID: \"4809da89-f589-40e2-9221-eca185183eca\") "
Sep 08 14:01:14.739851 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.739720    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4809da89-f589-40e2-9221-eca185183eca-console-serving-cert\") pod \"4809da89-f589-40e2-9221-eca185183eca\" (UID: \"4809da89-f589-40e2-9221-eca185183eca\") "
Sep 08 14:01:14.739988 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.739967    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4809da89-f589-40e2-9221-eca185183eca-console-config" (OuterVolumeSpecName: "console-config") pod "4809da89-f589-40e2-9221-eca185183eca" (UID: "4809da89-f589-40e2-9221-eca185183eca"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:01:14.740200 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.740093    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4809da89-f589-40e2-9221-eca185183eca-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4809da89-f589-40e2-9221-eca185183eca" (UID: "4809da89-f589-40e2-9221-eca185183eca"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:01:14.740200 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.740145    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4809da89-f589-40e2-9221-eca185183eca-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4809da89-f589-40e2-9221-eca185183eca" (UID: "4809da89-f589-40e2-9221-eca185183eca"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:01:14.740200 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.740149    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4809da89-f589-40e2-9221-eca185183eca-service-ca" (OuterVolumeSpecName: "service-ca") pod "4809da89-f589-40e2-9221-eca185183eca" (UID: "4809da89-f589-40e2-9221-eca185183eca"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:01:14.741877 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.741854    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4809da89-f589-40e2-9221-eca185183eca-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4809da89-f589-40e2-9221-eca185183eca" (UID: "4809da89-f589-40e2-9221-eca185183eca"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:01:14.741955 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.741899    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4809da89-f589-40e2-9221-eca185183eca-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4809da89-f589-40e2-9221-eca185183eca" (UID: "4809da89-f589-40e2-9221-eca185183eca"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:01:14.741955 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.741917    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4809da89-f589-40e2-9221-eca185183eca-kube-api-access-q6d2c" (OuterVolumeSpecName: "kube-api-access-q6d2c") pod "4809da89-f589-40e2-9221-eca185183eca" (UID: "4809da89-f589-40e2-9221-eca185183eca"). InnerVolumeSpecName "kube-api-access-q6d2c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:01:14.840726 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.840705    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4809da89-f589-40e2-9221-eca185183eca-service-ca\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:01:14.840726 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.840724    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4809da89-f589-40e2-9221-eca185183eca-trusted-ca-bundle\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:01:14.840860 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.840732    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4809da89-f589-40e2-9221-eca185183eca-console-serving-cert\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:01:14.840860 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.840742    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4809da89-f589-40e2-9221-eca185183eca-console-oauth-config\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:01:14.840860 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.840757    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6d2c\" (UniqueName: \"kubernetes.io/projected/4809da89-f589-40e2-9221-eca185183eca-kube-api-access-q6d2c\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:01:14.840860 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.840771    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4809da89-f589-40e2-9221-eca185183eca-console-config\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:01:14.840860 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.840779    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4809da89-f589-40e2-9221-eca185183eca-oauth-serving-cert\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:01:14.988022 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.987984    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d9f898499-g4ph7"]
Sep 08 14:01:14.991827 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:14.991804    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d9f898499-g4ph7"]
Sep 08 14:01:16.973142 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:01:16.973104    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4809da89-f589-40e2-9221-eca185183eca" path="/var/lib/kubelet/pods/4809da89-f589-40e2-9221-eca185183eca/volumes"
Sep 08 14:02:40.479397 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:40.479364    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954emgdtr"]
Sep 08 14:02:40.479817 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:40.479677    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4809da89-f589-40e2-9221-eca185183eca" containerName="console"
Sep 08 14:02:40.479817 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:40.479688    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4809da89-f589-40e2-9221-eca185183eca" containerName="console"
Sep 08 14:02:40.479817 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:40.479758    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4809da89-f589-40e2-9221-eca185183eca" containerName="console"
Sep 08 14:02:40.482708 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:40.482692    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954emgdtr"
Sep 08 14:02:40.485412 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:40.485392    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 14:02:40.486459 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:40.486443    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4hd7f\""
Sep 08 14:02:40.486527 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:40.486443    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 14:02:40.499551 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:40.496481    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954emgdtr"]
Sep 08 14:02:40.549020 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:40.548988    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b11f507-56ca-4d6a-98ba-64a967e84244-bundle\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954emgdtr\" (UID: \"3b11f507-56ca-4d6a-98ba-64a967e84244\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954emgdtr"
Sep 08 14:02:40.549020 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:40.549024    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b11f507-56ca-4d6a-98ba-64a967e84244-util\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954emgdtr\" (UID: \"3b11f507-56ca-4d6a-98ba-64a967e84244\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954emgdtr"
Sep 08 14:02:40.549199 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:40.549077    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjqd5\" (UniqueName: \"kubernetes.io/projected/3b11f507-56ca-4d6a-98ba-64a967e84244-kube-api-access-tjqd5\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954emgdtr\" (UID: \"3b11f507-56ca-4d6a-98ba-64a967e84244\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954emgdtr"
Sep 08 14:02:40.649923 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:40.649885    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b11f507-56ca-4d6a-98ba-64a967e84244-util\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954emgdtr\" (UID: \"3b11f507-56ca-4d6a-98ba-64a967e84244\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954emgdtr"
Sep 08 14:02:40.650042 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:40.649942    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjqd5\" (UniqueName: \"kubernetes.io/projected/3b11f507-56ca-4d6a-98ba-64a967e84244-kube-api-access-tjqd5\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954emgdtr\" (UID: \"3b11f507-56ca-4d6a-98ba-64a967e84244\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954emgdtr"
Sep 08 14:02:40.650042 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:40.649977    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b11f507-56ca-4d6a-98ba-64a967e84244-bundle\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954emgdtr\" (UID: \"3b11f507-56ca-4d6a-98ba-64a967e84244\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954emgdtr"
Sep 08 14:02:40.650314 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:40.650296    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b11f507-56ca-4d6a-98ba-64a967e84244-util\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954emgdtr\" (UID: \"3b11f507-56ca-4d6a-98ba-64a967e84244\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954emgdtr"
Sep 08 14:02:40.650362 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:40.650306    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b11f507-56ca-4d6a-98ba-64a967e84244-bundle\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954emgdtr\" (UID: \"3b11f507-56ca-4d6a-98ba-64a967e84244\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954emgdtr"
Sep 08 14:02:40.659925 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:40.659895    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjqd5\" (UniqueName: \"kubernetes.io/projected/3b11f507-56ca-4d6a-98ba-64a967e84244-kube-api-access-tjqd5\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954emgdtr\" (UID: \"3b11f507-56ca-4d6a-98ba-64a967e84244\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954emgdtr"
Sep 08 14:02:40.791512 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:40.791458    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954emgdtr"
Sep 08 14:02:41.065038 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:41.064962    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954emgdtr"]
Sep 08 14:02:41.067555 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:02:41.067529    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b11f507_56ca_4d6a_98ba_64a967e84244.slice/crio-9e186fe643eedcbaf7aac40ffad7af664f149b88f3e8373b9abc6c11551c4b3f WatchSource:0}: Error finding container 9e186fe643eedcbaf7aac40ffad7af664f149b88f3e8373b9abc6c11551c4b3f: Status 404 returned error can't find the container with id 9e186fe643eedcbaf7aac40ffad7af664f149b88f3e8373b9abc6c11551c4b3f
Sep 08 14:02:41.971047 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:41.971012    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954emgdtr" event={"ID":"3b11f507-56ca-4d6a-98ba-64a967e84244","Type":"ContainerStarted","Data":"9e186fe643eedcbaf7aac40ffad7af664f149b88f3e8373b9abc6c11551c4b3f"}
Sep 08 14:02:44.133764 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.133730    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"]
Sep 08 14:02:44.138540 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.138518    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:44.141119 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.141092    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 14:02:44.141235 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.141126    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-dp8qz\""
Sep 08 14:02:44.150811 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.150790    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"]
Sep 08 14:02:44.181574 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.181544    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdz4j\" (UniqueName: \"kubernetes.io/projected/c96b73a0-662e-4995-b19f-14015a3e664f-kube-api-access-mdz4j\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rvlrc\" (UID: \"c96b73a0-662e-4995-b19f-14015a3e664f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:44.181700 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.181586    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c96b73a0-662e-4995-b19f-14015a3e664f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rvlrc\" (UID: \"c96b73a0-662e-4995-b19f-14015a3e664f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:44.181700 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.181621    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c96b73a0-662e-4995-b19f-14015a3e664f-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rvlrc\" (UID: \"c96b73a0-662e-4995-b19f-14015a3e664f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:44.181700 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.181647    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c96b73a0-662e-4995-b19f-14015a3e664f-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rvlrc\" (UID: \"c96b73a0-662e-4995-b19f-14015a3e664f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:44.181700 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.181663    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c96b73a0-662e-4995-b19f-14015a3e664f-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rvlrc\" (UID: \"c96b73a0-662e-4995-b19f-14015a3e664f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:44.181884 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.181731    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c96b73a0-662e-4995-b19f-14015a3e664f-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rvlrc\" (UID: \"c96b73a0-662e-4995-b19f-14015a3e664f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:44.181884 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.181762    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c96b73a0-662e-4995-b19f-14015a3e664f-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rvlrc\" (UID: \"c96b73a0-662e-4995-b19f-14015a3e664f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:44.181884 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.181818    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c96b73a0-662e-4995-b19f-14015a3e664f-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rvlrc\" (UID: \"c96b73a0-662e-4995-b19f-14015a3e664f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:44.181884 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.181834    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c96b73a0-662e-4995-b19f-14015a3e664f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rvlrc\" (UID: \"c96b73a0-662e-4995-b19f-14015a3e664f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:44.218724 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.218697    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"]
Sep 08 14:02:44.222115 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.222091    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:44.225277 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.225254    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-fm7ww\""
Sep 08 14:02:44.241527 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.241501    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"]
Sep 08 14:02:44.282418 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.282393    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c96b73a0-662e-4995-b19f-14015a3e664f-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rvlrc\" (UID: \"c96b73a0-662e-4995-b19f-14015a3e664f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:44.282547 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.282436    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c96b73a0-662e-4995-b19f-14015a3e664f-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rvlrc\" (UID: \"c96b73a0-662e-4995-b19f-14015a3e664f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:44.282547 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.282453    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c96b73a0-662e-4995-b19f-14015a3e664f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rvlrc\" (UID: \"c96b73a0-662e-4995-b19f-14015a3e664f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:44.282547 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.282486    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m\" (UID: \"493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:44.282547 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.282512    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m\" (UID: \"493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:44.282547 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.282535    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd6vx\" (UniqueName: \"kubernetes.io/projected/493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad-kube-api-access-wd6vx\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m\" (UID: \"493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:44.282898 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.282566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdz4j\" (UniqueName: \"kubernetes.io/projected/c96b73a0-662e-4995-b19f-14015a3e664f-kube-api-access-mdz4j\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rvlrc\" (UID: \"c96b73a0-662e-4995-b19f-14015a3e664f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:44.282898 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.282598    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c96b73a0-662e-4995-b19f-14015a3e664f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rvlrc\" (UID: \"c96b73a0-662e-4995-b19f-14015a3e664f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:44.282898 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.282623    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c96b73a0-662e-4995-b19f-14015a3e664f-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rvlrc\" (UID: \"c96b73a0-662e-4995-b19f-14015a3e664f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:44.282898 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.282729    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c96b73a0-662e-4995-b19f-14015a3e664f-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rvlrc\" (UID: \"c96b73a0-662e-4995-b19f-14015a3e664f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:44.282898 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.282754    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m\" (UID: \"493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:44.282898 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.282787    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c96b73a0-662e-4995-b19f-14015a3e664f-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rvlrc\" (UID: \"c96b73a0-662e-4995-b19f-14015a3e664f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:44.282898 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.282811    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m\" (UID: \"493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:44.282898 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.282845    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m\" (UID: \"493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:44.282898 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.282876    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m\" (UID: \"493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:44.283375 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.282918    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m\" (UID: \"493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:44.283375 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.282974    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c96b73a0-662e-4995-b19f-14015a3e664f-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rvlrc\" (UID: \"c96b73a0-662e-4995-b19f-14015a3e664f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:44.283375 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.282998    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m\" (UID: \"493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:44.283375 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.282973    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c96b73a0-662e-4995-b19f-14015a3e664f-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rvlrc\" (UID: \"c96b73a0-662e-4995-b19f-14015a3e664f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:44.283375 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.283079    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c96b73a0-662e-4995-b19f-14015a3e664f-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rvlrc\" (UID: \"c96b73a0-662e-4995-b19f-14015a3e664f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:44.283622 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.283486    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c96b73a0-662e-4995-b19f-14015a3e664f-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rvlrc\" (UID: \"c96b73a0-662e-4995-b19f-14015a3e664f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:44.283667 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.283620    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c96b73a0-662e-4995-b19f-14015a3e664f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rvlrc\" (UID: \"c96b73a0-662e-4995-b19f-14015a3e664f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:44.283667 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.283633    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c96b73a0-662e-4995-b19f-14015a3e664f-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rvlrc\" (UID: \"c96b73a0-662e-4995-b19f-14015a3e664f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:44.285714 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.285690    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c96b73a0-662e-4995-b19f-14015a3e664f-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rvlrc\" (UID: \"c96b73a0-662e-4995-b19f-14015a3e664f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:44.285849 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.285831    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c96b73a0-662e-4995-b19f-14015a3e664f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rvlrc\" (UID: \"c96b73a0-662e-4995-b19f-14015a3e664f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:44.294873 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.294843    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c96b73a0-662e-4995-b19f-14015a3e664f-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rvlrc\" (UID: \"c96b73a0-662e-4995-b19f-14015a3e664f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:44.296306 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.296285    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdz4j\" (UniqueName: \"kubernetes.io/projected/c96b73a0-662e-4995-b19f-14015a3e664f-kube-api-access-mdz4j\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rvlrc\" (UID: \"c96b73a0-662e-4995-b19f-14015a3e664f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:44.384482 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.384389    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m\" (UID: \"493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:44.384482 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.384443    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m\" (UID: \"493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:44.384482 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.384472    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd6vx\" (UniqueName: \"kubernetes.io/projected/493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad-kube-api-access-wd6vx\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m\" (UID: \"493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:44.384754 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.384510    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m\" (UID: \"493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:44.384754 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.384537    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m\" (UID: \"493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:44.384754 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.384567    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m\" (UID: \"493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:44.384754 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.384597    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m\" (UID: \"493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:44.384754 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.384633    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m\" (UID: \"493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:44.384754 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.384682    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m\" (UID: \"493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:44.385046 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.384864    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m\" (UID: \"493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:44.385046 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.384975    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m\" (UID: \"493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:44.385046 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.384993    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m\" (UID: \"493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:44.385629 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.385596    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m\" (UID: \"493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:44.385754 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.385704    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m\" (UID: \"493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:44.387500 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.387470    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m\" (UID: \"493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:44.387615 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.387555    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m\" (UID: \"493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:44.396578 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.396555    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m\" (UID: \"493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:44.400663 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.400643    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd6vx\" (UniqueName: \"kubernetes.io/projected/493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad-kube-api-access-wd6vx\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m\" (UID: \"493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:44.451404 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.451368    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:44.534686 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:44.534652    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:45.752655 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:45.752621    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0n8drq"]
Sep 08 14:02:45.756177 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:45.756155    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0n8drq"
Sep 08 14:02:45.769109 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:45.769083    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0n8drq"]
Sep 08 14:02:45.846597 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:45.846565    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6znzq"]
Sep 08 14:02:45.850049 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:45.850021    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6znzq"
Sep 08 14:02:45.859989 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:45.859935    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6znzq"]
Sep 08 14:02:45.896758 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:45.896727    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6znzq\" (UID: \"2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6znzq"
Sep 08 14:02:45.896919 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:45.896768    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6znzq\" (UID: \"2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6znzq"
Sep 08 14:02:45.896919 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:45.896822    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d22ff0ba-5ab3-46eb-9829-725455000ff5-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0n8drq\" (UID: \"d22ff0ba-5ab3-46eb-9829-725455000ff5\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0n8drq"
Sep 08 14:02:45.896919 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:45.896853    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjrbx\" (UniqueName: \"kubernetes.io/projected/d22ff0ba-5ab3-46eb-9829-725455000ff5-kube-api-access-zjrbx\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0n8drq\" (UID: \"d22ff0ba-5ab3-46eb-9829-725455000ff5\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0n8drq"
Sep 08 14:02:45.896919 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:45.896899    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d22ff0ba-5ab3-46eb-9829-725455000ff5-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0n8drq\" (UID: \"d22ff0ba-5ab3-46eb-9829-725455000ff5\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0n8drq"
Sep 08 14:02:45.897051 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:45.897003    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r9tw\" (UniqueName: \"kubernetes.io/projected/2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012-kube-api-access-2r9tw\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6znzq\" (UID: \"2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6znzq"
Sep 08 14:02:45.944700 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:45.944598    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpgc46"]
Sep 08 14:02:45.948341 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:45.948320    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpgc46"
Sep 08 14:02:45.958264 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:45.958236    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpgc46"]
Sep 08 14:02:45.997500 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:45.997474    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d22ff0ba-5ab3-46eb-9829-725455000ff5-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0n8drq\" (UID: \"d22ff0ba-5ab3-46eb-9829-725455000ff5\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0n8drq"
Sep 08 14:02:45.997579 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:45.997540    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r9tw\" (UniqueName: \"kubernetes.io/projected/2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012-kube-api-access-2r9tw\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6znzq\" (UID: \"2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6znzq"
Sep 08 14:02:45.997623 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:45.997604    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/decb7c4e-8c7a-4224-bd39-21e799c863aa-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpgc46\" (UID: \"decb7c4e-8c7a-4224-bd39-21e799c863aa\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpgc46"
Sep 08 14:02:45.997670 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:45.997657    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6znzq\" (UID: \"2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6znzq"
Sep 08 14:02:45.997703 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:45.997687    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6znzq\" (UID: \"2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6znzq"
Sep 08 14:02:45.997755 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:45.997733    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d22ff0ba-5ab3-46eb-9829-725455000ff5-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0n8drq\" (UID: \"d22ff0ba-5ab3-46eb-9829-725455000ff5\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0n8drq"
Sep 08 14:02:45.997795 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:45.997767    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjrbx\" (UniqueName: \"kubernetes.io/projected/d22ff0ba-5ab3-46eb-9829-725455000ff5-kube-api-access-zjrbx\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0n8drq\" (UID: \"d22ff0ba-5ab3-46eb-9829-725455000ff5\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0n8drq"
Sep 08 14:02:45.997838 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:45.997795    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c57f\" (UniqueName: \"kubernetes.io/projected/decb7c4e-8c7a-4224-bd39-21e799c863aa-kube-api-access-8c57f\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpgc46\" (UID: \"decb7c4e-8c7a-4224-bd39-21e799c863aa\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpgc46"
Sep 08 14:02:45.997872 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:45.997837    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/decb7c4e-8c7a-4224-bd39-21e799c863aa-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpgc46\" (UID: \"decb7c4e-8c7a-4224-bd39-21e799c863aa\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpgc46"
Sep 08 14:02:45.999083 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:45.998377    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6znzq\" (UID: \"2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6znzq"
Sep 08 14:02:45.999083 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:45.998702    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d22ff0ba-5ab3-46eb-9829-725455000ff5-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0n8drq\" (UID: \"d22ff0ba-5ab3-46eb-9829-725455000ff5\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0n8drq"
Sep 08 14:02:45.999083 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:45.998794    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6znzq\" (UID: \"2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6znzq"
Sep 08 14:02:45.999083 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:45.998961    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d22ff0ba-5ab3-46eb-9829-725455000ff5-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0n8drq\" (UID: \"d22ff0ba-5ab3-46eb-9829-725455000ff5\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0n8drq"
Sep 08 14:02:46.007484 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.007463    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjrbx\" (UniqueName: \"kubernetes.io/projected/d22ff0ba-5ab3-46eb-9829-725455000ff5-kube-api-access-zjrbx\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0n8drq\" (UID: \"d22ff0ba-5ab3-46eb-9829-725455000ff5\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0n8drq"
Sep 08 14:02:46.007731 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.007711    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r9tw\" (UniqueName: \"kubernetes.io/projected/2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012-kube-api-access-2r9tw\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6znzq\" (UID: \"2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6znzq"
Sep 08 14:02:46.046844 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.046820    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr"]
Sep 08 14:02:46.051562 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.051547    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr"
Sep 08 14:02:46.059430 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.059409    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr"]
Sep 08 14:02:46.067704 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.067688    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0n8drq"
Sep 08 14:02:46.098793 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.098760    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c57f\" (UniqueName: \"kubernetes.io/projected/decb7c4e-8c7a-4224-bd39-21e799c863aa-kube-api-access-8c57f\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpgc46\" (UID: \"decb7c4e-8c7a-4224-bd39-21e799c863aa\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpgc46"
Sep 08 14:02:46.098938 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.098821    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/decb7c4e-8c7a-4224-bd39-21e799c863aa-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpgc46\" (UID: \"decb7c4e-8c7a-4224-bd39-21e799c863aa\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpgc46"
Sep 08 14:02:46.098938 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.098861    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6lrc\" (UniqueName: \"kubernetes.io/projected/73794fa2-f92c-4133-a2e1-60026fd94bbe-kube-api-access-d6lrc\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr\" (UID: \"73794fa2-f92c-4133-a2e1-60026fd94bbe\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr"
Sep 08 14:02:46.098938 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.098905    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73794fa2-f92c-4133-a2e1-60026fd94bbe-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr\" (UID: \"73794fa2-f92c-4133-a2e1-60026fd94bbe\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr"
Sep 08 14:02:46.099146 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.098938    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73794fa2-f92c-4133-a2e1-60026fd94bbe-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr\" (UID: \"73794fa2-f92c-4133-a2e1-60026fd94bbe\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr"
Sep 08 14:02:46.099146 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.099017    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/decb7c4e-8c7a-4224-bd39-21e799c863aa-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpgc46\" (UID: \"decb7c4e-8c7a-4224-bd39-21e799c863aa\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpgc46"
Sep 08 14:02:46.099300 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.099280    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/decb7c4e-8c7a-4224-bd39-21e799c863aa-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpgc46\" (UID: \"decb7c4e-8c7a-4224-bd39-21e799c863aa\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpgc46"
Sep 08 14:02:46.099414 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.099394    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/decb7c4e-8c7a-4224-bd39-21e799c863aa-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpgc46\" (UID: \"decb7c4e-8c7a-4224-bd39-21e799c863aa\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpgc46"
Sep 08 14:02:46.108902 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.108866    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c57f\" (UniqueName: \"kubernetes.io/projected/decb7c4e-8c7a-4224-bd39-21e799c863aa-kube-api-access-8c57f\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpgc46\" (UID: \"decb7c4e-8c7a-4224-bd39-21e799c863aa\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpgc46"
Sep 08 14:02:46.161260 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.161235    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6znzq"
Sep 08 14:02:46.197092 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.196984    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"]
Sep 08 14:02:46.199504 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.199471    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"]
Sep 08 14:02:46.199923 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.199808    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6lrc\" (UniqueName: \"kubernetes.io/projected/73794fa2-f92c-4133-a2e1-60026fd94bbe-kube-api-access-d6lrc\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr\" (UID: \"73794fa2-f92c-4133-a2e1-60026fd94bbe\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr"
Sep 08 14:02:46.199923 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.199857    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73794fa2-f92c-4133-a2e1-60026fd94bbe-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr\" (UID: \"73794fa2-f92c-4133-a2e1-60026fd94bbe\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr"
Sep 08 14:02:46.199923 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.199883    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73794fa2-f92c-4133-a2e1-60026fd94bbe-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr\" (UID: \"73794fa2-f92c-4133-a2e1-60026fd94bbe\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr"
Sep 08 14:02:46.200345 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.200325    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73794fa2-f92c-4133-a2e1-60026fd94bbe-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr\" (UID: \"73794fa2-f92c-4133-a2e1-60026fd94bbe\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr"
Sep 08 14:02:46.200428 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.200355    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73794fa2-f92c-4133-a2e1-60026fd94bbe-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr\" (UID: \"73794fa2-f92c-4133-a2e1-60026fd94bbe\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr"
Sep 08 14:02:46.201381 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:02:46.201352    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc96b73a0_662e_4995_b19f_14015a3e664f.slice/crio-7e9c23896eb736b0a2e4769835af7afb05e80aba06ae99bc01c736211077e2e2 WatchSource:0}: Error finding container 7e9c23896eb736b0a2e4769835af7afb05e80aba06ae99bc01c736211077e2e2: Status 404 returned error can't find the container with id 7e9c23896eb736b0a2e4769835af7afb05e80aba06ae99bc01c736211077e2e2
Sep 08 14:02:46.202478 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:02:46.202444    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod493c38f4_5d0c_44c2_91c0_d0f2d6fde4ad.slice/crio-74805c435df6f50205cddf38e2e180e10cd6429eb790e965a6b44e7d2816e4eb WatchSource:0}: Error finding container 74805c435df6f50205cddf38e2e180e10cd6429eb790e965a6b44e7d2816e4eb: Status 404 returned error can't find the container with id 74805c435df6f50205cddf38e2e180e10cd6429eb790e965a6b44e7d2816e4eb
Sep 08 14:02:46.221921 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.221896    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6lrc\" (UniqueName: \"kubernetes.io/projected/73794fa2-f92c-4133-a2e1-60026fd94bbe-kube-api-access-d6lrc\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr\" (UID: \"73794fa2-f92c-4133-a2e1-60026fd94bbe\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr"
Sep 08 14:02:46.274011 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.273953    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpgc46"
Sep 08 14:02:46.353187 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.353153    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0n8drq"]
Sep 08 14:02:46.356743 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:02:46.356718    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd22ff0ba_5ab3_46eb_9829_725455000ff5.slice/crio-9dea718cc549535a245117c0fde0fed30cbaf34cb09f823718d2d36b2356821b WatchSource:0}: Error finding container 9dea718cc549535a245117c0fde0fed30cbaf34cb09f823718d2d36b2356821b: Status 404 returned error can't find the container with id 9dea718cc549535a245117c0fde0fed30cbaf34cb09f823718d2d36b2356821b
Sep 08 14:02:46.367144 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.367125    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr"
Sep 08 14:02:46.438367 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.438340    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6znzq"]
Sep 08 14:02:46.442821 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:02:46.442776    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c9fde26_bf11_4d5f_ad7d_d0ab2dfa1012.slice/crio-fab8144e24e6c968174447b100364ada0350f95f4b34e7bb93c434c8d3cabae5 WatchSource:0}: Error finding container fab8144e24e6c968174447b100364ada0350f95f4b34e7bb93c434c8d3cabae5: Status 404 returned error can't find the container with id fab8144e24e6c968174447b100364ada0350f95f4b34e7bb93c434c8d3cabae5
Sep 08 14:02:46.548343 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.548296    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpgc46"]
Sep 08 14:02:46.561126 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:02:46.561101    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddecb7c4e_8c7a_4224_bd39_21e799c863aa.slice/crio-728f9ef3e4ef7651002010e02e0ac9736ab32025ea6676ab3324659511d593d5 WatchSource:0}: Error finding container 728f9ef3e4ef7651002010e02e0ac9736ab32025ea6676ab3324659511d593d5: Status 404 returned error can't find the container with id 728f9ef3e4ef7651002010e02e0ac9736ab32025ea6676ab3324659511d593d5
Sep 08 14:02:46.645887 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.645855    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr"]
Sep 08 14:02:46.720766 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:02:46.720734    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73794fa2_f92c_4133_a2e1_60026fd94bbe.slice/crio-0297a81893a69539f986bd4b22153f4478b71067b4846aee8da969e23c9a3f43 WatchSource:0}: Error finding container 0297a81893a69539f986bd4b22153f4478b71067b4846aee8da969e23c9a3f43: Status 404 returned error can't find the container with id 0297a81893a69539f986bd4b22153f4478b71067b4846aee8da969e23c9a3f43
Sep 08 14:02:46.989612 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.989584    2575 generic.go:356] "Generic (PLEG): container finished" podID="73794fa2-f92c-4133-a2e1-60026fd94bbe" containerID="4d4be23b449ed5515ea4422266f9c1af03dec0532686feef98042e7d73f889cf" exitCode=0
Sep 08 14:02:46.990022 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.989639    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr" event={"ID":"73794fa2-f92c-4133-a2e1-60026fd94bbe","Type":"ContainerDied","Data":"4d4be23b449ed5515ea4422266f9c1af03dec0532686feef98042e7d73f889cf"}
Sep 08 14:02:46.990022 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.989695    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr" event={"ID":"73794fa2-f92c-4133-a2e1-60026fd94bbe","Type":"ContainerStarted","Data":"0297a81893a69539f986bd4b22153f4478b71067b4846aee8da969e23c9a3f43"}
Sep 08 14:02:46.991535 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.991511    2575 generic.go:356] "Generic (PLEG): container finished" podID="2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012" containerID="42599b2a1f7fabd4dede161d3613a8bfb77606c01d88142154d45851b0aec8ce" exitCode=0
Sep 08 14:02:46.991631 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.991604    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6znzq" event={"ID":"2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012","Type":"ContainerDied","Data":"42599b2a1f7fabd4dede161d3613a8bfb77606c01d88142154d45851b0aec8ce"}
Sep 08 14:02:46.991690 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.991646    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6znzq" event={"ID":"2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012","Type":"ContainerStarted","Data":"fab8144e24e6c968174447b100364ada0350f95f4b34e7bb93c434c8d3cabae5"}
Sep 08 14:02:46.994156 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.994132    2575 generic.go:356] "Generic (PLEG): container finished" podID="d22ff0ba-5ab3-46eb-9829-725455000ff5" containerID="1fd537146c9e8e554872582e32cf29524688683a7b0f6a05123756845d9ca3be" exitCode=0
Sep 08 14:02:46.994242 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.994200    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0n8drq" event={"ID":"d22ff0ba-5ab3-46eb-9829-725455000ff5","Type":"ContainerDied","Data":"1fd537146c9e8e554872582e32cf29524688683a7b0f6a05123756845d9ca3be"}
Sep 08 14:02:46.994242 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.994226    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0n8drq" event={"ID":"d22ff0ba-5ab3-46eb-9829-725455000ff5","Type":"ContainerStarted","Data":"9dea718cc549535a245117c0fde0fed30cbaf34cb09f823718d2d36b2356821b"}
Sep 08 14:02:46.996075 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.995997    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc" event={"ID":"c96b73a0-662e-4995-b19f-14015a3e664f","Type":"ContainerStarted","Data":"7e9c23896eb736b0a2e4769835af7afb05e80aba06ae99bc01c736211077e2e2"}
Sep 08 14:02:46.997542 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.997517    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m" event={"ID":"493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad","Type":"ContainerStarted","Data":"74805c435df6f50205cddf38e2e180e10cd6429eb790e965a6b44e7d2816e4eb"}
Sep 08 14:02:46.999631 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.999609    2575 generic.go:356] "Generic (PLEG): container finished" podID="3b11f507-56ca-4d6a-98ba-64a967e84244" containerID="5e88fa34331b1c056d7e850ab3dfaed86556971304293aeeea4639368ed14ff9" exitCode=0
Sep 08 14:02:46.999766 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:46.999695    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954emgdtr" event={"ID":"3b11f507-56ca-4d6a-98ba-64a967e84244","Type":"ContainerDied","Data":"5e88fa34331b1c056d7e850ab3dfaed86556971304293aeeea4639368ed14ff9"}
Sep 08 14:02:47.001670 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:47.001648    2575 generic.go:356] "Generic (PLEG): container finished" podID="decb7c4e-8c7a-4224-bd39-21e799c863aa" containerID="3a09958a3d326edd99c2a6331d2b6dfd657ecbe546c4c192b6bbaa225897460f" exitCode=0
Sep 08 14:02:47.001828 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:47.001687    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpgc46" event={"ID":"decb7c4e-8c7a-4224-bd39-21e799c863aa","Type":"ContainerDied","Data":"3a09958a3d326edd99c2a6331d2b6dfd657ecbe546c4c192b6bbaa225897460f"}
Sep 08 14:02:47.001828 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:47.001719    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpgc46" event={"ID":"decb7c4e-8c7a-4224-bd39-21e799c863aa","Type":"ContainerStarted","Data":"728f9ef3e4ef7651002010e02e0ac9736ab32025ea6676ab3324659511d593d5"}
Sep 08 14:02:48.009512 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:48.009465    2575 generic.go:356] "Generic (PLEG): container finished" podID="decb7c4e-8c7a-4224-bd39-21e799c863aa" containerID="e873ddd663556c9fe0ceeb58448884da691e3678555e6ddf4acc899aa41353e0" exitCode=0
Sep 08 14:02:48.009953 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:48.009603    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpgc46" event={"ID":"decb7c4e-8c7a-4224-bd39-21e799c863aa","Type":"ContainerDied","Data":"e873ddd663556c9fe0ceeb58448884da691e3678555e6ddf4acc899aa41353e0"}
Sep 08 14:02:48.012376 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:48.012295    2575 generic.go:356] "Generic (PLEG): container finished" podID="2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012" containerID="1b891b59bb958168682c3a8f6e1c6860c1b1fbc5613c70837c70a1d71cb295e0" exitCode=0
Sep 08 14:02:48.012376 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:48.012332    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6znzq" event={"ID":"2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012","Type":"ContainerDied","Data":"1b891b59bb958168682c3a8f6e1c6860c1b1fbc5613c70837c70a1d71cb295e0"}
Sep 08 14:02:49.018455 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:49.018421    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr" event={"ID":"73794fa2-f92c-4133-a2e1-60026fd94bbe","Type":"ContainerStarted","Data":"cda74ee6d7c44985c50b1af5d8b856c64461f9cd349d338ba730e7bc269e7085"}
Sep 08 14:02:49.217866 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:49.217819    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:02:49.217952 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:49.217909    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:02:49.217952 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:49.217937    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:02:49.223697 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:49.223672    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:02:49.223770 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:49.223729    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:02:49.223770 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:49.223759    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:02:50.025340 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:50.025299    2575 generic.go:356] "Generic (PLEG): container finished" podID="73794fa2-f92c-4133-a2e1-60026fd94bbe" containerID="cda74ee6d7c44985c50b1af5d8b856c64461f9cd349d338ba730e7bc269e7085" exitCode=0
Sep 08 14:02:50.025784 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:50.025382    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr" event={"ID":"73794fa2-f92c-4133-a2e1-60026fd94bbe","Type":"ContainerDied","Data":"cda74ee6d7c44985c50b1af5d8b856c64461f9cd349d338ba730e7bc269e7085"}
Sep 08 14:02:50.027396 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:50.027366    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc" event={"ID":"c96b73a0-662e-4995-b19f-14015a3e664f","Type":"ContainerStarted","Data":"935cee6761516bb177606d0d3a00060208bcbeeec03eef571509db0e2e684b5e"}
Sep 08 14:02:50.030019 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:50.029993    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m" event={"ID":"493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad","Type":"ContainerStarted","Data":"5be834b7fd76fa9a92b09f32b353ddf61c98ed65c47c33b094e37b2a21b52f51"}
Sep 08 14:02:50.096364 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:50.096320    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc" podStartSLOduration=3.07636878 podStartE2EDuration="6.096304673s" totalImagesPullingTime="3.019935893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:02:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:02:50.095930349 +0000 UTC m=+245.585647401" watchObservedRunningTime="2026-09-08 14:02:50.096304673 +0000 UTC m=+245.586021725"
Sep 08 14:02:50.124317 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:50.123796    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m" podStartSLOduration=3.110684642 podStartE2EDuration="6.123776214s" totalImagesPullingTime="3.013091572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:02:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:02:50.12316652 +0000 UTC m=+245.612883572" watchObservedRunningTime="2026-09-08 14:02:50.123776214 +0000 UTC m=+245.613493267"
Sep 08 14:02:50.451618 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:50.451528    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:50.457502 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:50.457475    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:50.535718 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:50.535679    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:50.542126 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:50.542101    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:51.036584 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:51.036530    2575 generic.go:356] "Generic (PLEG): container finished" podID="3b11f507-56ca-4d6a-98ba-64a967e84244" containerID="fc694f1a0257c025257aa35b3b61b818795cf9e5229b5b261cfc6e652b826d7b" exitCode=0
Sep 08 14:02:51.036584 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:51.036570    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954emgdtr" event={"ID":"3b11f507-56ca-4d6a-98ba-64a967e84244","Type":"ContainerDied","Data":"fc694f1a0257c025257aa35b3b61b818795cf9e5229b5b261cfc6e652b826d7b"}
Sep 08 14:02:51.037446 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:51.037292    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:51.037446 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:51.037347    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:51.038076 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:51.037994    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:02:51.038076 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:51.038042    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m"
Sep 08 14:02:58.075800 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:58.075764    2575 generic.go:356] "Generic (PLEG): container finished" podID="d22ff0ba-5ab3-46eb-9829-725455000ff5" containerID="495ab236e8833935f5cd04283fea0cf572027d1aa93af03e816aa3b2d385df16" exitCode=0
Sep 08 14:02:58.076243 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:58.075843    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0n8drq" event={"ID":"d22ff0ba-5ab3-46eb-9829-725455000ff5","Type":"ContainerDied","Data":"495ab236e8833935f5cd04283fea0cf572027d1aa93af03e816aa3b2d385df16"}
Sep 08 14:02:58.077890 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:58.077865    2575 generic.go:356] "Generic (PLEG): container finished" podID="3b11f507-56ca-4d6a-98ba-64a967e84244" containerID="e622f7914ddd2540093b1d0975fe0dc0661f3b5f75bc609210b955654f1a9fd5" exitCode=0
Sep 08 14:02:58.077998 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:58.077936    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954emgdtr" event={"ID":"3b11f507-56ca-4d6a-98ba-64a967e84244","Type":"ContainerDied","Data":"e622f7914ddd2540093b1d0975fe0dc0661f3b5f75bc609210b955654f1a9fd5"}
Sep 08 14:02:58.080312 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:58.080291    2575 generic.go:356] "Generic (PLEG): container finished" podID="decb7c4e-8c7a-4224-bd39-21e799c863aa" containerID="666a5665d771c0092abda388707e5bf556756f39c84f58e5f9ccb8ca7d9ae108" exitCode=0
Sep 08 14:02:58.080425 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:58.080363    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpgc46" event={"ID":"decb7c4e-8c7a-4224-bd39-21e799c863aa","Type":"ContainerDied","Data":"666a5665d771c0092abda388707e5bf556756f39c84f58e5f9ccb8ca7d9ae108"}
Sep 08 14:02:58.082402 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:58.082375    2575 generic.go:356] "Generic (PLEG): container finished" podID="73794fa2-f92c-4133-a2e1-60026fd94bbe" containerID="17ec4baac0ac9c672bda365387c7b6d9eff4be7fdd7afbf9eb28bb29c35f51df" exitCode=0
Sep 08 14:02:58.082496 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:58.082445    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr" event={"ID":"73794fa2-f92c-4133-a2e1-60026fd94bbe","Type":"ContainerDied","Data":"17ec4baac0ac9c672bda365387c7b6d9eff4be7fdd7afbf9eb28bb29c35f51df"}
Sep 08 14:02:58.086940 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:58.086788    2575 generic.go:356] "Generic (PLEG): container finished" podID="2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012" containerID="228d8dcac8525600a467dfd212899466174ddc857134da21d81935e7f49289bb" exitCode=0
Sep 08 14:02:58.086940 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:58.086818    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6znzq" event={"ID":"2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012","Type":"ContainerDied","Data":"228d8dcac8525600a467dfd212899466174ddc857134da21d81935e7f49289bb"}
Sep 08 14:02:59.093756 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.093720    2575 generic.go:356] "Generic (PLEG): container finished" podID="d22ff0ba-5ab3-46eb-9829-725455000ff5" containerID="47da072173a29a1530cf022ba9164d0f23670f0cc49b57032e787bbc311aa460" exitCode=0
Sep 08 14:02:59.094191 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.093808    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0n8drq" event={"ID":"d22ff0ba-5ab3-46eb-9829-725455000ff5","Type":"ContainerDied","Data":"47da072173a29a1530cf022ba9164d0f23670f0cc49b57032e787bbc311aa460"}
Sep 08 14:02:59.258408 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.258384    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6znzq"
Sep 08 14:02:59.273722 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.273698    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr"
Sep 08 14:02:59.298854 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.298832    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954emgdtr"
Sep 08 14:02:59.306163 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.306136    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpgc46"
Sep 08 14:02:59.421630 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.421592    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b11f507-56ca-4d6a-98ba-64a967e84244-util\") pod \"3b11f507-56ca-4d6a-98ba-64a967e84244\" (UID: \"3b11f507-56ca-4d6a-98ba-64a967e84244\") "
Sep 08 14:02:59.421630 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.421630    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012-bundle\") pod \"2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012\" (UID: \"2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012\") "
Sep 08 14:02:59.421814 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.421660    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8c57f\" (UniqueName: \"kubernetes.io/projected/decb7c4e-8c7a-4224-bd39-21e799c863aa-kube-api-access-8c57f\") pod \"decb7c4e-8c7a-4224-bd39-21e799c863aa\" (UID: \"decb7c4e-8c7a-4224-bd39-21e799c863aa\") "
Sep 08 14:02:59.421814 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.421697    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjqd5\" (UniqueName: \"kubernetes.io/projected/3b11f507-56ca-4d6a-98ba-64a967e84244-kube-api-access-tjqd5\") pod \"3b11f507-56ca-4d6a-98ba-64a967e84244\" (UID: \"3b11f507-56ca-4d6a-98ba-64a967e84244\") "
Sep 08 14:02:59.421814 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.421735    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73794fa2-f92c-4133-a2e1-60026fd94bbe-util\") pod \"73794fa2-f92c-4133-a2e1-60026fd94bbe\" (UID: \"73794fa2-f92c-4133-a2e1-60026fd94bbe\") "
Sep 08 14:02:59.421814 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.421770    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b11f507-56ca-4d6a-98ba-64a967e84244-bundle\") pod \"3b11f507-56ca-4d6a-98ba-64a967e84244\" (UID: \"3b11f507-56ca-4d6a-98ba-64a967e84244\") "
Sep 08 14:02:59.421814 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.421807    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73794fa2-f92c-4133-a2e1-60026fd94bbe-bundle\") pod \"73794fa2-f92c-4133-a2e1-60026fd94bbe\" (UID: \"73794fa2-f92c-4133-a2e1-60026fd94bbe\") "
Sep 08 14:02:59.422086 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.421841    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2r9tw\" (UniqueName: \"kubernetes.io/projected/2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012-kube-api-access-2r9tw\") pod \"2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012\" (UID: \"2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012\") "
Sep 08 14:02:59.422086 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.421874    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/decb7c4e-8c7a-4224-bd39-21e799c863aa-util\") pod \"decb7c4e-8c7a-4224-bd39-21e799c863aa\" (UID: \"decb7c4e-8c7a-4224-bd39-21e799c863aa\") "
Sep 08 14:02:59.422086 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.421908    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6lrc\" (UniqueName: \"kubernetes.io/projected/73794fa2-f92c-4133-a2e1-60026fd94bbe-kube-api-access-d6lrc\") pod \"73794fa2-f92c-4133-a2e1-60026fd94bbe\" (UID: \"73794fa2-f92c-4133-a2e1-60026fd94bbe\") "
Sep 08 14:02:59.422086 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.421938    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012-util\") pod \"2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012\" (UID: \"2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012\") "
Sep 08 14:02:59.422086 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.421985    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/decb7c4e-8c7a-4224-bd39-21e799c863aa-bundle\") pod \"decb7c4e-8c7a-4224-bd39-21e799c863aa\" (UID: \"decb7c4e-8c7a-4224-bd39-21e799c863aa\") "
Sep 08 14:02:59.422441 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.422412    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012-bundle" (OuterVolumeSpecName: "bundle") pod "2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012" (UID: "2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:02:59.422740 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.422713    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/decb7c4e-8c7a-4224-bd39-21e799c863aa-bundle" (OuterVolumeSpecName: "bundle") pod "decb7c4e-8c7a-4224-bd39-21e799c863aa" (UID: "decb7c4e-8c7a-4224-bd39-21e799c863aa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:02:59.423660 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.423623    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73794fa2-f92c-4133-a2e1-60026fd94bbe-bundle" (OuterVolumeSpecName: "bundle") pod "73794fa2-f92c-4133-a2e1-60026fd94bbe" (UID: "73794fa2-f92c-4133-a2e1-60026fd94bbe"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:02:59.424609 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.424581    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/decb7c4e-8c7a-4224-bd39-21e799c863aa-kube-api-access-8c57f" (OuterVolumeSpecName: "kube-api-access-8c57f") pod "decb7c4e-8c7a-4224-bd39-21e799c863aa" (UID: "decb7c4e-8c7a-4224-bd39-21e799c863aa"). InnerVolumeSpecName "kube-api-access-8c57f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:02:59.424705 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.424608    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b11f507-56ca-4d6a-98ba-64a967e84244-bundle" (OuterVolumeSpecName: "bundle") pod "3b11f507-56ca-4d6a-98ba-64a967e84244" (UID: "3b11f507-56ca-4d6a-98ba-64a967e84244"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:02:59.425275 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.425243    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012-kube-api-access-2r9tw" (OuterVolumeSpecName: "kube-api-access-2r9tw") pod "2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012" (UID: "2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012"). InnerVolumeSpecName "kube-api-access-2r9tw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:02:59.425357 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.425322    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b11f507-56ca-4d6a-98ba-64a967e84244-kube-api-access-tjqd5" (OuterVolumeSpecName: "kube-api-access-tjqd5") pod "3b11f507-56ca-4d6a-98ba-64a967e84244" (UID: "3b11f507-56ca-4d6a-98ba-64a967e84244"). InnerVolumeSpecName "kube-api-access-tjqd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:02:59.426232 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.426210    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73794fa2-f92c-4133-a2e1-60026fd94bbe-kube-api-access-d6lrc" (OuterVolumeSpecName: "kube-api-access-d6lrc") pod "73794fa2-f92c-4133-a2e1-60026fd94bbe" (UID: "73794fa2-f92c-4133-a2e1-60026fd94bbe"). InnerVolumeSpecName "kube-api-access-d6lrc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:02:59.427750 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.427731    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/decb7c4e-8c7a-4224-bd39-21e799c863aa-util" (OuterVolumeSpecName: "util") pod "decb7c4e-8c7a-4224-bd39-21e799c863aa" (UID: "decb7c4e-8c7a-4224-bd39-21e799c863aa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:02:59.428018 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.427997    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b11f507-56ca-4d6a-98ba-64a967e84244-util" (OuterVolumeSpecName: "util") pod "3b11f507-56ca-4d6a-98ba-64a967e84244" (UID: "3b11f507-56ca-4d6a-98ba-64a967e84244"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:02:59.428108 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.428085    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73794fa2-f92c-4133-a2e1-60026fd94bbe-util" (OuterVolumeSpecName: "util") pod "73794fa2-f92c-4133-a2e1-60026fd94bbe" (UID: "73794fa2-f92c-4133-a2e1-60026fd94bbe"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:02:59.429032 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.429016    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012-util" (OuterVolumeSpecName: "util") pod "2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012" (UID: "2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:02:59.522676 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.522649    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8c57f\" (UniqueName: \"kubernetes.io/projected/decb7c4e-8c7a-4224-bd39-21e799c863aa-kube-api-access-8c57f\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:02:59.522676 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.522676    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjqd5\" (UniqueName: \"kubernetes.io/projected/3b11f507-56ca-4d6a-98ba-64a967e84244-kube-api-access-tjqd5\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:02:59.522831 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.522687    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73794fa2-f92c-4133-a2e1-60026fd94bbe-util\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:02:59.522831 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.522696    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b11f507-56ca-4d6a-98ba-64a967e84244-bundle\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:02:59.522831 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.522704    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73794fa2-f92c-4133-a2e1-60026fd94bbe-bundle\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:02:59.522831 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.522711    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2r9tw\" (UniqueName: \"kubernetes.io/projected/2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012-kube-api-access-2r9tw\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:02:59.522831 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.522718    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/decb7c4e-8c7a-4224-bd39-21e799c863aa-util\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:02:59.522831 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.522726    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6lrc\" (UniqueName: \"kubernetes.io/projected/73794fa2-f92c-4133-a2e1-60026fd94bbe-kube-api-access-d6lrc\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:02:59.522831 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.522734    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012-util\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:02:59.522831 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.522741    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/decb7c4e-8c7a-4224-bd39-21e799c863aa-bundle\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:02:59.522831 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.522748    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b11f507-56ca-4d6a-98ba-64a967e84244-util\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:02:59.522831 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:02:59.522754    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012-bundle\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:03:00.100634 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:00.100605    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954emgdtr"
Sep 08 14:03:00.101045 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:00.100605    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954emgdtr" event={"ID":"3b11f507-56ca-4d6a-98ba-64a967e84244","Type":"ContainerDied","Data":"9e186fe643eedcbaf7aac40ffad7af664f149b88f3e8373b9abc6c11551c4b3f"}
Sep 08 14:03:00.101045 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:00.100726    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e186fe643eedcbaf7aac40ffad7af664f149b88f3e8373b9abc6c11551c4b3f"
Sep 08 14:03:00.102524 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:00.102503    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpgc46"
Sep 08 14:03:00.102648 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:00.102536    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpgc46" event={"ID":"decb7c4e-8c7a-4224-bd39-21e799c863aa","Type":"ContainerDied","Data":"728f9ef3e4ef7651002010e02e0ac9736ab32025ea6676ab3324659511d593d5"}
Sep 08 14:03:00.102648 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:00.102580    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="728f9ef3e4ef7651002010e02e0ac9736ab32025ea6676ab3324659511d593d5"
Sep 08 14:03:00.104743 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:00.104718    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr"
Sep 08 14:03:00.104743 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:00.104720    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532xzqr" event={"ID":"73794fa2-f92c-4133-a2e1-60026fd94bbe","Type":"ContainerDied","Data":"0297a81893a69539f986bd4b22153f4478b71067b4846aee8da969e23c9a3f43"}
Sep 08 14:03:00.104874 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:00.104760    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0297a81893a69539f986bd4b22153f4478b71067b4846aee8da969e23c9a3f43"
Sep 08 14:03:00.106987 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:00.106960    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6znzq" event={"ID":"2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012","Type":"ContainerDied","Data":"fab8144e24e6c968174447b100364ada0350f95f4b34e7bb93c434c8d3cabae5"}
Sep 08 14:03:00.107106 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:00.106990    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6znzq"
Sep 08 14:03:00.107106 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:00.106996    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fab8144e24e6c968174447b100364ada0350f95f4b34e7bb93c434c8d3cabae5"
Sep 08 14:03:00.234421 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:00.234393    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0n8drq"
Sep 08 14:03:00.328198 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:00.328170    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjrbx\" (UniqueName: \"kubernetes.io/projected/d22ff0ba-5ab3-46eb-9829-725455000ff5-kube-api-access-zjrbx\") pod \"d22ff0ba-5ab3-46eb-9829-725455000ff5\" (UID: \"d22ff0ba-5ab3-46eb-9829-725455000ff5\") "
Sep 08 14:03:00.328334 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:00.328223    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d22ff0ba-5ab3-46eb-9829-725455000ff5-bundle\") pod \"d22ff0ba-5ab3-46eb-9829-725455000ff5\" (UID: \"d22ff0ba-5ab3-46eb-9829-725455000ff5\") "
Sep 08 14:03:00.328334 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:00.328260    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d22ff0ba-5ab3-46eb-9829-725455000ff5-util\") pod \"d22ff0ba-5ab3-46eb-9829-725455000ff5\" (UID: \"d22ff0ba-5ab3-46eb-9829-725455000ff5\") "
Sep 08 14:03:00.328776 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:00.328747    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d22ff0ba-5ab3-46eb-9829-725455000ff5-bundle" (OuterVolumeSpecName: "bundle") pod "d22ff0ba-5ab3-46eb-9829-725455000ff5" (UID: "d22ff0ba-5ab3-46eb-9829-725455000ff5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:03:00.330534 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:00.330492    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d22ff0ba-5ab3-46eb-9829-725455000ff5-kube-api-access-zjrbx" (OuterVolumeSpecName: "kube-api-access-zjrbx") pod "d22ff0ba-5ab3-46eb-9829-725455000ff5" (UID: "d22ff0ba-5ab3-46eb-9829-725455000ff5"). InnerVolumeSpecName "kube-api-access-zjrbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:03:00.333458 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:00.333436    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d22ff0ba-5ab3-46eb-9829-725455000ff5-util" (OuterVolumeSpecName: "util") pod "d22ff0ba-5ab3-46eb-9829-725455000ff5" (UID: "d22ff0ba-5ab3-46eb-9829-725455000ff5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:03:00.428918 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:00.428892    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d22ff0ba-5ab3-46eb-9829-725455000ff5-bundle\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:03:00.428918 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:00.428915    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d22ff0ba-5ab3-46eb-9829-725455000ff5-util\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:03:00.429042 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:00.428930    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjrbx\" (UniqueName: \"kubernetes.io/projected/d22ff0ba-5ab3-46eb-9829-725455000ff5-kube-api-access-zjrbx\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:03:01.113094 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.113046    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0n8drq"
Sep 08 14:03:01.113094 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.113087    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0n8drq" event={"ID":"d22ff0ba-5ab3-46eb-9829-725455000ff5","Type":"ContainerDied","Data":"9dea718cc549535a245117c0fde0fed30cbaf34cb09f823718d2d36b2356821b"}
Sep 08 14:03:01.113513 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.113133    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9dea718cc549535a245117c0fde0fed30cbaf34cb09f823718d2d36b2356821b"
Sep 08 14:03:01.301411 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301333    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-56d489b4b8-wtt8b"]
Sep 08 14:03:01.301638 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301624    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b11f507-56ca-4d6a-98ba-64a967e84244" containerName="pull"
Sep 08 14:03:01.301680 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301639    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b11f507-56ca-4d6a-98ba-64a967e84244" containerName="pull"
Sep 08 14:03:01.301680 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301649    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73794fa2-f92c-4133-a2e1-60026fd94bbe" containerName="pull"
Sep 08 14:03:01.301680 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301655    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="73794fa2-f92c-4133-a2e1-60026fd94bbe" containerName="pull"
Sep 08 14:03:01.301680 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301662    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d22ff0ba-5ab3-46eb-9829-725455000ff5" containerName="extract"
Sep 08 14:03:01.301680 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301667    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d22ff0ba-5ab3-46eb-9829-725455000ff5" containerName="extract"
Sep 08 14:03:01.301680 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301675    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73794fa2-f92c-4133-a2e1-60026fd94bbe" containerName="extract"
Sep 08 14:03:01.301680 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301680    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="73794fa2-f92c-4133-a2e1-60026fd94bbe" containerName="extract"
Sep 08 14:03:01.301867 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301688    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="decb7c4e-8c7a-4224-bd39-21e799c863aa" containerName="util"
Sep 08 14:03:01.301867 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301693    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="decb7c4e-8c7a-4224-bd39-21e799c863aa" containerName="util"
Sep 08 14:03:01.301867 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301700    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73794fa2-f92c-4133-a2e1-60026fd94bbe" containerName="util"
Sep 08 14:03:01.301867 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301705    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="73794fa2-f92c-4133-a2e1-60026fd94bbe" containerName="util"
Sep 08 14:03:01.301867 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301712    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012" containerName="pull"
Sep 08 14:03:01.301867 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301716    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012" containerName="pull"
Sep 08 14:03:01.301867 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301722    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="decb7c4e-8c7a-4224-bd39-21e799c863aa" containerName="pull"
Sep 08 14:03:01.301867 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301727    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="decb7c4e-8c7a-4224-bd39-21e799c863aa" containerName="pull"
Sep 08 14:03:01.301867 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301738    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b11f507-56ca-4d6a-98ba-64a967e84244" containerName="util"
Sep 08 14:03:01.301867 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301743    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b11f507-56ca-4d6a-98ba-64a967e84244" containerName="util"
Sep 08 14:03:01.301867 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301747    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d22ff0ba-5ab3-46eb-9829-725455000ff5" containerName="util"
Sep 08 14:03:01.301867 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301752    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d22ff0ba-5ab3-46eb-9829-725455000ff5" containerName="util"
Sep 08 14:03:01.301867 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301759    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="decb7c4e-8c7a-4224-bd39-21e799c863aa" containerName="extract"
Sep 08 14:03:01.301867 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301764    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="decb7c4e-8c7a-4224-bd39-21e799c863aa" containerName="extract"
Sep 08 14:03:01.301867 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301771    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012" containerName="util"
Sep 08 14:03:01.301867 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301776    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012" containerName="util"
Sep 08 14:03:01.301867 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301782    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012" containerName="extract"
Sep 08 14:03:01.301867 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301787    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012" containerName="extract"
Sep 08 14:03:01.301867 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301793    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b11f507-56ca-4d6a-98ba-64a967e84244" containerName="extract"
Sep 08 14:03:01.301867 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301798    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b11f507-56ca-4d6a-98ba-64a967e84244" containerName="extract"
Sep 08 14:03:01.301867 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301802    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d22ff0ba-5ab3-46eb-9829-725455000ff5" containerName="pull"
Sep 08 14:03:01.301867 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301806    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d22ff0ba-5ab3-46eb-9829-725455000ff5" containerName="pull"
Sep 08 14:03:01.301867 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301848    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c9fde26-bf11-4d5f-ad7d-d0ab2dfa1012" containerName="extract"
Sep 08 14:03:01.301867 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301858    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="decb7c4e-8c7a-4224-bd39-21e799c863aa" containerName="extract"
Sep 08 14:03:01.301867 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301864    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d22ff0ba-5ab3-46eb-9829-725455000ff5" containerName="extract"
Sep 08 14:03:01.301867 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301869    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b11f507-56ca-4d6a-98ba-64a967e84244" containerName="extract"
Sep 08 14:03:01.301867 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.301875    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="73794fa2-f92c-4133-a2e1-60026fd94bbe" containerName="extract"
Sep 08 14:03:01.304766 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.304751    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-wtt8b"
Sep 08 14:03:01.307228 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.307201    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Sep 08 14:03:01.307316 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.307301    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-x54hv\""
Sep 08 14:03:01.307420 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.307404    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Sep 08 14:03:01.312780 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.312757    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-56d489b4b8-wtt8b"]
Sep 08 14:03:01.435966 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.435931    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71bd32c4-b16c-4fad-bb9c-9affe63f7855-tmp\") pod \"jobset-operator-56d489b4b8-wtt8b\" (UID: \"71bd32c4-b16c-4fad-bb9c-9affe63f7855\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-wtt8b"
Sep 08 14:03:01.436157 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.435978    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4z6n\" (UniqueName: \"kubernetes.io/projected/71bd32c4-b16c-4fad-bb9c-9affe63f7855-kube-api-access-g4z6n\") pod \"jobset-operator-56d489b4b8-wtt8b\" (UID: \"71bd32c4-b16c-4fad-bb9c-9affe63f7855\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-wtt8b"
Sep 08 14:03:01.536480 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.536436    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4z6n\" (UniqueName: \"kubernetes.io/projected/71bd32c4-b16c-4fad-bb9c-9affe63f7855-kube-api-access-g4z6n\") pod \"jobset-operator-56d489b4b8-wtt8b\" (UID: \"71bd32c4-b16c-4fad-bb9c-9affe63f7855\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-wtt8b"
Sep 08 14:03:01.536645 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.536519    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71bd32c4-b16c-4fad-bb9c-9affe63f7855-tmp\") pod \"jobset-operator-56d489b4b8-wtt8b\" (UID: \"71bd32c4-b16c-4fad-bb9c-9affe63f7855\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-wtt8b"
Sep 08 14:03:01.536841 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.536826    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71bd32c4-b16c-4fad-bb9c-9affe63f7855-tmp\") pod \"jobset-operator-56d489b4b8-wtt8b\" (UID: \"71bd32c4-b16c-4fad-bb9c-9affe63f7855\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-wtt8b"
Sep 08 14:03:01.545475 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.545451    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4z6n\" (UniqueName: \"kubernetes.io/projected/71bd32c4-b16c-4fad-bb9c-9affe63f7855-kube-api-access-g4z6n\") pod \"jobset-operator-56d489b4b8-wtt8b\" (UID: \"71bd32c4-b16c-4fad-bb9c-9affe63f7855\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-wtt8b"
Sep 08 14:03:01.630859 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.630822    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-wtt8b"
Sep 08 14:03:01.902725 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:01.902688    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-56d489b4b8-wtt8b"]
Sep 08 14:03:01.904848 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:03:01.904822    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71bd32c4_b16c_4fad_bb9c_9affe63f7855.slice/crio-7a6144791065da1391424be366be43b18ee86202dfde433a2ce8fddc49ae3ee8 WatchSource:0}: Error finding container 7a6144791065da1391424be366be43b18ee86202dfde433a2ce8fddc49ae3ee8: Status 404 returned error can't find the container with id 7a6144791065da1391424be366be43b18ee86202dfde433a2ce8fddc49ae3ee8
Sep 08 14:03:02.119734 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:02.119700    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-wtt8b" event={"ID":"71bd32c4-b16c-4fad-bb9c-9affe63f7855","Type":"ContainerStarted","Data":"7a6144791065da1391424be366be43b18ee86202dfde433a2ce8fddc49ae3ee8"}
Sep 08 14:03:06.140149 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:06.140116    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-wtt8b" event={"ID":"71bd32c4-b16c-4fad-bb9c-9affe63f7855","Type":"ContainerStarted","Data":"c558563843319126a7d81142f3e84183f7280dcad135ad6c05d5c9aadd0b65bb"}
Sep 08 14:03:06.161743 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:06.161700    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-wtt8b" podStartSLOduration=1.501139261 podStartE2EDuration="5.161684386s" totalImagesPullingTime="3.660545125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:03:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:03:06.15910463 +0000 UTC m=+261.648821681" watchObservedRunningTime="2026-09-08 14:03:06.161684386 +0000 UTC m=+261.651401438"
Sep 08 14:03:09.903912 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:09.903869    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-pdtgc"]
Sep 08 14:03:09.906325 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:09.906300    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-pdtgc"
Sep 08 14:03:09.909720 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:09.909668    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 08 14:03:09.910427 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:09.910401    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 08 14:03:09.910582 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:09.910483    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-jm57p\""
Sep 08 14:03:09.952814 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:09.952791    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-pdtgc"]
Sep 08 14:03:10.005269 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:10.005236    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw7t2\" (UniqueName: \"kubernetes.io/projected/e338f731-f85c-4f8f-afb5-60cf277d3869-kube-api-access-kw7t2\") pod \"cert-manager-operator-controller-manager-684f79c9b9-pdtgc\" (UID: \"e338f731-f85c-4f8f-afb5-60cf277d3869\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-pdtgc"
Sep 08 14:03:10.005413 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:10.005275    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e338f731-f85c-4f8f-afb5-60cf277d3869-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-pdtgc\" (UID: \"e338f731-f85c-4f8f-afb5-60cf277d3869\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-pdtgc"
Sep 08 14:03:10.106556 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:10.106531    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e338f731-f85c-4f8f-afb5-60cf277d3869-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-pdtgc\" (UID: \"e338f731-f85c-4f8f-afb5-60cf277d3869\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-pdtgc"
Sep 08 14:03:10.106684 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:10.106596    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw7t2\" (UniqueName: \"kubernetes.io/projected/e338f731-f85c-4f8f-afb5-60cf277d3869-kube-api-access-kw7t2\") pod \"cert-manager-operator-controller-manager-684f79c9b9-pdtgc\" (UID: \"e338f731-f85c-4f8f-afb5-60cf277d3869\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-pdtgc"
Sep 08 14:03:10.106953 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:10.106935    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e338f731-f85c-4f8f-afb5-60cf277d3869-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-pdtgc\" (UID: \"e338f731-f85c-4f8f-afb5-60cf277d3869\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-pdtgc"
Sep 08 14:03:10.127051 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:10.127030    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw7t2\" (UniqueName: \"kubernetes.io/projected/e338f731-f85c-4f8f-afb5-60cf277d3869-kube-api-access-kw7t2\") pod \"cert-manager-operator-controller-manager-684f79c9b9-pdtgc\" (UID: \"e338f731-f85c-4f8f-afb5-60cf277d3869\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-pdtgc"
Sep 08 14:03:10.216695 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:10.216621    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-pdtgc"
Sep 08 14:03:10.499089 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:10.499047    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-pdtgc"]
Sep 08 14:03:10.500867 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:03:10.500843    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode338f731_f85c_4f8f_afb5_60cf277d3869.slice/crio-1a7de1af657abbe6965590c2aa1f5b1d0d601f2bb21e0d33e8b4370ef108d52a WatchSource:0}: Error finding container 1a7de1af657abbe6965590c2aa1f5b1d0d601f2bb21e0d33e8b4370ef108d52a: Status 404 returned error can't find the container with id 1a7de1af657abbe6965590c2aa1f5b1d0d601f2bb21e0d33e8b4370ef108d52a
Sep 08 14:03:11.167892 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:11.167839    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-pdtgc" event={"ID":"e338f731-f85c-4f8f-afb5-60cf277d3869","Type":"ContainerStarted","Data":"1a7de1af657abbe6965590c2aa1f5b1d0d601f2bb21e0d33e8b4370ef108d52a"}
Sep 08 14:03:13.179455 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:13.179368    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-pdtgc" event={"ID":"e338f731-f85c-4f8f-afb5-60cf277d3869","Type":"ContainerStarted","Data":"d1a5ce9d40f65d8061e371fd37b724106be260791232a40645327d3ed3b671a9"}
Sep 08 14:03:13.204919 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:13.204869    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-pdtgc" podStartSLOduration=1.883717501 podStartE2EDuration="4.204851234s" totalImagesPullingTime="2.321133733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:03:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:03:13.203880864 +0000 UTC m=+268.693597917" watchObservedRunningTime="2026-09-08 14:03:13.204851234 +0000 UTC m=+268.694568291"
Sep 08 14:03:17.388333 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:17.388300    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-p2bgg"]
Sep 08 14:03:17.390524 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:17.390508    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-p2bgg"
Sep 08 14:03:17.394072 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:17.394033    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-pp4z7\""
Sep 08 14:03:17.394267 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:17.394252    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 08 14:03:17.394444 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:17.394427    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 08 14:03:17.411172 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:17.411147    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-p2bgg"]
Sep 08 14:03:17.468484 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:17.468457    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ecf33b28-5ef1-43b2-bdda-c661a1aa4436-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84995cf88c-p2bgg\" (UID: \"ecf33b28-5ef1-43b2-bdda-c661a1aa4436\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-p2bgg"
Sep 08 14:03:17.468615 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:17.468488    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtbss\" (UniqueName: \"kubernetes.io/projected/ecf33b28-5ef1-43b2-bdda-c661a1aa4436-kube-api-access-wtbss\") pod \"kuadrant-operator-controller-manager-84995cf88c-p2bgg\" (UID: \"ecf33b28-5ef1-43b2-bdda-c661a1aa4436\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-p2bgg"
Sep 08 14:03:17.569588 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:17.569562    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ecf33b28-5ef1-43b2-bdda-c661a1aa4436-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84995cf88c-p2bgg\" (UID: \"ecf33b28-5ef1-43b2-bdda-c661a1aa4436\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-p2bgg"
Sep 08 14:03:17.569731 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:17.569595    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtbss\" (UniqueName: \"kubernetes.io/projected/ecf33b28-5ef1-43b2-bdda-c661a1aa4436-kube-api-access-wtbss\") pod \"kuadrant-operator-controller-manager-84995cf88c-p2bgg\" (UID: \"ecf33b28-5ef1-43b2-bdda-c661a1aa4436\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-p2bgg"
Sep 08 14:03:17.569958 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:17.569939    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ecf33b28-5ef1-43b2-bdda-c661a1aa4436-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84995cf88c-p2bgg\" (UID: \"ecf33b28-5ef1-43b2-bdda-c661a1aa4436\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-p2bgg"
Sep 08 14:03:17.595018 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:17.594992    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtbss\" (UniqueName: \"kubernetes.io/projected/ecf33b28-5ef1-43b2-bdda-c661a1aa4436-kube-api-access-wtbss\") pod \"kuadrant-operator-controller-manager-84995cf88c-p2bgg\" (UID: \"ecf33b28-5ef1-43b2-bdda-c661a1aa4436\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-p2bgg"
Sep 08 14:03:17.700810 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:17.700730    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-p2bgg"
Sep 08 14:03:17.989912 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:17.989890    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-p2bgg"]
Sep 08 14:03:17.992328 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:03:17.992302    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecf33b28_5ef1_43b2_bdda_c661a1aa4436.slice/crio-26dee0e49395daa3dc1df045d269b21a2494fa603daf34f5f7aa1ab54df21318 WatchSource:0}: Error finding container 26dee0e49395daa3dc1df045d269b21a2494fa603daf34f5f7aa1ab54df21318: Status 404 returned error can't find the container with id 26dee0e49395daa3dc1df045d269b21a2494fa603daf34f5f7aa1ab54df21318
Sep 08 14:03:18.203126 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:18.203086    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-p2bgg" event={"ID":"ecf33b28-5ef1-43b2-bdda-c661a1aa4436","Type":"ContainerStarted","Data":"26dee0e49395daa3dc1df045d269b21a2494fa603daf34f5f7aa1ab54df21318"}
Sep 08 14:03:21.159595 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:21.159558    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-ffcddf5cd-44ttm"]
Sep 08 14:03:21.162220 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:21.162196    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-44ttm"
Sep 08 14:03:21.164836 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:21.164812    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-mmxz7\""
Sep 08 14:03:21.165189 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:21.165169    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 08 14:03:21.189319 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:21.189294    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-ffcddf5cd-44ttm"]
Sep 08 14:03:21.200422 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:21.200393    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nzwx\" (UniqueName: \"kubernetes.io/projected/42eeff20-c5a8-4e27-9aba-693c9ff3ff65-kube-api-access-9nzwx\") pod \"dns-operator-controller-manager-ffcddf5cd-44ttm\" (UID: \"42eeff20-c5a8-4e27-9aba-693c9ff3ff65\") " pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-44ttm"
Sep 08 14:03:21.301623 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:21.301573    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nzwx\" (UniqueName: \"kubernetes.io/projected/42eeff20-c5a8-4e27-9aba-693c9ff3ff65-kube-api-access-9nzwx\") pod \"dns-operator-controller-manager-ffcddf5cd-44ttm\" (UID: \"42eeff20-c5a8-4e27-9aba-693c9ff3ff65\") " pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-44ttm"
Sep 08 14:03:21.311968 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:21.311941    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nzwx\" (UniqueName: \"kubernetes.io/projected/42eeff20-c5a8-4e27-9aba-693c9ff3ff65-kube-api-access-9nzwx\") pod \"dns-operator-controller-manager-ffcddf5cd-44ttm\" (UID: \"42eeff20-c5a8-4e27-9aba-693c9ff3ff65\") " pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-44ttm"
Sep 08 14:03:21.475343 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:21.475246    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-44ttm"
Sep 08 14:03:21.775218 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:21.775184    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-ffcddf5cd-44ttm"]
Sep 08 14:03:21.777487 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:03:21.777456    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42eeff20_c5a8_4e27_9aba_693c9ff3ff65.slice/crio-3c0148719716c58b064152d917f616969d4ead1dd7ebf47eb7bea1ec00a9bc5f WatchSource:0}: Error finding container 3c0148719716c58b064152d917f616969d4ead1dd7ebf47eb7bea1ec00a9bc5f: Status 404 returned error can't find the container with id 3c0148719716c58b064152d917f616969d4ead1dd7ebf47eb7bea1ec00a9bc5f
Sep 08 14:03:22.227638 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:22.227604    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-44ttm" event={"ID":"42eeff20-c5a8-4e27-9aba-693c9ff3ff65","Type":"ContainerStarted","Data":"3c0148719716c58b064152d917f616969d4ead1dd7ebf47eb7bea1ec00a9bc5f"}
Sep 08 14:03:22.229366 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:22.229343    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-p2bgg" event={"ID":"ecf33b28-5ef1-43b2-bdda-c661a1aa4436","Type":"ContainerStarted","Data":"98574e2d7aa492af12a189fc39f6ed7fb2789f4d4a93c3ab0bdfcaebcd9414da"}
Sep 08 14:03:22.229495 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:22.229474    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-p2bgg"
Sep 08 14:03:22.254349 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:22.254308    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-p2bgg" podStartSLOduration=1.6907599549999999 podStartE2EDuration="5.254296405s" totalImagesPullingTime="3.56353645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:03:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:03:22.253047529 +0000 UTC m=+277.742764580" watchObservedRunningTime="2026-09-08 14:03:22.254296405 +0000 UTC m=+277.744013456"
Sep 08 14:03:24.919519 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:24.919472    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb"]
Sep 08 14:03:24.922258 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:24.922240    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb"
Sep 08 14:03:24.930213 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:03:24.930186    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-webhook-cert\" is forbidden: User \"system:node:ip-10-0-130-125.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub-operator-system\": no relationship found between node 'ip-10-0-130-125.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" type="*v1.Secret"
Sep 08 14:03:24.930385 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:03:24.930303    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"opendatahub-operator-controller-manager-77cd5f6c85-g7hkb\" is forbidden: User \"system:node:ip-10-0-130-125.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub-operator-system\": no relationship found between node 'ip-10-0-130-125.ec2.internal' and this object" podUID="f30c8922-c82c-42fb-b5cc-09179dc8743a" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb"
Sep 08 14:03:24.930385 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:03:24.930325    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-125.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"opendatahub-operator-system\": no relationship found between node 'ip-10-0-130-125.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Sep 08 14:03:24.930385 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:03:24.930325    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-dockercfg-kzwgl\" is forbidden: User \"system:node:ip-10-0-130-125.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub-operator-system\": no relationship found between node 'ip-10-0-130-125.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-kzwgl\"" type="*v1.Secret"
Sep 08 14:03:24.930385 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:03:24.930330    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-service-cert\" is forbidden: User \"system:node:ip-10-0-130-125.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub-operator-system\": no relationship found between node 'ip-10-0-130-125.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" type="*v1.Secret"
Sep 08 14:03:24.930664 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:03:24.930469    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-125.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"opendatahub-operator-system\": no relationship found between node 'ip-10-0-130-125.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Sep 08 14:03:24.930850 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:03:24.930775    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-metrics-tls\" is forbidden: User \"system:node:ip-10-0-130-125.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub-operator-system\": no relationship found between node 'ip-10-0-130-125.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" type="*v1.Secret"
Sep 08 14:03:24.941721 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:24.941694    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb"]
Sep 08 14:03:25.031911 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:25.031877    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f30c8922-c82c-42fb-b5cc-09179dc8743a-manifests\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-g7hkb\" (UID: \"f30c8922-c82c-42fb-b5cc-09179dc8743a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb"
Sep 08 14:03:25.032127 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:25.031923    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f30c8922-c82c-42fb-b5cc-09179dc8743a-metrics-cert\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-g7hkb\" (UID: \"f30c8922-c82c-42fb-b5cc-09179dc8743a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb"
Sep 08 14:03:25.032127 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:25.031942    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sr7b\" (UniqueName: \"kubernetes.io/projected/f30c8922-c82c-42fb-b5cc-09179dc8743a-kube-api-access-9sr7b\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-g7hkb\" (UID: \"f30c8922-c82c-42fb-b5cc-09179dc8743a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb"
Sep 08 14:03:25.032127 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:25.031961    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f30c8922-c82c-42fb-b5cc-09179dc8743a-tmp\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-g7hkb\" (UID: \"f30c8922-c82c-42fb-b5cc-09179dc8743a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb"
Sep 08 14:03:25.032127 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:25.032026    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f30c8922-c82c-42fb-b5cc-09179dc8743a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-g7hkb\" (UID: \"f30c8922-c82c-42fb-b5cc-09179dc8743a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb"
Sep 08 14:03:25.032127 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:25.032117    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f30c8922-c82c-42fb-b5cc-09179dc8743a-webhook-cert\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-g7hkb\" (UID: \"f30c8922-c82c-42fb-b5cc-09179dc8743a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb"
Sep 08 14:03:25.133154 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:25.133120    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f30c8922-c82c-42fb-b5cc-09179dc8743a-webhook-cert\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-g7hkb\" (UID: \"f30c8922-c82c-42fb-b5cc-09179dc8743a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb"
Sep 08 14:03:25.133331 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:25.133179    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f30c8922-c82c-42fb-b5cc-09179dc8743a-manifests\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-g7hkb\" (UID: \"f30c8922-c82c-42fb-b5cc-09179dc8743a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb"
Sep 08 14:03:25.133331 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:25.133211    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f30c8922-c82c-42fb-b5cc-09179dc8743a-metrics-cert\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-g7hkb\" (UID: \"f30c8922-c82c-42fb-b5cc-09179dc8743a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb"
Sep 08 14:03:25.133331 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:25.133226    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sr7b\" (UniqueName: \"kubernetes.io/projected/f30c8922-c82c-42fb-b5cc-09179dc8743a-kube-api-access-9sr7b\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-g7hkb\" (UID: \"f30c8922-c82c-42fb-b5cc-09179dc8743a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb"
Sep 08 14:03:25.133331 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:25.133244    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f30c8922-c82c-42fb-b5cc-09179dc8743a-tmp\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-g7hkb\" (UID: \"f30c8922-c82c-42fb-b5cc-09179dc8743a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb"
Sep 08 14:03:25.133331 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:25.133269    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f30c8922-c82c-42fb-b5cc-09179dc8743a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-g7hkb\" (UID: \"f30c8922-c82c-42fb-b5cc-09179dc8743a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb"
Sep 08 14:03:25.133667 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:25.133645    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f30c8922-c82c-42fb-b5cc-09179dc8743a-manifests\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-g7hkb\" (UID: \"f30c8922-c82c-42fb-b5cc-09179dc8743a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb"
Sep 08 14:03:25.135507 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:25.135489    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f30c8922-c82c-42fb-b5cc-09179dc8743a-tmp\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-g7hkb\" (UID: \"f30c8922-c82c-42fb-b5cc-09179dc8743a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb"
Sep 08 14:03:25.905743 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:25.905710    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Sep 08 14:03:25.917984 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:25.917956    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-c4fzp"]
Sep 08 14:03:25.920257 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:25.920243    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-c4fzp"
Sep 08 14:03:25.923454 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:25.923430    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 08 14:03:25.923557 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:25.923489    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-fm9vc\""
Sep 08 14:03:25.923557 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:25.923498    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 08 14:03:25.935606 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:25.935523    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-c4fzp"]
Sep 08 14:03:25.951521 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:25.951493    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnb9l\" (UniqueName: \"kubernetes.io/projected/cfca69eb-3680-46a8-9961-d49d8be8f802-kube-api-access-jnb9l\") pod \"cert-manager-55b4d954d5-c4fzp\" (UID: \"cfca69eb-3680-46a8-9961-d49d8be8f802\") " pod="cert-manager/cert-manager-55b4d954d5-c4fzp"
Sep 08 14:03:25.951720 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:25.951701    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfca69eb-3680-46a8-9961-d49d8be8f802-bound-sa-token\") pod \"cert-manager-55b4d954d5-c4fzp\" (UID: \"cfca69eb-3680-46a8-9961-d49d8be8f802\") " pod="cert-manager/cert-manager-55b4d954d5-c4fzp"
Sep 08 14:03:26.009598 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:26.009569    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-565895c755-z64ls"]
Sep 08 14:03:26.012131 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:26.012116    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-z64ls"
Sep 08 14:03:26.015131 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:26.015110    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-mbsq2\""
Sep 08 14:03:26.026973 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:26.026948    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-565895c755-z64ls"]
Sep 08 14:03:26.052930 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:26.052911    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnb9l\" (UniqueName: \"kubernetes.io/projected/cfca69eb-3680-46a8-9961-d49d8be8f802-kube-api-access-jnb9l\") pod \"cert-manager-55b4d954d5-c4fzp\" (UID: \"cfca69eb-3680-46a8-9961-d49d8be8f802\") " pod="cert-manager/cert-manager-55b4d954d5-c4fzp"
Sep 08 14:03:26.053027 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:26.052947    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfca69eb-3680-46a8-9961-d49d8be8f802-bound-sa-token\") pod \"cert-manager-55b4d954d5-c4fzp\" (UID: \"cfca69eb-3680-46a8-9961-d49d8be8f802\") " pod="cert-manager/cert-manager-55b4d954d5-c4fzp"
Sep 08 14:03:26.053123 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:26.053101    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh7jm\" (UniqueName: \"kubernetes.io/projected/919aa0f6-0f64-4e0f-91b4-50dc8baa324c-kube-api-access-wh7jm\") pod \"limitador-operator-controller-manager-565895c755-z64ls\" (UID: \"919aa0f6-0f64-4e0f-91b4-50dc8baa324c\") " pod="kuadrant-system/limitador-operator-controller-manager-565895c755-z64ls"
Sep 08 14:03:26.066755 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:26.066733    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnb9l\" (UniqueName: \"kubernetes.io/projected/cfca69eb-3680-46a8-9961-d49d8be8f802-kube-api-access-jnb9l\") pod \"cert-manager-55b4d954d5-c4fzp\" (UID: \"cfca69eb-3680-46a8-9961-d49d8be8f802\") " pod="cert-manager/cert-manager-55b4d954d5-c4fzp"
Sep 08 14:03:26.082372 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:26.082345    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfca69eb-3680-46a8-9961-d49d8be8f802-bound-sa-token\") pod \"cert-manager-55b4d954d5-c4fzp\" (UID: \"cfca69eb-3680-46a8-9961-d49d8be8f802\") " pod="cert-manager/cert-manager-55b4d954d5-c4fzp"
Sep 08 14:03:26.121631 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:26.121611    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Sep 08 14:03:26.125967 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:26.125943    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sr7b\" (UniqueName: \"kubernetes.io/projected/f30c8922-c82c-42fb-b5cc-09179dc8743a-kube-api-access-9sr7b\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-g7hkb\" (UID: \"f30c8922-c82c-42fb-b5cc-09179dc8743a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb"
Sep 08 14:03:26.133510 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:03:26.133486    2575 secret.go:189] Couldn't get secret opendatahub-operator-system/opendatahub-operator-metrics-tls: failed to sync secret cache: timed out waiting for the condition
Sep 08 14:03:26.133510 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:03:26.133499    2575 secret.go:189] Couldn't get secret opendatahub-operator-system/opendatahub-operator-controller-manager-service-cert: failed to sync secret cache: timed out waiting for the condition
Sep 08 14:03:26.133643 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:03:26.133490    2575 secret.go:189] Couldn't get secret opendatahub-operator-system/opendatahub-operator-controller-manager-service-cert: failed to sync secret cache: timed out waiting for the condition
Sep 08 14:03:26.133643 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:03:26.133552    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f30c8922-c82c-42fb-b5cc-09179dc8743a-metrics-cert podName:f30c8922-c82c-42fb-b5cc-09179dc8743a nodeName:}" failed. No retries permitted until 2026-09-08 14:03:26.633534942 +0000 UTC m=+282.123251975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-cert" (UniqueName: "kubernetes.io/secret/f30c8922-c82c-42fb-b5cc-09179dc8743a-metrics-cert") pod "opendatahub-operator-controller-manager-77cd5f6c85-g7hkb" (UID: "f30c8922-c82c-42fb-b5cc-09179dc8743a") : failed to sync secret cache: timed out waiting for the condition
Sep 08 14:03:26.133643 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:03:26.133568    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f30c8922-c82c-42fb-b5cc-09179dc8743a-webhook-cert podName:f30c8922-c82c-42fb-b5cc-09179dc8743a nodeName:}" failed. No retries permitted until 2026-09-08 14:03:26.63355745 +0000 UTC m=+282.123274484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/f30c8922-c82c-42fb-b5cc-09179dc8743a-webhook-cert") pod "opendatahub-operator-controller-manager-77cd5f6c85-g7hkb" (UID: "f30c8922-c82c-42fb-b5cc-09179dc8743a") : failed to sync secret cache: timed out waiting for the condition
Sep 08 14:03:26.133643 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:03:26.133582    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f30c8922-c82c-42fb-b5cc-09179dc8743a-apiservice-cert podName:f30c8922-c82c-42fb-b5cc-09179dc8743a nodeName:}" failed. No retries permitted until 2026-09-08 14:03:26.633574774 +0000 UTC m=+282.123291807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "apiservice-cert" (UniqueName: "kubernetes.io/secret/f30c8922-c82c-42fb-b5cc-09179dc8743a-apiservice-cert") pod "opendatahub-operator-controller-manager-77cd5f6c85-g7hkb" (UID: "f30c8922-c82c-42fb-b5cc-09179dc8743a") : failed to sync secret cache: timed out waiting for the condition
Sep 08 14:03:26.154537 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:26.154512    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh7jm\" (UniqueName: \"kubernetes.io/projected/919aa0f6-0f64-4e0f-91b4-50dc8baa324c-kube-api-access-wh7jm\") pod \"limitador-operator-controller-manager-565895c755-z64ls\" (UID: \"919aa0f6-0f64-4e0f-91b4-50dc8baa324c\") " pod="kuadrant-system/limitador-operator-controller-manager-565895c755-z64ls"
Sep 08 14:03:26.168584 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:26.168526    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh7jm\" (UniqueName: \"kubernetes.io/projected/919aa0f6-0f64-4e0f-91b4-50dc8baa324c-kube-api-access-wh7jm\") pod \"limitador-operator-controller-manager-565895c755-z64ls\" (UID: \"919aa0f6-0f64-4e0f-91b4-50dc8baa324c\") " pod="kuadrant-system/limitador-operator-controller-manager-565895c755-z64ls"
Sep 08 14:03:26.180348 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:26.180323    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 08 14:03:26.204730 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:26.204708    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Sep 08 14:03:26.229494 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:26.229474    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-c4fzp"
Sep 08 14:03:26.266094 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:26.265979    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 08 14:03:26.322532 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:26.322500    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-z64ls"
Sep 08 14:03:26.502084 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:26.501996    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-kzwgl\""
Sep 08 14:03:26.516630 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:26.516601    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-c4fzp"]
Sep 08 14:03:26.523648 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:03:26.523625    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcfca69eb_3680_46a8_9961_d49d8be8f802.slice/crio-9b5dafa549b03877eb4ab054484b6b2eb2ac8cf6f2e7cdeea22f2740840a2d82 WatchSource:0}: Error finding container 9b5dafa549b03877eb4ab054484b6b2eb2ac8cf6f2e7cdeea22f2740840a2d82: Status 404 returned error can't find the container with id 9b5dafa549b03877eb4ab054484b6b2eb2ac8cf6f2e7cdeea22f2740840a2d82
Sep 08 14:03:26.642573 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:26.642545    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-565895c755-z64ls"]
Sep 08 14:03:26.645487 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:03:26.645462    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod919aa0f6_0f64_4e0f_91b4_50dc8baa324c.slice/crio-a0deab867a2f54cfff9c96822b1cc535c3fc0daeb7628c8b8b9567ff15a427ea WatchSource:0}: Error finding container a0deab867a2f54cfff9c96822b1cc535c3fc0daeb7628c8b8b9567ff15a427ea: Status 404 returned error can't find the container with id a0deab867a2f54cfff9c96822b1cc535c3fc0daeb7628c8b8b9567ff15a427ea
Sep 08 14:03:26.658435 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:26.658411    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f30c8922-c82c-42fb-b5cc-09179dc8743a-metrics-cert\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-g7hkb\" (UID: \"f30c8922-c82c-42fb-b5cc-09179dc8743a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb"
Sep 08 14:03:26.658538 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:26.658459    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f30c8922-c82c-42fb-b5cc-09179dc8743a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-g7hkb\" (UID: \"f30c8922-c82c-42fb-b5cc-09179dc8743a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb"
Sep 08 14:03:26.658538 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:26.658505    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f30c8922-c82c-42fb-b5cc-09179dc8743a-webhook-cert\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-g7hkb\" (UID: \"f30c8922-c82c-42fb-b5cc-09179dc8743a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb"
Sep 08 14:03:26.661045 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:26.661022    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f30c8922-c82c-42fb-b5cc-09179dc8743a-metrics-cert\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-g7hkb\" (UID: \"f30c8922-c82c-42fb-b5cc-09179dc8743a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb"
Sep 08 14:03:26.661136 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:26.661105    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f30c8922-c82c-42fb-b5cc-09179dc8743a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-g7hkb\" (UID: \"f30c8922-c82c-42fb-b5cc-09179dc8743a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb"
Sep 08 14:03:26.661182 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:26.661143    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f30c8922-c82c-42fb-b5cc-09179dc8743a-webhook-cert\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-g7hkb\" (UID: \"f30c8922-c82c-42fb-b5cc-09179dc8743a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb"
Sep 08 14:03:26.732788 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:26.732759    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb"
Sep 08 14:03:27.017128 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:27.017089    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb"]
Sep 08 14:03:27.018758 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:03:27.018708    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf30c8922_c82c_42fb_b5cc_09179dc8743a.slice/crio-ef85a54112bd069a1cad78b3e28a9e5561bc6727da3c7e467bf4c3994d47d5b5 WatchSource:0}: Error finding container ef85a54112bd069a1cad78b3e28a9e5561bc6727da3c7e467bf4c3994d47d5b5: Status 404 returned error can't find the container with id ef85a54112bd069a1cad78b3e28a9e5561bc6727da3c7e467bf4c3994d47d5b5
Sep 08 14:03:27.256577 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:27.256540    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb" event={"ID":"f30c8922-c82c-42fb-b5cc-09179dc8743a","Type":"ContainerStarted","Data":"ef85a54112bd069a1cad78b3e28a9e5561bc6727da3c7e467bf4c3994d47d5b5"}
Sep 08 14:03:27.258454 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:27.258424    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-c4fzp" event={"ID":"cfca69eb-3680-46a8-9961-d49d8be8f802","Type":"ContainerStarted","Data":"9b5dafa549b03877eb4ab054484b6b2eb2ac8cf6f2e7cdeea22f2740840a2d82"}
Sep 08 14:03:27.259965 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:27.259936    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-z64ls" event={"ID":"919aa0f6-0f64-4e0f-91b4-50dc8baa324c","Type":"ContainerStarted","Data":"a0deab867a2f54cfff9c96822b1cc535c3fc0daeb7628c8b8b9567ff15a427ea"}
Sep 08 14:03:28.271234 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:28.271098    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-z64ls" event={"ID":"919aa0f6-0f64-4e0f-91b4-50dc8baa324c","Type":"ContainerStarted","Data":"43a87c03b47dddce52bb52be21f4063f36cfd2feecff6df3167acf244679c57c"}
Sep 08 14:03:28.271234 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:28.271198    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-z64ls"
Sep 08 14:03:28.292630 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:28.292505    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-z64ls" podStartSLOduration=1.838916824 podStartE2EDuration="3.292487484s" totalImagesPullingTime="1.45357066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:03:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:03:28.290246653 +0000 UTC m=+283.779963707" watchObservedRunningTime="2026-09-08 14:03:28.292487484 +0000 UTC m=+283.782204535"
Sep 08 14:03:30.285776 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:30.285740    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-84d9bfc694-l6dmr"]
Sep 08 14:03:30.289626 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:30.289601    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-84d9bfc694-l6dmr"
Sep 08 14:03:30.292323 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:30.292301    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-mbskw\""
Sep 08 14:03:30.305107 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:30.305085    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-84d9bfc694-l6dmr"]
Sep 08 14:03:30.392767 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:30.392730    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrlx5\" (UniqueName: \"kubernetes.io/projected/d72465de-118e-4209-be33-c726adcfbb03-kube-api-access-mrlx5\") pod \"authorino-operator-84d9bfc694-l6dmr\" (UID: \"d72465de-118e-4209-be33-c726adcfbb03\") " pod="kuadrant-system/authorino-operator-84d9bfc694-l6dmr"
Sep 08 14:03:30.493550 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:30.493513    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrlx5\" (UniqueName: \"kubernetes.io/projected/d72465de-118e-4209-be33-c726adcfbb03-kube-api-access-mrlx5\") pod \"authorino-operator-84d9bfc694-l6dmr\" (UID: \"d72465de-118e-4209-be33-c726adcfbb03\") " pod="kuadrant-system/authorino-operator-84d9bfc694-l6dmr"
Sep 08 14:03:30.504761 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:30.504730    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrlx5\" (UniqueName: \"kubernetes.io/projected/d72465de-118e-4209-be33-c726adcfbb03-kube-api-access-mrlx5\") pod \"authorino-operator-84d9bfc694-l6dmr\" (UID: \"d72465de-118e-4209-be33-c726adcfbb03\") " pod="kuadrant-system/authorino-operator-84d9bfc694-l6dmr"
Sep 08 14:03:30.601241 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:30.601209    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-84d9bfc694-l6dmr"
Sep 08 14:03:31.191803 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:31.191780    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-84d9bfc694-l6dmr"]
Sep 08 14:03:31.193468 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:03:31.193436    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd72465de_118e_4209_be33_c726adcfbb03.slice/crio-1c83a26b748bf92d0d9883600c5c891ef897ec4ecbe2e72bb2f7c14199f2296c WatchSource:0}: Error finding container 1c83a26b748bf92d0d9883600c5c891ef897ec4ecbe2e72bb2f7c14199f2296c: Status 404 returned error can't find the container with id 1c83a26b748bf92d0d9883600c5c891ef897ec4ecbe2e72bb2f7c14199f2296c
Sep 08 14:03:31.290722 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:31.290690    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-84d9bfc694-l6dmr" event={"ID":"d72465de-118e-4209-be33-c726adcfbb03","Type":"ContainerStarted","Data":"1c83a26b748bf92d0d9883600c5c891ef897ec4ecbe2e72bb2f7c14199f2296c"}
Sep 08 14:03:31.292344 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:31.292316    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb" event={"ID":"f30c8922-c82c-42fb-b5cc-09179dc8743a","Type":"ContainerStarted","Data":"711fbbed096d2fb48d7fbbba143e9f0f81a3330b6cdc5d5ec48f177312319491"}
Sep 08 14:03:31.293974 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:31.293950    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-c4fzp" event={"ID":"cfca69eb-3680-46a8-9961-d49d8be8f802","Type":"ContainerStarted","Data":"18f61d1611bd473df8305ec87b5a62eb1bddce425a858199ebdc37d458982a49"}
Sep 08 14:03:31.339258 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:31.339209    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-c4fzp" podStartSLOduration=1.94127195 podStartE2EDuration="6.339195199s" totalImagesPullingTime="4.397923249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:03:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:03:31.337443098 +0000 UTC m=+286.827160160" watchObservedRunningTime="2026-09-08 14:03:31.339195199 +0000 UTC m=+286.828912250"
Sep 08 14:03:32.300276 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:32.300242    2575 generic.go:356] "Generic (PLEG): container finished" podID="f30c8922-c82c-42fb-b5cc-09179dc8743a" containerID="711fbbed096d2fb48d7fbbba143e9f0f81a3330b6cdc5d5ec48f177312319491" exitCode=0
Sep 08 14:03:32.300555 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:32.300316    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb" event={"ID":"f30c8922-c82c-42fb-b5cc-09179dc8743a","Type":"ContainerDied","Data":"711fbbed096d2fb48d7fbbba143e9f0f81a3330b6cdc5d5ec48f177312319491"}
Sep 08 14:03:33.236702 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:33.236670    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-p2bgg"
Sep 08 14:03:33.307146 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:33.307108    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb" event={"ID":"f30c8922-c82c-42fb-b5cc-09179dc8743a","Type":"ContainerStarted","Data":"e7c78a76e778a8e3a593a6938a90c32649aa1304dfcdad1a17eec3eecb4c0ba0"}
Sep 08 14:03:33.307570 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:33.307200    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb"
Sep 08 14:03:33.308975 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:33.308951    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-84d9bfc694-l6dmr" event={"ID":"d72465de-118e-4209-be33-c726adcfbb03","Type":"ContainerStarted","Data":"cfcba098bbe75b3d960536363bfe7f7be383e83a969bd6371999a176da7dee53"}
Sep 08 14:03:33.309134 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:33.309091    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-84d9bfc694-l6dmr"
Sep 08 14:03:33.349143 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:33.349098    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb" podStartSLOduration=4.472990729 podStartE2EDuration="9.349083603s" totalImagesPullingTime="4.363628769s" totalInitContainerRuntime="512.464105ms" isStatefulPod=false podCreationTimestamp="2026-09-08 14:03:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:03:33.344624553 +0000 UTC m=+288.834341605" watchObservedRunningTime="2026-09-08 14:03:33.349083603 +0000 UTC m=+288.838800652"
Sep 08 14:03:33.374308 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:33.374268    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-84d9bfc694-l6dmr" podStartSLOduration=2.273446984 podStartE2EDuration="3.374253725s" totalImagesPullingTime="1.100806741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:03:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:03:33.371660924 +0000 UTC m=+288.861377975" watchObservedRunningTime="2026-09-08 14:03:33.374253725 +0000 UTC m=+288.863970775"
Sep 08 14:03:36.326132 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:36.326094    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-44ttm" event={"ID":"42eeff20-c5a8-4e27-9aba-693c9ff3ff65","Type":"ContainerStarted","Data":"5fdb2498a1b00f1b2d342799eec684ae03acd0b4431cdd71de09699da5985b2a"}
Sep 08 14:03:36.326545 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:36.326272    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-44ttm"
Sep 08 14:03:36.347495 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:36.347446    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-44ttm" podStartSLOduration=1.402472615 podStartE2EDuration="15.347431919s" totalImagesPullingTime="13.944959304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:03:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:03:36.345691195 +0000 UTC m=+291.835408248" watchObservedRunningTime="2026-09-08 14:03:36.347431919 +0000 UTC m=+291.837148970"
Sep 08 14:03:39.281842 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:39.281807    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-z64ls"
Sep 08 14:03:44.316440 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:44.316410    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-g7hkb"
Sep 08 14:03:44.316804 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:44.316479    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-84d9bfc694-l6dmr"
Sep 08 14:03:44.909008 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:44.908983    2575 kubelet.go:1648] "Image garbage collection succeeded"
Sep 08 14:03:47.333563 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:47.333527    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-44ttm"
Sep 08 14:03:50.066019 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:50.065987    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-p2bgg"]
Sep 08 14:03:50.066395 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:50.066200    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-p2bgg" podUID="ecf33b28-5ef1-43b2-bdda-c661a1aa4436" containerName="manager" containerID="cri-o://98574e2d7aa492af12a189fc39f6ed7fb2789f4d4a93c3ab0bdfcaebcd9414da" gracePeriod=10
Sep 08 14:03:50.309626 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:50.309594    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-p2bgg"
Sep 08 14:03:50.394375 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:50.394340    2575 generic.go:356] "Generic (PLEG): container finished" podID="ecf33b28-5ef1-43b2-bdda-c661a1aa4436" containerID="98574e2d7aa492af12a189fc39f6ed7fb2789f4d4a93c3ab0bdfcaebcd9414da" exitCode=0
Sep 08 14:03:50.394543 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:50.394381    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-p2bgg"
Sep 08 14:03:50.394543 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:50.394430    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-p2bgg" event={"ID":"ecf33b28-5ef1-43b2-bdda-c661a1aa4436","Type":"ContainerDied","Data":"98574e2d7aa492af12a189fc39f6ed7fb2789f4d4a93c3ab0bdfcaebcd9414da"}
Sep 08 14:03:50.394543 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:50.394523    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-p2bgg" event={"ID":"ecf33b28-5ef1-43b2-bdda-c661a1aa4436","Type":"ContainerDied","Data":"26dee0e49395daa3dc1df045d269b21a2494fa603daf34f5f7aa1ab54df21318"}
Sep 08 14:03:50.394709 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:50.394553    2575 scope.go:117] "RemoveContainer" containerID="98574e2d7aa492af12a189fc39f6ed7fb2789f4d4a93c3ab0bdfcaebcd9414da"
Sep 08 14:03:50.403037 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:50.403019    2575 scope.go:117] "RemoveContainer" containerID="98574e2d7aa492af12a189fc39f6ed7fb2789f4d4a93c3ab0bdfcaebcd9414da"
Sep 08 14:03:50.403411 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:03:50.403392    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98574e2d7aa492af12a189fc39f6ed7fb2789f4d4a93c3ab0bdfcaebcd9414da\": container with ID starting with 98574e2d7aa492af12a189fc39f6ed7fb2789f4d4a93c3ab0bdfcaebcd9414da not found: ID does not exist" containerID="98574e2d7aa492af12a189fc39f6ed7fb2789f4d4a93c3ab0bdfcaebcd9414da"
Sep 08 14:03:50.403460 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:50.403424    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98574e2d7aa492af12a189fc39f6ed7fb2789f4d4a93c3ab0bdfcaebcd9414da"} err="failed to get container status \"98574e2d7aa492af12a189fc39f6ed7fb2789f4d4a93c3ab0bdfcaebcd9414da\": rpc error: code = NotFound desc = could not find container \"98574e2d7aa492af12a189fc39f6ed7fb2789f4d4a93c3ab0bdfcaebcd9414da\": container with ID starting with 98574e2d7aa492af12a189fc39f6ed7fb2789f4d4a93c3ab0bdfcaebcd9414da not found: ID does not exist"
Sep 08 14:03:50.449826 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:50.449799    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ecf33b28-5ef1-43b2-bdda-c661a1aa4436-extensions-socket-volume\") pod \"ecf33b28-5ef1-43b2-bdda-c661a1aa4436\" (UID: \"ecf33b28-5ef1-43b2-bdda-c661a1aa4436\") "
Sep 08 14:03:50.449959 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:50.449885    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtbss\" (UniqueName: \"kubernetes.io/projected/ecf33b28-5ef1-43b2-bdda-c661a1aa4436-kube-api-access-wtbss\") pod \"ecf33b28-5ef1-43b2-bdda-c661a1aa4436\" (UID: \"ecf33b28-5ef1-43b2-bdda-c661a1aa4436\") "
Sep 08 14:03:50.450269 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:50.450239    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecf33b28-5ef1-43b2-bdda-c661a1aa4436-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ecf33b28-5ef1-43b2-bdda-c661a1aa4436" (UID: "ecf33b28-5ef1-43b2-bdda-c661a1aa4436"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:03:50.452205 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:50.452180    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecf33b28-5ef1-43b2-bdda-c661a1aa4436-kube-api-access-wtbss" (OuterVolumeSpecName: "kube-api-access-wtbss") pod "ecf33b28-5ef1-43b2-bdda-c661a1aa4436" (UID: "ecf33b28-5ef1-43b2-bdda-c661a1aa4436"). InnerVolumeSpecName "kube-api-access-wtbss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:03:50.551049 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:50.551012    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ecf33b28-5ef1-43b2-bdda-c661a1aa4436-extensions-socket-volume\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:03:50.551049 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:50.551042    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtbss\" (UniqueName: \"kubernetes.io/projected/ecf33b28-5ef1-43b2-bdda-c661a1aa4436-kube-api-access-wtbss\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:03:50.726533 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:50.726503    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-p2bgg"]
Sep 08 14:03:50.734590 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:50.734569    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-p2bgg"]
Sep 08 14:03:50.973285 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:03:50.973210    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecf33b28-5ef1-43b2-bdda-c661a1aa4436" path="/var/lib/kubelet/pods/ecf33b28-5ef1-43b2-bdda-c661a1aa4436/volumes"
Sep 08 14:04:00.775369 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:00.775337    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"]
Sep 08 14:04:00.775938 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:00.775693    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecf33b28-5ef1-43b2-bdda-c661a1aa4436" containerName="manager"
Sep 08 14:04:00.775938 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:00.775707    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecf33b28-5ef1-43b2-bdda-c661a1aa4436" containerName="manager"
Sep 08 14:04:00.775938 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:00.775769    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecf33b28-5ef1-43b2-bdda-c661a1aa4436" containerName="manager"
Sep 08 14:04:00.785284 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:00.785265    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:00.788337 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:00.788310    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-2z7vx\""
Sep 08 14:04:00.790768 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:00.790744    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"]
Sep 08 14:04:00.933692 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:00.933653    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fdaa6f4-1805-4368-bc9d-e4db8ac4922d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s\" (UID: \"9fdaa6f4-1805-4368-bc9d-e4db8ac4922d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:00.933692 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:00.933687    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fdaa6f4-1805-4368-bc9d-e4db8ac4922d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s\" (UID: \"9fdaa6f4-1805-4368-bc9d-e4db8ac4922d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:00.933934 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:00.933706    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fdaa6f4-1805-4368-bc9d-e4db8ac4922d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s\" (UID: \"9fdaa6f4-1805-4368-bc9d-e4db8ac4922d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:00.933934 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:00.933774    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fdaa6f4-1805-4368-bc9d-e4db8ac4922d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s\" (UID: \"9fdaa6f4-1805-4368-bc9d-e4db8ac4922d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:00.933934 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:00.933839    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fdaa6f4-1805-4368-bc9d-e4db8ac4922d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s\" (UID: \"9fdaa6f4-1805-4368-bc9d-e4db8ac4922d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:00.933934 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:00.933870    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fdaa6f4-1805-4368-bc9d-e4db8ac4922d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s\" (UID: \"9fdaa6f4-1805-4368-bc9d-e4db8ac4922d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:00.934172 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:00.933940    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fdaa6f4-1805-4368-bc9d-e4db8ac4922d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s\" (UID: \"9fdaa6f4-1805-4368-bc9d-e4db8ac4922d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:00.934172 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:00.933982    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh6px\" (UniqueName: \"kubernetes.io/projected/9fdaa6f4-1805-4368-bc9d-e4db8ac4922d-kube-api-access-kh6px\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s\" (UID: \"9fdaa6f4-1805-4368-bc9d-e4db8ac4922d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:00.934172 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:00.934030    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fdaa6f4-1805-4368-bc9d-e4db8ac4922d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s\" (UID: \"9fdaa6f4-1805-4368-bc9d-e4db8ac4922d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:01.035145 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.035039    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fdaa6f4-1805-4368-bc9d-e4db8ac4922d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s\" (UID: \"9fdaa6f4-1805-4368-bc9d-e4db8ac4922d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:01.035145 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.035118    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fdaa6f4-1805-4368-bc9d-e4db8ac4922d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s\" (UID: \"9fdaa6f4-1805-4368-bc9d-e4db8ac4922d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:01.035365 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.035152    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fdaa6f4-1805-4368-bc9d-e4db8ac4922d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s\" (UID: \"9fdaa6f4-1805-4368-bc9d-e4db8ac4922d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:01.035365 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.035172    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh6px\" (UniqueName: \"kubernetes.io/projected/9fdaa6f4-1805-4368-bc9d-e4db8ac4922d-kube-api-access-kh6px\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s\" (UID: \"9fdaa6f4-1805-4368-bc9d-e4db8ac4922d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:01.035365 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.035190    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fdaa6f4-1805-4368-bc9d-e4db8ac4922d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s\" (UID: \"9fdaa6f4-1805-4368-bc9d-e4db8ac4922d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:01.035365 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.035243    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fdaa6f4-1805-4368-bc9d-e4db8ac4922d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s\" (UID: \"9fdaa6f4-1805-4368-bc9d-e4db8ac4922d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:01.035365 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.035265    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fdaa6f4-1805-4368-bc9d-e4db8ac4922d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s\" (UID: \"9fdaa6f4-1805-4368-bc9d-e4db8ac4922d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:01.035365 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.035288    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fdaa6f4-1805-4368-bc9d-e4db8ac4922d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s\" (UID: \"9fdaa6f4-1805-4368-bc9d-e4db8ac4922d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:01.035365 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.035325    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fdaa6f4-1805-4368-bc9d-e4db8ac4922d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s\" (UID: \"9fdaa6f4-1805-4368-bc9d-e4db8ac4922d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:01.036036 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.035718    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fdaa6f4-1805-4368-bc9d-e4db8ac4922d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s\" (UID: \"9fdaa6f4-1805-4368-bc9d-e4db8ac4922d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:01.036036 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.035852    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fdaa6f4-1805-4368-bc9d-e4db8ac4922d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s\" (UID: \"9fdaa6f4-1805-4368-bc9d-e4db8ac4922d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:01.036254 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.036139    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fdaa6f4-1805-4368-bc9d-e4db8ac4922d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s\" (UID: \"9fdaa6f4-1805-4368-bc9d-e4db8ac4922d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:01.036335 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.036313    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fdaa6f4-1805-4368-bc9d-e4db8ac4922d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s\" (UID: \"9fdaa6f4-1805-4368-bc9d-e4db8ac4922d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:01.036433 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.036415    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fdaa6f4-1805-4368-bc9d-e4db8ac4922d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s\" (UID: \"9fdaa6f4-1805-4368-bc9d-e4db8ac4922d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:01.037918 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.037890    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fdaa6f4-1805-4368-bc9d-e4db8ac4922d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s\" (UID: \"9fdaa6f4-1805-4368-bc9d-e4db8ac4922d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:01.038755 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.038728    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fdaa6f4-1805-4368-bc9d-e4db8ac4922d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s\" (UID: \"9fdaa6f4-1805-4368-bc9d-e4db8ac4922d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:01.044374 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.044343    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fdaa6f4-1805-4368-bc9d-e4db8ac4922d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s\" (UID: \"9fdaa6f4-1805-4368-bc9d-e4db8ac4922d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:01.044981 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.044960    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh6px\" (UniqueName: \"kubernetes.io/projected/9fdaa6f4-1805-4368-bc9d-e4db8ac4922d-kube-api-access-kh6px\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s\" (UID: \"9fdaa6f4-1805-4368-bc9d-e4db8ac4922d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:01.095999 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.095964    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:01.395363 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.395333    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"]
Sep 08 14:04:01.397385 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:04:01.397359    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fdaa6f4_1805_4368_bc9d_e4db8ac4922d.slice/crio-b606a2074df0d013f6b08640fb8c10c8dd7117758f9be81efa030c6ff4717d4e WatchSource:0}: Error finding container b606a2074df0d013f6b08640fb8c10c8dd7117758f9be81efa030c6ff4717d4e: Status 404 returned error can't find the container with id b606a2074df0d013f6b08640fb8c10c8dd7117758f9be81efa030c6ff4717d4e
Sep 08 14:04:01.399550 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.399522    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:04:01.399645 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.399629    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:04:01.399707 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.399677    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:04:01.460811 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.460765    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s" event={"ID":"9fdaa6f4-1805-4368-bc9d-e4db8ac4922d","Type":"ContainerStarted","Data":"b606a2074df0d013f6b08640fb8c10c8dd7117758f9be81efa030c6ff4717d4e"}
Sep 08 14:04:01.748265 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.748183    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-97zc6"]
Sep 08 14:04:01.751664 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.751637    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-97zc6"
Sep 08 14:04:01.754296 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.754275    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 08 14:04:01.754412 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.754325    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-shs6h\""
Sep 08 14:04:01.755084 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.755046    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 14:04:01.755150 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.755137    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 08 14:04:01.765935 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.765913    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-97zc6"]
Sep 08 14:04:01.843266 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.843232    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/981b33bf-e5b5-4c75-a53f-9e52f956adfd-data\") pod \"postgres-69fb4594cf-97zc6\" (UID: \"981b33bf-e5b5-4c75-a53f-9e52f956adfd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-97zc6"
Sep 08 14:04:01.843633 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.843298    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzpkt\" (UniqueName: \"kubernetes.io/projected/981b33bf-e5b5-4c75-a53f-9e52f956adfd-kube-api-access-hzpkt\") pod \"postgres-69fb4594cf-97zc6\" (UID: \"981b33bf-e5b5-4c75-a53f-9e52f956adfd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-97zc6"
Sep 08 14:04:01.875193 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.875161    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-module-controller-manager-54765d59fd-jkfkv"]
Sep 08 14:04:01.878415 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.878398    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-54765d59fd-jkfkv"
Sep 08 14:04:01.880893 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.880874    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-module-controller-manager-dockercfg-f9d6h\""
Sep 08 14:04:01.881131 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.881117    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\""
Sep 08 14:04:01.881325 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.881307    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 08 14:04:01.881422 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.881405    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 08 14:04:01.888610 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.888587    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-54765d59fd-jkfkv"]
Sep 08 14:04:01.944466 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.944429    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/981b33bf-e5b5-4c75-a53f-9e52f956adfd-data\") pod \"postgres-69fb4594cf-97zc6\" (UID: \"981b33bf-e5b5-4c75-a53f-9e52f956adfd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-97zc6"
Sep 08 14:04:01.944622 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.944491    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzpkt\" (UniqueName: \"kubernetes.io/projected/981b33bf-e5b5-4c75-a53f-9e52f956adfd-kube-api-access-hzpkt\") pod \"postgres-69fb4594cf-97zc6\" (UID: \"981b33bf-e5b5-4c75-a53f-9e52f956adfd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-97zc6"
Sep 08 14:04:01.944847 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.944821    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/981b33bf-e5b5-4c75-a53f-9e52f956adfd-data\") pod \"postgres-69fb4594cf-97zc6\" (UID: \"981b33bf-e5b5-4c75-a53f-9e52f956adfd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-97zc6"
Sep 08 14:04:01.952931 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:01.952906    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzpkt\" (UniqueName: \"kubernetes.io/projected/981b33bf-e5b5-4c75-a53f-9e52f956adfd-kube-api-access-hzpkt\") pod \"postgres-69fb4594cf-97zc6\" (UID: \"981b33bf-e5b5-4c75-a53f-9e52f956adfd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-97zc6"
Sep 08 14:04:02.045355 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:02.045266    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/012c765a-53d5-45d6-8436-d2e2415e29b0-tmp\") pod \"kserve-module-controller-manager-54765d59fd-jkfkv\" (UID: \"012c765a-53d5-45d6-8436-d2e2415e29b0\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-jkfkv"
Sep 08 14:04:02.045495 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:02.045357    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5twkh\" (UniqueName: \"kubernetes.io/projected/012c765a-53d5-45d6-8436-d2e2415e29b0-kube-api-access-5twkh\") pod \"kserve-module-controller-manager-54765d59fd-jkfkv\" (UID: \"012c765a-53d5-45d6-8436-d2e2415e29b0\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-jkfkv"
Sep 08 14:04:02.045495 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:02.045462    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/012c765a-53d5-45d6-8436-d2e2415e29b0-trusted-ca\") pod \"kserve-module-controller-manager-54765d59fd-jkfkv\" (UID: \"012c765a-53d5-45d6-8436-d2e2415e29b0\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-jkfkv"
Sep 08 14:04:02.045619 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:02.045495    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/012c765a-53d5-45d6-8436-d2e2415e29b0-manifests\") pod \"kserve-module-controller-manager-54765d59fd-jkfkv\" (UID: \"012c765a-53d5-45d6-8436-d2e2415e29b0\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-jkfkv"
Sep 08 14:04:02.062170 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:02.062143    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-97zc6"
Sep 08 14:04:02.146837 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:02.146799    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/012c765a-53d5-45d6-8436-d2e2415e29b0-tmp\") pod \"kserve-module-controller-manager-54765d59fd-jkfkv\" (UID: \"012c765a-53d5-45d6-8436-d2e2415e29b0\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-jkfkv"
Sep 08 14:04:02.146998 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:02.146856    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5twkh\" (UniqueName: \"kubernetes.io/projected/012c765a-53d5-45d6-8436-d2e2415e29b0-kube-api-access-5twkh\") pod \"kserve-module-controller-manager-54765d59fd-jkfkv\" (UID: \"012c765a-53d5-45d6-8436-d2e2415e29b0\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-jkfkv"
Sep 08 14:04:02.146998 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:02.146923    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/012c765a-53d5-45d6-8436-d2e2415e29b0-trusted-ca\") pod \"kserve-module-controller-manager-54765d59fd-jkfkv\" (UID: \"012c765a-53d5-45d6-8436-d2e2415e29b0\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-jkfkv"
Sep 08 14:04:02.146998 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:02.146956    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/012c765a-53d5-45d6-8436-d2e2415e29b0-manifests\") pod \"kserve-module-controller-manager-54765d59fd-jkfkv\" (UID: \"012c765a-53d5-45d6-8436-d2e2415e29b0\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-jkfkv"
Sep 08 14:04:02.147241 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:02.147218    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/012c765a-53d5-45d6-8436-d2e2415e29b0-tmp\") pod \"kserve-module-controller-manager-54765d59fd-jkfkv\" (UID: \"012c765a-53d5-45d6-8436-d2e2415e29b0\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-jkfkv"
Sep 08 14:04:02.147356 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:02.147338    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/012c765a-53d5-45d6-8436-d2e2415e29b0-manifests\") pod \"kserve-module-controller-manager-54765d59fd-jkfkv\" (UID: \"012c765a-53d5-45d6-8436-d2e2415e29b0\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-jkfkv"
Sep 08 14:04:02.147525 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:02.147509    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/012c765a-53d5-45d6-8436-d2e2415e29b0-trusted-ca\") pod \"kserve-module-controller-manager-54765d59fd-jkfkv\" (UID: \"012c765a-53d5-45d6-8436-d2e2415e29b0\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-jkfkv"
Sep 08 14:04:02.159996 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:02.159964    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5twkh\" (UniqueName: \"kubernetes.io/projected/012c765a-53d5-45d6-8436-d2e2415e29b0-kube-api-access-5twkh\") pod \"kserve-module-controller-manager-54765d59fd-jkfkv\" (UID: \"012c765a-53d5-45d6-8436-d2e2415e29b0\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-jkfkv"
Sep 08 14:04:02.189229 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:02.189195    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-54765d59fd-jkfkv"
Sep 08 14:04:02.343960 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:02.343936    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-97zc6"]
Sep 08 14:04:02.345908 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:04:02.345880    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod981b33bf_e5b5_4c75_a53f_9e52f956adfd.slice/crio-5df27d7082644fee65a5fa6aaa06e4cb1fd6da5316243bd8829c35f11a692d5c WatchSource:0}: Error finding container 5df27d7082644fee65a5fa6aaa06e4cb1fd6da5316243bd8829c35f11a692d5c: Status 404 returned error can't find the container with id 5df27d7082644fee65a5fa6aaa06e4cb1fd6da5316243bd8829c35f11a692d5c
Sep 08 14:04:02.347349 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:02.347333    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 14:04:02.468811 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:02.468769    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-97zc6" event={"ID":"981b33bf-e5b5-4c75-a53f-9e52f956adfd","Type":"ContainerStarted","Data":"5df27d7082644fee65a5fa6aaa06e4cb1fd6da5316243bd8829c35f11a692d5c"}
Sep 08 14:04:02.470480 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:02.470443    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s" event={"ID":"9fdaa6f4-1805-4368-bc9d-e4db8ac4922d","Type":"ContainerStarted","Data":"08adfe5fe9b03f78c7d8dd9b848bd4cb80531328457a681cbc3dfea6aebdda25"}
Sep 08 14:04:02.488437 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:02.488414    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-54765d59fd-jkfkv"]
Sep 08 14:04:02.489340 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:04:02.489311    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod012c765a_53d5_45d6_8436_d2e2415e29b0.slice/crio-97af0a31fc98a9f39f1165dd44af03e361c05bb67fbf05a804b12cd2dd2af99c WatchSource:0}: Error finding container 97af0a31fc98a9f39f1165dd44af03e361c05bb67fbf05a804b12cd2dd2af99c: Status 404 returned error can't find the container with id 97af0a31fc98a9f39f1165dd44af03e361c05bb67fbf05a804b12cd2dd2af99c
Sep 08 14:04:02.531642 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:02.531592    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s" podStartSLOduration=2.531576022 podStartE2EDuration="2.531576022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:04:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:04:02.529282547 +0000 UTC m=+318.018999608" watchObservedRunningTime="2026-09-08 14:04:02.531576022 +0000 UTC m=+318.021293074"
Sep 08 14:04:03.097027 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:03.096988    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:03.103637 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:03.103563    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:03.481185 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:03.481101    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-54765d59fd-jkfkv" event={"ID":"012c765a-53d5-45d6-8436-d2e2415e29b0","Type":"ContainerStarted","Data":"97af0a31fc98a9f39f1165dd44af03e361c05bb67fbf05a804b12cd2dd2af99c"}
Sep 08 14:04:03.481981 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:03.481954    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:03.483460 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:03.483437    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s"
Sep 08 14:04:07.454004 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:07.453970    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:04:07.469775 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:07.469748    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:04:07.469918 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:07.469893    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"
Sep 08 14:04:07.472420 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:07.472346    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 08 14:04:07.472542 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:07.472346    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tvfsh\""
Sep 08 14:04:07.486763 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:07.486742    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:04:07.597622 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:07.597573    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttcqv\" (UniqueName: \"kubernetes.io/projected/03aa9577-6520-43ed-a73e-113efe413ab2-kube-api-access-ttcqv\") pod \"limitador-limitador-85d9db4d5d-jmlvn\" (UID: \"03aa9577-6520-43ed-a73e-113efe413ab2\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"
Sep 08 14:04:07.597823 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:07.597712    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/03aa9577-6520-43ed-a73e-113efe413ab2-config-file\") pod \"limitador-limitador-85d9db4d5d-jmlvn\" (UID: \"03aa9577-6520-43ed-a73e-113efe413ab2\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"
Sep 08 14:04:07.699391 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:07.699231    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttcqv\" (UniqueName: \"kubernetes.io/projected/03aa9577-6520-43ed-a73e-113efe413ab2-kube-api-access-ttcqv\") pod \"limitador-limitador-85d9db4d5d-jmlvn\" (UID: \"03aa9577-6520-43ed-a73e-113efe413ab2\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"
Sep 08 14:04:07.699391 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:07.699317    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/03aa9577-6520-43ed-a73e-113efe413ab2-config-file\") pod \"limitador-limitador-85d9db4d5d-jmlvn\" (UID: \"03aa9577-6520-43ed-a73e-113efe413ab2\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"
Sep 08 14:04:07.700114 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:07.700084    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/03aa9577-6520-43ed-a73e-113efe413ab2-config-file\") pod \"limitador-limitador-85d9db4d5d-jmlvn\" (UID: \"03aa9577-6520-43ed-a73e-113efe413ab2\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"
Sep 08 14:04:07.708821 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:07.708760    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttcqv\" (UniqueName: \"kubernetes.io/projected/03aa9577-6520-43ed-a73e-113efe413ab2-kube-api-access-ttcqv\") pod \"limitador-limitador-85d9db4d5d-jmlvn\" (UID: \"03aa9577-6520-43ed-a73e-113efe413ab2\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"
Sep 08 14:04:07.783999 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:07.783955    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"
Sep 08 14:04:07.912015 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:07.911978    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c548b5d7d-vp6rm"]
Sep 08 14:04:07.917781 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:07.917755    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-vp6rm"
Sep 08 14:04:07.920269 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:07.920239    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-sp9m6\""
Sep 08 14:04:07.921749 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:07.921728    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-vp6rm"]
Sep 08 14:04:08.106539 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:08.106496    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzb4q\" (UniqueName: \"kubernetes.io/projected/d1999487-0508-4628-8fb6-059e69d9defe-kube-api-access-jzb4q\") pod \"authorino-c548b5d7d-vp6rm\" (UID: \"d1999487-0508-4628-8fb6-059e69d9defe\") " pod="kuadrant-system/authorino-c548b5d7d-vp6rm"
Sep 08 14:04:08.207497 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:08.207463    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzb4q\" (UniqueName: \"kubernetes.io/projected/d1999487-0508-4628-8fb6-059e69d9defe-kube-api-access-jzb4q\") pod \"authorino-c548b5d7d-vp6rm\" (UID: \"d1999487-0508-4628-8fb6-059e69d9defe\") " pod="kuadrant-system/authorino-c548b5d7d-vp6rm"
Sep 08 14:04:08.215772 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:08.215711    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzb4q\" (UniqueName: \"kubernetes.io/projected/d1999487-0508-4628-8fb6-059e69d9defe-kube-api-access-jzb4q\") pod \"authorino-c548b5d7d-vp6rm\" (UID: \"d1999487-0508-4628-8fb6-059e69d9defe\") " pod="kuadrant-system/authorino-c548b5d7d-vp6rm"
Sep 08 14:04:08.228512 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:08.228492    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-vp6rm"
Sep 08 14:04:08.246478 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:08.246436    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:04:08.246642 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:04:08.246621    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03aa9577_6520_43ed_a73e_113efe413ab2.slice/crio-a87650ec1d8451336a426f2e569f48c050dae10b77dac0e52a30d92e4ac0d65c WatchSource:0}: Error finding container a87650ec1d8451336a426f2e569f48c050dae10b77dac0e52a30d92e4ac0d65c: Status 404 returned error can't find the container with id a87650ec1d8451336a426f2e569f48c050dae10b77dac0e52a30d92e4ac0d65c
Sep 08 14:04:08.498386 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:08.498362    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-vp6rm"]
Sep 08 14:04:08.500909 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:04:08.500886    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1999487_0508_4628_8fb6_059e69d9defe.slice/crio-564707beb0ad4efb2b8690c3ae86d15e840f9f9239bf7c5c58475b9f967462e5 WatchSource:0}: Error finding container 564707beb0ad4efb2b8690c3ae86d15e840f9f9239bf7c5c58475b9f967462e5: Status 404 returned error can't find the container with id 564707beb0ad4efb2b8690c3ae86d15e840f9f9239bf7c5c58475b9f967462e5
Sep 08 14:04:08.518291 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:08.518253    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-54765d59fd-jkfkv" event={"ID":"012c765a-53d5-45d6-8436-d2e2415e29b0","Type":"ContainerStarted","Data":"ada3ecf97c3d46461f11c7d958c43655ea48471c48d5a0f8e931ed45bd0b1c06"}
Sep 08 14:04:08.518412 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:08.518390    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-module-controller-manager-54765d59fd-jkfkv"
Sep 08 14:04:08.519481 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:08.519454    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn" event={"ID":"03aa9577-6520-43ed-a73e-113efe413ab2","Type":"ContainerStarted","Data":"a87650ec1d8451336a426f2e569f48c050dae10b77dac0e52a30d92e4ac0d65c"}
Sep 08 14:04:08.520686 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:08.520658    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-vp6rm" event={"ID":"d1999487-0508-4628-8fb6-059e69d9defe","Type":"ContainerStarted","Data":"564707beb0ad4efb2b8690c3ae86d15e840f9f9239bf7c5c58475b9f967462e5"}
Sep 08 14:04:08.522166 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:08.522143    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-97zc6" event={"ID":"981b33bf-e5b5-4c75-a53f-9e52f956adfd","Type":"ContainerStarted","Data":"3e5105b68fbca50355065ef8856ac03e26dcfd69071a02b4735c593a9b1fc399"}
Sep 08 14:04:08.522259 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:08.522226    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-97zc6"
Sep 08 14:04:08.536992 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:08.536946    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-module-controller-manager-54765d59fd-jkfkv" podStartSLOduration=2.058190587 podStartE2EDuration="7.536934386s" totalImagesPullingTime="5.478743799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:04:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:04:08.53588164 +0000 UTC m=+324.025598694" watchObservedRunningTime="2026-09-08 14:04:08.536934386 +0000 UTC m=+324.026651438"
Sep 08 14:04:08.552122 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:08.552082    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-97zc6" podStartSLOduration=1.91217397 podStartE2EDuration="7.552068756s" totalImagesPullingTime="5.639894786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:04:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:04:08.550279442 +0000 UTC m=+324.039996493" watchObservedRunningTime="2026-09-08 14:04:08.552068756 +0000 UTC m=+324.041785800"
Sep 08 14:04:10.537429 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:10.537345    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn" event={"ID":"03aa9577-6520-43ed-a73e-113efe413ab2","Type":"ContainerStarted","Data":"07e5c37606473fa30503e30b2ceaad021aebcdf10043b5a3a6b117bf0e466c17"}
Sep 08 14:04:10.537429 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:10.537412    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"
Sep 08 14:04:10.538966 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:10.538937    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-vp6rm" event={"ID":"d1999487-0508-4628-8fb6-059e69d9defe","Type":"ContainerStarted","Data":"cee0a92614ac82c54a23e1eae4d6703fc1ee280f764cfa119fa271b1069205d3"}
Sep 08 14:04:10.557260 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:10.557218    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn" podStartSLOduration=2.194536056 podStartE2EDuration="3.557205922s" totalImagesPullingTime="1.362669866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:04:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:04:10.555312413 +0000 UTC m=+326.045029491" watchObservedRunningTime="2026-09-08 14:04:10.557205922 +0000 UTC m=+326.046923017"
Sep 08 14:04:10.573882 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:10.573846    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c548b5d7d-vp6rm" podStartSLOduration=1.945715867 podStartE2EDuration="3.57383332s" totalImagesPullingTime="1.628117453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:04:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:04:10.572299552 +0000 UTC m=+326.062016603" watchObservedRunningTime="2026-09-08 14:04:10.57383332 +0000 UTC m=+326.063550372"
Sep 08 14:04:14.560832 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:14.560799    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-97zc6"
Sep 08 14:04:21.545644 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:21.545610    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"
Sep 08 14:04:29.533927 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:29.533889    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-module-controller-manager-54765d59fd-jkfkv"
Sep 08 14:04:58.120269 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:58.120231    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:04:59.234265 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:59.234231    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-7d6487fcc8-prjwl"]
Sep 08 14:04:59.240381 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:59.240352    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-7d6487fcc8-prjwl"
Sep 08 14:04:59.244520 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:59.244489    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-ln8tj\""
Sep 08 14:04:59.244646 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:59.244537    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 08 14:04:59.262005 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:59.261977    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-7d6487fcc8-prjwl"]
Sep 08 14:04:59.348176 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:59.348142    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd236640-df86-45d3-b7f9-5f6bcc877c0d-tls-certs\") pod \"model-serving-api-7d6487fcc8-prjwl\" (UID: \"fd236640-df86-45d3-b7f9-5f6bcc877c0d\") " pod="opendatahub/model-serving-api-7d6487fcc8-prjwl"
Sep 08 14:04:59.348343 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:59.348202    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcgvp\" (UniqueName: \"kubernetes.io/projected/fd236640-df86-45d3-b7f9-5f6bcc877c0d-kube-api-access-jcgvp\") pod \"model-serving-api-7d6487fcc8-prjwl\" (UID: \"fd236640-df86-45d3-b7f9-5f6bcc877c0d\") " pod="opendatahub/model-serving-api-7d6487fcc8-prjwl"
Sep 08 14:04:59.449519 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:59.449476    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd236640-df86-45d3-b7f9-5f6bcc877c0d-tls-certs\") pod \"model-serving-api-7d6487fcc8-prjwl\" (UID: \"fd236640-df86-45d3-b7f9-5f6bcc877c0d\") " pod="opendatahub/model-serving-api-7d6487fcc8-prjwl"
Sep 08 14:04:59.449720 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:59.449527    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcgvp\" (UniqueName: \"kubernetes.io/projected/fd236640-df86-45d3-b7f9-5f6bcc877c0d-kube-api-access-jcgvp\") pod \"model-serving-api-7d6487fcc8-prjwl\" (UID: \"fd236640-df86-45d3-b7f9-5f6bcc877c0d\") " pod="opendatahub/model-serving-api-7d6487fcc8-prjwl"
Sep 08 14:04:59.452287 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:59.452261    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd236640-df86-45d3-b7f9-5f6bcc877c0d-tls-certs\") pod \"model-serving-api-7d6487fcc8-prjwl\" (UID: \"fd236640-df86-45d3-b7f9-5f6bcc877c0d\") " pod="opendatahub/model-serving-api-7d6487fcc8-prjwl"
Sep 08 14:04:59.493549 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:59.493492    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcgvp\" (UniqueName: \"kubernetes.io/projected/fd236640-df86-45d3-b7f9-5f6bcc877c0d-kube-api-access-jcgvp\") pod \"model-serving-api-7d6487fcc8-prjwl\" (UID: \"fd236640-df86-45d3-b7f9-5f6bcc877c0d\") " pod="opendatahub/model-serving-api-7d6487fcc8-prjwl"
Sep 08 14:04:59.550956 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:59.550928    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-7d6487fcc8-prjwl"
Sep 08 14:04:59.831069 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:04:59.831024    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-7d6487fcc8-prjwl"]
Sep 08 14:04:59.848723 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:04:59.848682    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd236640_df86_45d3_b7f9_5f6bcc877c0d.slice/crio-eef93786b21469d8373eb1ed9b0f77f3313ea36437e3e6ebe13eddf3c8d7de4d WatchSource:0}: Error finding container eef93786b21469d8373eb1ed9b0f77f3313ea36437e3e6ebe13eddf3c8d7de4d: Status 404 returned error can't find the container with id eef93786b21469d8373eb1ed9b0f77f3313ea36437e3e6ebe13eddf3c8d7de4d
Sep 08 14:05:00.804667 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:00.804626    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-7d6487fcc8-prjwl" event={"ID":"fd236640-df86-45d3-b7f9-5f6bcc877c0d","Type":"ContainerStarted","Data":"eef93786b21469d8373eb1ed9b0f77f3313ea36437e3e6ebe13eddf3c8d7de4d"}
Sep 08 14:05:01.811834 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:01.811741    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-7d6487fcc8-prjwl" event={"ID":"fd236640-df86-45d3-b7f9-5f6bcc877c0d","Type":"ContainerStarted","Data":"828ba8dbb6a25d8e28fdc78ad2bccca63eac983bde8fad23fa87a66721385288"}
Sep 08 14:05:01.811834 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:01.811806    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-7d6487fcc8-prjwl"
Sep 08 14:05:01.841635 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:01.841570    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-7d6487fcc8-prjwl" podStartSLOduration=1.153882265 podStartE2EDuration="2.841553875s" totalImagesPullingTime="1.68767161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:04:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:05:01.840640051 +0000 UTC m=+377.330357113" watchObservedRunningTime="2026-09-08 14:05:01.841553875 +0000 UTC m=+377.331270926"
Sep 08 14:05:06.150804 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.150769    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-55f6cffdd8-7hl2f"]
Sep 08 14:05:06.155720 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.155700    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-7hl2f"
Sep 08 14:05:06.159164 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.159140    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 08 14:05:06.159285 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.159189    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2nwq2\""
Sep 08 14:05:06.159285 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.159210    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 14:05:06.165323 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.165302    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-55f6cffdd8-7hl2f"]
Sep 08 14:05:06.213874 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.213842    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf4737ba-baf3-4ac4-9c89-6b0a943df5b7-openshift-service-ca\") pod \"maas-api-55f6cffdd8-7hl2f\" (UID: \"bf4737ba-baf3-4ac4-9c89-6b0a943df5b7\") " pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-7hl2f"
Sep 08 14:05:06.214086 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.213881    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf4737ba-baf3-4ac4-9c89-6b0a943df5b7-metrics-certs\") pod \"maas-api-55f6cffdd8-7hl2f\" (UID: \"bf4737ba-baf3-4ac4-9c89-6b0a943df5b7\") " pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-7hl2f"
Sep 08 14:05:06.214086 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.213969    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf4737ba-baf3-4ac4-9c89-6b0a943df5b7-maas-api-tls\") pod \"maas-api-55f6cffdd8-7hl2f\" (UID: \"bf4737ba-baf3-4ac4-9c89-6b0a943df5b7\") " pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-7hl2f"
Sep 08 14:05:06.214086 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.214013    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5hd8\" (UniqueName: \"kubernetes.io/projected/bf4737ba-baf3-4ac4-9c89-6b0a943df5b7-kube-api-access-r5hd8\") pod \"maas-api-55f6cffdd8-7hl2f\" (UID: \"bf4737ba-baf3-4ac4-9c89-6b0a943df5b7\") " pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-7hl2f"
Sep 08 14:05:06.305538 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.305505    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6586b8bc49-kj98g"]
Sep 08 14:05:06.309077 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.309034    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6586b8bc49-kj98g"
Sep 08 14:05:06.314725 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.314697    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf4737ba-baf3-4ac4-9c89-6b0a943df5b7-metrics-certs\") pod \"maas-api-55f6cffdd8-7hl2f\" (UID: \"bf4737ba-baf3-4ac4-9c89-6b0a943df5b7\") " pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-7hl2f"
Sep 08 14:05:06.314831 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.314815    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwlx5\" (UniqueName: \"kubernetes.io/projected/0e28a84c-9235-49ec-96f9-b554ed18ada9-kube-api-access-bwlx5\") pod \"authorino-6586b8bc49-kj98g\" (UID: \"0e28a84c-9235-49ec-96f9-b554ed18ada9\") " pod="kuadrant-system/authorino-6586b8bc49-kj98g"
Sep 08 14:05:06.314877 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.314859    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf4737ba-baf3-4ac4-9c89-6b0a943df5b7-maas-api-tls\") pod \"maas-api-55f6cffdd8-7hl2f\" (UID: \"bf4737ba-baf3-4ac4-9c89-6b0a943df5b7\") " pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-7hl2f"
Sep 08 14:05:06.314920 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.314891    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5hd8\" (UniqueName: \"kubernetes.io/projected/bf4737ba-baf3-4ac4-9c89-6b0a943df5b7-kube-api-access-r5hd8\") pod \"maas-api-55f6cffdd8-7hl2f\" (UID: \"bf4737ba-baf3-4ac4-9c89-6b0a943df5b7\") " pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-7hl2f"
Sep 08 14:05:06.315010 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.314959    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf4737ba-baf3-4ac4-9c89-6b0a943df5b7-openshift-service-ca\") pod \"maas-api-55f6cffdd8-7hl2f\" (UID: \"bf4737ba-baf3-4ac4-9c89-6b0a943df5b7\") " pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-7hl2f"
Sep 08 14:05:06.315819 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.315727    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf4737ba-baf3-4ac4-9c89-6b0a943df5b7-openshift-service-ca\") pod \"maas-api-55f6cffdd8-7hl2f\" (UID: \"bf4737ba-baf3-4ac4-9c89-6b0a943df5b7\") " pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-7hl2f"
Sep 08 14:05:06.318240 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.318207    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf4737ba-baf3-4ac4-9c89-6b0a943df5b7-metrics-certs\") pod \"maas-api-55f6cffdd8-7hl2f\" (UID: \"bf4737ba-baf3-4ac4-9c89-6b0a943df5b7\") " pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-7hl2f"
Sep 08 14:05:06.318346 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.318213    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf4737ba-baf3-4ac4-9c89-6b0a943df5b7-maas-api-tls\") pod \"maas-api-55f6cffdd8-7hl2f\" (UID: \"bf4737ba-baf3-4ac4-9c89-6b0a943df5b7\") " pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-7hl2f"
Sep 08 14:05:06.320015 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.319998    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6586b8bc49-kj98g"]
Sep 08 14:05:06.328807 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.328783    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5hd8\" (UniqueName: \"kubernetes.io/projected/bf4737ba-baf3-4ac4-9c89-6b0a943df5b7-kube-api-access-r5hd8\") pod \"maas-api-55f6cffdd8-7hl2f\" (UID: \"bf4737ba-baf3-4ac4-9c89-6b0a943df5b7\") " pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-7hl2f"
Sep 08 14:05:06.373501 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.373464    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6586b8bc49-kj98g"]
Sep 08 14:05:06.373778 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:05:06.373759    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-bwlx5], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6586b8bc49-kj98g" podUID="0e28a84c-9235-49ec-96f9-b554ed18ada9"
Sep 08 14:05:06.416108 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.416027    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwlx5\" (UniqueName: \"kubernetes.io/projected/0e28a84c-9235-49ec-96f9-b554ed18ada9-kube-api-access-bwlx5\") pod \"authorino-6586b8bc49-kj98g\" (UID: \"0e28a84c-9235-49ec-96f9-b554ed18ada9\") " pod="kuadrant-system/authorino-6586b8bc49-kj98g"
Sep 08 14:05:06.424658 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.424621    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwlx5\" (UniqueName: \"kubernetes.io/projected/0e28a84c-9235-49ec-96f9-b554ed18ada9-kube-api-access-bwlx5\") pod \"authorino-6586b8bc49-kj98g\" (UID: \"0e28a84c-9235-49ec-96f9-b554ed18ada9\") " pod="kuadrant-system/authorino-6586b8bc49-kj98g"
Sep 08 14:05:06.467384 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.467350    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-7hl2f"
Sep 08 14:05:06.745015 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.744991    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-55f6cffdd8-7hl2f"]
Sep 08 14:05:06.748200 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:05:06.748165    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf4737ba_baf3_4ac4_9c89_6b0a943df5b7.slice/crio-2fde124f1fd3b16ee5a4ea0bef9c24e304882644b5d7c91639a83838e757ec1a WatchSource:0}: Error finding container 2fde124f1fd3b16ee5a4ea0bef9c24e304882644b5d7c91639a83838e757ec1a: Status 404 returned error can't find the container with id 2fde124f1fd3b16ee5a4ea0bef9c24e304882644b5d7c91639a83838e757ec1a
Sep 08 14:05:06.844032 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.843996    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6586b8bc49-kj98g"
Sep 08 14:05:06.844210 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.843996    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-7hl2f" event={"ID":"bf4737ba-baf3-4ac4-9c89-6b0a943df5b7","Type":"ContainerStarted","Data":"2fde124f1fd3b16ee5a4ea0bef9c24e304882644b5d7c91639a83838e757ec1a"}
Sep 08 14:05:06.851192 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.851171    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6586b8bc49-kj98g"
Sep 08 14:05:06.919948 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.919915    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwlx5\" (UniqueName: \"kubernetes.io/projected/0e28a84c-9235-49ec-96f9-b554ed18ada9-kube-api-access-bwlx5\") pod \"0e28a84c-9235-49ec-96f9-b554ed18ada9\" (UID: \"0e28a84c-9235-49ec-96f9-b554ed18ada9\") "
Sep 08 14:05:06.922279 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:06.922248    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e28a84c-9235-49ec-96f9-b554ed18ada9-kube-api-access-bwlx5" (OuterVolumeSpecName: "kube-api-access-bwlx5") pod "0e28a84c-9235-49ec-96f9-b554ed18ada9" (UID: "0e28a84c-9235-49ec-96f9-b554ed18ada9"). InnerVolumeSpecName "kube-api-access-bwlx5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:05:07.021311 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:07.021234    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwlx5\" (UniqueName: \"kubernetes.io/projected/0e28a84c-9235-49ec-96f9-b554ed18ada9-kube-api-access-bwlx5\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:05:07.070168 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:07.070115    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-rvlrc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.20:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 14:05:07.070334 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:07.070184    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc" podUID="c96b73a0-662e-4995-b19f-14015a3e664f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.20:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 14:05:07.852774 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:07.852733    2575 generic.go:356] "Generic (PLEG): container finished" podID="c96b73a0-662e-4995-b19f-14015a3e664f" containerID="935cee6761516bb177606d0d3a00060208bcbeeec03eef571509db0e2e684b5e" exitCode=0
Sep 08 14:05:07.853285 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:07.852813    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc" event={"ID":"c96b73a0-662e-4995-b19f-14015a3e664f","Type":"ContainerDied","Data":"935cee6761516bb177606d0d3a00060208bcbeeec03eef571509db0e2e684b5e"}
Sep 08 14:05:07.853285 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:07.852934    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6586b8bc49-kj98g"
Sep 08 14:05:07.853575 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:07.853559    2575 scope.go:117] "RemoveContainer" containerID="935cee6761516bb177606d0d3a00060208bcbeeec03eef571509db0e2e684b5e"
Sep 08 14:05:07.854760 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:07.854732    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:05:07.854858 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:07.854816    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:05:07.854917 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:07.854863    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:05:07.907248 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:07.907217    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6586b8bc49-kj98g"]
Sep 08 14:05:07.909712 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:07.909690    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6586b8bc49-kj98g"]
Sep 08 14:05:08.526942 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:08.526880    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-vp6rm"]
Sep 08 14:05:08.527183 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:08.527127    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c548b5d7d-vp6rm" podUID="d1999487-0508-4628-8fb6-059e69d9defe" containerName="authorino" containerID="cri-o://cee0a92614ac82c54a23e1eae4d6703fc1ee280f764cfa119fa271b1069205d3" gracePeriod=30
Sep 08 14:05:08.861417 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:08.861385    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-7hl2f" event={"ID":"bf4737ba-baf3-4ac4-9c89-6b0a943df5b7","Type":"ContainerStarted","Data":"b5381f3caad25e506bff93c8e6e7c334a658a4a94d8248d423e24009cda0a875"}
Sep 08 14:05:08.861826 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:08.861564    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-7hl2f"
Sep 08 14:05:08.863603 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:08.863577    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc" event={"ID":"c96b73a0-662e-4995-b19f-14015a3e664f","Type":"ContainerStarted","Data":"0b27a2486967c983b7482aa2c2472ef2b61cc953fe75127f46603e2e7fc69139"}
Sep 08 14:05:08.864819 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:08.864794    2575 generic.go:356] "Generic (PLEG): container finished" podID="d1999487-0508-4628-8fb6-059e69d9defe" containerID="cee0a92614ac82c54a23e1eae4d6703fc1ee280f764cfa119fa271b1069205d3" exitCode=0
Sep 08 14:05:08.864900 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:08.864839    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-vp6rm" event={"ID":"d1999487-0508-4628-8fb6-059e69d9defe","Type":"ContainerDied","Data":"cee0a92614ac82c54a23e1eae4d6703fc1ee280f764cfa119fa271b1069205d3"}
Sep 08 14:05:08.864900 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:08.864858    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-vp6rm" event={"ID":"d1999487-0508-4628-8fb6-059e69d9defe","Type":"ContainerDied","Data":"564707beb0ad4efb2b8690c3ae86d15e840f9f9239bf7c5c58475b9f967462e5"}
Sep 08 14:05:08.864900 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:08.864869    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="564707beb0ad4efb2b8690c3ae86d15e840f9f9239bf7c5c58475b9f967462e5"
Sep 08 14:05:08.866001 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:08.865984    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-vp6rm"
Sep 08 14:05:08.882201 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:08.882156    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-7hl2f" podStartSLOduration=0.919025104 podStartE2EDuration="2.882140744s" totalImagesPullingTime="1.96311564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:05:08.880893352 +0000 UTC m=+384.370610405" watchObservedRunningTime="2026-09-08 14:05:08.882140744 +0000 UTC m=+384.371857797"
Sep 08 14:05:08.947639 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:08.947610    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzb4q\" (UniqueName: \"kubernetes.io/projected/d1999487-0508-4628-8fb6-059e69d9defe-kube-api-access-jzb4q\") pod \"d1999487-0508-4628-8fb6-059e69d9defe\" (UID: \"d1999487-0508-4628-8fb6-059e69d9defe\") "
Sep 08 14:05:08.949981 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:08.949946    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1999487-0508-4628-8fb6-059e69d9defe-kube-api-access-jzb4q" (OuterVolumeSpecName: "kube-api-access-jzb4q") pod "d1999487-0508-4628-8fb6-059e69d9defe" (UID: "d1999487-0508-4628-8fb6-059e69d9defe"). InnerVolumeSpecName "kube-api-access-jzb4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:05:08.974175 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:08.974151    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e28a84c-9235-49ec-96f9-b554ed18ada9" path="/var/lib/kubelet/pods/0e28a84c-9235-49ec-96f9-b554ed18ada9/volumes"
Sep 08 14:05:09.048839 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:09.048746    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzb4q\" (UniqueName: \"kubernetes.io/projected/d1999487-0508-4628-8fb6-059e69d9defe-kube-api-access-jzb4q\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:05:09.452330 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:09.452292    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:05:09.452582 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:09.452555    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-rvlrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.20:15021/healthz/ready\": dial tcp 10.134.0.20:15021: connect: connection refused" start-of-body=
Sep 08 14:05:09.452643 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:09.452619    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc" podUID="c96b73a0-662e-4995-b19f-14015a3e664f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.20:15021/healthz/ready\": dial tcp 10.134.0.20:15021: connect: connection refused"
Sep 08 14:05:09.870599 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:09.870566    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-vp6rm"
Sep 08 14:05:09.887787 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:09.887762    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-vp6rm"]
Sep 08 14:05:09.891785 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:09.891763    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-vp6rm"]
Sep 08 14:05:10.452491 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:10.452451    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-rvlrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.20:15021/healthz/ready\": dial tcp 10.134.0.20:15021: connect: connection refused" start-of-body=
Sep 08 14:05:10.452680 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:10.452514    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc" podUID="c96b73a0-662e-4995-b19f-14015a3e664f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.20:15021/healthz/ready\": dial tcp 10.134.0.20:15021: connect: connection refused"
Sep 08 14:05:10.973917 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:10.973882    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1999487-0508-4628-8fb6-059e69d9defe" path="/var/lib/kubelet/pods/d1999487-0508-4628-8fb6-059e69d9defe/volumes"
Sep 08 14:05:11.452264 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:11.452211    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-rvlrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.20:15021/healthz/ready\": dial tcp 10.134.0.20:15021: connect: connection refused" start-of-body=
Sep 08 14:05:11.452434 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:11.452284    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc" podUID="c96b73a0-662e-4995-b19f-14015a3e664f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.20:15021/healthz/ready\": dial tcp 10.134.0.20:15021: connect: connection refused"
Sep 08 14:05:12.452512 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:12.452477    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-rvlrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.20:15021/healthz/ready\": dial tcp 10.134.0.20:15021: connect: connection refused" start-of-body=
Sep 08 14:05:12.452902 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:12.452535    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc" podUID="c96b73a0-662e-4995-b19f-14015a3e664f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.20:15021/healthz/ready\": dial tcp 10.134.0.20:15021: connect: connection refused"
Sep 08 14:05:12.838412 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:12.838380    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-7d6487fcc8-prjwl"
Sep 08 14:05:13.452261 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.452224    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-rvlrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.20:15021/healthz/ready\": dial tcp 10.134.0.20:15021: connect: connection refused" start-of-body=
Sep 08 14:05:13.452446 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.452287    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc" podUID="c96b73a0-662e-4995-b19f-14015a3e664f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.20:15021/healthz/ready\": dial tcp 10.134.0.20:15021: connect: connection refused"
Sep 08 14:05:13.641305 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.641271    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-df66fd975-5rpw7"]
Sep 08 14:05:13.641874 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.641854    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1999487-0508-4628-8fb6-059e69d9defe" containerName="authorino"
Sep 08 14:05:13.641923 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.641879    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1999487-0508-4628-8fb6-059e69d9defe" containerName="authorino"
Sep 08 14:05:13.642012 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.641999    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1999487-0508-4628-8fb6-059e69d9defe" containerName="authorino"
Sep 08 14:05:13.645047 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.645026    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-df66fd975-5rpw7"
Sep 08 14:05:13.649552 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.649530    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 08 14:05:13.649661 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.649540    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 08 14:05:13.650684 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.650663    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 14:05:13.652045 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.651750    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6cln7\""
Sep 08 14:05:13.661196 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.661171    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 08 14:05:13.662501 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.662477    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-df66fd975-5rpw7"]
Sep 08 14:05:13.662639 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.662621    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 08 14:05:13.662989 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.662967    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 08 14:05:13.662989 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.662980    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 14:05:13.663147 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.662978    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 08 14:05:13.688701 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.688681    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/879573f7-bb58-4b5d-be37-9f7abae495eb-service-ca\") pod \"console-df66fd975-5rpw7\" (UID: \"879573f7-bb58-4b5d-be37-9f7abae495eb\") " pod="openshift-console/console-df66fd975-5rpw7"
Sep 08 14:05:13.688798 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.688711    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/879573f7-bb58-4b5d-be37-9f7abae495eb-console-serving-cert\") pod \"console-df66fd975-5rpw7\" (UID: \"879573f7-bb58-4b5d-be37-9f7abae495eb\") " pod="openshift-console/console-df66fd975-5rpw7"
Sep 08 14:05:13.688798 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.688734    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/879573f7-bb58-4b5d-be37-9f7abae495eb-trusted-ca-bundle\") pod \"console-df66fd975-5rpw7\" (UID: \"879573f7-bb58-4b5d-be37-9f7abae495eb\") " pod="openshift-console/console-df66fd975-5rpw7"
Sep 08 14:05:13.688798 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.688786    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/879573f7-bb58-4b5d-be37-9f7abae495eb-console-config\") pod \"console-df66fd975-5rpw7\" (UID: \"879573f7-bb58-4b5d-be37-9f7abae495eb\") " pod="openshift-console/console-df66fd975-5rpw7"
Sep 08 14:05:13.688896 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.688813    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/879573f7-bb58-4b5d-be37-9f7abae495eb-oauth-serving-cert\") pod \"console-df66fd975-5rpw7\" (UID: \"879573f7-bb58-4b5d-be37-9f7abae495eb\") " pod="openshift-console/console-df66fd975-5rpw7"
Sep 08 14:05:13.688896 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.688862    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzc5v\" (UniqueName: \"kubernetes.io/projected/879573f7-bb58-4b5d-be37-9f7abae495eb-kube-api-access-kzc5v\") pod \"console-df66fd975-5rpw7\" (UID: \"879573f7-bb58-4b5d-be37-9f7abae495eb\") " pod="openshift-console/console-df66fd975-5rpw7"
Sep 08 14:05:13.688896 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.688879    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/879573f7-bb58-4b5d-be37-9f7abae495eb-console-oauth-config\") pod \"console-df66fd975-5rpw7\" (UID: \"879573f7-bb58-4b5d-be37-9f7abae495eb\") " pod="openshift-console/console-df66fd975-5rpw7"
Sep 08 14:05:13.790189 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.790102    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/879573f7-bb58-4b5d-be37-9f7abae495eb-console-config\") pod \"console-df66fd975-5rpw7\" (UID: \"879573f7-bb58-4b5d-be37-9f7abae495eb\") " pod="openshift-console/console-df66fd975-5rpw7"
Sep 08 14:05:13.790189 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.790136    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/879573f7-bb58-4b5d-be37-9f7abae495eb-oauth-serving-cert\") pod \"console-df66fd975-5rpw7\" (UID: \"879573f7-bb58-4b5d-be37-9f7abae495eb\") " pod="openshift-console/console-df66fd975-5rpw7"
Sep 08 14:05:13.790189 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.790170    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzc5v\" (UniqueName: \"kubernetes.io/projected/879573f7-bb58-4b5d-be37-9f7abae495eb-kube-api-access-kzc5v\") pod \"console-df66fd975-5rpw7\" (UID: \"879573f7-bb58-4b5d-be37-9f7abae495eb\") " pod="openshift-console/console-df66fd975-5rpw7"
Sep 08 14:05:13.790399 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.790289    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/879573f7-bb58-4b5d-be37-9f7abae495eb-console-oauth-config\") pod \"console-df66fd975-5rpw7\" (UID: \"879573f7-bb58-4b5d-be37-9f7abae495eb\") " pod="openshift-console/console-df66fd975-5rpw7"
Sep 08 14:05:13.790439 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.790403    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/879573f7-bb58-4b5d-be37-9f7abae495eb-service-ca\") pod \"console-df66fd975-5rpw7\" (UID: \"879573f7-bb58-4b5d-be37-9f7abae495eb\") " pod="openshift-console/console-df66fd975-5rpw7"
Sep 08 14:05:13.790473 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.790443    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/879573f7-bb58-4b5d-be37-9f7abae495eb-console-serving-cert\") pod \"console-df66fd975-5rpw7\" (UID: \"879573f7-bb58-4b5d-be37-9f7abae495eb\") " pod="openshift-console/console-df66fd975-5rpw7"
Sep 08 14:05:13.790519 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.790481    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/879573f7-bb58-4b5d-be37-9f7abae495eb-trusted-ca-bundle\") pod \"console-df66fd975-5rpw7\" (UID: \"879573f7-bb58-4b5d-be37-9f7abae495eb\") " pod="openshift-console/console-df66fd975-5rpw7"
Sep 08 14:05:13.790987 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.790927    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/879573f7-bb58-4b5d-be37-9f7abae495eb-oauth-serving-cert\") pod \"console-df66fd975-5rpw7\" (UID: \"879573f7-bb58-4b5d-be37-9f7abae495eb\") " pod="openshift-console/console-df66fd975-5rpw7"
Sep 08 14:05:13.791192 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.791178    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/879573f7-bb58-4b5d-be37-9f7abae495eb-service-ca\") pod \"console-df66fd975-5rpw7\" (UID: \"879573f7-bb58-4b5d-be37-9f7abae495eb\") " pod="openshift-console/console-df66fd975-5rpw7"
Sep 08 14:05:13.791273 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.791246    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/879573f7-bb58-4b5d-be37-9f7abae495eb-console-config\") pod \"console-df66fd975-5rpw7\" (UID: \"879573f7-bb58-4b5d-be37-9f7abae495eb\") " pod="openshift-console/console-df66fd975-5rpw7"
Sep 08 14:05:13.791596 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.791573    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/879573f7-bb58-4b5d-be37-9f7abae495eb-trusted-ca-bundle\") pod \"console-df66fd975-5rpw7\" (UID: \"879573f7-bb58-4b5d-be37-9f7abae495eb\") " pod="openshift-console/console-df66fd975-5rpw7"
Sep 08 14:05:13.792990 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.792963    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/879573f7-bb58-4b5d-be37-9f7abae495eb-console-oauth-config\") pod \"console-df66fd975-5rpw7\" (UID: \"879573f7-bb58-4b5d-be37-9f7abae495eb\") " pod="openshift-console/console-df66fd975-5rpw7"
Sep 08 14:05:13.792990 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.792973    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/879573f7-bb58-4b5d-be37-9f7abae495eb-console-serving-cert\") pod \"console-df66fd975-5rpw7\" (UID: \"879573f7-bb58-4b5d-be37-9f7abae495eb\") " pod="openshift-console/console-df66fd975-5rpw7"
Sep 08 14:05:13.802645 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.802622    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzc5v\" (UniqueName: \"kubernetes.io/projected/879573f7-bb58-4b5d-be37-9f7abae495eb-kube-api-access-kzc5v\") pod \"console-df66fd975-5rpw7\" (UID: \"879573f7-bb58-4b5d-be37-9f7abae495eb\") " pod="openshift-console/console-df66fd975-5rpw7"
Sep 08 14:05:13.955014 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:13.954975    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-df66fd975-5rpw7"
Sep 08 14:05:14.228655 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:14.228634    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-df66fd975-5rpw7"]
Sep 08 14:05:14.230164 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:05:14.230143    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod879573f7_bb58_4b5d_be37_9f7abae495eb.slice/crio-dcfb3ee548ad286a29717405023f45b99fec92df28c2134f41186b4cce7b5510 WatchSource:0}: Error finding container dcfb3ee548ad286a29717405023f45b99fec92df28c2134f41186b4cce7b5510: Status 404 returned error can't find the container with id dcfb3ee548ad286a29717405023f45b99fec92df28c2134f41186b4cce7b5510
Sep 08 14:05:14.455180 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:14.455146    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:05:14.455525 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:14.455504    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:05:14.456154 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:14.456136    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rvlrc"
Sep 08 14:05:14.875754 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:14.875726    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-7hl2f"
Sep 08 14:05:14.903451 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:14.903419    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-df66fd975-5rpw7" event={"ID":"879573f7-bb58-4b5d-be37-9f7abae495eb","Type":"ContainerStarted","Data":"f33dcbb0c4214c21c6b24fa5ba9bcc47404efdf09e86d017a485c9b7b9d94d13"}
Sep 08 14:05:14.903628 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:14.903469    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-df66fd975-5rpw7" event={"ID":"879573f7-bb58-4b5d-be37-9f7abae495eb","Type":"ContainerStarted","Data":"dcfb3ee548ad286a29717405023f45b99fec92df28c2134f41186b4cce7b5510"}
Sep 08 14:05:14.944398 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:14.944353    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-df66fd975-5rpw7" podStartSLOduration=1.9443353399999999 podStartE2EDuration="1.94433534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:05:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:05:14.941172918 +0000 UTC m=+390.430889971" watchObservedRunningTime="2026-09-08 14:05:14.94433534 +0000 UTC m=+390.434052391"
Sep 08 14:05:23.955611 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:23.955578    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-df66fd975-5rpw7"
Sep 08 14:05:23.956114 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:23.955645    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-df66fd975-5rpw7"
Sep 08 14:05:23.960175 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:23.960149    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-df66fd975-5rpw7"
Sep 08 14:05:24.966349 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:05:24.966319    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-df66fd975-5rpw7"
Sep 08 14:06:29.486135 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:29.486101    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:06:40.760403 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:40.760365    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:06:51.357409 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:51.357371    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:06:58.395782 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:58.395745    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s"]
Sep 08 14:06:58.400096 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:58.400074    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s"
Sep 08 14:06:58.403595 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:58.403567    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-b2v2m\""
Sep 08 14:06:58.403688 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:58.403567    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 08 14:06:58.403688 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:58.403568    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 08 14:06:58.403805 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:58.403641    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 08 14:06:58.408331 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:58.408310    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s"]
Sep 08 14:06:58.565691 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:58.565656    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d127be9-734c-4955-949a-a44a69ac67bd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s\" (UID: \"1d127be9-734c-4955-949a-a44a69ac67bd\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s"
Sep 08 14:06:58.565885 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:58.565700    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d127be9-734c-4955-949a-a44a69ac67bd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s\" (UID: \"1d127be9-734c-4955-949a-a44a69ac67bd\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s"
Sep 08 14:06:58.565885 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:58.565739    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4cx2\" (UniqueName: \"kubernetes.io/projected/1d127be9-734c-4955-949a-a44a69ac67bd-kube-api-access-k4cx2\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s\" (UID: \"1d127be9-734c-4955-949a-a44a69ac67bd\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s"
Sep 08 14:06:58.565885 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:58.565851    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d127be9-734c-4955-949a-a44a69ac67bd-dshm\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s\" (UID: \"1d127be9-734c-4955-949a-a44a69ac67bd\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s"
Sep 08 14:06:58.565885 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:58.565875    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d127be9-734c-4955-949a-a44a69ac67bd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s\" (UID: \"1d127be9-734c-4955-949a-a44a69ac67bd\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s"
Sep 08 14:06:58.566120 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:58.565895    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d127be9-734c-4955-949a-a44a69ac67bd-home\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s\" (UID: \"1d127be9-734c-4955-949a-a44a69ac67bd\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s"
Sep 08 14:06:58.667118 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:58.667011    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4cx2\" (UniqueName: \"kubernetes.io/projected/1d127be9-734c-4955-949a-a44a69ac67bd-kube-api-access-k4cx2\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s\" (UID: \"1d127be9-734c-4955-949a-a44a69ac67bd\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s"
Sep 08 14:06:58.667118 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:58.667111    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d127be9-734c-4955-949a-a44a69ac67bd-dshm\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s\" (UID: \"1d127be9-734c-4955-949a-a44a69ac67bd\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s"
Sep 08 14:06:58.667332 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:58.667134    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d127be9-734c-4955-949a-a44a69ac67bd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s\" (UID: \"1d127be9-734c-4955-949a-a44a69ac67bd\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s"
Sep 08 14:06:58.667332 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:58.667152    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d127be9-734c-4955-949a-a44a69ac67bd-home\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s\" (UID: \"1d127be9-734c-4955-949a-a44a69ac67bd\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s"
Sep 08 14:06:58.667332 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:58.667179    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d127be9-734c-4955-949a-a44a69ac67bd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s\" (UID: \"1d127be9-734c-4955-949a-a44a69ac67bd\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s"
Sep 08 14:06:58.667332 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:58.667266    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d127be9-734c-4955-949a-a44a69ac67bd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s\" (UID: \"1d127be9-734c-4955-949a-a44a69ac67bd\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s"
Sep 08 14:06:58.667544 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:58.667523    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d127be9-734c-4955-949a-a44a69ac67bd-home\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s\" (UID: \"1d127be9-734c-4955-949a-a44a69ac67bd\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s"
Sep 08 14:06:58.667603 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:58.667586    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d127be9-734c-4955-949a-a44a69ac67bd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s\" (UID: \"1d127be9-734c-4955-949a-a44a69ac67bd\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s"
Sep 08 14:06:58.667676 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:58.667659    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d127be9-734c-4955-949a-a44a69ac67bd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s\" (UID: \"1d127be9-734c-4955-949a-a44a69ac67bd\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s"
Sep 08 14:06:58.669649 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:58.669630    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d127be9-734c-4955-949a-a44a69ac67bd-dshm\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s\" (UID: \"1d127be9-734c-4955-949a-a44a69ac67bd\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s"
Sep 08 14:06:58.669923 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:58.669905    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d127be9-734c-4955-949a-a44a69ac67bd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s\" (UID: \"1d127be9-734c-4955-949a-a44a69ac67bd\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s"
Sep 08 14:06:58.677529 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:58.677509    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4cx2\" (UniqueName: \"kubernetes.io/projected/1d127be9-734c-4955-949a-a44a69ac67bd-kube-api-access-k4cx2\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s\" (UID: \"1d127be9-734c-4955-949a-a44a69ac67bd\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s"
Sep 08 14:06:58.712260 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:58.712239    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s"
Sep 08 14:06:58.986541 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:58.986520    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s"]
Sep 08 14:06:58.988207 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:06:58.988173    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d127be9_734c_4955_949a_a44a69ac67bd.slice/crio-e250d8133d5d3d1205f58f7bf88432005827e8a56f466e821030af910aab7c02 WatchSource:0}: Error finding container e250d8133d5d3d1205f58f7bf88432005827e8a56f466e821030af910aab7c02: Status 404 returned error can't find the container with id e250d8133d5d3d1205f58f7bf88432005827e8a56f466e821030af910aab7c02
Sep 08 14:06:59.470013 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:59.469977    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s" event={"ID":"1d127be9-734c-4955-949a-a44a69ac67bd","Type":"ContainerStarted","Data":"e250d8133d5d3d1205f58f7bf88432005827e8a56f466e821030af910aab7c02"}
Sep 08 14:06:59.660224 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:06:59.660190    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:07:00.476591 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:07:00.476556    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s" event={"ID":"1d127be9-734c-4955-949a-a44a69ac67bd","Type":"ContainerStarted","Data":"f711f61c7dc441cfb7d6569d1287c97b005a193fc4cce7b19c445e61d25294c9"}
Sep 08 14:07:00.497207 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:07:00.497160    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s" podStartSLOduration=1.455514204 podStartE2EDuration="2.497144637s" totalImagesPullingTime="1.041630433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:06:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:07:00.495505026 +0000 UTC m=+495.985222092" watchObservedRunningTime="2026-09-08 14:07:00.497144637 +0000 UTC m=+495.986861689"
Sep 08 14:07:00.712724 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:07:00.712687    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s"
Sep 08 14:07:08.713126 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:07:08.713089    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s"
Sep 08 14:07:08.725805 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:07:08.725780    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s"
Sep 08 14:07:09.536997 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:07:09.536968    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s"
Sep 08 14:07:09.983763 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:07:09.983722    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:07:27.161403 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:07:27.161366    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:08:05.776600 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:05.776523    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph"]
Sep 08 14:08:05.780662 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:05.780642    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph"
Sep 08 14:08:05.783281 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:05.783261    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 08 14:08:05.787583 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:05.787559    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph"]
Sep 08 14:08:05.861321 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:05.861282    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f771c478-fe48-4918-8e89-d3bafddb0510-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph\" (UID: \"f771c478-fe48-4918-8e89-d3bafddb0510\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph"
Sep 08 14:08:05.861505 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:05.861384    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mxrg\" (UniqueName: \"kubernetes.io/projected/f771c478-fe48-4918-8e89-d3bafddb0510-kube-api-access-5mxrg\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph\" (UID: \"f771c478-fe48-4918-8e89-d3bafddb0510\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph"
Sep 08 14:08:05.861505 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:05.861446    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f771c478-fe48-4918-8e89-d3bafddb0510-dshm\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph\" (UID: \"f771c478-fe48-4918-8e89-d3bafddb0510\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph"
Sep 08 14:08:05.861505 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:05.861495    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f771c478-fe48-4918-8e89-d3bafddb0510-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph\" (UID: \"f771c478-fe48-4918-8e89-d3bafddb0510\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph"
Sep 08 14:08:05.861666 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:05.861608    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f771c478-fe48-4918-8e89-d3bafddb0510-home\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph\" (UID: \"f771c478-fe48-4918-8e89-d3bafddb0510\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph"
Sep 08 14:08:05.861666 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:05.861646    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f771c478-fe48-4918-8e89-d3bafddb0510-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph\" (UID: \"f771c478-fe48-4918-8e89-d3bafddb0510\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph"
Sep 08 14:08:05.963108 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:05.963030    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f771c478-fe48-4918-8e89-d3bafddb0510-home\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph\" (UID: \"f771c478-fe48-4918-8e89-d3bafddb0510\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph"
Sep 08 14:08:05.963108 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:05.963085    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f771c478-fe48-4918-8e89-d3bafddb0510-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph\" (UID: \"f771c478-fe48-4918-8e89-d3bafddb0510\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph"
Sep 08 14:08:05.963108 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:05.963106    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f771c478-fe48-4918-8e89-d3bafddb0510-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph\" (UID: \"f771c478-fe48-4918-8e89-d3bafddb0510\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph"
Sep 08 14:08:05.963407 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:05.963141    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mxrg\" (UniqueName: \"kubernetes.io/projected/f771c478-fe48-4918-8e89-d3bafddb0510-kube-api-access-5mxrg\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph\" (UID: \"f771c478-fe48-4918-8e89-d3bafddb0510\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph"
Sep 08 14:08:05.963407 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:05.963177    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f771c478-fe48-4918-8e89-d3bafddb0510-dshm\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph\" (UID: \"f771c478-fe48-4918-8e89-d3bafddb0510\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph"
Sep 08 14:08:05.963407 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:05.963199    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f771c478-fe48-4918-8e89-d3bafddb0510-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph\" (UID: \"f771c478-fe48-4918-8e89-d3bafddb0510\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph"
Sep 08 14:08:05.963566 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:05.963484    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f771c478-fe48-4918-8e89-d3bafddb0510-home\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph\" (UID: \"f771c478-fe48-4918-8e89-d3bafddb0510\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph"
Sep 08 14:08:05.963566 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:05.963498    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f771c478-fe48-4918-8e89-d3bafddb0510-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph\" (UID: \"f771c478-fe48-4918-8e89-d3bafddb0510\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph"
Sep 08 14:08:05.963664 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:05.963602    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f771c478-fe48-4918-8e89-d3bafddb0510-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph\" (UID: \"f771c478-fe48-4918-8e89-d3bafddb0510\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph"
Sep 08 14:08:05.965607 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:05.965579    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f771c478-fe48-4918-8e89-d3bafddb0510-dshm\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph\" (UID: \"f771c478-fe48-4918-8e89-d3bafddb0510\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph"
Sep 08 14:08:05.965781 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:05.965763    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f771c478-fe48-4918-8e89-d3bafddb0510-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph\" (UID: \"f771c478-fe48-4918-8e89-d3bafddb0510\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph"
Sep 08 14:08:05.971932 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:05.971909    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mxrg\" (UniqueName: \"kubernetes.io/projected/f771c478-fe48-4918-8e89-d3bafddb0510-kube-api-access-5mxrg\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph\" (UID: \"f771c478-fe48-4918-8e89-d3bafddb0510\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph"
Sep 08 14:08:06.090967 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:06.090935    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph"
Sep 08 14:08:06.372211 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:06.372187    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph"]
Sep 08 14:08:06.374471 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:08:06.374440    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf771c478_fe48_4918_8e89_d3bafddb0510.slice/crio-5b278fe79de4c00974a9e7a12682b78654d010f14aacede099e980a47450e1ab WatchSource:0}: Error finding container 5b278fe79de4c00974a9e7a12682b78654d010f14aacede099e980a47450e1ab: Status 404 returned error can't find the container with id 5b278fe79de4c00974a9e7a12682b78654d010f14aacede099e980a47450e1ab
Sep 08 14:08:06.865412 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:06.865373    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph" event={"ID":"f771c478-fe48-4918-8e89-d3bafddb0510","Type":"ContainerStarted","Data":"6ff54f4458ad5347de528e53949df504c45732eb169fc7946976d8b7e08c7ac5"}
Sep 08 14:08:06.865917 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:06.865424    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph" event={"ID":"f771c478-fe48-4918-8e89-d3bafddb0510","Type":"ContainerStarted","Data":"5b278fe79de4c00974a9e7a12682b78654d010f14aacede099e980a47450e1ab"}
Sep 08 14:08:06.885807 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:06.885757    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph" podStartSLOduration=1.6986738300000002 podStartE2EDuration="1.885742199s" totalImagesPullingTime="187.068369ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:08:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:08:06.883999541 +0000 UTC m=+562.373716596" watchObservedRunningTime="2026-09-08 14:08:06.885742199 +0000 UTC m=+562.375459285"
Sep 08 14:08:07.091693 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:07.091648    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph"
Sep 08 14:08:08.459901 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:08.459863    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:08:16.091729 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:16.091690    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph"
Sep 08 14:08:16.103956 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:16.103929    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph"
Sep 08 14:08:16.927455 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:08:16.927424    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph"
Sep 08 14:09:00.132099 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:00.132038    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-594f4d9c74-htkq7"]
Sep 08 14:09:00.135677 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:00.135654    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-594f4d9c74-htkq7"
Sep 08 14:09:00.139105 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:00.139082    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-sp9m6\""
Sep 08 14:09:00.139691 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:00.139671    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 08 14:09:00.162664 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:00.162643    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-594f4d9c74-htkq7"]
Sep 08 14:09:00.220083 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:00.220022    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wfws\" (UniqueName: \"kubernetes.io/projected/145a1a6c-be40-4ee0-ae70-255d98de93c0-kube-api-access-9wfws\") pod \"authorino-594f4d9c74-htkq7\" (UID: \"145a1a6c-be40-4ee0-ae70-255d98de93c0\") " pod="kuadrant-system/authorino-594f4d9c74-htkq7"
Sep 08 14:09:00.220237 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:00.220197    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/145a1a6c-be40-4ee0-ae70-255d98de93c0-tls-cert\") pod \"authorino-594f4d9c74-htkq7\" (UID: \"145a1a6c-be40-4ee0-ae70-255d98de93c0\") " pod="kuadrant-system/authorino-594f4d9c74-htkq7"
Sep 08 14:09:00.321346 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:00.321321    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wfws\" (UniqueName: \"kubernetes.io/projected/145a1a6c-be40-4ee0-ae70-255d98de93c0-kube-api-access-9wfws\") pod \"authorino-594f4d9c74-htkq7\" (UID: \"145a1a6c-be40-4ee0-ae70-255d98de93c0\") " pod="kuadrant-system/authorino-594f4d9c74-htkq7"
Sep 08 14:09:00.321488 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:00.321412    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/145a1a6c-be40-4ee0-ae70-255d98de93c0-tls-cert\") pod \"authorino-594f4d9c74-htkq7\" (UID: \"145a1a6c-be40-4ee0-ae70-255d98de93c0\") " pod="kuadrant-system/authorino-594f4d9c74-htkq7"
Sep 08 14:09:00.323896 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:00.323871    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/145a1a6c-be40-4ee0-ae70-255d98de93c0-tls-cert\") pod \"authorino-594f4d9c74-htkq7\" (UID: \"145a1a6c-be40-4ee0-ae70-255d98de93c0\") " pod="kuadrant-system/authorino-594f4d9c74-htkq7"
Sep 08 14:09:00.332453 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:00.332430    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wfws\" (UniqueName: \"kubernetes.io/projected/145a1a6c-be40-4ee0-ae70-255d98de93c0-kube-api-access-9wfws\") pod \"authorino-594f4d9c74-htkq7\" (UID: \"145a1a6c-be40-4ee0-ae70-255d98de93c0\") " pod="kuadrant-system/authorino-594f4d9c74-htkq7"
Sep 08 14:09:00.445449 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:00.445361    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-594f4d9c74-htkq7"
Sep 08 14:09:00.717860 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:00.717837    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-594f4d9c74-htkq7"]
Sep 08 14:09:00.719946 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:09:00.719915    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod145a1a6c_be40_4ee0_ae70_255d98de93c0.slice/crio-8bc343f3761b3f0b651cc18260d62d95a455de2e7d9e102e78a7fc1f09f4dcc0 WatchSource:0}: Error finding container 8bc343f3761b3f0b651cc18260d62d95a455de2e7d9e102e78a7fc1f09f4dcc0: Status 404 returned error can't find the container with id 8bc343f3761b3f0b651cc18260d62d95a455de2e7d9e102e78a7fc1f09f4dcc0
Sep 08 14:09:01.180009 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:01.179958    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-594f4d9c74-htkq7" event={"ID":"145a1a6c-be40-4ee0-ae70-255d98de93c0","Type":"ContainerStarted","Data":"8bc343f3761b3f0b651cc18260d62d95a455de2e7d9e102e78a7fc1f09f4dcc0"}
Sep 08 14:09:02.189048 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:02.189009    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-594f4d9c74-htkq7" event={"ID":"145a1a6c-be40-4ee0-ae70-255d98de93c0","Type":"ContainerStarted","Data":"ffd71888799dd5f2f07ca8d82a9ad334e85cc1f161140b33ae83a0ae05d946be"}
Sep 08 14:09:02.207614 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:02.207555    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-594f4d9c74-htkq7" podStartSLOduration=1.418027991 podStartE2EDuration="2.20753904s" totalImagesPullingTime="789.511049ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:09:02.205257046 +0000 UTC m=+617.694974099" watchObservedRunningTime="2026-09-08 14:09:02.20753904 +0000 UTC m=+617.697256091"
Sep 08 14:09:25.130508 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:25.130473    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:09:29.843101 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:29.843048    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"]
Sep 08 14:09:29.847742 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:29.847713    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:29.852325 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:29.852304    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-41383d-openshift-default-dockercfg-qgqb9\""
Sep 08 14:09:29.868207 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:29.868187    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"]
Sep 08 14:09:29.997677 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:29.997644    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d11c09a7-92b1-4faf-8628-eafd1f96379d-credential-socket\") pod \"e2e-autores-41383d-openshift-default-7974f5cfb-fsf79\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") " pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:29.997677 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:29.997678    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d11c09a7-92b1-4faf-8628-eafd1f96379d-workload-certs\") pod \"e2e-autores-41383d-openshift-default-7974f5cfb-fsf79\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") " pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:29.997897 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:29.997698    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d11c09a7-92b1-4faf-8628-eafd1f96379d-istio-token\") pod \"e2e-autores-41383d-openshift-default-7974f5cfb-fsf79\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") " pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:29.997897 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:29.997722    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d11c09a7-92b1-4faf-8628-eafd1f96379d-istio-data\") pod \"e2e-autores-41383d-openshift-default-7974f5cfb-fsf79\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") " pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:29.997897 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:29.997768    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d11c09a7-92b1-4faf-8628-eafd1f96379d-istiod-ca-cert\") pod \"e2e-autores-41383d-openshift-default-7974f5cfb-fsf79\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") " pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:29.998035 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:29.997888    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d11c09a7-92b1-4faf-8628-eafd1f96379d-workload-socket\") pod \"e2e-autores-41383d-openshift-default-7974f5cfb-fsf79\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") " pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:29.998035 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:29.997964    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-758v2\" (UniqueName: \"kubernetes.io/projected/d11c09a7-92b1-4faf-8628-eafd1f96379d-kube-api-access-758v2\") pod \"e2e-autores-41383d-openshift-default-7974f5cfb-fsf79\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") " pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:29.998173 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:29.998042    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d11c09a7-92b1-4faf-8628-eafd1f96379d-istio-envoy\") pod \"e2e-autores-41383d-openshift-default-7974f5cfb-fsf79\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") " pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:29.998173 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:29.998128    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d11c09a7-92b1-4faf-8628-eafd1f96379d-istio-podinfo\") pod \"e2e-autores-41383d-openshift-default-7974f5cfb-fsf79\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") " pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:30.099358 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:30.099266    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-758v2\" (UniqueName: \"kubernetes.io/projected/d11c09a7-92b1-4faf-8628-eafd1f96379d-kube-api-access-758v2\") pod \"e2e-autores-41383d-openshift-default-7974f5cfb-fsf79\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") " pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:30.099358 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:30.099314    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d11c09a7-92b1-4faf-8628-eafd1f96379d-istio-envoy\") pod \"e2e-autores-41383d-openshift-default-7974f5cfb-fsf79\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") " pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:30.099358 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:30.099342    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d11c09a7-92b1-4faf-8628-eafd1f96379d-istio-podinfo\") pod \"e2e-autores-41383d-openshift-default-7974f5cfb-fsf79\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") " pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:30.099646 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:30.099376    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d11c09a7-92b1-4faf-8628-eafd1f96379d-credential-socket\") pod \"e2e-autores-41383d-openshift-default-7974f5cfb-fsf79\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") " pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:30.099646 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:30.099403    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d11c09a7-92b1-4faf-8628-eafd1f96379d-workload-certs\") pod \"e2e-autores-41383d-openshift-default-7974f5cfb-fsf79\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") " pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:30.099646 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:30.099423    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d11c09a7-92b1-4faf-8628-eafd1f96379d-istio-token\") pod \"e2e-autores-41383d-openshift-default-7974f5cfb-fsf79\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") " pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:30.099646 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:30.099468    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d11c09a7-92b1-4faf-8628-eafd1f96379d-istio-data\") pod \"e2e-autores-41383d-openshift-default-7974f5cfb-fsf79\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") " pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:30.099646 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:30.099501    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d11c09a7-92b1-4faf-8628-eafd1f96379d-istiod-ca-cert\") pod \"e2e-autores-41383d-openshift-default-7974f5cfb-fsf79\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") " pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:30.099646 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:30.099572    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d11c09a7-92b1-4faf-8628-eafd1f96379d-workload-socket\") pod \"e2e-autores-41383d-openshift-default-7974f5cfb-fsf79\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") " pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:30.099978 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:30.099826    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d11c09a7-92b1-4faf-8628-eafd1f96379d-credential-socket\") pod \"e2e-autores-41383d-openshift-default-7974f5cfb-fsf79\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") " pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:30.099978 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:30.099860    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d11c09a7-92b1-4faf-8628-eafd1f96379d-workload-certs\") pod \"e2e-autores-41383d-openshift-default-7974f5cfb-fsf79\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") " pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:30.099978 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:30.099917    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d11c09a7-92b1-4faf-8628-eafd1f96379d-istio-data\") pod \"e2e-autores-41383d-openshift-default-7974f5cfb-fsf79\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") " pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:30.100124 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:30.100091    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d11c09a7-92b1-4faf-8628-eafd1f96379d-workload-socket\") pod \"e2e-autores-41383d-openshift-default-7974f5cfb-fsf79\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") " pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:30.100593 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:30.100569    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d11c09a7-92b1-4faf-8628-eafd1f96379d-istiod-ca-cert\") pod \"e2e-autores-41383d-openshift-default-7974f5cfb-fsf79\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") " pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:30.101879 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:30.101855    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d11c09a7-92b1-4faf-8628-eafd1f96379d-istio-envoy\") pod \"e2e-autores-41383d-openshift-default-7974f5cfb-fsf79\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") " pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:30.101979 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:30.101905    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d11c09a7-92b1-4faf-8628-eafd1f96379d-istio-podinfo\") pod \"e2e-autores-41383d-openshift-default-7974f5cfb-fsf79\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") " pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:30.124564 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:30.124537    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d11c09a7-92b1-4faf-8628-eafd1f96379d-istio-token\") pod \"e2e-autores-41383d-openshift-default-7974f5cfb-fsf79\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") " pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:30.126650 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:30.126625    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-758v2\" (UniqueName: \"kubernetes.io/projected/d11c09a7-92b1-4faf-8628-eafd1f96379d-kube-api-access-758v2\") pod \"e2e-autores-41383d-openshift-default-7974f5cfb-fsf79\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") " pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:30.158733 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:30.158707    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:30.434886 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:30.434861    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"]
Sep 08 14:09:30.436680 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:09:30.436657    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd11c09a7_92b1_4faf_8628_eafd1f96379d.slice/crio-a3ea6afe34e64f679a596d93d062805ce68c388a80381d2f6cd07c924522a4ca WatchSource:0}: Error finding container a3ea6afe34e64f679a596d93d062805ce68c388a80381d2f6cd07c924522a4ca: Status 404 returned error can't find the container with id a3ea6afe34e64f679a596d93d062805ce68c388a80381d2f6cd07c924522a4ca
Sep 08 14:09:30.438885 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:30.438851    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:09:30.438982 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:30.438930    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:09:30.438982 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:30.438976    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:09:31.356530 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.356494    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79" event={"ID":"d11c09a7-92b1-4faf-8628-eafd1f96379d","Type":"ContainerStarted","Data":"2bf55dbc705398b925969e757ad3d50a7ea15679ddba2352d2f30dcf7910957a"}
Sep 08 14:09:31.356968 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.356555    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79" event={"ID":"d11c09a7-92b1-4faf-8628-eafd1f96379d","Type":"ContainerStarted","Data":"a3ea6afe34e64f679a596d93d062805ce68c388a80381d2f6cd07c924522a4ca"}
Sep 08 14:09:31.380396 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.380347    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79" podStartSLOduration=2.380331498 podStartE2EDuration="2.380331498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:09:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:09:31.377908188 +0000 UTC m=+646.867625242" watchObservedRunningTime="2026-09-08 14:09:31.380331498 +0000 UTC m=+646.870048551"
Sep 08 14:09:31.482823 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.482793    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"]
Sep 08 14:09:31.486440 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.486417    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:31.489820 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.489789    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-6a4001b4-openshift-default-dockercfg-xcgfw\""
Sep 08 14:09:31.526615 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.526586    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"]
Sep 08 14:09:31.612972 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.612878    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/393ea684-5023-48b7-ae73-d0b7f8e9d084-istiod-ca-cert\") pod \"e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") " pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:31.613165 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.612994    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/393ea684-5023-48b7-ae73-d0b7f8e9d084-istio-token\") pod \"e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") " pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:31.613165 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.613026    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/393ea684-5023-48b7-ae73-d0b7f8e9d084-istio-data\") pod \"e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") " pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:31.613165 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.613095    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/393ea684-5023-48b7-ae73-d0b7f8e9d084-workload-certs\") pod \"e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") " pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:31.613165 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.613129    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/393ea684-5023-48b7-ae73-d0b7f8e9d084-istio-envoy\") pod \"e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") " pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:31.613374 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.613168    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwnn5\" (UniqueName: \"kubernetes.io/projected/393ea684-5023-48b7-ae73-d0b7f8e9d084-kube-api-access-kwnn5\") pod \"e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") " pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:31.613374 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.613198    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/393ea684-5023-48b7-ae73-d0b7f8e9d084-workload-socket\") pod \"e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") " pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:31.613374 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.613222    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/393ea684-5023-48b7-ae73-d0b7f8e9d084-credential-socket\") pod \"e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") " pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:31.613374 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.613280    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/393ea684-5023-48b7-ae73-d0b7f8e9d084-istio-podinfo\") pod \"e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") " pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:31.713918 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.713887    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/393ea684-5023-48b7-ae73-d0b7f8e9d084-istio-podinfo\") pod \"e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") " pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:31.714136 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.713927    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/393ea684-5023-48b7-ae73-d0b7f8e9d084-istiod-ca-cert\") pod \"e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") " pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:31.714136 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.713975    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/393ea684-5023-48b7-ae73-d0b7f8e9d084-istio-token\") pod \"e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") " pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:31.714136 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.713996    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/393ea684-5023-48b7-ae73-d0b7f8e9d084-istio-data\") pod \"e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") " pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:31.714136 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.714015    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/393ea684-5023-48b7-ae73-d0b7f8e9d084-workload-certs\") pod \"e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") " pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:31.714136 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.714033    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/393ea684-5023-48b7-ae73-d0b7f8e9d084-istio-envoy\") pod \"e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") " pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:31.714413 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.714128    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwnn5\" (UniqueName: \"kubernetes.io/projected/393ea684-5023-48b7-ae73-d0b7f8e9d084-kube-api-access-kwnn5\") pod \"e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") " pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:31.714413 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.714265    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/393ea684-5023-48b7-ae73-d0b7f8e9d084-workload-socket\") pod \"e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") " pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:31.714413 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.714306    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/393ea684-5023-48b7-ae73-d0b7f8e9d084-credential-socket\") pod \"e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") " pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:31.714527 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.714479    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/393ea684-5023-48b7-ae73-d0b7f8e9d084-workload-certs\") pod \"e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") " pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:31.714807 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.714784    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/393ea684-5023-48b7-ae73-d0b7f8e9d084-istio-data\") pod \"e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") " pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:31.714880 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.714864    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/393ea684-5023-48b7-ae73-d0b7f8e9d084-istiod-ca-cert\") pod \"e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") " pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:31.714944 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.714922    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/393ea684-5023-48b7-ae73-d0b7f8e9d084-workload-socket\") pod \"e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") " pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:31.715020 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.715000    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/393ea684-5023-48b7-ae73-d0b7f8e9d084-credential-socket\") pod \"e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") " pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:31.716538 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.716517    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/393ea684-5023-48b7-ae73-d0b7f8e9d084-istio-envoy\") pod \"e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") " pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:31.716691 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.716675    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/393ea684-5023-48b7-ae73-d0b7f8e9d084-istio-podinfo\") pod \"e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") " pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:31.726627 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.726606    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwnn5\" (UniqueName: \"kubernetes.io/projected/393ea684-5023-48b7-ae73-d0b7f8e9d084-kube-api-access-kwnn5\") pod \"e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") " pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:31.729764 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.729744    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/393ea684-5023-48b7-ae73-d0b7f8e9d084-istio-token\") pod \"e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") " pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:31.797618 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:31.797593    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:32.096296 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:32.096267    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"]
Sep 08 14:09:32.097569 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:09:32.097543    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod393ea684_5023_48b7_ae73_d0b7f8e9d084.slice/crio-7f5eca016fd0ff77ce755728ffdd58dd22649b7ec552b4c871addc3f92d6f4ae WatchSource:0}: Error finding container 7f5eca016fd0ff77ce755728ffdd58dd22649b7ec552b4c871addc3f92d6f4ae: Status 404 returned error can't find the container with id 7f5eca016fd0ff77ce755728ffdd58dd22649b7ec552b4c871addc3f92d6f4ae
Sep 08 14:09:32.099872 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:32.099845    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:09:32.099932 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:32.099921    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:09:32.099968 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:32.099947    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:09:32.159713 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:32.159692    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:32.165036 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:32.165016    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:32.365037 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:32.364940    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6" event={"ID":"393ea684-5023-48b7-ae73-d0b7f8e9d084","Type":"ContainerStarted","Data":"6765843c3d1cd3ca0d7135cab54edab0517b5dcf86e2eb81917261454f91f7f1"}
Sep 08 14:09:32.365504 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:32.365243    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:32.365504 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:32.365291    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6" event={"ID":"393ea684-5023-48b7-ae73-d0b7f8e9d084","Type":"ContainerStarted","Data":"7f5eca016fd0ff77ce755728ffdd58dd22649b7ec552b4c871addc3f92d6f4ae"}
Sep 08 14:09:32.365925 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:32.365904    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:32.395157 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:32.395108    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6" podStartSLOduration=1.395094517 podStartE2EDuration="1.395094517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:09:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:09:32.392159098 +0000 UTC m=+647.881876194" watchObservedRunningTime="2026-09-08 14:09:32.395094517 +0000 UTC m=+647.884811568"
Sep 08 14:09:32.798169 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:32.798087    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:33.803319 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:33.803284    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:34.376373 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:34.376338    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:34.377093 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:34.377074    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:35.827681 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:35.827646    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt"]
Sep 08 14:09:35.832167 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:35.832144    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt"
Sep 08 14:09:35.835041 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:35.835018    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-6a4001b4-serving-cert\""
Sep 08 14:09:35.898812 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:35.898787    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt"]
Sep 08 14:09:35.950886 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:35.950851    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzg9w\" (UniqueName: \"kubernetes.io/projected/9eb72210-d999-4fb7-9550-c7b11a8719f6-kube-api-access-bzg9w\") pod \"maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt\" (UID: \"9eb72210-d999-4fb7-9550-c7b11a8719f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt"
Sep 08 14:09:35.951107 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:35.950956    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9eb72210-d999-4fb7-9550-c7b11a8719f6-maas-api-tls\") pod \"maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt\" (UID: \"9eb72210-d999-4fb7-9550-c7b11a8719f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt"
Sep 08 14:09:35.951107 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:35.950982    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9eb72210-d999-4fb7-9550-c7b11a8719f6-metrics-certs\") pod \"maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt\" (UID: \"9eb72210-d999-4fb7-9550-c7b11a8719f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt"
Sep 08 14:09:35.951107 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:35.951036    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9eb72210-d999-4fb7-9550-c7b11a8719f6-openshift-service-ca\") pod \"maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt\" (UID: \"9eb72210-d999-4fb7-9550-c7b11a8719f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt"
Sep 08 14:09:36.051841 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:36.051798    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzg9w\" (UniqueName: \"kubernetes.io/projected/9eb72210-d999-4fb7-9550-c7b11a8719f6-kube-api-access-bzg9w\") pod \"maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt\" (UID: \"9eb72210-d999-4fb7-9550-c7b11a8719f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt"
Sep 08 14:09:36.052038 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:36.051906    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9eb72210-d999-4fb7-9550-c7b11a8719f6-maas-api-tls\") pod \"maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt\" (UID: \"9eb72210-d999-4fb7-9550-c7b11a8719f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt"
Sep 08 14:09:36.052038 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:36.051934    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9eb72210-d999-4fb7-9550-c7b11a8719f6-metrics-certs\") pod \"maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt\" (UID: \"9eb72210-d999-4fb7-9550-c7b11a8719f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt"
Sep 08 14:09:36.052225 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:09:36.052044    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-serving-cert: secret "maas-api-e2e-ait-6a4001b4-serving-cert" not found
Sep 08 14:09:36.052225 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:09:36.052139    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9eb72210-d999-4fb7-9550-c7b11a8719f6-maas-api-tls podName:9eb72210-d999-4fb7-9550-c7b11a8719f6 nodeName:}" failed. No retries permitted until 2026-09-08 14:09:36.552115156 +0000 UTC m=+652.041832187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9eb72210-d999-4fb7-9550-c7b11a8719f6-maas-api-tls") pod "maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt" (UID: "9eb72210-d999-4fb7-9550-c7b11a8719f6") : secret "maas-api-e2e-ait-6a4001b4-serving-cert" not found
Sep 08 14:09:36.052225 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:36.052195    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9eb72210-d999-4fb7-9550-c7b11a8719f6-openshift-service-ca\") pod \"maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt\" (UID: \"9eb72210-d999-4fb7-9550-c7b11a8719f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt"
Sep 08 14:09:36.052797 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:36.052778    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9eb72210-d999-4fb7-9550-c7b11a8719f6-openshift-service-ca\") pod \"maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt\" (UID: \"9eb72210-d999-4fb7-9550-c7b11a8719f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt"
Sep 08 14:09:36.054576 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:36.054549    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9eb72210-d999-4fb7-9550-c7b11a8719f6-metrics-certs\") pod \"maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt\" (UID: \"9eb72210-d999-4fb7-9550-c7b11a8719f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt"
Sep 08 14:09:36.063683 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:36.063658    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzg9w\" (UniqueName: \"kubernetes.io/projected/9eb72210-d999-4fb7-9550-c7b11a8719f6-kube-api-access-bzg9w\") pod \"maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt\" (UID: \"9eb72210-d999-4fb7-9550-c7b11a8719f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt"
Sep 08 14:09:36.558487 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:36.558450    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9eb72210-d999-4fb7-9550-c7b11a8719f6-maas-api-tls\") pod \"maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt\" (UID: \"9eb72210-d999-4fb7-9550-c7b11a8719f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt"
Sep 08 14:09:36.560872 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:36.560853    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9eb72210-d999-4fb7-9550-c7b11a8719f6-maas-api-tls\") pod \"maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt\" (UID: \"9eb72210-d999-4fb7-9550-c7b11a8719f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt"
Sep 08 14:09:36.742535 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:36.742499    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt"
Sep 08 14:09:37.026253 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:37.026222    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt"]
Sep 08 14:09:37.028336 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:09:37.028299    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eb72210_d999_4fb7_9550_c7b11a8719f6.slice/crio-7264806b927dc05712d6362abf64bd34a712eb981d4a005ffe676eecbf4f5bf0 WatchSource:0}: Error finding container 7264806b927dc05712d6362abf64bd34a712eb981d4a005ffe676eecbf4f5bf0: Status 404 returned error can't find the container with id 7264806b927dc05712d6362abf64bd34a712eb981d4a005ffe676eecbf4f5bf0
Sep 08 14:09:37.030016 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:37.029998    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 14:09:37.398579 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:37.398549    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt" event={"ID":"9eb72210-d999-4fb7-9550-c7b11a8719f6","Type":"ContainerStarted","Data":"7264806b927dc05712d6362abf64bd34a712eb981d4a005ffe676eecbf4f5bf0"}
Sep 08 14:09:38.405648 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:38.405612    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt" event={"ID":"9eb72210-d999-4fb7-9550-c7b11a8719f6","Type":"ContainerStarted","Data":"9b649698a2ce0eeb88e5f946a0479e5a70c8a72720cbadff2d43c5d0b94103b5"}
Sep 08 14:09:38.406013 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:38.405730    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt"
Sep 08 14:09:38.429029 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:38.428972    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt" podStartSLOduration=3.06057404 podStartE2EDuration="3.428959706s" totalImagesPullingTime="368.385666ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:09:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:09:38.426383969 +0000 UTC m=+653.916101038" watchObservedRunningTime="2026-09-08 14:09:38.428959706 +0000 UTC m=+653.918676757"
Sep 08 14:09:44.415731 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:44.415702    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt"
Sep 08 14:09:45.061473 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:45.061439    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:09:55.514621 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:55.514586    2575 generic.go:356] "Generic (PLEG): container finished" podID="d11c09a7-92b1-4faf-8628-eafd1f96379d" containerID="2bf55dbc705398b925969e757ad3d50a7ea15679ddba2352d2f30dcf7910957a" exitCode=0
Sep 08 14:09:55.515048 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:55.514659    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79" event={"ID":"d11c09a7-92b1-4faf-8628-eafd1f96379d","Type":"ContainerDied","Data":"2bf55dbc705398b925969e757ad3d50a7ea15679ddba2352d2f30dcf7910957a"}
Sep 08 14:09:55.515120 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:55.515088    2575 scope.go:117] "RemoveContainer" containerID="2bf55dbc705398b925969e757ad3d50a7ea15679ddba2352d2f30dcf7910957a"
Sep 08 14:09:55.516165 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:55.516130    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:09:55.516267 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:55.516229    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:09:55.516330 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:55.516276    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:09:56.522387 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:56.522352    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79" event={"ID":"d11c09a7-92b1-4faf-8628-eafd1f96379d","Type":"ContainerStarted","Data":"6d9eabf294377cb84362998bb3b40f64b7828d206241ffb106be1edaaff2d269"}
Sep 08 14:09:56.524013 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:56.523992    2575 generic.go:356] "Generic (PLEG): container finished" podID="393ea684-5023-48b7-ae73-d0b7f8e9d084" containerID="6765843c3d1cd3ca0d7135cab54edab0517b5dcf86e2eb81917261454f91f7f1" exitCode=0
Sep 08 14:09:56.524138 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:56.524076    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6" event={"ID":"393ea684-5023-48b7-ae73-d0b7f8e9d084","Type":"ContainerDied","Data":"6765843c3d1cd3ca0d7135cab54edab0517b5dcf86e2eb81917261454f91f7f1"}
Sep 08 14:09:56.524423 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:56.524410    2575 scope.go:117] "RemoveContainer" containerID="6765843c3d1cd3ca0d7135cab54edab0517b5dcf86e2eb81917261454f91f7f1"
Sep 08 14:09:56.525486 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:56.525460    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:09:56.525579 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:56.525524    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:09:56.525579 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:56.525564    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:09:57.159770 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:57.159735    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:09:57.160092 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:57.160037    2575 patch_prober.go:28] interesting pod/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 08 14:09:57.160204 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:57.160149    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79" podUID="d11c09a7-92b1-4faf-8628-eafd1f96379d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 08 14:09:57.537769 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:57.537669    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6" event={"ID":"393ea684-5023-48b7-ae73-d0b7f8e9d084","Type":"ContainerStarted","Data":"40af28d3782db4b6ba6e1c480e9098efa43f790b5f18bca7d89e3c02d4643559"}
Sep 08 14:09:57.797821 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:57.797735    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:09:57.797991 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:57.797893    2575 patch_prober.go:28] interesting pod/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 08 14:09:57.797991 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:57.797958    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6" podUID="393ea684-5023-48b7-ae73-d0b7f8e9d084" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 08 14:09:58.160105 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:58.160031    2575 patch_prober.go:28] interesting pod/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 08 14:09:58.160317 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:58.160150    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79" podUID="d11c09a7-92b1-4faf-8628-eafd1f96379d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 08 14:09:58.798089 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:58.798036    2575 patch_prober.go:28] interesting pod/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 08 14:09:58.798464 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:58.798126    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6" podUID="393ea684-5023-48b7-ae73-d0b7f8e9d084" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 08 14:09:59.159375 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:59.159331    2575 patch_prober.go:28] interesting pod/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 08 14:09:59.159589 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:59.159401    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79" podUID="d11c09a7-92b1-4faf-8628-eafd1f96379d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 08 14:09:59.798898 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:59.798856    2575 patch_prober.go:28] interesting pod/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 08 14:09:59.799308 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:09:59.798935    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6" podUID="393ea684-5023-48b7-ae73-d0b7f8e9d084" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 08 14:10:00.159605 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:00.159565    2575 patch_prober.go:28] interesting pod/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 08 14:10:00.159980 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:00.159933    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79" podUID="d11c09a7-92b1-4faf-8628-eafd1f96379d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 08 14:10:00.798468 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:00.798432    2575 patch_prober.go:28] interesting pod/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 08 14:10:00.798629 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:00.798498    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6" podUID="393ea684-5023-48b7-ae73-d0b7f8e9d084" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 08 14:10:01.160104 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:01.160070    2575 patch_prober.go:28] interesting pod/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 08 14:10:01.160702 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:01.160645    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79" podUID="d11c09a7-92b1-4faf-8628-eafd1f96379d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 08 14:10:01.798314 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:01.798277    2575 patch_prober.go:28] interesting pod/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 08 14:10:01.798500 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:01.798333    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6" podUID="393ea684-5023-48b7-ae73-d0b7f8e9d084" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 08 14:10:02.160498 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:02.160016    2575 patch_prober.go:28] interesting pod/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 08 14:10:02.160498 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:02.160111    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79" podUID="d11c09a7-92b1-4faf-8628-eafd1f96379d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 08 14:10:02.366108 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:02.366068    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:10:02.799004 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:02.798966    2575 patch_prober.go:28] interesting pod/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 08 14:10:02.799208 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:02.799034    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6" podUID="393ea684-5023-48b7-ae73-d0b7f8e9d084" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 08 14:10:03.163630 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:03.163600    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:10:03.164670 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:03.164653    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:10:03.802936 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:03.802903    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:10:03.803348 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:03.803320    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:10:03.804042 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:03.804025    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:10:07.860455 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:07.860422    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:10:15.470488 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:15.470456    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt"]
Sep 08 14:10:15.470921 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:15.470658    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt" podUID="9eb72210-d999-4fb7-9550-c7b11a8719f6" containerName="maas-api" containerID="cri-o://9b649698a2ce0eeb88e5f946a0479e5a70c8a72720cbadff2d43c5d0b94103b5" gracePeriod=30
Sep 08 14:10:15.503273 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:10:15.503228    2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eb72210_d999_4fb7_9550_c7b11a8719f6.slice/crio-9b649698a2ce0eeb88e5f946a0479e5a70c8a72720cbadff2d43c5d0b94103b5.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eb72210_d999_4fb7_9550_c7b11a8719f6.slice/crio-conmon-9b649698a2ce0eeb88e5f946a0479e5a70c8a72720cbadff2d43c5d0b94103b5.scope\": RecentStats: unable to find data in memory cache]"
Sep 08 14:10:15.503432 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:10:15.503331    2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eb72210_d999_4fb7_9550_c7b11a8719f6.slice/crio-conmon-9b649698a2ce0eeb88e5f946a0479e5a70c8a72720cbadff2d43c5d0b94103b5.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eb72210_d999_4fb7_9550_c7b11a8719f6.slice/crio-9b649698a2ce0eeb88e5f946a0479e5a70c8a72720cbadff2d43c5d0b94103b5.scope\": RecentStats: unable to find data in memory cache]"
Sep 08 14:10:15.660795 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:15.660767    2575 generic.go:356] "Generic (PLEG): container finished" podID="9eb72210-d999-4fb7-9550-c7b11a8719f6" containerID="9b649698a2ce0eeb88e5f946a0479e5a70c8a72720cbadff2d43c5d0b94103b5" exitCode=0
Sep 08 14:10:15.660959 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:15.660843    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt" event={"ID":"9eb72210-d999-4fb7-9550-c7b11a8719f6","Type":"ContainerDied","Data":"9b649698a2ce0eeb88e5f946a0479e5a70c8a72720cbadff2d43c5d0b94103b5"}
Sep 08 14:10:15.723393 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:15.723333    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt"
Sep 08 14:10:15.854297 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:15.854266    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzg9w\" (UniqueName: \"kubernetes.io/projected/9eb72210-d999-4fb7-9550-c7b11a8719f6-kube-api-access-bzg9w\") pod \"9eb72210-d999-4fb7-9550-c7b11a8719f6\" (UID: \"9eb72210-d999-4fb7-9550-c7b11a8719f6\") "
Sep 08 14:10:15.854476 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:15.854310    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9eb72210-d999-4fb7-9550-c7b11a8719f6-openshift-service-ca\") pod \"9eb72210-d999-4fb7-9550-c7b11a8719f6\" (UID: \"9eb72210-d999-4fb7-9550-c7b11a8719f6\") "
Sep 08 14:10:15.854476 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:15.854398    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9eb72210-d999-4fb7-9550-c7b11a8719f6-maas-api-tls\") pod \"9eb72210-d999-4fb7-9550-c7b11a8719f6\" (UID: \"9eb72210-d999-4fb7-9550-c7b11a8719f6\") "
Sep 08 14:10:15.854476 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:15.854419    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9eb72210-d999-4fb7-9550-c7b11a8719f6-metrics-certs\") pod \"9eb72210-d999-4fb7-9550-c7b11a8719f6\" (UID: \"9eb72210-d999-4fb7-9550-c7b11a8719f6\") "
Sep 08 14:10:15.855182 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:15.855150    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9eb72210-d999-4fb7-9550-c7b11a8719f6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9eb72210-d999-4fb7-9550-c7b11a8719f6" (UID: "9eb72210-d999-4fb7-9550-c7b11a8719f6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:10:15.857465 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:15.857424    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9eb72210-d999-4fb7-9550-c7b11a8719f6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9eb72210-d999-4fb7-9550-c7b11a8719f6" (UID: "9eb72210-d999-4fb7-9550-c7b11a8719f6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:10:15.858739 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:15.858716    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9eb72210-d999-4fb7-9550-c7b11a8719f6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9eb72210-d999-4fb7-9550-c7b11a8719f6" (UID: "9eb72210-d999-4fb7-9550-c7b11a8719f6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:10:15.860006 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:15.859980    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9eb72210-d999-4fb7-9550-c7b11a8719f6-kube-api-access-bzg9w" (OuterVolumeSpecName: "kube-api-access-bzg9w") pod "9eb72210-d999-4fb7-9550-c7b11a8719f6" (UID: "9eb72210-d999-4fb7-9550-c7b11a8719f6"). InnerVolumeSpecName "kube-api-access-bzg9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:10:15.937780 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:15.937746    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"]
Sep 08 14:10:15.937980 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:15.937957    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6" podUID="393ea684-5023-48b7-ae73-d0b7f8e9d084" containerName="istio-proxy" containerID="cri-o://40af28d3782db4b6ba6e1c480e9098efa43f790b5f18bca7d89e3c02d4643559" gracePeriod=30
Sep 08 14:10:15.956365 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:15.956326    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9eb72210-d999-4fb7-9550-c7b11a8719f6-maas-api-tls\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:10:15.956365 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:15.956360    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9eb72210-d999-4fb7-9550-c7b11a8719f6-metrics-certs\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:10:15.956365 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:15.956370    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzg9w\" (UniqueName: \"kubernetes.io/projected/9eb72210-d999-4fb7-9550-c7b11a8719f6-kube-api-access-bzg9w\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:10:15.956552 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:15.956380    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9eb72210-d999-4fb7-9550-c7b11a8719f6-openshift-service-ca\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:10:16.668164 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:16.668125    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt" event={"ID":"9eb72210-d999-4fb7-9550-c7b11a8719f6","Type":"ContainerDied","Data":"7264806b927dc05712d6362abf64bd34a712eb981d4a005ffe676eecbf4f5bf0"}
Sep 08 14:10:16.668164 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:16.668161    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt"
Sep 08 14:10:16.668656 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:16.668209    2575 scope.go:117] "RemoveContainer" containerID="9b649698a2ce0eeb88e5f946a0479e5a70c8a72720cbadff2d43c5d0b94103b5"
Sep 08 14:10:16.689895 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:16.689865    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt"]
Sep 08 14:10:16.692224 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:16.692206    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6a4001b4-7dc46dd855-k9fmt"]
Sep 08 14:10:16.974529 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:16.974453    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9eb72210-d999-4fb7-9550-c7b11a8719f6" path="/var/lib/kubelet/pods/9eb72210-d999-4fb7-9550-c7b11a8719f6/volumes"
Sep 08 14:10:18.805425 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:18.805389    2575 patch_prober.go:28] interesting pod/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 14:10:18.805812 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:18.805454    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6" podUID="393ea684-5023-48b7-ae73-d0b7f8e9d084" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 14:10:19.883009 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:19.882971    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8"]
Sep 08 14:10:19.883434 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:19.883417    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9eb72210-d999-4fb7-9550-c7b11a8719f6" containerName="maas-api"
Sep 08 14:10:19.883504 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:19.883438    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9eb72210-d999-4fb7-9550-c7b11a8719f6" containerName="maas-api"
Sep 08 14:10:19.883583 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:19.883563    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9eb72210-d999-4fb7-9550-c7b11a8719f6" containerName="maas-api"
Sep 08 14:10:19.886683 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:19.886663    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8"
Sep 08 14:10:19.889572 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:19.889549    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-f6640f0d-serving-cert\""
Sep 08 14:10:19.908025 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:19.908004    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8"]
Sep 08 14:10:19.996768 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:19.996737    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57ec431f-c183-43a1-a809-cbc350b8b2c0-maas-api-tls\") pod \"maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8\" (UID: \"57ec431f-c183-43a1-a809-cbc350b8b2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8"
Sep 08 14:10:19.996932 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:19.996783    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57ec431f-c183-43a1-a809-cbc350b8b2c0-openshift-service-ca\") pod \"maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8\" (UID: \"57ec431f-c183-43a1-a809-cbc350b8b2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8"
Sep 08 14:10:19.996932 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:19.996808    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvqkl\" (UniqueName: \"kubernetes.io/projected/57ec431f-c183-43a1-a809-cbc350b8b2c0-kube-api-access-bvqkl\") pod \"maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8\" (UID: \"57ec431f-c183-43a1-a809-cbc350b8b2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8"
Sep 08 14:10:19.997030 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:19.996936    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57ec431f-c183-43a1-a809-cbc350b8b2c0-metrics-certs\") pod \"maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8\" (UID: \"57ec431f-c183-43a1-a809-cbc350b8b2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8"
Sep 08 14:10:20.097853 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:20.097817    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57ec431f-c183-43a1-a809-cbc350b8b2c0-openshift-service-ca\") pod \"maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8\" (UID: \"57ec431f-c183-43a1-a809-cbc350b8b2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8"
Sep 08 14:10:20.097853 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:20.097859    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvqkl\" (UniqueName: \"kubernetes.io/projected/57ec431f-c183-43a1-a809-cbc350b8b2c0-kube-api-access-bvqkl\") pod \"maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8\" (UID: \"57ec431f-c183-43a1-a809-cbc350b8b2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8"
Sep 08 14:10:20.098151 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:20.097912    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57ec431f-c183-43a1-a809-cbc350b8b2c0-metrics-certs\") pod \"maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8\" (UID: \"57ec431f-c183-43a1-a809-cbc350b8b2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8"
Sep 08 14:10:20.098151 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:20.097964    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57ec431f-c183-43a1-a809-cbc350b8b2c0-maas-api-tls\") pod \"maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8\" (UID: \"57ec431f-c183-43a1-a809-cbc350b8b2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8"
Sep 08 14:10:20.098542 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:20.098519    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57ec431f-c183-43a1-a809-cbc350b8b2c0-openshift-service-ca\") pod \"maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8\" (UID: \"57ec431f-c183-43a1-a809-cbc350b8b2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8"
Sep 08 14:10:20.100509 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:20.100479    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57ec431f-c183-43a1-a809-cbc350b8b2c0-metrics-certs\") pod \"maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8\" (UID: \"57ec431f-c183-43a1-a809-cbc350b8b2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8"
Sep 08 14:10:20.100607 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:20.100577    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57ec431f-c183-43a1-a809-cbc350b8b2c0-maas-api-tls\") pod \"maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8\" (UID: \"57ec431f-c183-43a1-a809-cbc350b8b2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8"
Sep 08 14:10:20.107325 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:20.107302    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvqkl\" (UniqueName: \"kubernetes.io/projected/57ec431f-c183-43a1-a809-cbc350b8b2c0-kube-api-access-bvqkl\") pod \"maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8\" (UID: \"57ec431f-c183-43a1-a809-cbc350b8b2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8"
Sep 08 14:10:20.199678 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:20.199589    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8"
Sep 08 14:10:20.474086 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:20.474001    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8"]
Sep 08 14:10:20.478250 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:10:20.478223    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57ec431f_c183_43a1_a809_cbc350b8b2c0.slice/crio-a3e70aadee29593d85bc92c1c8340ecb24e205312875e3e3f5ae2771d99d1b93 WatchSource:0}: Error finding container a3e70aadee29593d85bc92c1c8340ecb24e205312875e3e3f5ae2771d99d1b93: Status 404 returned error can't find the container with id a3e70aadee29593d85bc92c1c8340ecb24e205312875e3e3f5ae2771d99d1b93
Sep 08 14:10:20.693639 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:20.693603    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8" event={"ID":"57ec431f-c183-43a1-a809-cbc350b8b2c0","Type":"ContainerStarted","Data":"a3e70aadee29593d85bc92c1c8340ecb24e205312875e3e3f5ae2771d99d1b93"}
Sep 08 14:10:21.190753 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.190730    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:10:21.309209 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.309189    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwnn5\" (UniqueName: \"kubernetes.io/projected/393ea684-5023-48b7-ae73-d0b7f8e9d084-kube-api-access-kwnn5\") pod \"393ea684-5023-48b7-ae73-d0b7f8e9d084\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") "
Sep 08 14:10:21.309285 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.309231    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/393ea684-5023-48b7-ae73-d0b7f8e9d084-istio-podinfo\") pod \"393ea684-5023-48b7-ae73-d0b7f8e9d084\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") "
Sep 08 14:10:21.309327 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.309301    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/393ea684-5023-48b7-ae73-d0b7f8e9d084-workload-socket\") pod \"393ea684-5023-48b7-ae73-d0b7f8e9d084\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") "
Sep 08 14:10:21.309368 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.309323    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/393ea684-5023-48b7-ae73-d0b7f8e9d084-istio-token\") pod \"393ea684-5023-48b7-ae73-d0b7f8e9d084\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") "
Sep 08 14:10:21.309403 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.309371    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/393ea684-5023-48b7-ae73-d0b7f8e9d084-istio-data\") pod \"393ea684-5023-48b7-ae73-d0b7f8e9d084\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") "
Sep 08 14:10:21.309453 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.309400    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/393ea684-5023-48b7-ae73-d0b7f8e9d084-credential-socket\") pod \"393ea684-5023-48b7-ae73-d0b7f8e9d084\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") "
Sep 08 14:10:21.309453 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.309427    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/393ea684-5023-48b7-ae73-d0b7f8e9d084-workload-certs\") pod \"393ea684-5023-48b7-ae73-d0b7f8e9d084\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") "
Sep 08 14:10:21.309573 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.309468    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/393ea684-5023-48b7-ae73-d0b7f8e9d084-istiod-ca-cert\") pod \"393ea684-5023-48b7-ae73-d0b7f8e9d084\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") "
Sep 08 14:10:21.309573 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.309493    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/393ea684-5023-48b7-ae73-d0b7f8e9d084-istio-envoy\") pod \"393ea684-5023-48b7-ae73-d0b7f8e9d084\" (UID: \"393ea684-5023-48b7-ae73-d0b7f8e9d084\") "
Sep 08 14:10:21.309991 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.309749    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/393ea684-5023-48b7-ae73-d0b7f8e9d084-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "393ea684-5023-48b7-ae73-d0b7f8e9d084" (UID: "393ea684-5023-48b7-ae73-d0b7f8e9d084"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:10:21.309991 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.309834    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/393ea684-5023-48b7-ae73-d0b7f8e9d084-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "393ea684-5023-48b7-ae73-d0b7f8e9d084" (UID: "393ea684-5023-48b7-ae73-d0b7f8e9d084"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:10:21.309991 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.309935    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/393ea684-5023-48b7-ae73-d0b7f8e9d084-credential-socket\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:10:21.309991 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.309957    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/393ea684-5023-48b7-ae73-d0b7f8e9d084-workload-certs\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:10:21.310271 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.310068    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/393ea684-5023-48b7-ae73-d0b7f8e9d084-istio-data" (OuterVolumeSpecName: "istio-data") pod "393ea684-5023-48b7-ae73-d0b7f8e9d084" (UID: "393ea684-5023-48b7-ae73-d0b7f8e9d084"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:10:21.310271 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.310100    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/393ea684-5023-48b7-ae73-d0b7f8e9d084-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "393ea684-5023-48b7-ae73-d0b7f8e9d084" (UID: "393ea684-5023-48b7-ae73-d0b7f8e9d084"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:10:21.310271 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.310181    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/393ea684-5023-48b7-ae73-d0b7f8e9d084-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "393ea684-5023-48b7-ae73-d0b7f8e9d084" (UID: "393ea684-5023-48b7-ae73-d0b7f8e9d084"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:10:21.311986 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.311967    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/393ea684-5023-48b7-ae73-d0b7f8e9d084-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "393ea684-5023-48b7-ae73-d0b7f8e9d084" (UID: "393ea684-5023-48b7-ae73-d0b7f8e9d084"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:10:21.312207 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.312181    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/393ea684-5023-48b7-ae73-d0b7f8e9d084-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "393ea684-5023-48b7-ae73-d0b7f8e9d084" (UID: "393ea684-5023-48b7-ae73-d0b7f8e9d084"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:10:21.312268 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.312216    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/393ea684-5023-48b7-ae73-d0b7f8e9d084-istio-token" (OuterVolumeSpecName: "istio-token") pod "393ea684-5023-48b7-ae73-d0b7f8e9d084" (UID: "393ea684-5023-48b7-ae73-d0b7f8e9d084"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:10:21.312268 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.312187    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/393ea684-5023-48b7-ae73-d0b7f8e9d084-kube-api-access-kwnn5" (OuterVolumeSpecName: "kube-api-access-kwnn5") pod "393ea684-5023-48b7-ae73-d0b7f8e9d084" (UID: "393ea684-5023-48b7-ae73-d0b7f8e9d084"). InnerVolumeSpecName "kube-api-access-kwnn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:10:21.411526 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.411491    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/393ea684-5023-48b7-ae73-d0b7f8e9d084-workload-socket\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:10:21.411526 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.411520    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/393ea684-5023-48b7-ae73-d0b7f8e9d084-istio-token\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:10:21.411526 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.411529    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/393ea684-5023-48b7-ae73-d0b7f8e9d084-istio-data\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:10:21.411796 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.411537    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/393ea684-5023-48b7-ae73-d0b7f8e9d084-istiod-ca-cert\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:10:21.411796 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.411545    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/393ea684-5023-48b7-ae73-d0b7f8e9d084-istio-envoy\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:10:21.411796 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.411553    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwnn5\" (UniqueName: \"kubernetes.io/projected/393ea684-5023-48b7-ae73-d0b7f8e9d084-kube-api-access-kwnn5\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:10:21.411796 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.411560    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/393ea684-5023-48b7-ae73-d0b7f8e9d084-istio-podinfo\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:10:21.700725 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.700688    2575 generic.go:356] "Generic (PLEG): container finished" podID="393ea684-5023-48b7-ae73-d0b7f8e9d084" containerID="40af28d3782db4b6ba6e1c480e9098efa43f790b5f18bca7d89e3c02d4643559" exitCode=0
Sep 08 14:10:21.700906 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.700744    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"
Sep 08 14:10:21.700906 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.700763    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6" event={"ID":"393ea684-5023-48b7-ae73-d0b7f8e9d084","Type":"ContainerDied","Data":"40af28d3782db4b6ba6e1c480e9098efa43f790b5f18bca7d89e3c02d4643559"}
Sep 08 14:10:21.700906 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.700819    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6" event={"ID":"393ea684-5023-48b7-ae73-d0b7f8e9d084","Type":"ContainerDied","Data":"7f5eca016fd0ff77ce755728ffdd58dd22649b7ec552b4c871addc3f92d6f4ae"}
Sep 08 14:10:21.700906 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.700842    2575 scope.go:117] "RemoveContainer" containerID="40af28d3782db4b6ba6e1c480e9098efa43f790b5f18bca7d89e3c02d4643559"
Sep 08 14:10:21.702647 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.702623    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8" event={"ID":"57ec431f-c183-43a1-a809-cbc350b8b2c0","Type":"ContainerStarted","Data":"3dbba375eab1af88cf5d31e9b12f8de1cec5e1c34bf83ad05bc6b1bd2f24544a"}
Sep 08 14:10:21.702748 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.702690    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8"
Sep 08 14:10:21.710628 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.710613    2575 scope.go:117] "RemoveContainer" containerID="6765843c3d1cd3ca0d7135cab54edab0517b5dcf86e2eb81917261454f91f7f1"
Sep 08 14:10:21.719332 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.719313    2575 scope.go:117] "RemoveContainer" containerID="40af28d3782db4b6ba6e1c480e9098efa43f790b5f18bca7d89e3c02d4643559"
Sep 08 14:10:21.719616 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:10:21.719595    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40af28d3782db4b6ba6e1c480e9098efa43f790b5f18bca7d89e3c02d4643559\": container with ID starting with 40af28d3782db4b6ba6e1c480e9098efa43f790b5f18bca7d89e3c02d4643559 not found: ID does not exist" containerID="40af28d3782db4b6ba6e1c480e9098efa43f790b5f18bca7d89e3c02d4643559"
Sep 08 14:10:21.719677 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.719623    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40af28d3782db4b6ba6e1c480e9098efa43f790b5f18bca7d89e3c02d4643559"} err="failed to get container status \"40af28d3782db4b6ba6e1c480e9098efa43f790b5f18bca7d89e3c02d4643559\": rpc error: code = NotFound desc = could not find container \"40af28d3782db4b6ba6e1c480e9098efa43f790b5f18bca7d89e3c02d4643559\": container with ID starting with 40af28d3782db4b6ba6e1c480e9098efa43f790b5f18bca7d89e3c02d4643559 not found: ID does not exist"
Sep 08 14:10:21.719677 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.719640    2575 scope.go:117] "RemoveContainer" containerID="6765843c3d1cd3ca0d7135cab54edab0517b5dcf86e2eb81917261454f91f7f1"
Sep 08 14:10:21.719885 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:10:21.719867    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6765843c3d1cd3ca0d7135cab54edab0517b5dcf86e2eb81917261454f91f7f1\": container with ID starting with 6765843c3d1cd3ca0d7135cab54edab0517b5dcf86e2eb81917261454f91f7f1 not found: ID does not exist" containerID="6765843c3d1cd3ca0d7135cab54edab0517b5dcf86e2eb81917261454f91f7f1"
Sep 08 14:10:21.719948 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.719896    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6765843c3d1cd3ca0d7135cab54edab0517b5dcf86e2eb81917261454f91f7f1"} err="failed to get container status \"6765843c3d1cd3ca0d7135cab54edab0517b5dcf86e2eb81917261454f91f7f1\": rpc error: code = NotFound desc = could not find container \"6765843c3d1cd3ca0d7135cab54edab0517b5dcf86e2eb81917261454f91f7f1\": container with ID starting with 6765843c3d1cd3ca0d7135cab54edab0517b5dcf86e2eb81917261454f91f7f1 not found: ID does not exist"
Sep 08 14:10:21.727793 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.727752    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8" podStartSLOduration=1.9039210739999999 podStartE2EDuration="2.727737717s" totalImagesPullingTime="823.816643ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:10:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:10:21.725965334 +0000 UTC m=+697.215682387" watchObservedRunningTime="2026-09-08 14:10:21.727737717 +0000 UTC m=+697.217454799"
Sep 08 14:10:21.742904 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.742882    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"]
Sep 08 14:10:21.751837 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:21.751814    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-6a4001b4-openshift-default-86888f768d-csgz6"]
Sep 08 14:10:22.974765 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:22.974735    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="393ea684-5023-48b7-ae73-d0b7f8e9d084" path="/var/lib/kubelet/pods/393ea684-5023-48b7-ae73-d0b7f8e9d084/volumes"
Sep 08 14:10:27.058287 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:27.058249    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:10:27.715012 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:27.714981    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8"
Sep 08 14:10:44.277035 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:44.276951    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"]
Sep 08 14:10:44.277620 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:44.277578    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="393ea684-5023-48b7-ae73-d0b7f8e9d084" containerName="istio-proxy"
Sep 08 14:10:44.277620 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:44.277597    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="393ea684-5023-48b7-ae73-d0b7f8e9d084" containerName="istio-proxy"
Sep 08 14:10:44.277620 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:44.277615    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="393ea684-5023-48b7-ae73-d0b7f8e9d084" containerName="istio-proxy"
Sep 08 14:10:44.277785 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:44.277624    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="393ea684-5023-48b7-ae73-d0b7f8e9d084" containerName="istio-proxy"
Sep 08 14:10:44.277785 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:44.277762    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="393ea684-5023-48b7-ae73-d0b7f8e9d084" containerName="istio-proxy"
Sep 08 14:10:44.279907 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:44.279885    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"
Sep 08 14:10:44.282364 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:44.282338    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-a-ce93b475-kserve-self-signed-certs\""
Sep 08 14:10:44.289352 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:44.289326    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"]
Sep 08 14:10:44.327047 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:44.327013    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-home\") pod \"e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx\" (UID: \"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716\") " pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"
Sep 08 14:10:44.327203 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:44.327079    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-model-cache\") pod \"e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx\" (UID: \"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716\") " pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"
Sep 08 14:10:44.327203 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:44.327114    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-dshm\") pod \"e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx\" (UID: \"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716\") " pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"
Sep 08 14:10:44.327203 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:44.327140    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-tls-certs\") pod \"e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx\" (UID: \"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716\") " pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"
Sep 08 14:10:44.327338 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:44.327219    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-tmp-dir\") pod \"e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx\" (UID: \"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716\") " pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"
Sep 08 14:10:44.327338 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:44.327305    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsll8\" (UniqueName: \"kubernetes.io/projected/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-kube-api-access-rsll8\") pod \"e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx\" (UID: \"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716\") " pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"
Sep 08 14:10:44.428405 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:44.428369    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-home\") pod \"e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx\" (UID: \"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716\") " pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"
Sep 08 14:10:44.428570 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:44.428416    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-model-cache\") pod \"e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx\" (UID: \"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716\") " pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"
Sep 08 14:10:44.428570 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:44.428444    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-dshm\") pod \"e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx\" (UID: \"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716\") " pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"
Sep 08 14:10:44.428570 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:44.428471    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-tls-certs\") pod \"e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx\" (UID: \"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716\") " pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"
Sep 08 14:10:44.428570 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:44.428525    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-tmp-dir\") pod \"e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx\" (UID: \"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716\") " pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"
Sep 08 14:10:44.428570 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:44.428553    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsll8\" (UniqueName: \"kubernetes.io/projected/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-kube-api-access-rsll8\") pod \"e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx\" (UID: \"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716\") " pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"
Sep 08 14:10:44.428813 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:44.428790    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-home\") pod \"e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx\" (UID: \"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716\") " pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"
Sep 08 14:10:44.428870 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:44.428815    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-model-cache\") pod \"e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx\" (UID: \"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716\") " pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"
Sep 08 14:10:44.428936 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:44.428869    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-tmp-dir\") pod \"e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx\" (UID: \"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716\") " pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"
Sep 08 14:10:44.430863 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:44.430842    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-dshm\") pod \"e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx\" (UID: \"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716\") " pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"
Sep 08 14:10:44.431201 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:44.431186    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-tls-certs\") pod \"e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx\" (UID: \"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716\") " pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"
Sep 08 14:10:44.437327 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:44.437309    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsll8\" (UniqueName: \"kubernetes.io/projected/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-kube-api-access-rsll8\") pod \"e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx\" (UID: \"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716\") " pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"
Sep 08 14:10:44.589349 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:44.589319    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"
Sep 08 14:10:44.862486 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:44.862461    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"]
Sep 08 14:10:44.863536 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:10:44.863511    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad1c9e6b_7551_47f9_9c6b_8c255f3cb716.slice/crio-3bef52c52d164c93fdb6c4fe2dacd2b2f3e469f465b1115a628691f1fffebe11 WatchSource:0}: Error finding container 3bef52c52d164c93fdb6c4fe2dacd2b2f3e469f465b1115a628691f1fffebe11: Status 404 returned error can't find the container with id 3bef52c52d164c93fdb6c4fe2dacd2b2f3e469f465b1115a628691f1fffebe11
Sep 08 14:10:44.966351 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:44.966311    2575 scope.go:117] "RemoveContainer" containerID="cee0a92614ac82c54a23e1eae4d6703fc1ee280f764cfa119fa271b1069205d3"
Sep 08 14:10:45.846122 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:45.846084    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx" event={"ID":"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716","Type":"ContainerStarted","Data":"9b9d1d911a20a45c0b2454a5a40799514c8260eb1ba64bdb635d4c25caa0a8e2"}
Sep 08 14:10:45.846549 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:45.846133    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx" event={"ID":"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716","Type":"ContainerStarted","Data":"3bef52c52d164c93fdb6c4fe2dacd2b2f3e469f465b1115a628691f1fffebe11"}
Sep 08 14:10:45.864328 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:45.864275    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx" podStartSLOduration=1.864256763 podStartE2EDuration="1.864256763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:10:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:10:45.861914847 +0000 UTC m=+721.351631895" watchObservedRunningTime="2026-09-08 14:10:45.864256763 +0000 UTC m=+721.353973816"
Sep 08 14:10:46.589559 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:46.589521    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"
Sep 08 14:10:50.587714 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:50.587676    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8"]
Sep 08 14:10:50.588318 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:50.587938    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8" podUID="57ec431f-c183-43a1-a809-cbc350b8b2c0" containerName="maas-api" containerID="cri-o://3dbba375eab1af88cf5d31e9b12f8de1cec5e1c34bf83ad05bc6b1bd2f24544a" gracePeriod=30
Sep 08 14:10:50.859096 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:50.859046    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8"
Sep 08 14:10:50.876864 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:50.876829    2575 generic.go:356] "Generic (PLEG): container finished" podID="57ec431f-c183-43a1-a809-cbc350b8b2c0" containerID="3dbba375eab1af88cf5d31e9b12f8de1cec5e1c34bf83ad05bc6b1bd2f24544a" exitCode=0
Sep 08 14:10:50.876999 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:50.876883    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8"
Sep 08 14:10:50.876999 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:50.876922    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8" event={"ID":"57ec431f-c183-43a1-a809-cbc350b8b2c0","Type":"ContainerDied","Data":"3dbba375eab1af88cf5d31e9b12f8de1cec5e1c34bf83ad05bc6b1bd2f24544a"}
Sep 08 14:10:50.876999 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:50.876986    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8" event={"ID":"57ec431f-c183-43a1-a809-cbc350b8b2c0","Type":"ContainerDied","Data":"a3e70aadee29593d85bc92c1c8340ecb24e205312875e3e3f5ae2771d99d1b93"}
Sep 08 14:10:50.877202 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:50.877016    2575 scope.go:117] "RemoveContainer" containerID="3dbba375eab1af88cf5d31e9b12f8de1cec5e1c34bf83ad05bc6b1bd2f24544a"
Sep 08 14:10:50.888401 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:50.888382    2575 scope.go:117] "RemoveContainer" containerID="3dbba375eab1af88cf5d31e9b12f8de1cec5e1c34bf83ad05bc6b1bd2f24544a"
Sep 08 14:10:50.888749 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:10:50.888722    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dbba375eab1af88cf5d31e9b12f8de1cec5e1c34bf83ad05bc6b1bd2f24544a\": container with ID starting with 3dbba375eab1af88cf5d31e9b12f8de1cec5e1c34bf83ad05bc6b1bd2f24544a not found: ID does not exist" containerID="3dbba375eab1af88cf5d31e9b12f8de1cec5e1c34bf83ad05bc6b1bd2f24544a"
Sep 08 14:10:50.888818 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:50.888763    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dbba375eab1af88cf5d31e9b12f8de1cec5e1c34bf83ad05bc6b1bd2f24544a"} err="failed to get container status \"3dbba375eab1af88cf5d31e9b12f8de1cec5e1c34bf83ad05bc6b1bd2f24544a\": rpc error: code = NotFound desc = could not find container \"3dbba375eab1af88cf5d31e9b12f8de1cec5e1c34bf83ad05bc6b1bd2f24544a\": container with ID starting with 3dbba375eab1af88cf5d31e9b12f8de1cec5e1c34bf83ad05bc6b1bd2f24544a not found: ID does not exist"
Sep 08 14:10:50.988116 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:50.988089    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvqkl\" (UniqueName: \"kubernetes.io/projected/57ec431f-c183-43a1-a809-cbc350b8b2c0-kube-api-access-bvqkl\") pod \"57ec431f-c183-43a1-a809-cbc350b8b2c0\" (UID: \"57ec431f-c183-43a1-a809-cbc350b8b2c0\") "
Sep 08 14:10:50.988303 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:50.988190    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57ec431f-c183-43a1-a809-cbc350b8b2c0-maas-api-tls\") pod \"57ec431f-c183-43a1-a809-cbc350b8b2c0\" (UID: \"57ec431f-c183-43a1-a809-cbc350b8b2c0\") "
Sep 08 14:10:50.988303 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:50.988217    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57ec431f-c183-43a1-a809-cbc350b8b2c0-openshift-service-ca\") pod \"57ec431f-c183-43a1-a809-cbc350b8b2c0\" (UID: \"57ec431f-c183-43a1-a809-cbc350b8b2c0\") "
Sep 08 14:10:50.988303 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:50.988254    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57ec431f-c183-43a1-a809-cbc350b8b2c0-metrics-certs\") pod \"57ec431f-c183-43a1-a809-cbc350b8b2c0\" (UID: \"57ec431f-c183-43a1-a809-cbc350b8b2c0\") "
Sep 08 14:10:50.988599 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:50.988571    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57ec431f-c183-43a1-a809-cbc350b8b2c0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "57ec431f-c183-43a1-a809-cbc350b8b2c0" (UID: "57ec431f-c183-43a1-a809-cbc350b8b2c0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:10:50.990527 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:50.990498    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57ec431f-c183-43a1-a809-cbc350b8b2c0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "57ec431f-c183-43a1-a809-cbc350b8b2c0" (UID: "57ec431f-c183-43a1-a809-cbc350b8b2c0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:10:50.990645 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:50.990559    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57ec431f-c183-43a1-a809-cbc350b8b2c0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "57ec431f-c183-43a1-a809-cbc350b8b2c0" (UID: "57ec431f-c183-43a1-a809-cbc350b8b2c0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:10:50.990741 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:50.990724    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57ec431f-c183-43a1-a809-cbc350b8b2c0-kube-api-access-bvqkl" (OuterVolumeSpecName: "kube-api-access-bvqkl") pod "57ec431f-c183-43a1-a809-cbc350b8b2c0" (UID: "57ec431f-c183-43a1-a809-cbc350b8b2c0"). InnerVolumeSpecName "kube-api-access-bvqkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:10:51.089256 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.089222    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57ec431f-c183-43a1-a809-cbc350b8b2c0-openshift-service-ca\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:10:51.089256 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.089254    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57ec431f-c183-43a1-a809-cbc350b8b2c0-metrics-certs\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:10:51.089495 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.089264    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvqkl\" (UniqueName: \"kubernetes.io/projected/57ec431f-c183-43a1-a809-cbc350b8b2c0-kube-api-access-bvqkl\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:10:51.089495 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.089277    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57ec431f-c183-43a1-a809-cbc350b8b2c0-maas-api-tls\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:10:51.204570 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.204539    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8"]
Sep 08 14:10:51.214471 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.214450    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f6640f0d-7dc7b9745b-725z8"]
Sep 08 14:10:51.661432 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.661393    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:10:51.759349 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.759322    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"]
Sep 08 14:10:51.759743 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.759728    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57ec431f-c183-43a1-a809-cbc350b8b2c0" containerName="maas-api"
Sep 08 14:10:51.759803 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.759746    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="57ec431f-c183-43a1-a809-cbc350b8b2c0" containerName="maas-api"
Sep 08 14:10:51.759912 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.759891    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="393ea684-5023-48b7-ae73-d0b7f8e9d084" containerName="istio-proxy"
Sep 08 14:10:51.759912 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.759911    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="57ec431f-c183-43a1-a809-cbc350b8b2c0" containerName="maas-api"
Sep 08 14:10:51.762719 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.762701    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:51.765249 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.765229    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-af7a8d88-openshift-default-dockercfg-lr4x9\""
Sep 08 14:10:51.778562 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.778535    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"]
Sep 08 14:10:51.895974 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.895941    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/161010a7-9987-4134-b816-335fd52d69fe-istio-envoy\") pod \"e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") " pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:51.895974 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.895978    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/161010a7-9987-4134-b816-335fd52d69fe-workload-socket\") pod \"e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") " pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:51.896205 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.896002    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/161010a7-9987-4134-b816-335fd52d69fe-istiod-ca-cert\") pod \"e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") " pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:51.896205 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.896043    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/161010a7-9987-4134-b816-335fd52d69fe-istio-token\") pod \"e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") " pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:51.896205 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.896078    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/161010a7-9987-4134-b816-335fd52d69fe-credential-socket\") pod \"e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") " pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:51.896205 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.896101    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/161010a7-9987-4134-b816-335fd52d69fe-workload-certs\") pod \"e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") " pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:51.896205 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.896146    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/161010a7-9987-4134-b816-335fd52d69fe-istio-podinfo\") pod \"e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") " pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:51.896205 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.896167    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/161010a7-9987-4134-b816-335fd52d69fe-istio-data\") pod \"e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") " pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:51.896448 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.896321    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmp95\" (UniqueName: \"kubernetes.io/projected/161010a7-9987-4134-b816-335fd52d69fe-kube-api-access-rmp95\") pod \"e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") " pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:51.997962 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.997857    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/161010a7-9987-4134-b816-335fd52d69fe-credential-socket\") pod \"e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") " pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:51.997962 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.997910    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/161010a7-9987-4134-b816-335fd52d69fe-workload-certs\") pod \"e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") " pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:51.998220 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.997981    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/161010a7-9987-4134-b816-335fd52d69fe-istio-podinfo\") pod \"e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") " pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:51.998220 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.998011    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/161010a7-9987-4134-b816-335fd52d69fe-istio-data\") pod \"e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") " pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:51.998220 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.998129    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmp95\" (UniqueName: \"kubernetes.io/projected/161010a7-9987-4134-b816-335fd52d69fe-kube-api-access-rmp95\") pod \"e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") " pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:51.998220 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.998186    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/161010a7-9987-4134-b816-335fd52d69fe-istio-envoy\") pod \"e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") " pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:51.998220 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.998210    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/161010a7-9987-4134-b816-335fd52d69fe-workload-socket\") pod \"e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") " pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:51.998767 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.998247    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/161010a7-9987-4134-b816-335fd52d69fe-istiod-ca-cert\") pod \"e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") " pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:51.998767 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.998275    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/161010a7-9987-4134-b816-335fd52d69fe-istio-token\") pod \"e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") " pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:51.998767 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.998362    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/161010a7-9987-4134-b816-335fd52d69fe-credential-socket\") pod \"e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") " pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:51.998767 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.998398    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/161010a7-9987-4134-b816-335fd52d69fe-workload-certs\") pod \"e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") " pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:51.999119 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.998797    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/161010a7-9987-4134-b816-335fd52d69fe-istio-data\") pod \"e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") " pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:51.999220 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.999166    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/161010a7-9987-4134-b816-335fd52d69fe-workload-socket\") pod \"e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") " pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:51.999781 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:51.999755    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/161010a7-9987-4134-b816-335fd52d69fe-istiod-ca-cert\") pod \"e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") " pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:52.001150 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:52.001123    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/161010a7-9987-4134-b816-335fd52d69fe-istio-envoy\") pod \"e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") " pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:52.001336 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:52.001317    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/161010a7-9987-4134-b816-335fd52d69fe-istio-podinfo\") pod \"e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") " pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:52.007323 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:52.007305    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/161010a7-9987-4134-b816-335fd52d69fe-istio-token\") pod \"e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") " pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:52.008815 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:52.008794    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmp95\" (UniqueName: \"kubernetes.io/projected/161010a7-9987-4134-b816-335fd52d69fe-kube-api-access-rmp95\") pod \"e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") " pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:52.073190 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:52.073152    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:52.354210 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:52.354183    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"]
Sep 08 14:10:52.356091 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:10:52.356042    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod161010a7_9987_4134_b816_335fd52d69fe.slice/crio-048b62a761c01c5d32512cba4f61f509e888d2c2ed84aa5ba45ee4ffec4ecdba WatchSource:0}: Error finding container 048b62a761c01c5d32512cba4f61f509e888d2c2ed84aa5ba45ee4ffec4ecdba: Status 404 returned error can't find the container with id 048b62a761c01c5d32512cba4f61f509e888d2c2ed84aa5ba45ee4ffec4ecdba
Sep 08 14:10:52.358484 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:52.358446    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:10:52.358593 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:52.358532    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:10:52.358593 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:52.358573    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:10:52.896369 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:52.896332    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t" event={"ID":"161010a7-9987-4134-b816-335fd52d69fe","Type":"ContainerStarted","Data":"ad7a24e2dbbc817d30b1c31cac66bb64d9189b00b31f3cd8fd13e83c4929e465"}
Sep 08 14:10:52.896744 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:52.896397    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t" event={"ID":"161010a7-9987-4134-b816-335fd52d69fe","Type":"ContainerStarted","Data":"048b62a761c01c5d32512cba4f61f509e888d2c2ed84aa5ba45ee4ffec4ecdba"}
Sep 08 14:10:52.948346 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:52.948290    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t" podStartSLOduration=1.948274396 podStartE2EDuration="1.948274396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:10:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:10:52.945608125 +0000 UTC m=+728.435325179" watchObservedRunningTime="2026-09-08 14:10:52.948274396 +0000 UTC m=+728.437991512"
Sep 08 14:10:52.974902 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:52.974868    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57ec431f-c183-43a1-a809-cbc350b8b2c0" path="/var/lib/kubelet/pods/57ec431f-c183-43a1-a809-cbc350b8b2c0/volumes"
Sep 08 14:10:53.073968 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:53.073930    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:53.079300 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:53.079278    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:53.902747 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:53.902707    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:53.903540 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:53.903522    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:10:54.590149 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:54.590118    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"
Sep 08 14:10:54.602706 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:54.602681    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"
Sep 08 14:10:54.920755 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:54.920669    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"
Sep 08 14:10:55.492692 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:55.492654    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9"]
Sep 08 14:10:55.496336 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:55.496314    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9"
Sep 08 14:10:55.499399 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:55.499377    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-af7a8d88-serving-cert\""
Sep 08 14:10:55.511334 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:55.511310    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9"]
Sep 08 14:10:55.635657 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:55.635624    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grqnm\" (UniqueName: \"kubernetes.io/projected/955a7276-f2af-45f4-a48f-a481efaab1d1-kube-api-access-grqnm\") pod \"maas-api-e2e-ait-af7a8d88-df567f578-xg4x9\" (UID: \"955a7276-f2af-45f4-a48f-a481efaab1d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9"
Sep 08 14:10:55.635827 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:55.635669    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/955a7276-f2af-45f4-a48f-a481efaab1d1-metrics-certs\") pod \"maas-api-e2e-ait-af7a8d88-df567f578-xg4x9\" (UID: \"955a7276-f2af-45f4-a48f-a481efaab1d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9"
Sep 08 14:10:55.635827 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:55.635753    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/955a7276-f2af-45f4-a48f-a481efaab1d1-openshift-service-ca\") pod \"maas-api-e2e-ait-af7a8d88-df567f578-xg4x9\" (UID: \"955a7276-f2af-45f4-a48f-a481efaab1d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9"
Sep 08 14:10:55.635827 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:55.635815    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/955a7276-f2af-45f4-a48f-a481efaab1d1-maas-api-tls\") pod \"maas-api-e2e-ait-af7a8d88-df567f578-xg4x9\" (UID: \"955a7276-f2af-45f4-a48f-a481efaab1d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9"
Sep 08 14:10:55.736941 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:55.736903    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/955a7276-f2af-45f4-a48f-a481efaab1d1-maas-api-tls\") pod \"maas-api-e2e-ait-af7a8d88-df567f578-xg4x9\" (UID: \"955a7276-f2af-45f4-a48f-a481efaab1d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9"
Sep 08 14:10:55.737134 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:55.736980    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grqnm\" (UniqueName: \"kubernetes.io/projected/955a7276-f2af-45f4-a48f-a481efaab1d1-kube-api-access-grqnm\") pod \"maas-api-e2e-ait-af7a8d88-df567f578-xg4x9\" (UID: \"955a7276-f2af-45f4-a48f-a481efaab1d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9"
Sep 08 14:10:55.737134 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:55.737036    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/955a7276-f2af-45f4-a48f-a481efaab1d1-metrics-certs\") pod \"maas-api-e2e-ait-af7a8d88-df567f578-xg4x9\" (UID: \"955a7276-f2af-45f4-a48f-a481efaab1d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9"
Sep 08 14:10:55.737134 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:10:55.737095    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-serving-cert: secret "maas-api-e2e-ait-af7a8d88-serving-cert" not found
Sep 08 14:10:55.737134 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:55.737126    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/955a7276-f2af-45f4-a48f-a481efaab1d1-openshift-service-ca\") pod \"maas-api-e2e-ait-af7a8d88-df567f578-xg4x9\" (UID: \"955a7276-f2af-45f4-a48f-a481efaab1d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9"
Sep 08 14:10:55.737284 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:10:55.737163    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/955a7276-f2af-45f4-a48f-a481efaab1d1-maas-api-tls podName:955a7276-f2af-45f4-a48f-a481efaab1d1 nodeName:}" failed. No retries permitted until 2026-09-08 14:10:56.237141224 +0000 UTC m=+731.726858270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/955a7276-f2af-45f4-a48f-a481efaab1d1-maas-api-tls") pod "maas-api-e2e-ait-af7a8d88-df567f578-xg4x9" (UID: "955a7276-f2af-45f4-a48f-a481efaab1d1") : secret "maas-api-e2e-ait-af7a8d88-serving-cert" not found
Sep 08 14:10:55.737879 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:55.737807    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/955a7276-f2af-45f4-a48f-a481efaab1d1-openshift-service-ca\") pod \"maas-api-e2e-ait-af7a8d88-df567f578-xg4x9\" (UID: \"955a7276-f2af-45f4-a48f-a481efaab1d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9"
Sep 08 14:10:55.739632 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:55.739611    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/955a7276-f2af-45f4-a48f-a481efaab1d1-metrics-certs\") pod \"maas-api-e2e-ait-af7a8d88-df567f578-xg4x9\" (UID: \"955a7276-f2af-45f4-a48f-a481efaab1d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9"
Sep 08 14:10:55.751099 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:55.751023    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grqnm\" (UniqueName: \"kubernetes.io/projected/955a7276-f2af-45f4-a48f-a481efaab1d1-kube-api-access-grqnm\") pod \"maas-api-e2e-ait-af7a8d88-df567f578-xg4x9\" (UID: \"955a7276-f2af-45f4-a48f-a481efaab1d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9"
Sep 08 14:10:56.243440 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:56.243406    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/955a7276-f2af-45f4-a48f-a481efaab1d1-maas-api-tls\") pod \"maas-api-e2e-ait-af7a8d88-df567f578-xg4x9\" (UID: \"955a7276-f2af-45f4-a48f-a481efaab1d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9"
Sep 08 14:10:56.245931 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:56.245908    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/955a7276-f2af-45f4-a48f-a481efaab1d1-maas-api-tls\") pod \"maas-api-e2e-ait-af7a8d88-df567f578-xg4x9\" (UID: \"955a7276-f2af-45f4-a48f-a481efaab1d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9"
Sep 08 14:10:56.407330 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:56.407295    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9"
Sep 08 14:10:56.701595 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:56.701565    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9"]
Sep 08 14:10:56.702750 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:10:56.702725    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod955a7276_f2af_45f4_a48f_a481efaab1d1.slice/crio-a5bc42fbc61e0bed82279ebfd5274ea8a9dad6999ea2298ecfb7057ccdc9dead WatchSource:0}: Error finding container a5bc42fbc61e0bed82279ebfd5274ea8a9dad6999ea2298ecfb7057ccdc9dead: Status 404 returned error can't find the container with id a5bc42fbc61e0bed82279ebfd5274ea8a9dad6999ea2298ecfb7057ccdc9dead
Sep 08 14:10:56.924673 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:56.924641    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9" event={"ID":"955a7276-f2af-45f4-a48f-a481efaab1d1","Type":"ContainerStarted","Data":"a5bc42fbc61e0bed82279ebfd5274ea8a9dad6999ea2298ecfb7057ccdc9dead"}
Sep 08 14:10:57.931895 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:57.931861    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9" event={"ID":"955a7276-f2af-45f4-a48f-a481efaab1d1","Type":"ContainerStarted","Data":"0d3f4f18e74f043ef13286bd70dce866dcb83ac047b95156306636d650bc3728"}
Sep 08 14:10:57.932357 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:57.931962    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9"
Sep 08 14:10:57.949652 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:10:57.949606    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9" podStartSLOduration=2.406901877 podStartE2EDuration="2.949592413s" totalImagesPullingTime="542.690536ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:10:57.948907877 +0000 UTC m=+733.438624931" watchObservedRunningTime="2026-09-08 14:10:57.949592413 +0000 UTC m=+733.439309465"
Sep 08 14:11:03.943018 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:03.942987    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9"
Sep 08 14:11:17.863902 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:17.863870    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:11:19.058784 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:19.058754    2575 generic.go:356] "Generic (PLEG): container finished" podID="161010a7-9987-4134-b816-335fd52d69fe" containerID="ad7a24e2dbbc817d30b1c31cac66bb64d9189b00b31f3cd8fd13e83c4929e465" exitCode=0
Sep 08 14:11:19.059217 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:19.058822    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t" event={"ID":"161010a7-9987-4134-b816-335fd52d69fe","Type":"ContainerDied","Data":"ad7a24e2dbbc817d30b1c31cac66bb64d9189b00b31f3cd8fd13e83c4929e465"}
Sep 08 14:11:19.059265 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:19.059235    2575 scope.go:117] "RemoveContainer" containerID="ad7a24e2dbbc817d30b1c31cac66bb64d9189b00b31f3cd8fd13e83c4929e465"
Sep 08 14:11:19.060325 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:19.060299    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:11:19.060419 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:19.060404    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:11:19.060459 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:19.060440    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:11:20.069066 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:20.069021    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t" event={"ID":"161010a7-9987-4134-b816-335fd52d69fe","Type":"ContainerStarted","Data":"870ef49c71fb7784d019d0ea4932f3e390808dc13b19a493d90a90269e684643"}
Sep 08 14:11:20.073388 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:20.073364    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:11:20.074715 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:20.074685    2575 patch_prober.go:28] interesting pod/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 08 14:11:20.074830 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:20.074746    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t" podUID="161010a7-9987-4134-b816-335fd52d69fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 08 14:11:21.073652 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:21.073617    2575 patch_prober.go:28] interesting pod/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 08 14:11:21.074040 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:21.073677    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t" podUID="161010a7-9987-4134-b816-335fd52d69fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 08 14:11:22.073867 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:22.073830    2575 patch_prober.go:28] interesting pod/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 08 14:11:22.074373 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:22.073899    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t" podUID="161010a7-9987-4134-b816-335fd52d69fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 08 14:11:23.073508 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:23.073472    2575 patch_prober.go:28] interesting pod/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 08 14:11:23.073691 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:23.073566    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t" podUID="161010a7-9987-4134-b816-335fd52d69fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 08 14:11:23.903435 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:23.903405    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:11:24.073929 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:24.073894    2575 patch_prober.go:28] interesting pod/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 08 14:11:24.074128 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:24.073950    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t" podUID="161010a7-9987-4134-b816-335fd52d69fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 08 14:11:25.074308 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:25.074276    2575 patch_prober.go:28] interesting pod/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 08 14:11:25.074677 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:25.074333    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t" podUID="161010a7-9987-4134-b816-335fd52d69fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 08 14:11:26.085760 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:26.084402    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:11:26.086231 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:26.086093    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9"]
Sep 08 14:11:26.087198 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:26.087165    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9" podUID="955a7276-f2af-45f4-a48f-a481efaab1d1" containerName="maas-api" containerID="cri-o://0d3f4f18e74f043ef13286bd70dce866dcb83ac047b95156306636d650bc3728" gracePeriod=30
Sep 08 14:11:26.098517 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:26.098496    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:11:26.349860 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:26.349803    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9"
Sep 08 14:11:26.441326 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:26.441285    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/955a7276-f2af-45f4-a48f-a481efaab1d1-maas-api-tls\") pod \"955a7276-f2af-45f4-a48f-a481efaab1d1\" (UID: \"955a7276-f2af-45f4-a48f-a481efaab1d1\") "
Sep 08 14:11:26.441519 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:26.441397    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/955a7276-f2af-45f4-a48f-a481efaab1d1-openshift-service-ca\") pod \"955a7276-f2af-45f4-a48f-a481efaab1d1\" (UID: \"955a7276-f2af-45f4-a48f-a481efaab1d1\") "
Sep 08 14:11:26.441519 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:26.441420    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grqnm\" (UniqueName: \"kubernetes.io/projected/955a7276-f2af-45f4-a48f-a481efaab1d1-kube-api-access-grqnm\") pod \"955a7276-f2af-45f4-a48f-a481efaab1d1\" (UID: \"955a7276-f2af-45f4-a48f-a481efaab1d1\") "
Sep 08 14:11:26.441519 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:26.441434    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/955a7276-f2af-45f4-a48f-a481efaab1d1-metrics-certs\") pod \"955a7276-f2af-45f4-a48f-a481efaab1d1\" (UID: \"955a7276-f2af-45f4-a48f-a481efaab1d1\") "
Sep 08 14:11:26.441810 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:26.441776    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/955a7276-f2af-45f4-a48f-a481efaab1d1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "955a7276-f2af-45f4-a48f-a481efaab1d1" (UID: "955a7276-f2af-45f4-a48f-a481efaab1d1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:11:26.443686 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:26.443651    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/955a7276-f2af-45f4-a48f-a481efaab1d1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "955a7276-f2af-45f4-a48f-a481efaab1d1" (UID: "955a7276-f2af-45f4-a48f-a481efaab1d1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:11:26.443779 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:26.443691    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/955a7276-f2af-45f4-a48f-a481efaab1d1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "955a7276-f2af-45f4-a48f-a481efaab1d1" (UID: "955a7276-f2af-45f4-a48f-a481efaab1d1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:11:26.443779 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:26.443691    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/955a7276-f2af-45f4-a48f-a481efaab1d1-kube-api-access-grqnm" (OuterVolumeSpecName: "kube-api-access-grqnm") pod "955a7276-f2af-45f4-a48f-a481efaab1d1" (UID: "955a7276-f2af-45f4-a48f-a481efaab1d1"). InnerVolumeSpecName "kube-api-access-grqnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:11:26.542889 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:26.542852    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/955a7276-f2af-45f4-a48f-a481efaab1d1-maas-api-tls\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:11:26.542889 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:26.542889    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/955a7276-f2af-45f4-a48f-a481efaab1d1-openshift-service-ca\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:11:26.543187 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:26.542907    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grqnm\" (UniqueName: \"kubernetes.io/projected/955a7276-f2af-45f4-a48f-a481efaab1d1-kube-api-access-grqnm\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:11:26.543187 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:26.542920    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/955a7276-f2af-45f4-a48f-a481efaab1d1-metrics-certs\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:11:26.997996 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:11:26.997972    2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod955a7276_f2af_45f4_a48f_a481efaab1d1.slice\": RecentStats: unable to find data in memory cache]"
Sep 08 14:11:27.115562 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:27.115533    2575 generic.go:356] "Generic (PLEG): container finished" podID="955a7276-f2af-45f4-a48f-a481efaab1d1" containerID="0d3f4f18e74f043ef13286bd70dce866dcb83ac047b95156306636d650bc3728" exitCode=0
Sep 08 14:11:27.115931 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:27.115581    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9"
Sep 08 14:11:27.115931 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:27.115618    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9" event={"ID":"955a7276-f2af-45f4-a48f-a481efaab1d1","Type":"ContainerDied","Data":"0d3f4f18e74f043ef13286bd70dce866dcb83ac047b95156306636d650bc3728"}
Sep 08 14:11:27.115931 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:27.115678    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9" event={"ID":"955a7276-f2af-45f4-a48f-a481efaab1d1","Type":"ContainerDied","Data":"a5bc42fbc61e0bed82279ebfd5274ea8a9dad6999ea2298ecfb7057ccdc9dead"}
Sep 08 14:11:27.115931 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:27.115702    2575 scope.go:117] "RemoveContainer" containerID="0d3f4f18e74f043ef13286bd70dce866dcb83ac047b95156306636d650bc3728"
Sep 08 14:11:27.124848 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:27.124826    2575 scope.go:117] "RemoveContainer" containerID="0d3f4f18e74f043ef13286bd70dce866dcb83ac047b95156306636d650bc3728"
Sep 08 14:11:27.125143 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:11:27.125121    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d3f4f18e74f043ef13286bd70dce866dcb83ac047b95156306636d650bc3728\": container with ID starting with 0d3f4f18e74f043ef13286bd70dce866dcb83ac047b95156306636d650bc3728 not found: ID does not exist" containerID="0d3f4f18e74f043ef13286bd70dce866dcb83ac047b95156306636d650bc3728"
Sep 08 14:11:27.125236 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:27.125149    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d3f4f18e74f043ef13286bd70dce866dcb83ac047b95156306636d650bc3728"} err="failed to get container status \"0d3f4f18e74f043ef13286bd70dce866dcb83ac047b95156306636d650bc3728\": rpc error: code = NotFound desc = could not find container \"0d3f4f18e74f043ef13286bd70dce866dcb83ac047b95156306636d650bc3728\": container with ID starting with 0d3f4f18e74f043ef13286bd70dce866dcb83ac047b95156306636d650bc3728 not found: ID does not exist"
Sep 08 14:11:27.137047 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:27.137028    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9"]
Sep 08 14:11:27.140951 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:27.140926    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-af7a8d88-df567f578-xg4x9"]
Sep 08 14:11:27.649889 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:27.649857    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"]
Sep 08 14:11:27.650099 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:27.650036    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t" podUID="161010a7-9987-4134-b816-335fd52d69fe" containerName="istio-proxy" containerID="cri-o://870ef49c71fb7784d019d0ea4932f3e390808dc13b19a493d90a90269e684643" gracePeriod=30
Sep 08 14:11:28.976284 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:28.976250    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="955a7276-f2af-45f4-a48f-a481efaab1d1" path="/var/lib/kubelet/pods/955a7276-f2af-45f4-a48f-a481efaab1d1/volumes"
Sep 08 14:11:32.409467 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:32.409433    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8"]
Sep 08 14:11:32.410034 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:32.410012    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="955a7276-f2af-45f4-a48f-a481efaab1d1" containerName="maas-api"
Sep 08 14:11:32.410164 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:32.410036    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="955a7276-f2af-45f4-a48f-a481efaab1d1" containerName="maas-api"
Sep 08 14:11:32.410229 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:32.410218    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="955a7276-f2af-45f4-a48f-a481efaab1d1" containerName="maas-api"
Sep 08 14:11:32.412879 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:32.412856    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8"
Sep 08 14:11:32.415498 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:32.415480    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-93eb17b6-serving-cert\""
Sep 08 14:11:32.443621 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:32.443596    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8"]
Sep 08 14:11:32.501632 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:32.501600    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29kfw\" (UniqueName: \"kubernetes.io/projected/3e73a174-f199-41a8-a477-fa4daab5edc6-kube-api-access-29kfw\") pod \"maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8\" (UID: \"3e73a174-f199-41a8-a477-fa4daab5edc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8"
Sep 08 14:11:32.501780 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:32.501640    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e73a174-f199-41a8-a477-fa4daab5edc6-maas-api-tls\") pod \"maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8\" (UID: \"3e73a174-f199-41a8-a477-fa4daab5edc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8"
Sep 08 14:11:32.501822 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:32.501770    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e73a174-f199-41a8-a477-fa4daab5edc6-metrics-certs\") pod \"maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8\" (UID: \"3e73a174-f199-41a8-a477-fa4daab5edc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8"
Sep 08 14:11:32.501822 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:32.501815    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e73a174-f199-41a8-a477-fa4daab5edc6-openshift-service-ca\") pod \"maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8\" (UID: \"3e73a174-f199-41a8-a477-fa4daab5edc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8"
Sep 08 14:11:32.602781 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:32.602747    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e73a174-f199-41a8-a477-fa4daab5edc6-metrics-certs\") pod \"maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8\" (UID: \"3e73a174-f199-41a8-a477-fa4daab5edc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8"
Sep 08 14:11:32.602963 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:32.602787    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e73a174-f199-41a8-a477-fa4daab5edc6-openshift-service-ca\") pod \"maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8\" (UID: \"3e73a174-f199-41a8-a477-fa4daab5edc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8"
Sep 08 14:11:32.602963 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:32.602823    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29kfw\" (UniqueName: \"kubernetes.io/projected/3e73a174-f199-41a8-a477-fa4daab5edc6-kube-api-access-29kfw\") pod \"maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8\" (UID: \"3e73a174-f199-41a8-a477-fa4daab5edc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8"
Sep 08 14:11:32.602963 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:32.602842    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e73a174-f199-41a8-a477-fa4daab5edc6-maas-api-tls\") pod \"maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8\" (UID: \"3e73a174-f199-41a8-a477-fa4daab5edc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8"
Sep 08 14:11:32.602963 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:11:32.602941    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-serving-cert: secret "maas-api-e2e-derive-93eb17b6-serving-cert" not found
Sep 08 14:11:32.603218 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:11:32.603014    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e73a174-f199-41a8-a477-fa4daab5edc6-maas-api-tls podName:3e73a174-f199-41a8-a477-fa4daab5edc6 nodeName:}" failed. No retries permitted until 2026-09-08 14:11:33.102995866 +0000 UTC m=+768.592712896 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3e73a174-f199-41a8-a477-fa4daab5edc6-maas-api-tls") pod "maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8" (UID: "3e73a174-f199-41a8-a477-fa4daab5edc6") : secret "maas-api-e2e-derive-93eb17b6-serving-cert" not found
Sep 08 14:11:32.603538 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:32.603519    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e73a174-f199-41a8-a477-fa4daab5edc6-openshift-service-ca\") pod \"maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8\" (UID: \"3e73a174-f199-41a8-a477-fa4daab5edc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8"
Sep 08 14:11:32.605401 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:32.605382    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e73a174-f199-41a8-a477-fa4daab5edc6-metrics-certs\") pod \"maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8\" (UID: \"3e73a174-f199-41a8-a477-fa4daab5edc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8"
Sep 08 14:11:32.613219 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:32.613200    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29kfw\" (UniqueName: \"kubernetes.io/projected/3e73a174-f199-41a8-a477-fa4daab5edc6-kube-api-access-29kfw\") pod \"maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8\" (UID: \"3e73a174-f199-41a8-a477-fa4daab5edc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8"
Sep 08 14:11:32.916226 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:32.916167    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:11:33.006164 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.006139    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/161010a7-9987-4134-b816-335fd52d69fe-istio-podinfo\") pod \"161010a7-9987-4134-b816-335fd52d69fe\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") "
Sep 08 14:11:33.006351 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.006179    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/161010a7-9987-4134-b816-335fd52d69fe-workload-socket\") pod \"161010a7-9987-4134-b816-335fd52d69fe\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") "
Sep 08 14:11:33.006351 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.006208    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/161010a7-9987-4134-b816-335fd52d69fe-istio-envoy\") pod \"161010a7-9987-4134-b816-335fd52d69fe\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") "
Sep 08 14:11:33.006351 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.006227    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/161010a7-9987-4134-b816-335fd52d69fe-credential-socket\") pod \"161010a7-9987-4134-b816-335fd52d69fe\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") "
Sep 08 14:11:33.006488 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.006349    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/161010a7-9987-4134-b816-335fd52d69fe-workload-certs\") pod \"161010a7-9987-4134-b816-335fd52d69fe\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") "
Sep 08 14:11:33.006488 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.006427    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/161010a7-9987-4134-b816-335fd52d69fe-istiod-ca-cert\") pod \"161010a7-9987-4134-b816-335fd52d69fe\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") "
Sep 08 14:11:33.006488 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.006437    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/161010a7-9987-4134-b816-335fd52d69fe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "161010a7-9987-4134-b816-335fd52d69fe" (UID: "161010a7-9987-4134-b816-335fd52d69fe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:11:33.006488 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.006459    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/161010a7-9987-4134-b816-335fd52d69fe-istio-data\") pod \"161010a7-9987-4134-b816-335fd52d69fe\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") "
Sep 08 14:11:33.006488 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.006477    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/161010a7-9987-4134-b816-335fd52d69fe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "161010a7-9987-4134-b816-335fd52d69fe" (UID: "161010a7-9987-4134-b816-335fd52d69fe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:11:33.006708 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.006526    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmp95\" (UniqueName: \"kubernetes.io/projected/161010a7-9987-4134-b816-335fd52d69fe-kube-api-access-rmp95\") pod \"161010a7-9987-4134-b816-335fd52d69fe\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") "
Sep 08 14:11:33.006708 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.006557    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/161010a7-9987-4134-b816-335fd52d69fe-istio-token\") pod \"161010a7-9987-4134-b816-335fd52d69fe\" (UID: \"161010a7-9987-4134-b816-335fd52d69fe\") "
Sep 08 14:11:33.006708 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.006667    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/161010a7-9987-4134-b816-335fd52d69fe-istio-data" (OuterVolumeSpecName: "istio-data") pod "161010a7-9987-4134-b816-335fd52d69fe" (UID: "161010a7-9987-4134-b816-335fd52d69fe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:11:33.006858 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.006738    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/161010a7-9987-4134-b816-335fd52d69fe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "161010a7-9987-4134-b816-335fd52d69fe" (UID: "161010a7-9987-4134-b816-335fd52d69fe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:11:33.006858 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.006756    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/161010a7-9987-4134-b816-335fd52d69fe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "161010a7-9987-4134-b816-335fd52d69fe" (UID: "161010a7-9987-4134-b816-335fd52d69fe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:11:33.007219 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.007195    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/161010a7-9987-4134-b816-335fd52d69fe-istiod-ca-cert\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:11:33.007288 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.007224    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/161010a7-9987-4134-b816-335fd52d69fe-istio-data\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:11:33.007288 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.007239    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/161010a7-9987-4134-b816-335fd52d69fe-workload-socket\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:11:33.007288 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.007252    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/161010a7-9987-4134-b816-335fd52d69fe-credential-socket\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:11:33.007288 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.007267    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/161010a7-9987-4134-b816-335fd52d69fe-workload-certs\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:11:33.008581 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.008554    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/161010a7-9987-4134-b816-335fd52d69fe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "161010a7-9987-4134-b816-335fd52d69fe" (UID: "161010a7-9987-4134-b816-335fd52d69fe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:11:33.008685 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.008591    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/161010a7-9987-4134-b816-335fd52d69fe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "161010a7-9987-4134-b816-335fd52d69fe" (UID: "161010a7-9987-4134-b816-335fd52d69fe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:11:33.008685 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.008614    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/161010a7-9987-4134-b816-335fd52d69fe-kube-api-access-rmp95" (OuterVolumeSpecName: "kube-api-access-rmp95") pod "161010a7-9987-4134-b816-335fd52d69fe" (UID: "161010a7-9987-4134-b816-335fd52d69fe"). InnerVolumeSpecName "kube-api-access-rmp95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:11:33.008685 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.008658    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/161010a7-9987-4134-b816-335fd52d69fe-istio-token" (OuterVolumeSpecName: "istio-token") pod "161010a7-9987-4134-b816-335fd52d69fe" (UID: "161010a7-9987-4134-b816-335fd52d69fe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:11:33.107969 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.107939    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e73a174-f199-41a8-a477-fa4daab5edc6-maas-api-tls\") pod \"maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8\" (UID: \"3e73a174-f199-41a8-a477-fa4daab5edc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8"
Sep 08 14:11:33.108184 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.108014    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/161010a7-9987-4134-b816-335fd52d69fe-istio-podinfo\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:11:33.108184 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.108109    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/161010a7-9987-4134-b816-335fd52d69fe-istio-envoy\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:11:33.108184 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.108124    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmp95\" (UniqueName: \"kubernetes.io/projected/161010a7-9987-4134-b816-335fd52d69fe-kube-api-access-rmp95\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:11:33.108184 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.108137    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/161010a7-9987-4134-b816-335fd52d69fe-istio-token\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:11:33.110389 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.110367    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e73a174-f199-41a8-a477-fa4daab5edc6-maas-api-tls\") pod \"maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8\" (UID: \"3e73a174-f199-41a8-a477-fa4daab5edc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8"
Sep 08 14:11:33.152461 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.152431    2575 generic.go:356] "Generic (PLEG): container finished" podID="161010a7-9987-4134-b816-335fd52d69fe" containerID="870ef49c71fb7784d019d0ea4932f3e390808dc13b19a493d90a90269e684643" exitCode=0
Sep 08 14:11:33.152620 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.152488    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"
Sep 08 14:11:33.152620 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.152515    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t" event={"ID":"161010a7-9987-4134-b816-335fd52d69fe","Type":"ContainerDied","Data":"870ef49c71fb7784d019d0ea4932f3e390808dc13b19a493d90a90269e684643"}
Sep 08 14:11:33.152620 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.152574    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t" event={"ID":"161010a7-9987-4134-b816-335fd52d69fe","Type":"ContainerDied","Data":"048b62a761c01c5d32512cba4f61f509e888d2c2ed84aa5ba45ee4ffec4ecdba"}
Sep 08 14:11:33.152620 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.152598    2575 scope.go:117] "RemoveContainer" containerID="870ef49c71fb7784d019d0ea4932f3e390808dc13b19a493d90a90269e684643"
Sep 08 14:11:33.162115 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.162092    2575 scope.go:117] "RemoveContainer" containerID="ad7a24e2dbbc817d30b1c31cac66bb64d9189b00b31f3cd8fd13e83c4929e465"
Sep 08 14:11:33.171065 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.171034    2575 scope.go:117] "RemoveContainer" containerID="870ef49c71fb7784d019d0ea4932f3e390808dc13b19a493d90a90269e684643"
Sep 08 14:11:33.171318 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:11:33.171302    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"870ef49c71fb7784d019d0ea4932f3e390808dc13b19a493d90a90269e684643\": container with ID starting with 870ef49c71fb7784d019d0ea4932f3e390808dc13b19a493d90a90269e684643 not found: ID does not exist" containerID="870ef49c71fb7784d019d0ea4932f3e390808dc13b19a493d90a90269e684643"
Sep 08 14:11:33.171368 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.171325    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"870ef49c71fb7784d019d0ea4932f3e390808dc13b19a493d90a90269e684643"} err="failed to get container status \"870ef49c71fb7784d019d0ea4932f3e390808dc13b19a493d90a90269e684643\": rpc error: code = NotFound desc = could not find container \"870ef49c71fb7784d019d0ea4932f3e390808dc13b19a493d90a90269e684643\": container with ID starting with 870ef49c71fb7784d019d0ea4932f3e390808dc13b19a493d90a90269e684643 not found: ID does not exist"
Sep 08 14:11:33.171368 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.171340    2575 scope.go:117] "RemoveContainer" containerID="ad7a24e2dbbc817d30b1c31cac66bb64d9189b00b31f3cd8fd13e83c4929e465"
Sep 08 14:11:33.171557 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:11:33.171542    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad7a24e2dbbc817d30b1c31cac66bb64d9189b00b31f3cd8fd13e83c4929e465\": container with ID starting with ad7a24e2dbbc817d30b1c31cac66bb64d9189b00b31f3cd8fd13e83c4929e465 not found: ID does not exist" containerID="ad7a24e2dbbc817d30b1c31cac66bb64d9189b00b31f3cd8fd13e83c4929e465"
Sep 08 14:11:33.171602 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.171561    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad7a24e2dbbc817d30b1c31cac66bb64d9189b00b31f3cd8fd13e83c4929e465"} err="failed to get container status \"ad7a24e2dbbc817d30b1c31cac66bb64d9189b00b31f3cd8fd13e83c4929e465\": rpc error: code = NotFound desc = could not find container \"ad7a24e2dbbc817d30b1c31cac66bb64d9189b00b31f3cd8fd13e83c4929e465\": container with ID starting with ad7a24e2dbbc817d30b1c31cac66bb64d9189b00b31f3cd8fd13e83c4929e465 not found: ID does not exist"
Sep 08 14:11:33.176358 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.176337    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"]
Sep 08 14:11:33.183456 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.183438    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-af7a8d88-openshift-default-79f7bf7c4b-ftr4t"]
Sep 08 14:11:33.322987 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.322963    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8"
Sep 08 14:11:33.606615 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:33.606590    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8"]
Sep 08 14:11:33.607942 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:11:33.607919    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e73a174_f199_41a8_a477_fa4daab5edc6.slice/crio-d4a4016dddd784fce529f4db12a35bad91c7a6292adf706039c02a0563e7f919 WatchSource:0}: Error finding container d4a4016dddd784fce529f4db12a35bad91c7a6292adf706039c02a0563e7f919: Status 404 returned error can't find the container with id d4a4016dddd784fce529f4db12a35bad91c7a6292adf706039c02a0563e7f919
Sep 08 14:11:34.161008 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:34.160979    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8" event={"ID":"3e73a174-f199-41a8-a477-fa4daab5edc6","Type":"ContainerStarted","Data":"d4a4016dddd784fce529f4db12a35bad91c7a6292adf706039c02a0563e7f919"}
Sep 08 14:11:34.974584 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:34.974551    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="161010a7-9987-4134-b816-335fd52d69fe" path="/var/lib/kubelet/pods/161010a7-9987-4134-b816-335fd52d69fe/volumes"
Sep 08 14:11:35.167109 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:35.167077    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8" event={"ID":"3e73a174-f199-41a8-a477-fa4daab5edc6","Type":"ContainerStarted","Data":"441d592d0200b286ec08f27dbb2028b8cd0f1a3311e30b2abf6129ef5984dbf1"}
Sep 08 14:11:35.167275 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:35.167197    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8"
Sep 08 14:11:35.187982 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:35.187937    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8" podStartSLOduration=2.668001645 podStartE2EDuration="3.187923664s" totalImagesPullingTime="519.922019ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:11:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:11:35.186315552 +0000 UTC m=+770.676032605" watchObservedRunningTime="2026-09-08 14:11:35.187923664 +0000 UTC m=+770.677640717"
Sep 08 14:11:36.786236 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:36.786201    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"]
Sep 08 14:11:36.786609 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:36.786582    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="161010a7-9987-4134-b816-335fd52d69fe" containerName="istio-proxy"
Sep 08 14:11:36.786609 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:36.786593    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="161010a7-9987-4134-b816-335fd52d69fe" containerName="istio-proxy"
Sep 08 14:11:36.786689 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:36.786678    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="161010a7-9987-4134-b816-335fd52d69fe" containerName="istio-proxy"
Sep 08 14:11:36.786729 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:36.786690    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="161010a7-9987-4134-b816-335fd52d69fe" containerName="istio-proxy"
Sep 08 14:11:36.788841 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:36.788825    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"
Sep 08 14:11:36.791232 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:36.791208    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-41383d\"/\"autores-model-41383d-kserve-self-signed-certs\""
Sep 08 14:11:36.792324 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:36.792309    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-41383d\"/\"default-dockercfg-7rp2v\""
Sep 08 14:11:36.792428 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:36.792411    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-41383d\"/\"kube-root-ca.crt\""
Sep 08 14:11:36.792494 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:36.792448    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-41383d\"/\"openshift-service-ca.crt\""
Sep 08 14:11:36.801147 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:36.801126    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"]
Sep 08 14:11:36.944279 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:36.944251    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f738e068-04ed-4822-a78c-b77a629e040a-tmp-dir\") pod \"autores-model-41383d-kserve-65bf94f64-c4kfc\" (UID: \"f738e068-04ed-4822-a78c-b77a629e040a\") " pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"
Sep 08 14:11:36.944504 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:36.944289    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f738e068-04ed-4822-a78c-b77a629e040a-tls-certs\") pod \"autores-model-41383d-kserve-65bf94f64-c4kfc\" (UID: \"f738e068-04ed-4822-a78c-b77a629e040a\") " pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"
Sep 08 14:11:36.944504 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:36.944346    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f738e068-04ed-4822-a78c-b77a629e040a-model-cache\") pod \"autores-model-41383d-kserve-65bf94f64-c4kfc\" (UID: \"f738e068-04ed-4822-a78c-b77a629e040a\") " pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"
Sep 08 14:11:36.944504 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:36.944390    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f738e068-04ed-4822-a78c-b77a629e040a-dshm\") pod \"autores-model-41383d-kserve-65bf94f64-c4kfc\" (UID: \"f738e068-04ed-4822-a78c-b77a629e040a\") " pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"
Sep 08 14:11:36.944504 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:36.944426    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f738e068-04ed-4822-a78c-b77a629e040a-home\") pod \"autores-model-41383d-kserve-65bf94f64-c4kfc\" (UID: \"f738e068-04ed-4822-a78c-b77a629e040a\") " pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"
Sep 08 14:11:36.944504 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:36.944479    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jvhc\" (UniqueName: \"kubernetes.io/projected/f738e068-04ed-4822-a78c-b77a629e040a-kube-api-access-5jvhc\") pod \"autores-model-41383d-kserve-65bf94f64-c4kfc\" (UID: \"f738e068-04ed-4822-a78c-b77a629e040a\") " pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"
Sep 08 14:11:37.045872 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:37.045787    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f738e068-04ed-4822-a78c-b77a629e040a-home\") pod \"autores-model-41383d-kserve-65bf94f64-c4kfc\" (UID: \"f738e068-04ed-4822-a78c-b77a629e040a\") " pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"
Sep 08 14:11:37.045872 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:37.045844    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jvhc\" (UniqueName: \"kubernetes.io/projected/f738e068-04ed-4822-a78c-b77a629e040a-kube-api-access-5jvhc\") pod \"autores-model-41383d-kserve-65bf94f64-c4kfc\" (UID: \"f738e068-04ed-4822-a78c-b77a629e040a\") " pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"
Sep 08 14:11:37.046188 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:37.045910    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f738e068-04ed-4822-a78c-b77a629e040a-tmp-dir\") pod \"autores-model-41383d-kserve-65bf94f64-c4kfc\" (UID: \"f738e068-04ed-4822-a78c-b77a629e040a\") " pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"
Sep 08 14:11:37.046188 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:37.045947    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f738e068-04ed-4822-a78c-b77a629e040a-tls-certs\") pod \"autores-model-41383d-kserve-65bf94f64-c4kfc\" (UID: \"f738e068-04ed-4822-a78c-b77a629e040a\") " pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"
Sep 08 14:11:37.046188 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:37.045971    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f738e068-04ed-4822-a78c-b77a629e040a-model-cache\") pod \"autores-model-41383d-kserve-65bf94f64-c4kfc\" (UID: \"f738e068-04ed-4822-a78c-b77a629e040a\") " pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"
Sep 08 14:11:37.046188 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:37.046091    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f738e068-04ed-4822-a78c-b77a629e040a-dshm\") pod \"autores-model-41383d-kserve-65bf94f64-c4kfc\" (UID: \"f738e068-04ed-4822-a78c-b77a629e040a\") " pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"
Sep 08 14:11:37.046409 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:37.046190    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f738e068-04ed-4822-a78c-b77a629e040a-home\") pod \"autores-model-41383d-kserve-65bf94f64-c4kfc\" (UID: \"f738e068-04ed-4822-a78c-b77a629e040a\") " pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"
Sep 08 14:11:37.046409 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:37.046268    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f738e068-04ed-4822-a78c-b77a629e040a-tmp-dir\") pod \"autores-model-41383d-kserve-65bf94f64-c4kfc\" (UID: \"f738e068-04ed-4822-a78c-b77a629e040a\") " pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"
Sep 08 14:11:37.046485 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:37.046415    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f738e068-04ed-4822-a78c-b77a629e040a-model-cache\") pod \"autores-model-41383d-kserve-65bf94f64-c4kfc\" (UID: \"f738e068-04ed-4822-a78c-b77a629e040a\") " pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"
Sep 08 14:11:37.048377 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:37.048355    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f738e068-04ed-4822-a78c-b77a629e040a-dshm\") pod \"autores-model-41383d-kserve-65bf94f64-c4kfc\" (UID: \"f738e068-04ed-4822-a78c-b77a629e040a\") " pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"
Sep 08 14:11:37.048653 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:37.048634    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f738e068-04ed-4822-a78c-b77a629e040a-tls-certs\") pod \"autores-model-41383d-kserve-65bf94f64-c4kfc\" (UID: \"f738e068-04ed-4822-a78c-b77a629e040a\") " pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"
Sep 08 14:11:37.055179 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:37.055162    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jvhc\" (UniqueName: \"kubernetes.io/projected/f738e068-04ed-4822-a78c-b77a629e040a-kube-api-access-5jvhc\") pod \"autores-model-41383d-kserve-65bf94f64-c4kfc\" (UID: \"f738e068-04ed-4822-a78c-b77a629e040a\") " pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"
Sep 08 14:11:37.098258 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:37.098231    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"
Sep 08 14:11:37.387072 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:37.387027    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"]
Sep 08 14:11:37.392629 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:11:37.392600    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf738e068_04ed_4822_a78c_b77a629e040a.slice/crio-6f45a8ac97140929bb55bfa462441e63182036a557051afa1a8203d24076d949 WatchSource:0}: Error finding container 6f45a8ac97140929bb55bfa462441e63182036a557051afa1a8203d24076d949: Status 404 returned error can't find the container with id 6f45a8ac97140929bb55bfa462441e63182036a557051afa1a8203d24076d949
Sep 08 14:11:38.188606 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:38.188568    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc" event={"ID":"f738e068-04ed-4822-a78c-b77a629e040a","Type":"ContainerStarted","Data":"c837e62964c796e8107406350d75d85e2f1171dc136a7a57ff653a0f0febb1ea"}
Sep 08 14:11:38.189102 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:38.188616    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc" event={"ID":"f738e068-04ed-4822-a78c-b77a629e040a","Type":"ContainerStarted","Data":"6f45a8ac97140929bb55bfa462441e63182036a557051afa1a8203d24076d949"}
Sep 08 14:11:38.216952 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:38.216908    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc" podStartSLOduration=2.216894332 podStartE2EDuration="2.216894332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:11:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:11:38.21369708 +0000 UTC m=+773.703414131" watchObservedRunningTime="2026-09-08 14:11:38.216894332 +0000 UTC m=+773.706611405"
Sep 08 14:11:39.098357 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:39.098328    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"
Sep 08 14:11:39.171190 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:39.171154    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:11:41.178355 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:41.178325    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8"
Sep 08 14:11:47.099349 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:47.099316    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"
Sep 08 14:11:47.111983 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:47.111964    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"
Sep 08 14:11:47.256003 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:11:47.255979    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"
Sep 08 14:12:01.245539 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:01.245497    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:12:03.091210 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:03.091170    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8"]
Sep 08 14:12:03.091717 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:03.091391    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8" podUID="3e73a174-f199-41a8-a477-fa4daab5edc6" containerName="maas-api" containerID="cri-o://441d592d0200b286ec08f27dbb2028b8cd0f1a3311e30b2abf6129ef5984dbf1" gracePeriod=30
Sep 08 14:12:03.339357 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:03.339324    2575 generic.go:356] "Generic (PLEG): container finished" podID="3e73a174-f199-41a8-a477-fa4daab5edc6" containerID="441d592d0200b286ec08f27dbb2028b8cd0f1a3311e30b2abf6129ef5984dbf1" exitCode=0
Sep 08 14:12:03.339357 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:03.339362    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8" event={"ID":"3e73a174-f199-41a8-a477-fa4daab5edc6","Type":"ContainerDied","Data":"441d592d0200b286ec08f27dbb2028b8cd0f1a3311e30b2abf6129ef5984dbf1"}
Sep 08 14:12:03.361201 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:03.361178    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8"
Sep 08 14:12:03.398847 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:03.398817    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29kfw\" (UniqueName: \"kubernetes.io/projected/3e73a174-f199-41a8-a477-fa4daab5edc6-kube-api-access-29kfw\") pod \"3e73a174-f199-41a8-a477-fa4daab5edc6\" (UID: \"3e73a174-f199-41a8-a477-fa4daab5edc6\") "
Sep 08 14:12:03.399041 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:03.398869    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e73a174-f199-41a8-a477-fa4daab5edc6-maas-api-tls\") pod \"3e73a174-f199-41a8-a477-fa4daab5edc6\" (UID: \"3e73a174-f199-41a8-a477-fa4daab5edc6\") "
Sep 08 14:12:03.399041 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:03.398910    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e73a174-f199-41a8-a477-fa4daab5edc6-openshift-service-ca\") pod \"3e73a174-f199-41a8-a477-fa4daab5edc6\" (UID: \"3e73a174-f199-41a8-a477-fa4daab5edc6\") "
Sep 08 14:12:03.399041 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:03.398938    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e73a174-f199-41a8-a477-fa4daab5edc6-metrics-certs\") pod \"3e73a174-f199-41a8-a477-fa4daab5edc6\" (UID: \"3e73a174-f199-41a8-a477-fa4daab5edc6\") "
Sep 08 14:12:03.399683 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:03.399630    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e73a174-f199-41a8-a477-fa4daab5edc6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3e73a174-f199-41a8-a477-fa4daab5edc6" (UID: "3e73a174-f199-41a8-a477-fa4daab5edc6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:12:03.402273 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:03.402243    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e73a174-f199-41a8-a477-fa4daab5edc6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3e73a174-f199-41a8-a477-fa4daab5edc6" (UID: "3e73a174-f199-41a8-a477-fa4daab5edc6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:12:03.402410 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:03.402385    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e73a174-f199-41a8-a477-fa4daab5edc6-kube-api-access-29kfw" (OuterVolumeSpecName: "kube-api-access-29kfw") pod "3e73a174-f199-41a8-a477-fa4daab5edc6" (UID: "3e73a174-f199-41a8-a477-fa4daab5edc6"). InnerVolumeSpecName "kube-api-access-29kfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:12:03.402479 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:03.402462    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e73a174-f199-41a8-a477-fa4daab5edc6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3e73a174-f199-41a8-a477-fa4daab5edc6" (UID: "3e73a174-f199-41a8-a477-fa4daab5edc6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:12:03.500240 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:03.500193    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29kfw\" (UniqueName: \"kubernetes.io/projected/3e73a174-f199-41a8-a477-fa4daab5edc6-kube-api-access-29kfw\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:12:03.500240 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:03.500233    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e73a174-f199-41a8-a477-fa4daab5edc6-maas-api-tls\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:12:03.500240 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:03.500243    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e73a174-f199-41a8-a477-fa4daab5edc6-openshift-service-ca\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:12:03.500240 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:03.500251    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e73a174-f199-41a8-a477-fa4daab5edc6-metrics-certs\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:12:04.346105 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:04.346045    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8"
Sep 08 14:12:04.346517 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:04.346101    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8" event={"ID":"3e73a174-f199-41a8-a477-fa4daab5edc6","Type":"ContainerDied","Data":"d4a4016dddd784fce529f4db12a35bad91c7a6292adf706039c02a0563e7f919"}
Sep 08 14:12:04.346517 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:04.346167    2575 scope.go:117] "RemoveContainer" containerID="441d592d0200b286ec08f27dbb2028b8cd0f1a3311e30b2abf6129ef5984dbf1"
Sep 08 14:12:04.370077 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:04.370040    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8"]
Sep 08 14:12:04.372216 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:04.372194    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-93eb17b6-78f96bb44c-92lr8"]
Sep 08 14:12:04.974422 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:04.974390    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e73a174-f199-41a8-a477-fa4daab5edc6" path="/var/lib/kubelet/pods/3e73a174-f199-41a8-a477-fa4daab5edc6/volumes"
Sep 08 14:12:11.276008 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.275919    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"]
Sep 08 14:12:11.276562 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.276390    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="161010a7-9987-4134-b816-335fd52d69fe" containerName="istio-proxy"
Sep 08 14:12:11.276562 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.276404    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="161010a7-9987-4134-b816-335fd52d69fe" containerName="istio-proxy"
Sep 08 14:12:11.276562 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.276425    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e73a174-f199-41a8-a477-fa4daab5edc6" containerName="maas-api"
Sep 08 14:12:11.276562 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.276431    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e73a174-f199-41a8-a477-fa4daab5edc6" containerName="maas-api"
Sep 08 14:12:11.276562 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.276496    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e73a174-f199-41a8-a477-fa4daab5edc6" containerName="maas-api"
Sep 08 14:12:11.279343 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.279324    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"
Sep 08 14:12:11.282027 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.282007    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-cb068d\"/\"kube-root-ca.crt\""
Sep 08 14:12:11.283129 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.283106    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-cb068d\"/\"test-model-cb068d-kserve-self-signed-certs\""
Sep 08 14:12:11.283129 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.283117    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-cb068d\"/\"openshift-service-ca.crt\""
Sep 08 14:12:11.283286 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.283130    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-cb068d\"/\"default-dockercfg-mhnwx\""
Sep 08 14:12:11.290216 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.290193    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"]
Sep 08 14:12:11.372326 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.372298    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vthcj\" (UniqueName: \"kubernetes.io/projected/f81854dd-ce0d-4152-8263-f4b486a905af-kube-api-access-vthcj\") pod \"test-model-cb068d-kserve-5f8cccf944-lr92t\" (UID: \"f81854dd-ce0d-4152-8263-f4b486a905af\") " pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"
Sep 08 14:12:11.372435 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.372347    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f81854dd-ce0d-4152-8263-f4b486a905af-tmp-dir\") pod \"test-model-cb068d-kserve-5f8cccf944-lr92t\" (UID: \"f81854dd-ce0d-4152-8263-f4b486a905af\") " pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"
Sep 08 14:12:11.372435 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.372398    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f81854dd-ce0d-4152-8263-f4b486a905af-dshm\") pod \"test-model-cb068d-kserve-5f8cccf944-lr92t\" (UID: \"f81854dd-ce0d-4152-8263-f4b486a905af\") " pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"
Sep 08 14:12:11.372520 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.372457    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f81854dd-ce0d-4152-8263-f4b486a905af-model-cache\") pod \"test-model-cb068d-kserve-5f8cccf944-lr92t\" (UID: \"f81854dd-ce0d-4152-8263-f4b486a905af\") " pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"
Sep 08 14:12:11.372520 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.372478    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f81854dd-ce0d-4152-8263-f4b486a905af-home\") pod \"test-model-cb068d-kserve-5f8cccf944-lr92t\" (UID: \"f81854dd-ce0d-4152-8263-f4b486a905af\") " pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"
Sep 08 14:12:11.372627 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.372570    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f81854dd-ce0d-4152-8263-f4b486a905af-tls-certs\") pod \"test-model-cb068d-kserve-5f8cccf944-lr92t\" (UID: \"f81854dd-ce0d-4152-8263-f4b486a905af\") " pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"
Sep 08 14:12:11.473282 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.473240    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vthcj\" (UniqueName: \"kubernetes.io/projected/f81854dd-ce0d-4152-8263-f4b486a905af-kube-api-access-vthcj\") pod \"test-model-cb068d-kserve-5f8cccf944-lr92t\" (UID: \"f81854dd-ce0d-4152-8263-f4b486a905af\") " pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"
Sep 08 14:12:11.473484 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.473299    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f81854dd-ce0d-4152-8263-f4b486a905af-tmp-dir\") pod \"test-model-cb068d-kserve-5f8cccf944-lr92t\" (UID: \"f81854dd-ce0d-4152-8263-f4b486a905af\") " pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"
Sep 08 14:12:11.473484 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.473333    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f81854dd-ce0d-4152-8263-f4b486a905af-dshm\") pod \"test-model-cb068d-kserve-5f8cccf944-lr92t\" (UID: \"f81854dd-ce0d-4152-8263-f4b486a905af\") " pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"
Sep 08 14:12:11.473484 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.473389    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f81854dd-ce0d-4152-8263-f4b486a905af-model-cache\") pod \"test-model-cb068d-kserve-5f8cccf944-lr92t\" (UID: \"f81854dd-ce0d-4152-8263-f4b486a905af\") " pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"
Sep 08 14:12:11.473484 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.473413    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f81854dd-ce0d-4152-8263-f4b486a905af-home\") pod \"test-model-cb068d-kserve-5f8cccf944-lr92t\" (UID: \"f81854dd-ce0d-4152-8263-f4b486a905af\") " pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"
Sep 08 14:12:11.473484 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.473453    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f81854dd-ce0d-4152-8263-f4b486a905af-tls-certs\") pod \"test-model-cb068d-kserve-5f8cccf944-lr92t\" (UID: \"f81854dd-ce0d-4152-8263-f4b486a905af\") " pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"
Sep 08 14:12:11.473780 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.473731    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f81854dd-ce0d-4152-8263-f4b486a905af-tmp-dir\") pod \"test-model-cb068d-kserve-5f8cccf944-lr92t\" (UID: \"f81854dd-ce0d-4152-8263-f4b486a905af\") " pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"
Sep 08 14:12:11.473864 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.473840    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f81854dd-ce0d-4152-8263-f4b486a905af-home\") pod \"test-model-cb068d-kserve-5f8cccf944-lr92t\" (UID: \"f81854dd-ce0d-4152-8263-f4b486a905af\") " pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"
Sep 08 14:12:11.473942 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.473926    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f81854dd-ce0d-4152-8263-f4b486a905af-model-cache\") pod \"test-model-cb068d-kserve-5f8cccf944-lr92t\" (UID: \"f81854dd-ce0d-4152-8263-f4b486a905af\") " pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"
Sep 08 14:12:11.475718 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.475699    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f81854dd-ce0d-4152-8263-f4b486a905af-dshm\") pod \"test-model-cb068d-kserve-5f8cccf944-lr92t\" (UID: \"f81854dd-ce0d-4152-8263-f4b486a905af\") " pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"
Sep 08 14:12:11.476114 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.476097    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f81854dd-ce0d-4152-8263-f4b486a905af-tls-certs\") pod \"test-model-cb068d-kserve-5f8cccf944-lr92t\" (UID: \"f81854dd-ce0d-4152-8263-f4b486a905af\") " pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"
Sep 08 14:12:11.481506 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.481481    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vthcj\" (UniqueName: \"kubernetes.io/projected/f81854dd-ce0d-4152-8263-f4b486a905af-kube-api-access-vthcj\") pod \"test-model-cb068d-kserve-5f8cccf944-lr92t\" (UID: \"f81854dd-ce0d-4152-8263-f4b486a905af\") " pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"
Sep 08 14:12:11.589406 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.589380    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"
Sep 08 14:12:11.871815 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:11.871787    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"]
Sep 08 14:12:11.872909 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:12:11.872876    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf81854dd_ce0d_4152_8263_f4b486a905af.slice/crio-d95d280188166401b8c4fa745bdd38f9c65cfdf1d3f746aba8c62af2afba77a2 WatchSource:0}: Error finding container d95d280188166401b8c4fa745bdd38f9c65cfdf1d3f746aba8c62af2afba77a2: Status 404 returned error can't find the container with id d95d280188166401b8c4fa745bdd38f9c65cfdf1d3f746aba8c62af2afba77a2
Sep 08 14:12:12.396545 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:12.396511    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t" event={"ID":"f81854dd-ce0d-4152-8263-f4b486a905af","Type":"ContainerStarted","Data":"225d80016be318a38d50c20496b0f112c81af4e74a826563d31d9357b1d5fec5"}
Sep 08 14:12:12.396906 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:12.396552    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t" event={"ID":"f81854dd-ce0d-4152-8263-f4b486a905af","Type":"ContainerStarted","Data":"d95d280188166401b8c4fa745bdd38f9c65cfdf1d3f746aba8c62af2afba77a2"}
Sep 08 14:12:12.417505 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:12.417454    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t" podStartSLOduration=1.4174390350000001 podStartE2EDuration="1.417439035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:12:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:12:12.415098219 +0000 UTC m=+807.904815271" watchObservedRunningTime="2026-09-08 14:12:12.417439035 +0000 UTC m=+807.907156128"
Sep 08 14:12:12.589483 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:12.589452    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"
Sep 08 14:12:21.590115 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:21.590077    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"
Sep 08 14:12:21.603084 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:21.603037    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"
Sep 08 14:12:22.465213 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:22.465127    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"
Sep 08 14:12:22.851133 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:22.851091    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:12:29.254733 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:29.254700    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"]
Sep 08 14:12:40.450862 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:40.450818    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:12:44.275226 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:44.275159    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc" podUID="f738e068-04ed-4822-a78c-b77a629e040a" containerName="main" containerID="cri-o://c837e62964c796e8107406350d75d85e2f1171dc136a7a57ff653a0f0febb1ea" gracePeriod=45
Sep 08 14:12:44.535946 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:44.535884    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"
Sep 08 14:12:44.574834 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:44.574805    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f738e068-04ed-4822-a78c-b77a629e040a-model-cache\") pod \"f738e068-04ed-4822-a78c-b77a629e040a\" (UID: \"f738e068-04ed-4822-a78c-b77a629e040a\") "
Sep 08 14:12:44.575004 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:44.574848    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f738e068-04ed-4822-a78c-b77a629e040a-tls-certs\") pod \"f738e068-04ed-4822-a78c-b77a629e040a\" (UID: \"f738e068-04ed-4822-a78c-b77a629e040a\") "
Sep 08 14:12:44.575004 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:44.574867    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f738e068-04ed-4822-a78c-b77a629e040a-home\") pod \"f738e068-04ed-4822-a78c-b77a629e040a\" (UID: \"f738e068-04ed-4822-a78c-b77a629e040a\") "
Sep 08 14:12:44.575004 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:44.574974    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f738e068-04ed-4822-a78c-b77a629e040a-dshm\") pod \"f738e068-04ed-4822-a78c-b77a629e040a\" (UID: \"f738e068-04ed-4822-a78c-b77a629e040a\") "
Sep 08 14:12:44.575224 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:44.575004    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jvhc\" (UniqueName: \"kubernetes.io/projected/f738e068-04ed-4822-a78c-b77a629e040a-kube-api-access-5jvhc\") pod \"f738e068-04ed-4822-a78c-b77a629e040a\" (UID: \"f738e068-04ed-4822-a78c-b77a629e040a\") "
Sep 08 14:12:44.575224 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:44.575031    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f738e068-04ed-4822-a78c-b77a629e040a-tmp-dir\") pod \"f738e068-04ed-4822-a78c-b77a629e040a\" (UID: \"f738e068-04ed-4822-a78c-b77a629e040a\") "
Sep 08 14:12:44.575224 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:44.575113    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f738e068-04ed-4822-a78c-b77a629e040a-model-cache" (OuterVolumeSpecName: "model-cache") pod "f738e068-04ed-4822-a78c-b77a629e040a" (UID: "f738e068-04ed-4822-a78c-b77a629e040a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:12:44.575224 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:44.575122    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f738e068-04ed-4822-a78c-b77a629e040a-home" (OuterVolumeSpecName: "home") pod "f738e068-04ed-4822-a78c-b77a629e040a" (UID: "f738e068-04ed-4822-a78c-b77a629e040a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:12:44.575448 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:44.575344    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f738e068-04ed-4822-a78c-b77a629e040a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f738e068-04ed-4822-a78c-b77a629e040a" (UID: "f738e068-04ed-4822-a78c-b77a629e040a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:12:44.575606 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:44.575585    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f738e068-04ed-4822-a78c-b77a629e040a-tmp-dir\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:12:44.575606 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:44.575607    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f738e068-04ed-4822-a78c-b77a629e040a-model-cache\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:12:44.575760 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:44.575619    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f738e068-04ed-4822-a78c-b77a629e040a-home\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:12:44.577292 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:44.577257    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f738e068-04ed-4822-a78c-b77a629e040a-dshm" (OuterVolumeSpecName: "dshm") pod "f738e068-04ed-4822-a78c-b77a629e040a" (UID: "f738e068-04ed-4822-a78c-b77a629e040a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:12:44.577405 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:44.577334    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f738e068-04ed-4822-a78c-b77a629e040a-kube-api-access-5jvhc" (OuterVolumeSpecName: "kube-api-access-5jvhc") pod "f738e068-04ed-4822-a78c-b77a629e040a" (UID: "f738e068-04ed-4822-a78c-b77a629e040a"). InnerVolumeSpecName "kube-api-access-5jvhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:12:44.577405 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:44.577347    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f738e068-04ed-4822-a78c-b77a629e040a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f738e068-04ed-4822-a78c-b77a629e040a" (UID: "f738e068-04ed-4822-a78c-b77a629e040a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:12:44.598128 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:44.598098    2575 generic.go:356] "Generic (PLEG): container finished" podID="f738e068-04ed-4822-a78c-b77a629e040a" containerID="c837e62964c796e8107406350d75d85e2f1171dc136a7a57ff653a0f0febb1ea" exitCode=0
Sep 08 14:12:44.598223 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:44.598189    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc" event={"ID":"f738e068-04ed-4822-a78c-b77a629e040a","Type":"ContainerDied","Data":"c837e62964c796e8107406350d75d85e2f1171dc136a7a57ff653a0f0febb1ea"}
Sep 08 14:12:44.598223 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:44.598206    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"
Sep 08 14:12:44.598308 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:44.598225    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc" event={"ID":"f738e068-04ed-4822-a78c-b77a629e040a","Type":"ContainerDied","Data":"6f45a8ac97140929bb55bfa462441e63182036a557051afa1a8203d24076d949"}
Sep 08 14:12:44.598308 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:44.598247    2575 scope.go:117] "RemoveContainer" containerID="c837e62964c796e8107406350d75d85e2f1171dc136a7a57ff653a0f0febb1ea"
Sep 08 14:12:44.607611 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:44.607594    2575 scope.go:117] "RemoveContainer" containerID="c837e62964c796e8107406350d75d85e2f1171dc136a7a57ff653a0f0febb1ea"
Sep 08 14:12:44.607868 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:12:44.607848    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c837e62964c796e8107406350d75d85e2f1171dc136a7a57ff653a0f0febb1ea\": container with ID starting with c837e62964c796e8107406350d75d85e2f1171dc136a7a57ff653a0f0febb1ea not found: ID does not exist" containerID="c837e62964c796e8107406350d75d85e2f1171dc136a7a57ff653a0f0febb1ea"
Sep 08 14:12:44.607906 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:44.607878    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c837e62964c796e8107406350d75d85e2f1171dc136a7a57ff653a0f0febb1ea"} err="failed to get container status \"c837e62964c796e8107406350d75d85e2f1171dc136a7a57ff653a0f0febb1ea\": rpc error: code = NotFound desc = could not find container \"c837e62964c796e8107406350d75d85e2f1171dc136a7a57ff653a0f0febb1ea\": container with ID starting with c837e62964c796e8107406350d75d85e2f1171dc136a7a57ff653a0f0febb1ea not found: ID does not exist"
Sep 08 14:12:44.621163 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:44.621141    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"]
Sep 08 14:12:44.625154 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:44.625135    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-41383d/autores-model-41383d-kserve-65bf94f64-c4kfc"]
Sep 08 14:12:44.676346 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:44.676326    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f738e068-04ed-4822-a78c-b77a629e040a-tls-certs\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:12:44.676346 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:44.676343    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f738e068-04ed-4822-a78c-b77a629e040a-dshm\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:12:44.676461 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:44.676351    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jvhc\" (UniqueName: \"kubernetes.io/projected/f738e068-04ed-4822-a78c-b77a629e040a-kube-api-access-5jvhc\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:12:44.976094 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:12:44.976045    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f738e068-04ed-4822-a78c-b77a629e040a" path="/var/lib/kubelet/pods/f738e068-04ed-4822-a78c-b77a629e040a/volumes"
Sep 08 14:13:00.635029 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:00.634998    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"]
Sep 08 14:13:01.674928 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:01.674888    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:13:07.221333 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:07.221291    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"]
Sep 08 14:13:07.221792 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:07.221546    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79" podUID="d11c09a7-92b1-4faf-8628-eafd1f96379d" containerName="istio-proxy" containerID="cri-o://6d9eabf294377cb84362998bb3b40f64b7828d206241ffb106be1edaaff2d269" gracePeriod=30
Sep 08 14:13:12.338036 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.338004    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p"]
Sep 08 14:13:12.338755 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.338595    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f738e068-04ed-4822-a78c-b77a629e040a" containerName="main"
Sep 08 14:13:12.338755 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.338618    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f738e068-04ed-4822-a78c-b77a629e040a" containerName="main"
Sep 08 14:13:12.338946 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.338773    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f738e068-04ed-4822-a78c-b77a629e040a" containerName="main"
Sep 08 14:13:12.342090 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.342070    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p"
Sep 08 14:13:12.344470 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.344445    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-3b812d-serving-cert\""
Sep 08 14:13:12.354630 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.354606    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p"]
Sep 08 14:13:12.436607 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.436579    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drflz\" (UniqueName: \"kubernetes.io/projected/7220d2e3-7580-4b77-8f85-7a40191bb07c-kube-api-access-drflz\") pod \"maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p\" (UID: \"7220d2e3-7580-4b77-8f85-7a40191bb07c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p"
Sep 08 14:13:12.436797 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.436685    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7220d2e3-7580-4b77-8f85-7a40191bb07c-metrics-certs\") pod \"maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p\" (UID: \"7220d2e3-7580-4b77-8f85-7a40191bb07c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p"
Sep 08 14:13:12.436797 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.436748    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7220d2e3-7580-4b77-8f85-7a40191bb07c-openshift-service-ca\") pod \"maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p\" (UID: \"7220d2e3-7580-4b77-8f85-7a40191bb07c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p"
Sep 08 14:13:12.436797 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.436767    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7220d2e3-7580-4b77-8f85-7a40191bb07c-maas-api-tls\") pod \"maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p\" (UID: \"7220d2e3-7580-4b77-8f85-7a40191bb07c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p"
Sep 08 14:13:12.489555 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.489496    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:13:12.537335 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.537304    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7220d2e3-7580-4b77-8f85-7a40191bb07c-openshift-service-ca\") pod \"maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p\" (UID: \"7220d2e3-7580-4b77-8f85-7a40191bb07c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p"
Sep 08 14:13:12.537488 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.537339    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7220d2e3-7580-4b77-8f85-7a40191bb07c-maas-api-tls\") pod \"maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p\" (UID: \"7220d2e3-7580-4b77-8f85-7a40191bb07c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p"
Sep 08 14:13:12.537488 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.537427    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drflz\" (UniqueName: \"kubernetes.io/projected/7220d2e3-7580-4b77-8f85-7a40191bb07c-kube-api-access-drflz\") pod \"maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p\" (UID: \"7220d2e3-7580-4b77-8f85-7a40191bb07c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p"
Sep 08 14:13:12.537582 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.537488    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7220d2e3-7580-4b77-8f85-7a40191bb07c-metrics-certs\") pod \"maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p\" (UID: \"7220d2e3-7580-4b77-8f85-7a40191bb07c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p"
Sep 08 14:13:12.538087 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.538046    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7220d2e3-7580-4b77-8f85-7a40191bb07c-openshift-service-ca\") pod \"maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p\" (UID: \"7220d2e3-7580-4b77-8f85-7a40191bb07c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p"
Sep 08 14:13:12.540023 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.540003    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7220d2e3-7580-4b77-8f85-7a40191bb07c-metrics-certs\") pod \"maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p\" (UID: \"7220d2e3-7580-4b77-8f85-7a40191bb07c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p"
Sep 08 14:13:12.540159 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.540143    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7220d2e3-7580-4b77-8f85-7a40191bb07c-maas-api-tls\") pod \"maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p\" (UID: \"7220d2e3-7580-4b77-8f85-7a40191bb07c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p"
Sep 08 14:13:12.546557 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.546529    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drflz\" (UniqueName: \"kubernetes.io/projected/7220d2e3-7580-4b77-8f85-7a40191bb07c-kube-api-access-drflz\") pod \"maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p\" (UID: \"7220d2e3-7580-4b77-8f85-7a40191bb07c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p"
Sep 08 14:13:12.637958 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.637928    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d11c09a7-92b1-4faf-8628-eafd1f96379d-workload-socket\") pod \"d11c09a7-92b1-4faf-8628-eafd1f96379d\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") "
Sep 08 14:13:12.637958 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.637965    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d11c09a7-92b1-4faf-8628-eafd1f96379d-istio-envoy\") pod \"d11c09a7-92b1-4faf-8628-eafd1f96379d\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") "
Sep 08 14:13:12.637958 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.637992    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d11c09a7-92b1-4faf-8628-eafd1f96379d-istio-data\") pod \"d11c09a7-92b1-4faf-8628-eafd1f96379d\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") "
Sep 08 14:13:12.638369 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.638018    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d11c09a7-92b1-4faf-8628-eafd1f96379d-istio-token\") pod \"d11c09a7-92b1-4faf-8628-eafd1f96379d\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") "
Sep 08 14:13:12.638369 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.638117    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d11c09a7-92b1-4faf-8628-eafd1f96379d-istio-podinfo\") pod \"d11c09a7-92b1-4faf-8628-eafd1f96379d\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") "
Sep 08 14:13:12.638369 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.638224    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-758v2\" (UniqueName: \"kubernetes.io/projected/d11c09a7-92b1-4faf-8628-eafd1f96379d-kube-api-access-758v2\") pod \"d11c09a7-92b1-4faf-8628-eafd1f96379d\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") "
Sep 08 14:13:12.638369 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.638259    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d11c09a7-92b1-4faf-8628-eafd1f96379d-credential-socket\") pod \"d11c09a7-92b1-4faf-8628-eafd1f96379d\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") "
Sep 08 14:13:12.638369 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.638304    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d11c09a7-92b1-4faf-8628-eafd1f96379d-workload-certs\") pod \"d11c09a7-92b1-4faf-8628-eafd1f96379d\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") "
Sep 08 14:13:12.638369 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.638356    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d11c09a7-92b1-4faf-8628-eafd1f96379d-istiod-ca-cert\") pod \"d11c09a7-92b1-4faf-8628-eafd1f96379d\" (UID: \"d11c09a7-92b1-4faf-8628-eafd1f96379d\") "
Sep 08 14:13:12.638682 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.638257    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d11c09a7-92b1-4faf-8628-eafd1f96379d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d11c09a7-92b1-4faf-8628-eafd1f96379d" (UID: "d11c09a7-92b1-4faf-8628-eafd1f96379d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:13:12.638682 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.638300    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d11c09a7-92b1-4faf-8628-eafd1f96379d-istio-data" (OuterVolumeSpecName: "istio-data") pod "d11c09a7-92b1-4faf-8628-eafd1f96379d" (UID: "d11c09a7-92b1-4faf-8628-eafd1f96379d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:13:12.638682 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.638505    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d11c09a7-92b1-4faf-8628-eafd1f96379d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d11c09a7-92b1-4faf-8628-eafd1f96379d" (UID: "d11c09a7-92b1-4faf-8628-eafd1f96379d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:13:12.638846 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.638736    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d11c09a7-92b1-4faf-8628-eafd1f96379d-credential-socket\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:13:12.638846 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.638755    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d11c09a7-92b1-4faf-8628-eafd1f96379d-workload-socket\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:13:12.638846 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.638769    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d11c09a7-92b1-4faf-8628-eafd1f96379d-istio-data\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:13:12.638999 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.638948    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d11c09a7-92b1-4faf-8628-eafd1f96379d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d11c09a7-92b1-4faf-8628-eafd1f96379d" (UID: "d11c09a7-92b1-4faf-8628-eafd1f96379d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:13:12.639072 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.639006    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d11c09a7-92b1-4faf-8628-eafd1f96379d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d11c09a7-92b1-4faf-8628-eafd1f96379d" (UID: "d11c09a7-92b1-4faf-8628-eafd1f96379d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:13:12.640899 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.640872    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d11c09a7-92b1-4faf-8628-eafd1f96379d-kube-api-access-758v2" (OuterVolumeSpecName: "kube-api-access-758v2") pod "d11c09a7-92b1-4faf-8628-eafd1f96379d" (UID: "d11c09a7-92b1-4faf-8628-eafd1f96379d"). InnerVolumeSpecName "kube-api-access-758v2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:13:12.641015 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.640919    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d11c09a7-92b1-4faf-8628-eafd1f96379d-istio-token" (OuterVolumeSpecName: "istio-token") pod "d11c09a7-92b1-4faf-8628-eafd1f96379d" (UID: "d11c09a7-92b1-4faf-8628-eafd1f96379d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:13:12.641105 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.641082    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d11c09a7-92b1-4faf-8628-eafd1f96379d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d11c09a7-92b1-4faf-8628-eafd1f96379d" (UID: "d11c09a7-92b1-4faf-8628-eafd1f96379d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:13:12.641232 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.641209    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d11c09a7-92b1-4faf-8628-eafd1f96379d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d11c09a7-92b1-4faf-8628-eafd1f96379d" (UID: "d11c09a7-92b1-4faf-8628-eafd1f96379d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:13:12.654435 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.654410    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p"
Sep 08 14:13:12.739808 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.739731    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-758v2\" (UniqueName: \"kubernetes.io/projected/d11c09a7-92b1-4faf-8628-eafd1f96379d-kube-api-access-758v2\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:13:12.739808 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.739758    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d11c09a7-92b1-4faf-8628-eafd1f96379d-workload-certs\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:13:12.739808 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.739767    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d11c09a7-92b1-4faf-8628-eafd1f96379d-istiod-ca-cert\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:13:12.739808 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.739774    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d11c09a7-92b1-4faf-8628-eafd1f96379d-istio-envoy\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:13:12.739808 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.739782    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d11c09a7-92b1-4faf-8628-eafd1f96379d-istio-token\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:13:12.739808 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.739789    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d11c09a7-92b1-4faf-8628-eafd1f96379d-istio-podinfo\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:13:12.761049 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.760923    2575 generic.go:356] "Generic (PLEG): container finished" podID="d11c09a7-92b1-4faf-8628-eafd1f96379d" containerID="6d9eabf294377cb84362998bb3b40f64b7828d206241ffb106be1edaaff2d269" exitCode=0
Sep 08 14:13:12.761049 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.760986    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"
Sep 08 14:13:12.761049 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.761028    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79" event={"ID":"d11c09a7-92b1-4faf-8628-eafd1f96379d","Type":"ContainerDied","Data":"6d9eabf294377cb84362998bb3b40f64b7828d206241ffb106be1edaaff2d269"}
Sep 08 14:13:12.761320 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.761115    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79" event={"ID":"d11c09a7-92b1-4faf-8628-eafd1f96379d","Type":"ContainerDied","Data":"a3ea6afe34e64f679a596d93d062805ce68c388a80381d2f6cd07c924522a4ca"}
Sep 08 14:13:12.761320 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.761135    2575 scope.go:117] "RemoveContainer" containerID="6d9eabf294377cb84362998bb3b40f64b7828d206241ffb106be1edaaff2d269"
Sep 08 14:13:12.770906 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.770891    2575 scope.go:117] "RemoveContainer" containerID="2bf55dbc705398b925969e757ad3d50a7ea15679ddba2352d2f30dcf7910957a"
Sep 08 14:13:12.779573 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.779560    2575 scope.go:117] "RemoveContainer" containerID="6d9eabf294377cb84362998bb3b40f64b7828d206241ffb106be1edaaff2d269"
Sep 08 14:13:12.779817 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:13:12.779800    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d9eabf294377cb84362998bb3b40f64b7828d206241ffb106be1edaaff2d269\": container with ID starting with 6d9eabf294377cb84362998bb3b40f64b7828d206241ffb106be1edaaff2d269 not found: ID does not exist" containerID="6d9eabf294377cb84362998bb3b40f64b7828d206241ffb106be1edaaff2d269"
Sep 08 14:13:12.779862 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.779823    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d9eabf294377cb84362998bb3b40f64b7828d206241ffb106be1edaaff2d269"} err="failed to get container status \"6d9eabf294377cb84362998bb3b40f64b7828d206241ffb106be1edaaff2d269\": rpc error: code = NotFound desc = could not find container \"6d9eabf294377cb84362998bb3b40f64b7828d206241ffb106be1edaaff2d269\": container with ID starting with 6d9eabf294377cb84362998bb3b40f64b7828d206241ffb106be1edaaff2d269 not found: ID does not exist"
Sep 08 14:13:12.779862 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.779838    2575 scope.go:117] "RemoveContainer" containerID="2bf55dbc705398b925969e757ad3d50a7ea15679ddba2352d2f30dcf7910957a"
Sep 08 14:13:12.780099 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:13:12.780081    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bf55dbc705398b925969e757ad3d50a7ea15679ddba2352d2f30dcf7910957a\": container with ID starting with 2bf55dbc705398b925969e757ad3d50a7ea15679ddba2352d2f30dcf7910957a not found: ID does not exist" containerID="2bf55dbc705398b925969e757ad3d50a7ea15679ddba2352d2f30dcf7910957a"
Sep 08 14:13:12.780151 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.780105    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bf55dbc705398b925969e757ad3d50a7ea15679ddba2352d2f30dcf7910957a"} err="failed to get container status \"2bf55dbc705398b925969e757ad3d50a7ea15679ddba2352d2f30dcf7910957a\": rpc error: code = NotFound desc = could not find container \"2bf55dbc705398b925969e757ad3d50a7ea15679ddba2352d2f30dcf7910957a\": container with ID starting with 2bf55dbc705398b925969e757ad3d50a7ea15679ddba2352d2f30dcf7910957a not found: ID does not exist"
Sep 08 14:13:12.784537 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.784515    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"]
Sep 08 14:13:12.790034 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.790011    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-41383d-openshift-default-7974f5cfb-fsf79"]
Sep 08 14:13:12.933009 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.932979    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p"]
Sep 08 14:13:12.934431 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:13:12.934408    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7220d2e3_7580_4b77_8f85_7a40191bb07c.slice/crio-e01affaee489a685f02e42b189baf618a2f6cd4b09ad1fa16b989bbc129b2ddc WatchSource:0}: Error finding container e01affaee489a685f02e42b189baf618a2f6cd4b09ad1fa16b989bbc129b2ddc: Status 404 returned error can't find the container with id e01affaee489a685f02e42b189baf618a2f6cd4b09ad1fa16b989bbc129b2ddc
Sep 08 14:13:12.974467 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:12.974443    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d11c09a7-92b1-4faf-8628-eafd1f96379d" path="/var/lib/kubelet/pods/d11c09a7-92b1-4faf-8628-eafd1f96379d/volumes"
Sep 08 14:13:13.771362 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:13.771322    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p" event={"ID":"7220d2e3-7580-4b77-8f85-7a40191bb07c","Type":"ContainerStarted","Data":"e861e57e6ff63066c267dbdc03f86f13c6b12ac7a9b87cd0b335b03b3e3ca730"}
Sep 08 14:13:13.771728 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:13.771387    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p" event={"ID":"7220d2e3-7580-4b77-8f85-7a40191bb07c","Type":"ContainerStarted","Data":"e01affaee489a685f02e42b189baf618a2f6cd4b09ad1fa16b989bbc129b2ddc"}
Sep 08 14:13:13.771728 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:13.771508    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p"
Sep 08 14:13:13.792082 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:13.792024    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p" podStartSLOduration=1.103180801 podStartE2EDuration="1.79200672s" totalImagesPullingTime="688.825919ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:13:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:13:13.789397209 +0000 UTC m=+869.279114261" watchObservedRunningTime="2026-09-08 14:13:13.79200672 +0000 UTC m=+869.281723767"
Sep 08 14:13:15.656249 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:15.656204    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx" podUID="ad1c9e6b-7551-47f9-9c6b-8c255f3cb716" containerName="main" containerID="cri-o://9b9d1d911a20a45c0b2454a5a40799514c8260eb1ba64bdb635d4c25caa0a8e2" gracePeriod=45
Sep 08 14:13:15.783691 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:15.783660    2575 generic.go:356] "Generic (PLEG): container finished" podID="ad1c9e6b-7551-47f9-9c6b-8c255f3cb716" containerID="9b9d1d911a20a45c0b2454a5a40799514c8260eb1ba64bdb635d4c25caa0a8e2" exitCode=0
Sep 08 14:13:15.783827 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:15.783734    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx" event={"ID":"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716","Type":"ContainerDied","Data":"9b9d1d911a20a45c0b2454a5a40799514c8260eb1ba64bdb635d4c25caa0a8e2"}
Sep 08 14:13:15.910285 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:15.910230    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"
Sep 08 14:13:16.074612 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:16.074579    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rsll8\" (UniqueName: \"kubernetes.io/projected/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-kube-api-access-rsll8\") pod \"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716\" (UID: \"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716\") "
Sep 08 14:13:16.074792 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:16.074633    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-home\") pod \"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716\" (UID: \"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716\") "
Sep 08 14:13:16.074792 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:16.074672    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-tls-certs\") pod \"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716\" (UID: \"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716\") "
Sep 08 14:13:16.074792 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:16.074709    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-tmp-dir\") pod \"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716\" (UID: \"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716\") "
Sep 08 14:13:16.074792 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:16.074724    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-dshm\") pod \"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716\" (UID: \"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716\") "
Sep 08 14:13:16.074792 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:16.074744    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-model-cache\") pod \"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716\" (UID: \"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716\") "
Sep 08 14:13:16.075094 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:16.074963    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-home" (OuterVolumeSpecName: "home") pod "ad1c9e6b-7551-47f9-9c6b-8c255f3cb716" (UID: "ad1c9e6b-7551-47f9-9c6b-8c255f3cb716"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:13:16.075094 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:16.074980    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ad1c9e6b-7551-47f9-9c6b-8c255f3cb716" (UID: "ad1c9e6b-7551-47f9-9c6b-8c255f3cb716"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:13:16.075180 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:16.075116    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-model-cache" (OuterVolumeSpecName: "model-cache") pod "ad1c9e6b-7551-47f9-9c6b-8c255f3cb716" (UID: "ad1c9e6b-7551-47f9-9c6b-8c255f3cb716"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:13:16.077040 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:16.077012    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ad1c9e6b-7551-47f9-9c6b-8c255f3cb716" (UID: "ad1c9e6b-7551-47f9-9c6b-8c255f3cb716"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:13:16.077214 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:16.077089    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-kube-api-access-rsll8" (OuterVolumeSpecName: "kube-api-access-rsll8") pod "ad1c9e6b-7551-47f9-9c6b-8c255f3cb716" (UID: "ad1c9e6b-7551-47f9-9c6b-8c255f3cb716"). InnerVolumeSpecName "kube-api-access-rsll8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:13:16.077214 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:16.077110    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-dshm" (OuterVolumeSpecName: "dshm") pod "ad1c9e6b-7551-47f9-9c6b-8c255f3cb716" (UID: "ad1c9e6b-7551-47f9-9c6b-8c255f3cb716"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:13:16.176010 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:16.175945    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rsll8\" (UniqueName: \"kubernetes.io/projected/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-kube-api-access-rsll8\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:13:16.176010 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:16.175967    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-home\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:13:16.176010 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:16.175976    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-tls-certs\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:13:16.176010 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:16.175985    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-tmp-dir\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:13:16.176010 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:16.175992    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-dshm\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:13:16.176010 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:16.175999    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716-model-cache\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:13:16.790712 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:16.790686    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"
Sep 08 14:13:16.791108 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:16.790736    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx" event={"ID":"ad1c9e6b-7551-47f9-9c6b-8c255f3cb716","Type":"ContainerDied","Data":"3bef52c52d164c93fdb6c4fe2dacd2b2f3e469f465b1115a628691f1fffebe11"}
Sep 08 14:13:16.791108 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:16.790789    2575 scope.go:117] "RemoveContainer" containerID="9b9d1d911a20a45c0b2454a5a40799514c8260eb1ba64bdb635d4c25caa0a8e2"
Sep 08 14:13:16.813096 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:16.813071    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"]
Sep 08 14:13:16.816379 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:16.816348    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-a-ce93b475-kserve-7c65786968-zhddx"]
Sep 08 14:13:16.974203 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:16.974175    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad1c9e6b-7551-47f9-9c6b-8c255f3cb716" path="/var/lib/kubelet/pods/ad1c9e6b-7551-47f9-9c6b-8c255f3cb716/volumes"
Sep 08 14:13:19.781927 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:19.781896    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p"
Sep 08 14:13:23.570630 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:23.570594    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:13:43.270230 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.270158    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"]
Sep 08 14:13:43.270671 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.270589    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d11c09a7-92b1-4faf-8628-eafd1f96379d" containerName="istio-proxy"
Sep 08 14:13:43.270671 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.270603    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d11c09a7-92b1-4faf-8628-eafd1f96379d" containerName="istio-proxy"
Sep 08 14:13:43.270671 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.270617    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d11c09a7-92b1-4faf-8628-eafd1f96379d" containerName="istio-proxy"
Sep 08 14:13:43.270671 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.270622    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d11c09a7-92b1-4faf-8628-eafd1f96379d" containerName="istio-proxy"
Sep 08 14:13:43.270671 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.270628    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad1c9e6b-7551-47f9-9c6b-8c255f3cb716" containerName="main"
Sep 08 14:13:43.270671 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.270633    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad1c9e6b-7551-47f9-9c6b-8c255f3cb716" containerName="main"
Sep 08 14:13:43.270863 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.270698    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad1c9e6b-7551-47f9-9c6b-8c255f3cb716" containerName="main"
Sep 08 14:13:43.270863 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.270707    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d11c09a7-92b1-4faf-8628-eafd1f96379d" containerName="istio-proxy"
Sep 08 14:13:43.270863 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.270714    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d11c09a7-92b1-4faf-8628-eafd1f96379d" containerName="istio-proxy"
Sep 08 14:13:43.273757 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.273741    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"
Sep 08 14:13:43.276655 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.276632    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-3b812d\"/\"explicit-model-3b812d-kserve-self-signed-certs\""
Sep 08 14:13:43.276774 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.276675    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-3b812d\"/\"openshift-service-ca.crt\""
Sep 08 14:13:43.276774 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.276686    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-3b812d\"/\"default-dockercfg-6bd69\""
Sep 08 14:13:43.277355 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.277342    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-3b812d\"/\"kube-root-ca.crt\""
Sep 08 14:13:43.297849 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.297830    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"]
Sep 08 14:13:43.427147 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.427123    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e37aa37f-562a-4c4f-b398-3743c8569ee7-tls-certs\") pod \"explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw\" (UID: \"e37aa37f-562a-4c4f-b398-3743c8569ee7\") " pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"
Sep 08 14:13:43.427299 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.427161    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e37aa37f-562a-4c4f-b398-3743c8569ee7-dshm\") pod \"explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw\" (UID: \"e37aa37f-562a-4c4f-b398-3743c8569ee7\") " pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"
Sep 08 14:13:43.427299 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.427198    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2hvn\" (UniqueName: \"kubernetes.io/projected/e37aa37f-562a-4c4f-b398-3743c8569ee7-kube-api-access-r2hvn\") pod \"explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw\" (UID: \"e37aa37f-562a-4c4f-b398-3743c8569ee7\") " pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"
Sep 08 14:13:43.427299 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.427287    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e37aa37f-562a-4c4f-b398-3743c8569ee7-home\") pod \"explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw\" (UID: \"e37aa37f-562a-4c4f-b398-3743c8569ee7\") " pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"
Sep 08 14:13:43.427455 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.427340    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e37aa37f-562a-4c4f-b398-3743c8569ee7-model-cache\") pod \"explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw\" (UID: \"e37aa37f-562a-4c4f-b398-3743c8569ee7\") " pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"
Sep 08 14:13:43.427455 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.427376    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e37aa37f-562a-4c4f-b398-3743c8569ee7-tmp-dir\") pod \"explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw\" (UID: \"e37aa37f-562a-4c4f-b398-3743c8569ee7\") " pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"
Sep 08 14:13:43.528310 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.528220    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e37aa37f-562a-4c4f-b398-3743c8569ee7-dshm\") pod \"explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw\" (UID: \"e37aa37f-562a-4c4f-b398-3743c8569ee7\") " pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"
Sep 08 14:13:43.528310 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.528284    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2hvn\" (UniqueName: \"kubernetes.io/projected/e37aa37f-562a-4c4f-b398-3743c8569ee7-kube-api-access-r2hvn\") pod \"explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw\" (UID: \"e37aa37f-562a-4c4f-b398-3743c8569ee7\") " pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"
Sep 08 14:13:43.528505 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.528343    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e37aa37f-562a-4c4f-b398-3743c8569ee7-home\") pod \"explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw\" (UID: \"e37aa37f-562a-4c4f-b398-3743c8569ee7\") " pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"
Sep 08 14:13:43.528505 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.528386    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e37aa37f-562a-4c4f-b398-3743c8569ee7-model-cache\") pod \"explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw\" (UID: \"e37aa37f-562a-4c4f-b398-3743c8569ee7\") " pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"
Sep 08 14:13:43.528505 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.528417    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e37aa37f-562a-4c4f-b398-3743c8569ee7-tmp-dir\") pod \"explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw\" (UID: \"e37aa37f-562a-4c4f-b398-3743c8569ee7\") " pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"
Sep 08 14:13:43.528505 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.528474    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e37aa37f-562a-4c4f-b398-3743c8569ee7-tls-certs\") pod \"explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw\" (UID: \"e37aa37f-562a-4c4f-b398-3743c8569ee7\") " pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"
Sep 08 14:13:43.528808 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.528782    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e37aa37f-562a-4c4f-b398-3743c8569ee7-home\") pod \"explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw\" (UID: \"e37aa37f-562a-4c4f-b398-3743c8569ee7\") " pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"
Sep 08 14:13:43.528890 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.528821    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e37aa37f-562a-4c4f-b398-3743c8569ee7-model-cache\") pod \"explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw\" (UID: \"e37aa37f-562a-4c4f-b398-3743c8569ee7\") " pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"
Sep 08 14:13:43.528890 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.528839    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e37aa37f-562a-4c4f-b398-3743c8569ee7-tmp-dir\") pod \"explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw\" (UID: \"e37aa37f-562a-4c4f-b398-3743c8569ee7\") " pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"
Sep 08 14:13:43.531011 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.530988    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e37aa37f-562a-4c4f-b398-3743c8569ee7-dshm\") pod \"explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw\" (UID: \"e37aa37f-562a-4c4f-b398-3743c8569ee7\") " pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"
Sep 08 14:13:43.531011 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.531004    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e37aa37f-562a-4c4f-b398-3743c8569ee7-tls-certs\") pod \"explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw\" (UID: \"e37aa37f-562a-4c4f-b398-3743c8569ee7\") " pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"
Sep 08 14:13:43.543801 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.543776    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2hvn\" (UniqueName: \"kubernetes.io/projected/e37aa37f-562a-4c4f-b398-3743c8569ee7-kube-api-access-r2hvn\") pod \"explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw\" (UID: \"e37aa37f-562a-4c4f-b398-3743c8569ee7\") " pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"
Sep 08 14:13:43.582969 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.582943    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"
Sep 08 14:13:43.864852 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.864820    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"]
Sep 08 14:13:43.866404 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:13:43.866376    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode37aa37f_562a_4c4f_b398_3743c8569ee7.slice/crio-0abee099da7b7db058fdb656dbb7ff38359711a69cfaea557438d454824ada42 WatchSource:0}: Error finding container 0abee099da7b7db058fdb656dbb7ff38359711a69cfaea557438d454824ada42: Status 404 returned error can't find the container with id 0abee099da7b7db058fdb656dbb7ff38359711a69cfaea557438d454824ada42
Sep 08 14:13:43.953901 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.953868    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw" event={"ID":"e37aa37f-562a-4c4f-b398-3743c8569ee7","Type":"ContainerStarted","Data":"e0a0409fa5a0ebb1a315a3a76a03e1edd65dfd498de4c11773cc588e1b4274c9"}
Sep 08 14:13:43.954040 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.953915    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw" event={"ID":"e37aa37f-562a-4c4f-b398-3743c8569ee7","Type":"ContainerStarted","Data":"0abee099da7b7db058fdb656dbb7ff38359711a69cfaea557438d454824ada42"}
Sep 08 14:13:43.980512 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:43.980462    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw" podStartSLOduration=0.980447331 podStartE2EDuration="980.447331ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:13:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:13:43.980103228 +0000 UTC m=+899.469820279" watchObservedRunningTime="2026-09-08 14:13:43.980447331 +0000 UTC m=+899.470164382"
Sep 08 14:13:44.161571 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:44.161499    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:13:44.583698 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:44.583663    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"
Sep 08 14:13:47.737380 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:47.737347    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt"]
Sep 08 14:13:47.742046 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:47.742027    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt"
Sep 08 14:13:47.745379 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:47.745358    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-a47a1a97-serving-cert\""
Sep 08 14:13:47.763859 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:47.763834    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt"]
Sep 08 14:13:47.872502 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:47.872473    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7wvf\" (UniqueName: \"kubernetes.io/projected/b955c0c9-68a4-4b08-9879-db934ea5c28d-kube-api-access-p7wvf\") pod \"maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt\" (UID: \"b955c0c9-68a4-4b08-9879-db934ea5c28d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt"
Sep 08 14:13:47.872643 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:47.872535    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b955c0c9-68a4-4b08-9879-db934ea5c28d-metrics-certs\") pod \"maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt\" (UID: \"b955c0c9-68a4-4b08-9879-db934ea5c28d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt"
Sep 08 14:13:47.872643 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:47.872565    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b955c0c9-68a4-4b08-9879-db934ea5c28d-openshift-service-ca\") pod \"maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt\" (UID: \"b955c0c9-68a4-4b08-9879-db934ea5c28d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt"
Sep 08 14:13:47.872643 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:47.872594    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b955c0c9-68a4-4b08-9879-db934ea5c28d-maas-api-tls\") pod \"maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt\" (UID: \"b955c0c9-68a4-4b08-9879-db934ea5c28d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt"
Sep 08 14:13:47.973824 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:47.973783    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b955c0c9-68a4-4b08-9879-db934ea5c28d-openshift-service-ca\") pod \"maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt\" (UID: \"b955c0c9-68a4-4b08-9879-db934ea5c28d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt"
Sep 08 14:13:47.974018 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:47.973843    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b955c0c9-68a4-4b08-9879-db934ea5c28d-maas-api-tls\") pod \"maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt\" (UID: \"b955c0c9-68a4-4b08-9879-db934ea5c28d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt"
Sep 08 14:13:47.974018 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:47.973896    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7wvf\" (UniqueName: \"kubernetes.io/projected/b955c0c9-68a4-4b08-9879-db934ea5c28d-kube-api-access-p7wvf\") pod \"maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt\" (UID: \"b955c0c9-68a4-4b08-9879-db934ea5c28d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt"
Sep 08 14:13:47.974018 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:47.973966    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b955c0c9-68a4-4b08-9879-db934ea5c28d-metrics-certs\") pod \"maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt\" (UID: \"b955c0c9-68a4-4b08-9879-db934ea5c28d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt"
Sep 08 14:13:47.974517 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:47.974483    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b955c0c9-68a4-4b08-9879-db934ea5c28d-openshift-service-ca\") pod \"maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt\" (UID: \"b955c0c9-68a4-4b08-9879-db934ea5c28d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt"
Sep 08 14:13:47.976542 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:47.976521    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b955c0c9-68a4-4b08-9879-db934ea5c28d-metrics-certs\") pod \"maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt\" (UID: \"b955c0c9-68a4-4b08-9879-db934ea5c28d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt"
Sep 08 14:13:47.976632 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:47.976568    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b955c0c9-68a4-4b08-9879-db934ea5c28d-maas-api-tls\") pod \"maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt\" (UID: \"b955c0c9-68a4-4b08-9879-db934ea5c28d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt"
Sep 08 14:13:47.982431 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:47.982411    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7wvf\" (UniqueName: \"kubernetes.io/projected/b955c0c9-68a4-4b08-9879-db934ea5c28d-kube-api-access-p7wvf\") pod \"maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt\" (UID: \"b955c0c9-68a4-4b08-9879-db934ea5c28d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt"
Sep 08 14:13:48.052685 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:48.052605    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt"
Sep 08 14:13:48.330016 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:48.329990    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt"]
Sep 08 14:13:48.331388 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:13:48.331358    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb955c0c9_68a4_4b08_9879_db934ea5c28d.slice/crio-5fe5a5325cd8eb0e9ddc406a377b09553c3f7c90288b054e244f43aa3e37e17e WatchSource:0}: Error finding container 5fe5a5325cd8eb0e9ddc406a377b09553c3f7c90288b054e244f43aa3e37e17e: Status 404 returned error can't find the container with id 5fe5a5325cd8eb0e9ddc406a377b09553c3f7c90288b054e244f43aa3e37e17e
Sep 08 14:13:48.988913 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:48.988838    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt" event={"ID":"b955c0c9-68a4-4b08-9879-db934ea5c28d","Type":"ContainerStarted","Data":"f41ce0352525b505fa1e7916a261bbe503779402f6ce5faf225ea81e1aef59f7"}
Sep 08 14:13:48.988913 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:48.988888    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt" event={"ID":"b955c0c9-68a4-4b08-9879-db934ea5c28d","Type":"ContainerStarted","Data":"5fe5a5325cd8eb0e9ddc406a377b09553c3f7c90288b054e244f43aa3e37e17e"}
Sep 08 14:13:48.989334 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:48.988932    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt"
Sep 08 14:13:49.022272 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:49.022221    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt" podStartSLOduration=1.675257687 podStartE2EDuration="2.022207749s" totalImagesPullingTime="346.950062ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:13:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:13:49.020755875 +0000 UTC m=+904.510472928" watchObservedRunningTime="2026-09-08 14:13:49.022207749 +0000 UTC m=+904.511924800"
Sep 08 14:13:53.583228 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:53.583194    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"
Sep 08 14:13:53.595714 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:53.595691    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"
Sep 08 14:13:54.026507 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:54.026413    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"
Sep 08 14:13:55.001681 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:13:55.001652    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt"
Sep 08 14:14:02.271156 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:02.271118    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"]
Sep 08 14:14:07.676862 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:07.676804    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:14:13.483782 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:13.483747    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p"]
Sep 08 14:14:13.484305 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:13.483932    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p" podUID="7220d2e3-7580-4b77-8f85-7a40191bb07c" containerName="maas-api" containerID="cri-o://e861e57e6ff63066c267dbdc03f86f13c6b12ac7a9b87cd0b335b03b3e3ca730" gracePeriod=30
Sep 08 14:14:13.745142 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:13.745081    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p"
Sep 08 14:14:13.821511 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:13.821481    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7220d2e3-7580-4b77-8f85-7a40191bb07c-openshift-service-ca\") pod \"7220d2e3-7580-4b77-8f85-7a40191bb07c\" (UID: \"7220d2e3-7580-4b77-8f85-7a40191bb07c\") "
Sep 08 14:14:13.821687 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:13.821518    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7220d2e3-7580-4b77-8f85-7a40191bb07c-maas-api-tls\") pod \"7220d2e3-7580-4b77-8f85-7a40191bb07c\" (UID: \"7220d2e3-7580-4b77-8f85-7a40191bb07c\") "
Sep 08 14:14:13.821687 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:13.821572    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drflz\" (UniqueName: \"kubernetes.io/projected/7220d2e3-7580-4b77-8f85-7a40191bb07c-kube-api-access-drflz\") pod \"7220d2e3-7580-4b77-8f85-7a40191bb07c\" (UID: \"7220d2e3-7580-4b77-8f85-7a40191bb07c\") "
Sep 08 14:14:13.821687 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:13.821618    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7220d2e3-7580-4b77-8f85-7a40191bb07c-metrics-certs\") pod \"7220d2e3-7580-4b77-8f85-7a40191bb07c\" (UID: \"7220d2e3-7580-4b77-8f85-7a40191bb07c\") "
Sep 08 14:14:13.821936 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:13.821911    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7220d2e3-7580-4b77-8f85-7a40191bb07c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7220d2e3-7580-4b77-8f85-7a40191bb07c" (UID: "7220d2e3-7580-4b77-8f85-7a40191bb07c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:14:13.823901 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:13.823870    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7220d2e3-7580-4b77-8f85-7a40191bb07c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7220d2e3-7580-4b77-8f85-7a40191bb07c" (UID: "7220d2e3-7580-4b77-8f85-7a40191bb07c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:14:13.824008 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:13.823909    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7220d2e3-7580-4b77-8f85-7a40191bb07c-kube-api-access-drflz" (OuterVolumeSpecName: "kube-api-access-drflz") pod "7220d2e3-7580-4b77-8f85-7a40191bb07c" (UID: "7220d2e3-7580-4b77-8f85-7a40191bb07c"). InnerVolumeSpecName "kube-api-access-drflz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:14:13.824008 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:13.823919    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7220d2e3-7580-4b77-8f85-7a40191bb07c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7220d2e3-7580-4b77-8f85-7a40191bb07c" (UID: "7220d2e3-7580-4b77-8f85-7a40191bb07c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:14:13.922879 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:13.922847    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7220d2e3-7580-4b77-8f85-7a40191bb07c-openshift-service-ca\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:14:13.922879 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:13.922875    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7220d2e3-7580-4b77-8f85-7a40191bb07c-maas-api-tls\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:14:13.922879 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:13.922885    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drflz\" (UniqueName: \"kubernetes.io/projected/7220d2e3-7580-4b77-8f85-7a40191bb07c-kube-api-access-drflz\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:14:13.923109 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:13.922893    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7220d2e3-7580-4b77-8f85-7a40191bb07c-metrics-certs\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:14:14.136178 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:14.136144    2575 generic.go:356] "Generic (PLEG): container finished" podID="7220d2e3-7580-4b77-8f85-7a40191bb07c" containerID="e861e57e6ff63066c267dbdc03f86f13c6b12ac7a9b87cd0b335b03b3e3ca730" exitCode=0
Sep 08 14:14:14.136345 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:14.136184    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p"
Sep 08 14:14:14.136345 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:14.136233    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p" event={"ID":"7220d2e3-7580-4b77-8f85-7a40191bb07c","Type":"ContainerDied","Data":"e861e57e6ff63066c267dbdc03f86f13c6b12ac7a9b87cd0b335b03b3e3ca730"}
Sep 08 14:14:14.136345 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:14.136283    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p" event={"ID":"7220d2e3-7580-4b77-8f85-7a40191bb07c","Type":"ContainerDied","Data":"e01affaee489a685f02e42b189baf618a2f6cd4b09ad1fa16b989bbc129b2ddc"}
Sep 08 14:14:14.136345 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:14.136308    2575 scope.go:117] "RemoveContainer" containerID="e861e57e6ff63066c267dbdc03f86f13c6b12ac7a9b87cd0b335b03b3e3ca730"
Sep 08 14:14:14.146957 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:14.146875    2575 scope.go:117] "RemoveContainer" containerID="e861e57e6ff63066c267dbdc03f86f13c6b12ac7a9b87cd0b335b03b3e3ca730"
Sep 08 14:14:14.147990 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:14:14.147920    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e861e57e6ff63066c267dbdc03f86f13c6b12ac7a9b87cd0b335b03b3e3ca730\": container with ID starting with e861e57e6ff63066c267dbdc03f86f13c6b12ac7a9b87cd0b335b03b3e3ca730 not found: ID does not exist" containerID="e861e57e6ff63066c267dbdc03f86f13c6b12ac7a9b87cd0b335b03b3e3ca730"
Sep 08 14:14:14.147990 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:14.147955    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e861e57e6ff63066c267dbdc03f86f13c6b12ac7a9b87cd0b335b03b3e3ca730"} err="failed to get container status \"e861e57e6ff63066c267dbdc03f86f13c6b12ac7a9b87cd0b335b03b3e3ca730\": rpc error: code = NotFound desc = could not find container \"e861e57e6ff63066c267dbdc03f86f13c6b12ac7a9b87cd0b335b03b3e3ca730\": container with ID starting with e861e57e6ff63066c267dbdc03f86f13c6b12ac7a9b87cd0b335b03b3e3ca730 not found: ID does not exist"
Sep 08 14:14:14.163332 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:14.163306    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p"]
Sep 08 14:14:14.167760 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:14.167741    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-3b812d-7ff95c8685-2tt7p"]
Sep 08 14:14:14.974886 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:14.974853    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7220d2e3-7580-4b77-8f85-7a40191bb07c" path="/var/lib/kubelet/pods/7220d2e3-7580-4b77-8f85-7a40191bb07c/volumes"
Sep 08 14:14:17.292203 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:17.292162    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw" podUID="e37aa37f-562a-4c4f-b398-3743c8569ee7" containerName="main" containerID="cri-o://e0a0409fa5a0ebb1a315a3a76a03e1edd65dfd498de4c11773cc588e1b4274c9" gracePeriod=45
Sep 08 14:14:17.546680 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:17.546623    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"
Sep 08 14:14:17.655158 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:17.655126    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e37aa37f-562a-4c4f-b398-3743c8569ee7-tls-certs\") pod \"e37aa37f-562a-4c4f-b398-3743c8569ee7\" (UID: \"e37aa37f-562a-4c4f-b398-3743c8569ee7\") "
Sep 08 14:14:17.655344 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:17.655220    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e37aa37f-562a-4c4f-b398-3743c8569ee7-tmp-dir\") pod \"e37aa37f-562a-4c4f-b398-3743c8569ee7\" (UID: \"e37aa37f-562a-4c4f-b398-3743c8569ee7\") "
Sep 08 14:14:17.655344 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:17.655266    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e37aa37f-562a-4c4f-b398-3743c8569ee7-home\") pod \"e37aa37f-562a-4c4f-b398-3743c8569ee7\" (UID: \"e37aa37f-562a-4c4f-b398-3743c8569ee7\") "
Sep 08 14:14:17.655344 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:17.655297    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e37aa37f-562a-4c4f-b398-3743c8569ee7-model-cache\") pod \"e37aa37f-562a-4c4f-b398-3743c8569ee7\" (UID: \"e37aa37f-562a-4c4f-b398-3743c8569ee7\") "
Sep 08 14:14:17.655524 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:17.655361    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e37aa37f-562a-4c4f-b398-3743c8569ee7-dshm\") pod \"e37aa37f-562a-4c4f-b398-3743c8569ee7\" (UID: \"e37aa37f-562a-4c4f-b398-3743c8569ee7\") "
Sep 08 14:14:17.655524 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:17.655397    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2hvn\" (UniqueName: \"kubernetes.io/projected/e37aa37f-562a-4c4f-b398-3743c8569ee7-kube-api-access-r2hvn\") pod \"e37aa37f-562a-4c4f-b398-3743c8569ee7\" (UID: \"e37aa37f-562a-4c4f-b398-3743c8569ee7\") "
Sep 08 14:14:17.655631 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:17.655528    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e37aa37f-562a-4c4f-b398-3743c8569ee7-home" (OuterVolumeSpecName: "home") pod "e37aa37f-562a-4c4f-b398-3743c8569ee7" (UID: "e37aa37f-562a-4c4f-b398-3743c8569ee7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:14:17.655631 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:17.655542    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e37aa37f-562a-4c4f-b398-3743c8569ee7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e37aa37f-562a-4c4f-b398-3743c8569ee7" (UID: "e37aa37f-562a-4c4f-b398-3743c8569ee7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:14:17.655631 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:17.655571    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e37aa37f-562a-4c4f-b398-3743c8569ee7-model-cache" (OuterVolumeSpecName: "model-cache") pod "e37aa37f-562a-4c4f-b398-3743c8569ee7" (UID: "e37aa37f-562a-4c4f-b398-3743c8569ee7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:14:17.656108 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:17.656087    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e37aa37f-562a-4c4f-b398-3743c8569ee7-tmp-dir\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:14:17.656215 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:17.656110    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e37aa37f-562a-4c4f-b398-3743c8569ee7-home\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:14:17.656215 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:17.656123    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e37aa37f-562a-4c4f-b398-3743c8569ee7-model-cache\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:14:17.657729 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:17.657707    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e37aa37f-562a-4c4f-b398-3743c8569ee7-dshm" (OuterVolumeSpecName: "dshm") pod "e37aa37f-562a-4c4f-b398-3743c8569ee7" (UID: "e37aa37f-562a-4c4f-b398-3743c8569ee7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:14:17.657816 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:17.657755    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e37aa37f-562a-4c4f-b398-3743c8569ee7-kube-api-access-r2hvn" (OuterVolumeSpecName: "kube-api-access-r2hvn") pod "e37aa37f-562a-4c4f-b398-3743c8569ee7" (UID: "e37aa37f-562a-4c4f-b398-3743c8569ee7"). InnerVolumeSpecName "kube-api-access-r2hvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:14:17.657816 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:17.657805    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e37aa37f-562a-4c4f-b398-3743c8569ee7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e37aa37f-562a-4c4f-b398-3743c8569ee7" (UID: "e37aa37f-562a-4c4f-b398-3743c8569ee7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:14:17.757445 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:17.757421    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e37aa37f-562a-4c4f-b398-3743c8569ee7-dshm\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:14:17.757445 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:17.757442    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2hvn\" (UniqueName: \"kubernetes.io/projected/e37aa37f-562a-4c4f-b398-3743c8569ee7-kube-api-access-r2hvn\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:14:17.757589 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:17.757453    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e37aa37f-562a-4c4f-b398-3743c8569ee7-tls-certs\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:14:18.162886 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:18.162848    2575 generic.go:356] "Generic (PLEG): container finished" podID="e37aa37f-562a-4c4f-b398-3743c8569ee7" containerID="e0a0409fa5a0ebb1a315a3a76a03e1edd65dfd498de4c11773cc588e1b4274c9" exitCode=0
Sep 08 14:14:18.163103 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:18.162889    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"
Sep 08 14:14:18.163103 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:18.162926    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw" event={"ID":"e37aa37f-562a-4c4f-b398-3743c8569ee7","Type":"ContainerDied","Data":"e0a0409fa5a0ebb1a315a3a76a03e1edd65dfd498de4c11773cc588e1b4274c9"}
Sep 08 14:14:18.163103 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:18.162965    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw" event={"ID":"e37aa37f-562a-4c4f-b398-3743c8569ee7","Type":"ContainerDied","Data":"0abee099da7b7db058fdb656dbb7ff38359711a69cfaea557438d454824ada42"}
Sep 08 14:14:18.163103 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:18.162981    2575 scope.go:117] "RemoveContainer" containerID="e0a0409fa5a0ebb1a315a3a76a03e1edd65dfd498de4c11773cc588e1b4274c9"
Sep 08 14:14:18.172837 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:18.172821    2575 scope.go:117] "RemoveContainer" containerID="e0a0409fa5a0ebb1a315a3a76a03e1edd65dfd498de4c11773cc588e1b4274c9"
Sep 08 14:14:18.173151 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:14:18.173132    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0a0409fa5a0ebb1a315a3a76a03e1edd65dfd498de4c11773cc588e1b4274c9\": container with ID starting with e0a0409fa5a0ebb1a315a3a76a03e1edd65dfd498de4c11773cc588e1b4274c9 not found: ID does not exist" containerID="e0a0409fa5a0ebb1a315a3a76a03e1edd65dfd498de4c11773cc588e1b4274c9"
Sep 08 14:14:18.173219 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:18.173159    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0a0409fa5a0ebb1a315a3a76a03e1edd65dfd498de4c11773cc588e1b4274c9"} err="failed to get container status \"e0a0409fa5a0ebb1a315a3a76a03e1edd65dfd498de4c11773cc588e1b4274c9\": rpc error: code = NotFound desc = could not find container \"e0a0409fa5a0ebb1a315a3a76a03e1edd65dfd498de4c11773cc588e1b4274c9\": container with ID starting with e0a0409fa5a0ebb1a315a3a76a03e1edd65dfd498de4c11773cc588e1b4274c9 not found: ID does not exist"
Sep 08 14:14:18.187185 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:18.187152    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"]
Sep 08 14:14:18.189356 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:18.189333    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-3b812d/explicit-model-3b812d-kserve-64c5f7d6f4-fz4sw"]
Sep 08 14:14:18.974537 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:18.974504    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e37aa37f-562a-4c4f-b398-3743c8569ee7" path="/var/lib/kubelet/pods/e37aa37f-562a-4c4f-b398-3743c8569ee7/volumes"
Sep 08 14:14:24.599863 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.599828    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"]
Sep 08 14:14:24.600240 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.600229    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e37aa37f-562a-4c4f-b398-3743c8569ee7" containerName="main"
Sep 08 14:14:24.600287 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.600241    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e37aa37f-562a-4c4f-b398-3743c8569ee7" containerName="main"
Sep 08 14:14:24.600287 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.600264    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7220d2e3-7580-4b77-8f85-7a40191bb07c" containerName="maas-api"
Sep 08 14:14:24.600287 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.600270    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7220d2e3-7580-4b77-8f85-7a40191bb07c" containerName="maas-api"
Sep 08 14:14:24.600384 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.600332    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e37aa37f-562a-4c4f-b398-3743c8569ee7" containerName="main"
Sep 08 14:14:24.600384 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.600341    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7220d2e3-7580-4b77-8f85-7a40191bb07c" containerName="maas-api"
Sep 08 14:14:24.604801 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.604782    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:24.613417 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.613387    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-3b082b-openshift-default-dockercfg-pxps9\""
Sep 08 14:14:24.652417 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.652384    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"]
Sep 08 14:14:24.722376 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.722347    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11bc4903-e9ad-4919-9754-60c985079e2e-istiod-ca-cert\") pod \"e2e-noten-3b082b-openshift-default-8476bc975d-f9r95\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") " pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:24.722533 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.722389    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11bc4903-e9ad-4919-9754-60c985079e2e-workload-socket\") pod \"e2e-noten-3b082b-openshift-default-8476bc975d-f9r95\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") " pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:24.722533 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.722426    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11bc4903-e9ad-4919-9754-60c985079e2e-istio-data\") pod \"e2e-noten-3b082b-openshift-default-8476bc975d-f9r95\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") " pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:24.722533 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.722453    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmtrm\" (UniqueName: \"kubernetes.io/projected/11bc4903-e9ad-4919-9754-60c985079e2e-kube-api-access-pmtrm\") pod \"e2e-noten-3b082b-openshift-default-8476bc975d-f9r95\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") " pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:24.722533 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.722483    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11bc4903-e9ad-4919-9754-60c985079e2e-istio-token\") pod \"e2e-noten-3b082b-openshift-default-8476bc975d-f9r95\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") " pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:24.722671 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.722586    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11bc4903-e9ad-4919-9754-60c985079e2e-istio-envoy\") pod \"e2e-noten-3b082b-openshift-default-8476bc975d-f9r95\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") " pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:24.722671 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.722619    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11bc4903-e9ad-4919-9754-60c985079e2e-credential-socket\") pod \"e2e-noten-3b082b-openshift-default-8476bc975d-f9r95\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") " pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:24.722671 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.722643    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11bc4903-e9ad-4919-9754-60c985079e2e-workload-certs\") pod \"e2e-noten-3b082b-openshift-default-8476bc975d-f9r95\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") " pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:24.722766 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.722669    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11bc4903-e9ad-4919-9754-60c985079e2e-istio-podinfo\") pod \"e2e-noten-3b082b-openshift-default-8476bc975d-f9r95\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") " pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:24.823467 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.823433    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11bc4903-e9ad-4919-9754-60c985079e2e-istio-envoy\") pod \"e2e-noten-3b082b-openshift-default-8476bc975d-f9r95\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") " pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:24.823467 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.823472    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11bc4903-e9ad-4919-9754-60c985079e2e-credential-socket\") pod \"e2e-noten-3b082b-openshift-default-8476bc975d-f9r95\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") " pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:24.823719 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.823488    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11bc4903-e9ad-4919-9754-60c985079e2e-workload-certs\") pod \"e2e-noten-3b082b-openshift-default-8476bc975d-f9r95\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") " pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:24.823719 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.823505    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11bc4903-e9ad-4919-9754-60c985079e2e-istio-podinfo\") pod \"e2e-noten-3b082b-openshift-default-8476bc975d-f9r95\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") " pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:24.823719 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.823538    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11bc4903-e9ad-4919-9754-60c985079e2e-istiod-ca-cert\") pod \"e2e-noten-3b082b-openshift-default-8476bc975d-f9r95\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") " pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:24.823719 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.823579    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11bc4903-e9ad-4919-9754-60c985079e2e-workload-socket\") pod \"e2e-noten-3b082b-openshift-default-8476bc975d-f9r95\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") " pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:24.823719 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.823618    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11bc4903-e9ad-4919-9754-60c985079e2e-istio-data\") pod \"e2e-noten-3b082b-openshift-default-8476bc975d-f9r95\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") " pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:24.823719 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.823650    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmtrm\" (UniqueName: \"kubernetes.io/projected/11bc4903-e9ad-4919-9754-60c985079e2e-kube-api-access-pmtrm\") pod \"e2e-noten-3b082b-openshift-default-8476bc975d-f9r95\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") " pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:24.823719 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.823701    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11bc4903-e9ad-4919-9754-60c985079e2e-istio-token\") pod \"e2e-noten-3b082b-openshift-default-8476bc975d-f9r95\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") " pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:24.824107 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.823948    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11bc4903-e9ad-4919-9754-60c985079e2e-credential-socket\") pod \"e2e-noten-3b082b-openshift-default-8476bc975d-f9r95\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") " pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:24.824107 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.823956    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11bc4903-e9ad-4919-9754-60c985079e2e-workload-certs\") pod \"e2e-noten-3b082b-openshift-default-8476bc975d-f9r95\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") " pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:24.824107 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.824089    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11bc4903-e9ad-4919-9754-60c985079e2e-workload-socket\") pod \"e2e-noten-3b082b-openshift-default-8476bc975d-f9r95\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") " pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:24.824373 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.824355    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11bc4903-e9ad-4919-9754-60c985079e2e-istio-data\") pod \"e2e-noten-3b082b-openshift-default-8476bc975d-f9r95\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") " pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:24.824620 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.824597    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11bc4903-e9ad-4919-9754-60c985079e2e-istiod-ca-cert\") pod \"e2e-noten-3b082b-openshift-default-8476bc975d-f9r95\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") " pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:24.825953 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.825930    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11bc4903-e9ad-4919-9754-60c985079e2e-istio-envoy\") pod \"e2e-noten-3b082b-openshift-default-8476bc975d-f9r95\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") " pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:24.826210 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.826192    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11bc4903-e9ad-4919-9754-60c985079e2e-istio-podinfo\") pod \"e2e-noten-3b082b-openshift-default-8476bc975d-f9r95\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") " pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:24.843294 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.843267    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11bc4903-e9ad-4919-9754-60c985079e2e-istio-token\") pod \"e2e-noten-3b082b-openshift-default-8476bc975d-f9r95\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") " pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:24.845333 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.845316    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmtrm\" (UniqueName: \"kubernetes.io/projected/11bc4903-e9ad-4919-9754-60c985079e2e-kube-api-access-pmtrm\") pod \"e2e-noten-3b082b-openshift-default-8476bc975d-f9r95\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") " pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:24.920630 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:24.920561    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:25.216297 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:25.216270    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"]
Sep 08 14:14:25.216937 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:14:25.216915    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11bc4903_e9ad_4919_9754_60c985079e2e.slice/crio-44bf5ccb7c3625354b7b69cb3e6d178b291caa48cb8aadcdca0cd52b4add3d53 WatchSource:0}: Error finding container 44bf5ccb7c3625354b7b69cb3e6d178b291caa48cb8aadcdca0cd52b4add3d53: Status 404 returned error can't find the container with id 44bf5ccb7c3625354b7b69cb3e6d178b291caa48cb8aadcdca0cd52b4add3d53
Sep 08 14:14:25.218999 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:25.218968    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:14:25.219121 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:25.219037    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:14:25.219121 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:25.219099    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:14:26.213401 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:26.213354    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95" event={"ID":"11bc4903-e9ad-4919-9754-60c985079e2e","Type":"ContainerStarted","Data":"558df0653559927f832c2cc091d0c4d2643aff1d79fc91c83e3f958945289b26"}
Sep 08 14:14:26.213853 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:26.213421    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95" event={"ID":"11bc4903-e9ad-4919-9754-60c985079e2e","Type":"ContainerStarted","Data":"44bf5ccb7c3625354b7b69cb3e6d178b291caa48cb8aadcdca0cd52b4add3d53"}
Sep 08 14:14:26.257282 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:26.257238    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95" podStartSLOduration=2.257222392 podStartE2EDuration="2.257222392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:14:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:14:26.253650317 +0000 UTC m=+941.743367368" watchObservedRunningTime="2026-09-08 14:14:26.257222392 +0000 UTC m=+941.746939498"
Sep 08 14:14:26.921759 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:26.921724    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:26.927598 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:26.927575    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:27.220348 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:27.220261    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:27.221310 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:27.221292    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:31.755880 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:31.755841    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt"]
Sep 08 14:14:31.756280 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:31.756097    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt" podUID="b955c0c9-68a4-4b08-9879-db934ea5c28d" containerName="maas-api" containerID="cri-o://f41ce0352525b505fa1e7916a261bbe503779402f6ce5faf225ea81e1aef59f7" gracePeriod=30
Sep 08 14:14:31.976176 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:31.976147    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:14:32.014098 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:32.014006    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt"
Sep 08 14:14:32.191474 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:32.191448    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b955c0c9-68a4-4b08-9879-db934ea5c28d-maas-api-tls\") pod \"b955c0c9-68a4-4b08-9879-db934ea5c28d\" (UID: \"b955c0c9-68a4-4b08-9879-db934ea5c28d\") "
Sep 08 14:14:32.191639 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:32.191501    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b955c0c9-68a4-4b08-9879-db934ea5c28d-openshift-service-ca\") pod \"b955c0c9-68a4-4b08-9879-db934ea5c28d\" (UID: \"b955c0c9-68a4-4b08-9879-db934ea5c28d\") "
Sep 08 14:14:32.191639 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:32.191528    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7wvf\" (UniqueName: \"kubernetes.io/projected/b955c0c9-68a4-4b08-9879-db934ea5c28d-kube-api-access-p7wvf\") pod \"b955c0c9-68a4-4b08-9879-db934ea5c28d\" (UID: \"b955c0c9-68a4-4b08-9879-db934ea5c28d\") "
Sep 08 14:14:32.191639 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:32.191577    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b955c0c9-68a4-4b08-9879-db934ea5c28d-metrics-certs\") pod \"b955c0c9-68a4-4b08-9879-db934ea5c28d\" (UID: \"b955c0c9-68a4-4b08-9879-db934ea5c28d\") "
Sep 08 14:14:32.191881 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:32.191847    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b955c0c9-68a4-4b08-9879-db934ea5c28d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b955c0c9-68a4-4b08-9879-db934ea5c28d" (UID: "b955c0c9-68a4-4b08-9879-db934ea5c28d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:14:32.193698 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:32.193672    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b955c0c9-68a4-4b08-9879-db934ea5c28d-kube-api-access-p7wvf" (OuterVolumeSpecName: "kube-api-access-p7wvf") pod "b955c0c9-68a4-4b08-9879-db934ea5c28d" (UID: "b955c0c9-68a4-4b08-9879-db934ea5c28d"). InnerVolumeSpecName "kube-api-access-p7wvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:14:32.193793 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:32.193706    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b955c0c9-68a4-4b08-9879-db934ea5c28d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b955c0c9-68a4-4b08-9879-db934ea5c28d" (UID: "b955c0c9-68a4-4b08-9879-db934ea5c28d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:14:32.193793 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:32.193744    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b955c0c9-68a4-4b08-9879-db934ea5c28d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b955c0c9-68a4-4b08-9879-db934ea5c28d" (UID: "b955c0c9-68a4-4b08-9879-db934ea5c28d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:14:32.249515 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:32.249486    2575 generic.go:356] "Generic (PLEG): container finished" podID="b955c0c9-68a4-4b08-9879-db934ea5c28d" containerID="f41ce0352525b505fa1e7916a261bbe503779402f6ce5faf225ea81e1aef59f7" exitCode=0
Sep 08 14:14:32.249635 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:32.249538    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt" event={"ID":"b955c0c9-68a4-4b08-9879-db934ea5c28d","Type":"ContainerDied","Data":"f41ce0352525b505fa1e7916a261bbe503779402f6ce5faf225ea81e1aef59f7"}
Sep 08 14:14:32.249635 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:32.249593    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt" event={"ID":"b955c0c9-68a4-4b08-9879-db934ea5c28d","Type":"ContainerDied","Data":"5fe5a5325cd8eb0e9ddc406a377b09553c3f7c90288b054e244f43aa3e37e17e"}
Sep 08 14:14:32.249635 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:32.249538    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt"
Sep 08 14:14:32.249635 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:32.249623    2575 scope.go:117] "RemoveContainer" containerID="f41ce0352525b505fa1e7916a261bbe503779402f6ce5faf225ea81e1aef59f7"
Sep 08 14:14:32.259266 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:32.259246    2575 scope.go:117] "RemoveContainer" containerID="f41ce0352525b505fa1e7916a261bbe503779402f6ce5faf225ea81e1aef59f7"
Sep 08 14:14:32.259545 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:14:32.259525    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f41ce0352525b505fa1e7916a261bbe503779402f6ce5faf225ea81e1aef59f7\": container with ID starting with f41ce0352525b505fa1e7916a261bbe503779402f6ce5faf225ea81e1aef59f7 not found: ID does not exist" containerID="f41ce0352525b505fa1e7916a261bbe503779402f6ce5faf225ea81e1aef59f7"
Sep 08 14:14:32.259615 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:32.259558    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f41ce0352525b505fa1e7916a261bbe503779402f6ce5faf225ea81e1aef59f7"} err="failed to get container status \"f41ce0352525b505fa1e7916a261bbe503779402f6ce5faf225ea81e1aef59f7\": rpc error: code = NotFound desc = could not find container \"f41ce0352525b505fa1e7916a261bbe503779402f6ce5faf225ea81e1aef59f7\": container with ID starting with f41ce0352525b505fa1e7916a261bbe503779402f6ce5faf225ea81e1aef59f7 not found: ID does not exist"
Sep 08 14:14:32.290154 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:32.290098    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt"]
Sep 08 14:14:32.292948 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:32.292930    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b955c0c9-68a4-4b08-9879-db934ea5c28d-openshift-service-ca\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:14:32.293010 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:32.292951    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7wvf\" (UniqueName: \"kubernetes.io/projected/b955c0c9-68a4-4b08-9879-db934ea5c28d-kube-api-access-p7wvf\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:14:32.293010 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:32.292962    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b955c0c9-68a4-4b08-9879-db934ea5c28d-metrics-certs\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:14:32.293010 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:32.292970    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b955c0c9-68a4-4b08-9879-db934ea5c28d-maas-api-tls\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:14:32.299009 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:32.298991    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a47a1a97-8665cf7f4f-xnjqt"]
Sep 08 14:14:32.984237 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:32.984196    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b955c0c9-68a4-4b08-9879-db934ea5c28d" path="/var/lib/kubelet/pods/b955c0c9-68a4-4b08-9879-db934ea5c28d/volumes"
Sep 08 14:14:34.611700 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:34.611654    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh"]
Sep 08 14:14:34.612291 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:34.612272    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b955c0c9-68a4-4b08-9879-db934ea5c28d" containerName="maas-api"
Sep 08 14:14:34.612379 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:34.612293    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b955c0c9-68a4-4b08-9879-db934ea5c28d" containerName="maas-api"
Sep 08 14:14:34.612434 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:34.612415    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b955c0c9-68a4-4b08-9879-db934ea5c28d" containerName="maas-api"
Sep 08 14:14:34.616911 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:34.616889    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh"
Sep 08 14:14:34.619431 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:34.619412    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-3b082b\"/\"kube-root-ca.crt\""
Sep 08 14:14:34.619515 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:34.619434    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-3b082b\"/\"openshift-service-ca.crt\""
Sep 08 14:14:34.620383 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:34.620365    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-3b082b\"/\"default-dockercfg-ml9h9\""
Sep 08 14:14:34.620469 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:34.620412    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-3b082b\"/\"noten-model-3b082b-kserve-self-signed-certs\""
Sep 08 14:14:34.625125 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:34.625107    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh"]
Sep 08 14:14:34.714643 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:34.714608    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-tls-certs\") pod \"noten-model-3b082b-kserve-8567cbf7d4-rf6dh\" (UID: \"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa\") " pod="ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh"
Sep 08 14:14:34.714643 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:34.714647    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4d5v\" (UniqueName: \"kubernetes.io/projected/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-kube-api-access-v4d5v\") pod \"noten-model-3b082b-kserve-8567cbf7d4-rf6dh\" (UID: \"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa\") " pod="ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh"
Sep 08 14:14:34.714877 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:34.714674    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-home\") pod \"noten-model-3b082b-kserve-8567cbf7d4-rf6dh\" (UID: \"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa\") " pod="ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh"
Sep 08 14:14:34.714877 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:34.714712    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-dshm\") pod \"noten-model-3b082b-kserve-8567cbf7d4-rf6dh\" (UID: \"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa\") " pod="ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh"
Sep 08 14:14:34.714877 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:34.714791    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-tmp-dir\") pod \"noten-model-3b082b-kserve-8567cbf7d4-rf6dh\" (UID: \"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa\") " pod="ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh"
Sep 08 14:14:34.714877 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:34.714850    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-model-cache\") pod \"noten-model-3b082b-kserve-8567cbf7d4-rf6dh\" (UID: \"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa\") " pod="ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh"
Sep 08 14:14:34.815386 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:34.815354    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-tmp-dir\") pod \"noten-model-3b082b-kserve-8567cbf7d4-rf6dh\" (UID: \"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa\") " pod="ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh"
Sep 08 14:14:34.815551 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:34.815397    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-model-cache\") pod \"noten-model-3b082b-kserve-8567cbf7d4-rf6dh\" (UID: \"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa\") " pod="ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh"
Sep 08 14:14:34.815551 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:34.815421    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-tls-certs\") pod \"noten-model-3b082b-kserve-8567cbf7d4-rf6dh\" (UID: \"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa\") " pod="ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh"
Sep 08 14:14:34.815668 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:34.815544    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4d5v\" (UniqueName: \"kubernetes.io/projected/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-kube-api-access-v4d5v\") pod \"noten-model-3b082b-kserve-8567cbf7d4-rf6dh\" (UID: \"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa\") " pod="ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh"
Sep 08 14:14:34.815668 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:34.815592    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-home\") pod \"noten-model-3b082b-kserve-8567cbf7d4-rf6dh\" (UID: \"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa\") " pod="ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh"
Sep 08 14:14:34.815668 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:34.815633    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-dshm\") pod \"noten-model-3b082b-kserve-8567cbf7d4-rf6dh\" (UID: \"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa\") " pod="ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh"
Sep 08 14:14:34.815813 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:34.815786    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-tmp-dir\") pod \"noten-model-3b082b-kserve-8567cbf7d4-rf6dh\" (UID: \"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa\") " pod="ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh"
Sep 08 14:14:34.815813 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:34.815804    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-model-cache\") pod \"noten-model-3b082b-kserve-8567cbf7d4-rf6dh\" (UID: \"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa\") " pod="ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh"
Sep 08 14:14:34.815971 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:34.815953    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-home\") pod \"noten-model-3b082b-kserve-8567cbf7d4-rf6dh\" (UID: \"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa\") " pod="ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh"
Sep 08 14:14:34.817900 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:34.817881    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-dshm\") pod \"noten-model-3b082b-kserve-8567cbf7d4-rf6dh\" (UID: \"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa\") " pod="ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh"
Sep 08 14:14:34.818124 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:34.818104    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-tls-certs\") pod \"noten-model-3b082b-kserve-8567cbf7d4-rf6dh\" (UID: \"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa\") " pod="ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh"
Sep 08 14:14:34.825438 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:34.825417    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4d5v\" (UniqueName: \"kubernetes.io/projected/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-kube-api-access-v4d5v\") pod \"noten-model-3b082b-kserve-8567cbf7d4-rf6dh\" (UID: \"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa\") " pod="ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh"
Sep 08 14:14:34.927294 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:34.927227    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh"
Sep 08 14:14:35.203473 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:35.203449    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh"]
Sep 08 14:14:35.206311 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:14:35.206284    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddad46bdd_26aa_41b1_be6d_3fac9c86bdaa.slice/crio-3fb2a7a4191932cd942972f2435d76d6155bdc073ed8cc629ab64915ede29247 WatchSource:0}: Error finding container 3fb2a7a4191932cd942972f2435d76d6155bdc073ed8cc629ab64915ede29247: Status 404 returned error can't find the container with id 3fb2a7a4191932cd942972f2435d76d6155bdc073ed8cc629ab64915ede29247
Sep 08 14:14:35.268438 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:35.268406    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh" event={"ID":"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa","Type":"ContainerStarted","Data":"3fb2a7a4191932cd942972f2435d76d6155bdc073ed8cc629ab64915ede29247"}
Sep 08 14:14:36.275474 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:36.275440    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh" event={"ID":"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa","Type":"ContainerStarted","Data":"019995c620a616263ab17f902000640d48e7bd1b1ed08bc0e7403c26d182cd3a"}
Sep 08 14:14:36.298467 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:36.298422    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh" podStartSLOduration=2.298407087 podStartE2EDuration="2.298407087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:14:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:14:36.296442398 +0000 UTC m=+951.786159461" watchObservedRunningTime="2026-09-08 14:14:36.298407087 +0000 UTC m=+951.788124144"
Sep 08 14:14:36.927394 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:36.927353    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh"
Sep 08 14:14:41.282117 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:41.282083    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh"]
Sep 08 14:14:41.388552 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:41.388520    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"]
Sep 08 14:14:41.388772 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:41.388725    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95" podUID="11bc4903-e9ad-4919-9754-60c985079e2e" containerName="istio-proxy" containerID="cri-o://558df0653559927f832c2cc091d0c4d2643aff1d79fc91c83e3f958945289b26" gracePeriod=30
Sep 08 14:14:42.222574 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:42.222535    2575 patch_prober.go:28] interesting pod/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 14:14:42.222751 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:42.222596    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95" podUID="11bc4903-e9ad-4919-9754-60c985079e2e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 14:14:46.645593 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:46.645561    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:46.732890 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:46.732820    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11bc4903-e9ad-4919-9754-60c985079e2e-workload-socket\") pod \"11bc4903-e9ad-4919-9754-60c985079e2e\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") "
Sep 08 14:14:46.732890 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:46.732888    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11bc4903-e9ad-4919-9754-60c985079e2e-istio-envoy\") pod \"11bc4903-e9ad-4919-9754-60c985079e2e\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") "
Sep 08 14:14:46.733113 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:46.732913    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmtrm\" (UniqueName: \"kubernetes.io/projected/11bc4903-e9ad-4919-9754-60c985079e2e-kube-api-access-pmtrm\") pod \"11bc4903-e9ad-4919-9754-60c985079e2e\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") "
Sep 08 14:14:46.733113 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:46.732986    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11bc4903-e9ad-4919-9754-60c985079e2e-istio-podinfo\") pod \"11bc4903-e9ad-4919-9754-60c985079e2e\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") "
Sep 08 14:14:46.733113 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:46.733014    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11bc4903-e9ad-4919-9754-60c985079e2e-credential-socket\") pod \"11bc4903-e9ad-4919-9754-60c985079e2e\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") "
Sep 08 14:14:46.733113 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:46.733037    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11bc4903-e9ad-4919-9754-60c985079e2e-workload-certs\") pod \"11bc4903-e9ad-4919-9754-60c985079e2e\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") "
Sep 08 14:14:46.733342 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:46.733113    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11bc4903-e9ad-4919-9754-60c985079e2e-istio-token\") pod \"11bc4903-e9ad-4919-9754-60c985079e2e\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") "
Sep 08 14:14:46.733342 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:46.733147    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11bc4903-e9ad-4919-9754-60c985079e2e-istio-data\") pod \"11bc4903-e9ad-4919-9754-60c985079e2e\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") "
Sep 08 14:14:46.733342 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:46.733152    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11bc4903-e9ad-4919-9754-60c985079e2e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "11bc4903-e9ad-4919-9754-60c985079e2e" (UID: "11bc4903-e9ad-4919-9754-60c985079e2e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:14:46.733342 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:46.733192    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11bc4903-e9ad-4919-9754-60c985079e2e-istiod-ca-cert\") pod \"11bc4903-e9ad-4919-9754-60c985079e2e\" (UID: \"11bc4903-e9ad-4919-9754-60c985079e2e\") "
Sep 08 14:14:46.733550 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:46.733369    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11bc4903-e9ad-4919-9754-60c985079e2e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "11bc4903-e9ad-4919-9754-60c985079e2e" (UID: "11bc4903-e9ad-4919-9754-60c985079e2e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:14:46.733550 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:46.733493    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11bc4903-e9ad-4919-9754-60c985079e2e-istio-data" (OuterVolumeSpecName: "istio-data") pod "11bc4903-e9ad-4919-9754-60c985079e2e" (UID: "11bc4903-e9ad-4919-9754-60c985079e2e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:14:46.733550 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:46.733540    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11bc4903-e9ad-4919-9754-60c985079e2e-workload-certs\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:14:46.733736 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:46.733560    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11bc4903-e9ad-4919-9754-60c985079e2e-workload-socket\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:14:46.733736 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:46.733601    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11bc4903-e9ad-4919-9754-60c985079e2e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "11bc4903-e9ad-4919-9754-60c985079e2e" (UID: "11bc4903-e9ad-4919-9754-60c985079e2e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:14:46.733889 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:46.733855    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11bc4903-e9ad-4919-9754-60c985079e2e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "11bc4903-e9ad-4919-9754-60c985079e2e" (UID: "11bc4903-e9ad-4919-9754-60c985079e2e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:14:46.735417 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:46.735389    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/11bc4903-e9ad-4919-9754-60c985079e2e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "11bc4903-e9ad-4919-9754-60c985079e2e" (UID: "11bc4903-e9ad-4919-9754-60c985079e2e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:14:46.735417 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:46.735396    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11bc4903-e9ad-4919-9754-60c985079e2e-kube-api-access-pmtrm" (OuterVolumeSpecName: "kube-api-access-pmtrm") pod "11bc4903-e9ad-4919-9754-60c985079e2e" (UID: "11bc4903-e9ad-4919-9754-60c985079e2e"). InnerVolumeSpecName "kube-api-access-pmtrm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:14:46.735417 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:46.735403    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11bc4903-e9ad-4919-9754-60c985079e2e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "11bc4903-e9ad-4919-9754-60c985079e2e" (UID: "11bc4903-e9ad-4919-9754-60c985079e2e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:14:46.735576 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:46.735483    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11bc4903-e9ad-4919-9754-60c985079e2e-istio-token" (OuterVolumeSpecName: "istio-token") pod "11bc4903-e9ad-4919-9754-60c985079e2e" (UID: "11bc4903-e9ad-4919-9754-60c985079e2e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:14:46.834488 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:46.834465    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11bc4903-e9ad-4919-9754-60c985079e2e-istio-data\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:14:46.834488 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:46.834485    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11bc4903-e9ad-4919-9754-60c985079e2e-istiod-ca-cert\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:14:46.834606 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:46.834493    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11bc4903-e9ad-4919-9754-60c985079e2e-istio-envoy\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:14:46.834606 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:46.834501    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmtrm\" (UniqueName: \"kubernetes.io/projected/11bc4903-e9ad-4919-9754-60c985079e2e-kube-api-access-pmtrm\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:14:46.834606 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:46.834509    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11bc4903-e9ad-4919-9754-60c985079e2e-istio-podinfo\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:14:46.834606 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:46.834517    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11bc4903-e9ad-4919-9754-60c985079e2e-credential-socket\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:14:46.834606 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:46.834526    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11bc4903-e9ad-4919-9754-60c985079e2e-istio-token\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:14:47.339726 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:47.339695    2575 generic.go:356] "Generic (PLEG): container finished" podID="11bc4903-e9ad-4919-9754-60c985079e2e" containerID="558df0653559927f832c2cc091d0c4d2643aff1d79fc91c83e3f958945289b26" exitCode=0
Sep 08 14:14:47.339886 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:47.339748    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"
Sep 08 14:14:47.339886 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:47.339774    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95" event={"ID":"11bc4903-e9ad-4919-9754-60c985079e2e","Type":"ContainerDied","Data":"558df0653559927f832c2cc091d0c4d2643aff1d79fc91c83e3f958945289b26"}
Sep 08 14:14:47.339886 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:47.339827    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95" event={"ID":"11bc4903-e9ad-4919-9754-60c985079e2e","Type":"ContainerDied","Data":"44bf5ccb7c3625354b7b69cb3e6d178b291caa48cb8aadcdca0cd52b4add3d53"}
Sep 08 14:14:47.339886 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:47.339850    2575 scope.go:117] "RemoveContainer" containerID="558df0653559927f832c2cc091d0c4d2643aff1d79fc91c83e3f958945289b26"
Sep 08 14:14:47.353117 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:47.352242    2575 scope.go:117] "RemoveContainer" containerID="558df0653559927f832c2cc091d0c4d2643aff1d79fc91c83e3f958945289b26"
Sep 08 14:14:47.355692 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:14:47.355661    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"558df0653559927f832c2cc091d0c4d2643aff1d79fc91c83e3f958945289b26\": container with ID starting with 558df0653559927f832c2cc091d0c4d2643aff1d79fc91c83e3f958945289b26 not found: ID does not exist" containerID="558df0653559927f832c2cc091d0c4d2643aff1d79fc91c83e3f958945289b26"
Sep 08 14:14:47.355783 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:47.355701    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"558df0653559927f832c2cc091d0c4d2643aff1d79fc91c83e3f958945289b26"} err="failed to get container status \"558df0653559927f832c2cc091d0c4d2643aff1d79fc91c83e3f958945289b26\": rpc error: code = NotFound desc = could not find container \"558df0653559927f832c2cc091d0c4d2643aff1d79fc91c83e3f958945289b26\": container with ID starting with 558df0653559927f832c2cc091d0c4d2643aff1d79fc91c83e3f958945289b26 not found: ID does not exist"
Sep 08 14:14:47.366140 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:47.366118    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"]
Sep 08 14:14:47.369125 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:47.369105    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-3b082b-openshift-default-8476bc975d-f9r95"]
Sep 08 14:14:48.974783 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:48.974751    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11bc4903-e9ad-4919-9754-60c985079e2e" path="/var/lib/kubelet/pods/11bc4903-e9ad-4919-9754-60c985079e2e/volumes"
Sep 08 14:14:53.789268 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:53.789232    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:14:56.302015 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.301957    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh" podUID="dad46bdd-26aa-41b1-be6d-3fac9c86bdaa" containerName="main" containerID="cri-o://019995c620a616263ab17f902000640d48e7bd1b1ed08bc0e7403c26d182cd3a" gracePeriod=45
Sep 08 14:14:56.337986 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.337955    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"]
Sep 08 14:14:56.338427 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.338409    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11bc4903-e9ad-4919-9754-60c985079e2e" containerName="istio-proxy"
Sep 08 14:14:56.338515 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.338429    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="11bc4903-e9ad-4919-9754-60c985079e2e" containerName="istio-proxy"
Sep 08 14:14:56.338572 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.338559    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="11bc4903-e9ad-4919-9754-60c985079e2e" containerName="istio-proxy"
Sep 08 14:14:56.341532 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.341512    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:56.344718 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.344695    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-2bcb20-openshift-default-dockercfg-hqk5l\""
Sep 08 14:14:56.359164 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.359143    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"]
Sep 08 14:14:56.418778 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.418746    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7040c2e-9fc6-4bf8-85af-649fff2674b8-istio-podinfo\") pod \"e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") " pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:56.418960 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.418816    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7040c2e-9fc6-4bf8-85af-649fff2674b8-istio-data\") pod \"e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") " pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:56.418960 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.418850    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7040c2e-9fc6-4bf8-85af-649fff2674b8-istio-envoy\") pod \"e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") " pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:56.418960 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.418884    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7040c2e-9fc6-4bf8-85af-649fff2674b8-istio-token\") pod \"e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") " pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:56.418960 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.418929    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7040c2e-9fc6-4bf8-85af-649fff2674b8-istiod-ca-cert\") pod \"e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") " pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:56.419200 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.418964    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7040c2e-9fc6-4bf8-85af-649fff2674b8-credential-socket\") pod \"e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") " pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:56.419200 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.419038    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5f4s\" (UniqueName: \"kubernetes.io/projected/e7040c2e-9fc6-4bf8-85af-649fff2674b8-kube-api-access-w5f4s\") pod \"e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") " pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:56.419200 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.419095    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7040c2e-9fc6-4bf8-85af-649fff2674b8-workload-certs\") pod \"e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") " pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:56.419200 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.419160    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7040c2e-9fc6-4bf8-85af-649fff2674b8-workload-socket\") pod \"e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") " pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:56.519679 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.519651    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7040c2e-9fc6-4bf8-85af-649fff2674b8-istio-token\") pod \"e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") " pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:56.519861 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.519697    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7040c2e-9fc6-4bf8-85af-649fff2674b8-istiod-ca-cert\") pod \"e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") " pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:56.519861 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.519721    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7040c2e-9fc6-4bf8-85af-649fff2674b8-credential-socket\") pod \"e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") " pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:56.519861 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.519765    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5f4s\" (UniqueName: \"kubernetes.io/projected/e7040c2e-9fc6-4bf8-85af-649fff2674b8-kube-api-access-w5f4s\") pod \"e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") " pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:56.519861 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.519789    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7040c2e-9fc6-4bf8-85af-649fff2674b8-workload-certs\") pod \"e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") " pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:56.519861 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.519826    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7040c2e-9fc6-4bf8-85af-649fff2674b8-workload-socket\") pod \"e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") " pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:56.519861 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.519844    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7040c2e-9fc6-4bf8-85af-649fff2674b8-istio-podinfo\") pod \"e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") " pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:56.520219 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.519874    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7040c2e-9fc6-4bf8-85af-649fff2674b8-istio-data\") pod \"e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") " pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:56.520219 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.519893    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7040c2e-9fc6-4bf8-85af-649fff2674b8-istio-envoy\") pod \"e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") " pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:56.520383 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.520358    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7040c2e-9fc6-4bf8-85af-649fff2674b8-workload-socket\") pod \"e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") " pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:56.520453 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.520404    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7040c2e-9fc6-4bf8-85af-649fff2674b8-istio-data\") pod \"e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") " pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:56.520453 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.520430    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7040c2e-9fc6-4bf8-85af-649fff2674b8-workload-certs\") pod \"e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") " pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:56.520564 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.520502    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7040c2e-9fc6-4bf8-85af-649fff2674b8-istiod-ca-cert\") pod \"e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") " pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:56.520629 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.520609    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7040c2e-9fc6-4bf8-85af-649fff2674b8-credential-socket\") pod \"e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") " pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:56.522411 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.522389    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7040c2e-9fc6-4bf8-85af-649fff2674b8-istio-envoy\") pod \"e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") " pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:56.522898 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.522880    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7040c2e-9fc6-4bf8-85af-649fff2674b8-istio-podinfo\") pod \"e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") " pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:56.533245 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.533225    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7040c2e-9fc6-4bf8-85af-649fff2674b8-istio-token\") pod \"e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") " pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:56.536169 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.536148    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5f4s\" (UniqueName: \"kubernetes.io/projected/e7040c2e-9fc6-4bf8-85af-649fff2674b8-kube-api-access-w5f4s\") pod \"e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") " pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:56.564115 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.564094    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh"
Sep 08 14:14:56.620853 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.620828    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-model-cache\") pod \"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa\" (UID: \"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa\") "
Sep 08 14:14:56.620987 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.620862    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-home\") pod \"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa\" (UID: \"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa\") "
Sep 08 14:14:56.620987 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.620898    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-dshm\") pod \"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa\" (UID: \"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa\") "
Sep 08 14:14:56.620987 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.620931    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4d5v\" (UniqueName: \"kubernetes.io/projected/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-kube-api-access-v4d5v\") pod \"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa\" (UID: \"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa\") "
Sep 08 14:14:56.620987 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.620959    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-tmp-dir\") pod \"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa\" (UID: \"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa\") "
Sep 08 14:14:56.621219 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.620995    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-tls-certs\") pod \"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa\" (UID: \"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa\") "
Sep 08 14:14:56.621219 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.621146    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-model-cache" (OuterVolumeSpecName: "model-cache") pod "dad46bdd-26aa-41b1-be6d-3fac9c86bdaa" (UID: "dad46bdd-26aa-41b1-be6d-3fac9c86bdaa"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:14:56.621219 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.621155    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-home" (OuterVolumeSpecName: "home") pod "dad46bdd-26aa-41b1-be6d-3fac9c86bdaa" (UID: "dad46bdd-26aa-41b1-be6d-3fac9c86bdaa"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:14:56.621369 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.621270    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dad46bdd-26aa-41b1-be6d-3fac9c86bdaa" (UID: "dad46bdd-26aa-41b1-be6d-3fac9c86bdaa"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:14:56.621426 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.621414    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-home\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:14:56.621481 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.621431    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-tmp-dir\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:14:56.621481 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.621446    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-model-cache\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:14:56.623288 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.623269    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-dshm" (OuterVolumeSpecName: "dshm") pod "dad46bdd-26aa-41b1-be6d-3fac9c86bdaa" (UID: "dad46bdd-26aa-41b1-be6d-3fac9c86bdaa"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:14:56.623406 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.623387    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dad46bdd-26aa-41b1-be6d-3fac9c86bdaa" (UID: "dad46bdd-26aa-41b1-be6d-3fac9c86bdaa"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:14:56.623406 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.623390    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-kube-api-access-v4d5v" (OuterVolumeSpecName: "kube-api-access-v4d5v") pod "dad46bdd-26aa-41b1-be6d-3fac9c86bdaa" (UID: "dad46bdd-26aa-41b1-be6d-3fac9c86bdaa"). InnerVolumeSpecName "kube-api-access-v4d5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:14:56.701974 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.701937    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:56.722282 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.722259    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4d5v\" (UniqueName: \"kubernetes.io/projected/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-kube-api-access-v4d5v\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:14:56.722377 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.722285    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-tls-certs\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:14:56.722377 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.722296    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa-dshm\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:14:56.981914 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.981886    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"]
Sep 08 14:14:56.984003 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:14:56.983973    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7040c2e_9fc6_4bf8_85af_649fff2674b8.slice/crio-644ee416cc115f69ddcf41079fe1770ad0881a898e66b473aae5872dfa4e437a WatchSource:0}: Error finding container 644ee416cc115f69ddcf41079fe1770ad0881a898e66b473aae5872dfa4e437a: Status 404 returned error can't find the container with id 644ee416cc115f69ddcf41079fe1770ad0881a898e66b473aae5872dfa4e437a
Sep 08 14:14:56.986261 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.986230    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:14:56.986339 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.986292    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:14:56.986339 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:56.986318    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:14:57.404262 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:57.404221    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l" event={"ID":"e7040c2e-9fc6-4bf8-85af-649fff2674b8","Type":"ContainerStarted","Data":"0d74f6d15bca283f2209ab92d380b726bce1898d457169646cc57353959aef49"}
Sep 08 14:14:57.404707 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:57.404281    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l" event={"ID":"e7040c2e-9fc6-4bf8-85af-649fff2674b8","Type":"ContainerStarted","Data":"644ee416cc115f69ddcf41079fe1770ad0881a898e66b473aae5872dfa4e437a"}
Sep 08 14:14:57.405583 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:57.405554    2575 generic.go:356] "Generic (PLEG): container finished" podID="dad46bdd-26aa-41b1-be6d-3fac9c86bdaa" containerID="019995c620a616263ab17f902000640d48e7bd1b1ed08bc0e7403c26d182cd3a" exitCode=0
Sep 08 14:14:57.405665 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:57.405596    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh"
Sep 08 14:14:57.405665 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:57.405617    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh" event={"ID":"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa","Type":"ContainerDied","Data":"019995c620a616263ab17f902000640d48e7bd1b1ed08bc0e7403c26d182cd3a"}
Sep 08 14:14:57.405665 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:57.405650    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh" event={"ID":"dad46bdd-26aa-41b1-be6d-3fac9c86bdaa","Type":"ContainerDied","Data":"3fb2a7a4191932cd942972f2435d76d6155bdc073ed8cc629ab64915ede29247"}
Sep 08 14:14:57.405778 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:57.405672    2575 scope.go:117] "RemoveContainer" containerID="019995c620a616263ab17f902000640d48e7bd1b1ed08bc0e7403c26d182cd3a"
Sep 08 14:14:57.415461 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:57.415443    2575 scope.go:117] "RemoveContainer" containerID="019995c620a616263ab17f902000640d48e7bd1b1ed08bc0e7403c26d182cd3a"
Sep 08 14:14:57.415752 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:14:57.415722    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"019995c620a616263ab17f902000640d48e7bd1b1ed08bc0e7403c26d182cd3a\": container with ID starting with 019995c620a616263ab17f902000640d48e7bd1b1ed08bc0e7403c26d182cd3a not found: ID does not exist" containerID="019995c620a616263ab17f902000640d48e7bd1b1ed08bc0e7403c26d182cd3a"
Sep 08 14:14:57.415840 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:57.415757    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"019995c620a616263ab17f902000640d48e7bd1b1ed08bc0e7403c26d182cd3a"} err="failed to get container status \"019995c620a616263ab17f902000640d48e7bd1b1ed08bc0e7403c26d182cd3a\": rpc error: code = NotFound desc = could not find container \"019995c620a616263ab17f902000640d48e7bd1b1ed08bc0e7403c26d182cd3a\": container with ID starting with 019995c620a616263ab17f902000640d48e7bd1b1ed08bc0e7403c26d182cd3a not found: ID does not exist"
Sep 08 14:14:57.440229 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:57.440182    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l" podStartSLOduration=1.440166666 podStartE2EDuration="1.440166666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:14:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:14:57.437839475 +0000 UTC m=+972.927556528" watchObservedRunningTime="2026-09-08 14:14:57.440166666 +0000 UTC m=+972.929883715"
Sep 08 14:14:57.452664 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:57.452637    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh"]
Sep 08 14:14:57.461334 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:57.461309    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-3b082b/noten-model-3b082b-kserve-8567cbf7d4-rf6dh"]
Sep 08 14:14:57.702931 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:57.702843    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:58.707589 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:58.707560    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:58.974473 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:58.974400    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dad46bdd-26aa-41b1-be6d-3fac9c86bdaa" path="/var/lib/kubelet/pods/dad46bdd-26aa-41b1-be6d-3fac9c86bdaa/volumes"
Sep 08 14:14:59.418955 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:59.418925    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:14:59.419837 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:14:59.419821    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:15:00.217393 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:00.217360    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29814615-lgqxq"]
Sep 08 14:15:00.217811 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:00.217774    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dad46bdd-26aa-41b1-be6d-3fac9c86bdaa" containerName="main"
Sep 08 14:15:00.217811 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:00.217785    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="dad46bdd-26aa-41b1-be6d-3fac9c86bdaa" containerName="main"
Sep 08 14:15:00.217901 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:00.217854    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="dad46bdd-26aa-41b1-be6d-3fac9c86bdaa" containerName="main"
Sep 08 14:15:00.222010 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:00.221992    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814615-lgqxq"
Sep 08 14:15:00.224825 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:00.224802    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d2tr9\""
Sep 08 14:15:00.231434 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:00.231418    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814615-lgqxq"
Sep 08 14:15:00.243833 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:00.243805    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29814615-lgqxq"]
Sep 08 14:15:00.539165 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:00.539050    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29814615-lgqxq"]
Sep 08 14:15:00.542411 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:15:00.542375    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd1cec57_4ce6_4147_8558_da5d16319941.slice/crio-b414f6f5408b86f04368438a75e371fb3cca398bfe178678e438b511511ca498 WatchSource:0}: Error finding container b414f6f5408b86f04368438a75e371fb3cca398bfe178678e438b511511ca498: Status 404 returned error can't find the container with id b414f6f5408b86f04368438a75e371fb3cca398bfe178678e438b511511ca498
Sep 08 14:15:00.544364 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:00.544347    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 14:15:00.678927 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:00.678893    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6"]
Sep 08 14:15:00.683735 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:00.683711    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6"
Sep 08 14:15:00.698453 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:00.698429    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-2bcb20-serving-cert\""
Sep 08 14:15:00.730738 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:00.730708    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6"]
Sep 08 14:15:00.760071 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:00.760024    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94df20b9-0c66-494b-9020-5e8e4144dbbf-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6\" (UID: \"94df20b9-0c66-494b-9020-5e8e4144dbbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6"
Sep 08 14:15:00.760233 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:00.760111    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94df20b9-0c66-494b-9020-5e8e4144dbbf-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6\" (UID: \"94df20b9-0c66-494b-9020-5e8e4144dbbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6"
Sep 08 14:15:00.760279 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:00.760226    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94df20b9-0c66-494b-9020-5e8e4144dbbf-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6\" (UID: \"94df20b9-0c66-494b-9020-5e8e4144dbbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6"
Sep 08 14:15:00.760312 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:00.760304    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87lnc\" (UniqueName: \"kubernetes.io/projected/94df20b9-0c66-494b-9020-5e8e4144dbbf-kube-api-access-87lnc\") pod \"maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6\" (UID: \"94df20b9-0c66-494b-9020-5e8e4144dbbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6"
Sep 08 14:15:00.860963 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:00.860927    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94df20b9-0c66-494b-9020-5e8e4144dbbf-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6\" (UID: \"94df20b9-0c66-494b-9020-5e8e4144dbbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6"
Sep 08 14:15:00.861199 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:00.861013    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87lnc\" (UniqueName: \"kubernetes.io/projected/94df20b9-0c66-494b-9020-5e8e4144dbbf-kube-api-access-87lnc\") pod \"maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6\" (UID: \"94df20b9-0c66-494b-9020-5e8e4144dbbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6"
Sep 08 14:15:00.861199 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:00.861043    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94df20b9-0c66-494b-9020-5e8e4144dbbf-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6\" (UID: \"94df20b9-0c66-494b-9020-5e8e4144dbbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6"
Sep 08 14:15:00.861199 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:15:00.861105    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-serving-cert: secret "maas-api-e2e-shared-a-w2-2bcb20-serving-cert" not found
Sep 08 14:15:00.861199 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:00.861107    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94df20b9-0c66-494b-9020-5e8e4144dbbf-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6\" (UID: \"94df20b9-0c66-494b-9020-5e8e4144dbbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6"
Sep 08 14:15:00.861199 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:15:00.861178    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94df20b9-0c66-494b-9020-5e8e4144dbbf-maas-api-tls podName:94df20b9-0c66-494b-9020-5e8e4144dbbf nodeName:}" failed. No retries permitted until 2026-09-08 14:15:01.36115581 +0000 UTC m=+976.850872842 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/94df20b9-0c66-494b-9020-5e8e4144dbbf-maas-api-tls") pod "maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6" (UID: "94df20b9-0c66-494b-9020-5e8e4144dbbf") : secret "maas-api-e2e-shared-a-w2-2bcb20-serving-cert" not found
Sep 08 14:15:00.861798 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:00.861777    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94df20b9-0c66-494b-9020-5e8e4144dbbf-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6\" (UID: \"94df20b9-0c66-494b-9020-5e8e4144dbbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6"
Sep 08 14:15:00.863714 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:00.863691    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94df20b9-0c66-494b-9020-5e8e4144dbbf-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6\" (UID: \"94df20b9-0c66-494b-9020-5e8e4144dbbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6"
Sep 08 14:15:00.875404 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:00.875373    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87lnc\" (UniqueName: \"kubernetes.io/projected/94df20b9-0c66-494b-9020-5e8e4144dbbf-kube-api-access-87lnc\") pod \"maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6\" (UID: \"94df20b9-0c66-494b-9020-5e8e4144dbbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6"
Sep 08 14:15:01.366337 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:01.366296    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94df20b9-0c66-494b-9020-5e8e4144dbbf-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6\" (UID: \"94df20b9-0c66-494b-9020-5e8e4144dbbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6"
Sep 08 14:15:01.369326 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:01.369299    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94df20b9-0c66-494b-9020-5e8e4144dbbf-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6\" (UID: \"94df20b9-0c66-494b-9020-5e8e4144dbbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6"
Sep 08 14:15:01.430838 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:01.430802    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814615-lgqxq" event={"ID":"fd1cec57-4ce6-4147-8558-da5d16319941","Type":"ContainerStarted","Data":"b414f6f5408b86f04368438a75e371fb3cca398bfe178678e438b511511ca498"}
Sep 08 14:15:01.596414 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:01.596378    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6"
Sep 08 14:15:01.891787 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:01.891740    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6"]
Sep 08 14:15:01.896520 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:15:01.896487    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94df20b9_0c66_494b_9020_5e8e4144dbbf.slice/crio-06196fff9717e71cc2f0f6c895b3ec177314175ae5c9894a6701773cd8a5f9ea WatchSource:0}: Error finding container 06196fff9717e71cc2f0f6c895b3ec177314175ae5c9894a6701773cd8a5f9ea: Status 404 returned error can't find the container with id 06196fff9717e71cc2f0f6c895b3ec177314175ae5c9894a6701773cd8a5f9ea
Sep 08 14:15:02.440433 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:02.440392    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6" event={"ID":"94df20b9-0c66-494b-9020-5e8e4144dbbf","Type":"ContainerStarted","Data":"06196fff9717e71cc2f0f6c895b3ec177314175ae5c9894a6701773cd8a5f9ea"}
Sep 08 14:15:03.448311 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:03.448278    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6" event={"ID":"94df20b9-0c66-494b-9020-5e8e4144dbbf","Type":"ContainerStarted","Data":"dc33c0009f9f6495c429e00c81031e72b5bf1bce9ea11f83306f1990c1bfe56c"}
Sep 08 14:15:03.448792 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:03.448419    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6"
Sep 08 14:15:03.470618 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:03.470511    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6" podStartSLOduration=2.153051011 podStartE2EDuration="3.470490767s" totalImagesPullingTime="1.317439756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:15:03.466991497 +0000 UTC m=+978.956708577" watchObservedRunningTime="2026-09-08 14:15:03.470490767 +0000 UTC m=+978.960207820"
Sep 08 14:15:04.458367 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:04.458321    2575 generic.go:356] "Generic (PLEG): container finished" podID="fd1cec57-4ce6-4147-8558-da5d16319941" containerID="a8d6c5eccb27d3eda978737fd942a4d37beaee3610d8612f82468a1e34d2b1fa" exitCode=0
Sep 08 14:15:04.458996 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:04.458402    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814615-lgqxq" event={"ID":"fd1cec57-4ce6-4147-8558-da5d16319941","Type":"ContainerDied","Data":"a8d6c5eccb27d3eda978737fd942a4d37beaee3610d8612f82468a1e34d2b1fa"}
Sep 08 14:15:05.604868 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:05.604844    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814615-lgqxq"
Sep 08 14:15:06.472302 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:06.472225    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814615-lgqxq"
Sep 08 14:15:06.472302 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:06.472258    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814615-lgqxq" event={"ID":"fd1cec57-4ce6-4147-8558-da5d16319941","Type":"ContainerDied","Data":"b414f6f5408b86f04368438a75e371fb3cca398bfe178678e438b511511ca498"}
Sep 08 14:15:06.472484 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:06.472305    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b414f6f5408b86f04368438a75e371fb3cca398bfe178678e438b511511ca498"
Sep 08 14:15:09.464262 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:09.464233    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6"
Sep 08 14:15:12.478782 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:12.478748    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:15:20.023931 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:20.023893    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"]
Sep 08 14:15:22.587292 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:22.587208    2575 generic.go:356] "Generic (PLEG): container finished" podID="e7040c2e-9fc6-4bf8-85af-649fff2674b8" containerID="0d74f6d15bca283f2209ab92d380b726bce1898d457169646cc57353959aef49" exitCode=0
Sep 08 14:15:22.587686 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:22.587282    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l" event={"ID":"e7040c2e-9fc6-4bf8-85af-649fff2674b8","Type":"ContainerDied","Data":"0d74f6d15bca283f2209ab92d380b726bce1898d457169646cc57353959aef49"}
Sep 08 14:15:22.587686 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:22.587682    2575 scope.go:117] "RemoveContainer" containerID="0d74f6d15bca283f2209ab92d380b726bce1898d457169646cc57353959aef49"
Sep 08 14:15:22.588769 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:22.588742    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:15:22.588837 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:22.588811    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:15:22.588872 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:22.588842    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 14:15:23.595556 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:23.595525    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l" event={"ID":"e7040c2e-9fc6-4bf8-85af-649fff2674b8","Type":"ContainerStarted","Data":"55ba081e2250aae39956e68d05c5b2e2958ac972d6195b3668a37d4c79adf8b3"}
Sep 08 14:15:23.702896 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:23.702861    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:15:23.703092 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:23.703073    2575 patch_prober.go:28] interesting pod/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 08 14:15:23.703142 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:23.703115    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l" podUID="e7040c2e-9fc6-4bf8-85af-649fff2674b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 08 14:15:24.702634 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:24.702601    2575 patch_prober.go:28] interesting pod/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 08 14:15:24.703009 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:24.702649    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l" podUID="e7040c2e-9fc6-4bf8-85af-649fff2674b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 08 14:15:25.703199 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:25.703155    2575 patch_prober.go:28] interesting pod/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 08 14:15:25.703593 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:25.703216    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l" podUID="e7040c2e-9fc6-4bf8-85af-649fff2674b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 08 14:15:26.702647 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:26.702607    2575 patch_prober.go:28] interesting pod/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 08 14:15:26.702831 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:26.702681    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l" podUID="e7040c2e-9fc6-4bf8-85af-649fff2674b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 08 14:15:27.702262 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:27.702220    2575 patch_prober.go:28] interesting pod/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 08 14:15:27.702704 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:27.702278    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l" podUID="e7040c2e-9fc6-4bf8-85af-649fff2674b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 08 14:15:28.706282 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:28.706252    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:15:28.706821 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:28.706666    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:15:28.707391 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:28.707375    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:15:28.975341 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:28.975270    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:15:29.230361 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:29.230286    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf"]
Sep 08 14:15:29.230859 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:29.230843    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd1cec57-4ce6-4147-8558-da5d16319941" containerName="cleanup"
Sep 08 14:15:29.230908 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:29.230861    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd1cec57-4ce6-4147-8558-da5d16319941" containerName="cleanup"
Sep 08 14:15:29.230962 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:29.230953    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd1cec57-4ce6-4147-8558-da5d16319941" containerName="cleanup"
Sep 08 14:15:29.238643 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:29.238622    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf"
Sep 08 14:15:29.242286 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:29.242265    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-e2a04d-serving-cert\""
Sep 08 14:15:29.248705 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:29.248684    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf"]
Sep 08 14:15:29.344333 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:29.344301    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f062c99c-8ab2-4bea-b278-de688e0ffd78-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf\" (UID: \"f062c99c-8ab2-4bea-b278-de688e0ffd78\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf"
Sep 08 14:15:29.344528 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:29.344351    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25tmj\" (UniqueName: \"kubernetes.io/projected/f062c99c-8ab2-4bea-b278-de688e0ffd78-kube-api-access-25tmj\") pod \"maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf\" (UID: \"f062c99c-8ab2-4bea-b278-de688e0ffd78\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf"
Sep 08 14:15:29.344528 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:29.344427    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f062c99c-8ab2-4bea-b278-de688e0ffd78-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf\" (UID: \"f062c99c-8ab2-4bea-b278-de688e0ffd78\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf"
Sep 08 14:15:29.344528 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:29.344496    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f062c99c-8ab2-4bea-b278-de688e0ffd78-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf\" (UID: \"f062c99c-8ab2-4bea-b278-de688e0ffd78\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf"
Sep 08 14:15:29.445541 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:29.445511    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f062c99c-8ab2-4bea-b278-de688e0ffd78-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf\" (UID: \"f062c99c-8ab2-4bea-b278-de688e0ffd78\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf"
Sep 08 14:15:29.445730 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:29.445594    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f062c99c-8ab2-4bea-b278-de688e0ffd78-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf\" (UID: \"f062c99c-8ab2-4bea-b278-de688e0ffd78\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf"
Sep 08 14:15:29.445730 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:29.445616    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25tmj\" (UniqueName: \"kubernetes.io/projected/f062c99c-8ab2-4bea-b278-de688e0ffd78-kube-api-access-25tmj\") pod \"maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf\" (UID: \"f062c99c-8ab2-4bea-b278-de688e0ffd78\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf"
Sep 08 14:15:29.445730 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:29.445644    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f062c99c-8ab2-4bea-b278-de688e0ffd78-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf\" (UID: \"f062c99c-8ab2-4bea-b278-de688e0ffd78\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf"
Sep 08 14:15:29.446347 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:29.446325    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f062c99c-8ab2-4bea-b278-de688e0ffd78-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf\" (UID: \"f062c99c-8ab2-4bea-b278-de688e0ffd78\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf"
Sep 08 14:15:29.448237 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:29.448211    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f062c99c-8ab2-4bea-b278-de688e0ffd78-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf\" (UID: \"f062c99c-8ab2-4bea-b278-de688e0ffd78\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf"
Sep 08 14:15:29.448326 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:29.448277    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f062c99c-8ab2-4bea-b278-de688e0ffd78-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf\" (UID: \"f062c99c-8ab2-4bea-b278-de688e0ffd78\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf"
Sep 08 14:15:29.455655 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:29.455633    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25tmj\" (UniqueName: \"kubernetes.io/projected/f062c99c-8ab2-4bea-b278-de688e0ffd78-kube-api-access-25tmj\") pod \"maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf\" (UID: \"f062c99c-8ab2-4bea-b278-de688e0ffd78\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf"
Sep 08 14:15:29.554940 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:29.554839    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf"
Sep 08 14:15:29.842614 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:29.842582    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf"]
Sep 08 14:15:29.843764 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:15:29.843739    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf062c99c_8ab2_4bea_b278_de688e0ffd78.slice/crio-798c4ab0c79eb204c648abece2d17320548b398bafe2b8f9ab5be114c8f4719c WatchSource:0}: Error finding container 798c4ab0c79eb204c648abece2d17320548b398bafe2b8f9ab5be114c8f4719c: Status 404 returned error can't find the container with id 798c4ab0c79eb204c648abece2d17320548b398bafe2b8f9ab5be114c8f4719c
Sep 08 14:15:30.646546 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:30.646512    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf" event={"ID":"f062c99c-8ab2-4bea-b278-de688e0ffd78","Type":"ContainerStarted","Data":"37075677959d87538a9e084b1e64f32d63334df044fc6162bee0c83535d28895"}
Sep 08 14:15:30.646753 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:30.646569    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf" event={"ID":"f062c99c-8ab2-4bea-b278-de688e0ffd78","Type":"ContainerStarted","Data":"798c4ab0c79eb204c648abece2d17320548b398bafe2b8f9ab5be114c8f4719c"}
Sep 08 14:15:30.646865 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:30.646847    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf"
Sep 08 14:15:30.666829 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:30.666782    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf" podStartSLOduration=1.277815941 podStartE2EDuration="1.666766795s" totalImagesPullingTime="388.950854ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:15:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:15:30.66502761 +0000 UTC m=+1006.154744662" watchObservedRunningTime="2026-09-08 14:15:30.666766795 +0000 UTC m=+1006.156483846"
Sep 08 14:15:35.044436 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:35.044396    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t" podUID="f81854dd-ce0d-4152-8263-f4b486a905af" containerName="main" containerID="cri-o://225d80016be318a38d50c20496b0f112c81af4e74a826563d31d9357b1d5fec5" gracePeriod=45
Sep 08 14:15:35.301403 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:35.301350    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"
Sep 08 14:15:35.402356 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:35.402322    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f81854dd-ce0d-4152-8263-f4b486a905af-dshm\") pod \"f81854dd-ce0d-4152-8263-f4b486a905af\" (UID: \"f81854dd-ce0d-4152-8263-f4b486a905af\") "
Sep 08 14:15:35.402512 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:35.402373    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f81854dd-ce0d-4152-8263-f4b486a905af-tls-certs\") pod \"f81854dd-ce0d-4152-8263-f4b486a905af\" (UID: \"f81854dd-ce0d-4152-8263-f4b486a905af\") "
Sep 08 14:15:35.402512 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:35.402458    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f81854dd-ce0d-4152-8263-f4b486a905af-model-cache\") pod \"f81854dd-ce0d-4152-8263-f4b486a905af\" (UID: \"f81854dd-ce0d-4152-8263-f4b486a905af\") "
Sep 08 14:15:35.402586 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:35.402530    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f81854dd-ce0d-4152-8263-f4b486a905af-tmp-dir\") pod \"f81854dd-ce0d-4152-8263-f4b486a905af\" (UID: \"f81854dd-ce0d-4152-8263-f4b486a905af\") "
Sep 08 14:15:35.402634 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:35.402585    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vthcj\" (UniqueName: \"kubernetes.io/projected/f81854dd-ce0d-4152-8263-f4b486a905af-kube-api-access-vthcj\") pod \"f81854dd-ce0d-4152-8263-f4b486a905af\" (UID: \"f81854dd-ce0d-4152-8263-f4b486a905af\") "
Sep 08 14:15:35.402634 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:35.402616    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f81854dd-ce0d-4152-8263-f4b486a905af-home\") pod \"f81854dd-ce0d-4152-8263-f4b486a905af\" (UID: \"f81854dd-ce0d-4152-8263-f4b486a905af\") "
Sep 08 14:15:35.402735 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:35.402672    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f81854dd-ce0d-4152-8263-f4b486a905af-model-cache" (OuterVolumeSpecName: "model-cache") pod "f81854dd-ce0d-4152-8263-f4b486a905af" (UID: "f81854dd-ce0d-4152-8263-f4b486a905af"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:15:35.402808 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:35.402774    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f81854dd-ce0d-4152-8263-f4b486a905af-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f81854dd-ce0d-4152-8263-f4b486a905af" (UID: "f81854dd-ce0d-4152-8263-f4b486a905af"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:15:35.402944 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:35.402918    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f81854dd-ce0d-4152-8263-f4b486a905af-home" (OuterVolumeSpecName: "home") pod "f81854dd-ce0d-4152-8263-f4b486a905af" (UID: "f81854dd-ce0d-4152-8263-f4b486a905af"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:15:35.403170 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:35.402948    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f81854dd-ce0d-4152-8263-f4b486a905af-model-cache\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:15:35.403170 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:35.402989    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f81854dd-ce0d-4152-8263-f4b486a905af-tmp-dir\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:15:35.404841 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:35.404806    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f81854dd-ce0d-4152-8263-f4b486a905af-dshm" (OuterVolumeSpecName: "dshm") pod "f81854dd-ce0d-4152-8263-f4b486a905af" (UID: "f81854dd-ce0d-4152-8263-f4b486a905af"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:15:35.404950 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:35.404869    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f81854dd-ce0d-4152-8263-f4b486a905af-kube-api-access-vthcj" (OuterVolumeSpecName: "kube-api-access-vthcj") pod "f81854dd-ce0d-4152-8263-f4b486a905af" (UID: "f81854dd-ce0d-4152-8263-f4b486a905af"). InnerVolumeSpecName "kube-api-access-vthcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:15:35.404950 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:35.404904    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f81854dd-ce0d-4152-8263-f4b486a905af-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f81854dd-ce0d-4152-8263-f4b486a905af" (UID: "f81854dd-ce0d-4152-8263-f4b486a905af"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:15:35.503729 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:35.503697    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vthcj\" (UniqueName: \"kubernetes.io/projected/f81854dd-ce0d-4152-8263-f4b486a905af-kube-api-access-vthcj\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:15:35.503729 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:35.503722    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f81854dd-ce0d-4152-8263-f4b486a905af-home\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:15:35.503926 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:35.503740    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f81854dd-ce0d-4152-8263-f4b486a905af-dshm\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:15:35.503926 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:35.503753    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f81854dd-ce0d-4152-8263-f4b486a905af-tls-certs\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:15:35.676253 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:35.676221    2575 generic.go:356] "Generic (PLEG): container finished" podID="f81854dd-ce0d-4152-8263-f4b486a905af" containerID="225d80016be318a38d50c20496b0f112c81af4e74a826563d31d9357b1d5fec5" exitCode=0
Sep 08 14:15:35.676536 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:35.676260    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"
Sep 08 14:15:35.676536 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:35.676308    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t" event={"ID":"f81854dd-ce0d-4152-8263-f4b486a905af","Type":"ContainerDied","Data":"225d80016be318a38d50c20496b0f112c81af4e74a826563d31d9357b1d5fec5"}
Sep 08 14:15:35.676536 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:35.676366    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t" event={"ID":"f81854dd-ce0d-4152-8263-f4b486a905af","Type":"ContainerDied","Data":"d95d280188166401b8c4fa745bdd38f9c65cfdf1d3f746aba8c62af2afba77a2"}
Sep 08 14:15:35.676536 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:35.676390    2575 scope.go:117] "RemoveContainer" containerID="225d80016be318a38d50c20496b0f112c81af4e74a826563d31d9357b1d5fec5"
Sep 08 14:15:35.686232 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:35.686212    2575 scope.go:117] "RemoveContainer" containerID="225d80016be318a38d50c20496b0f112c81af4e74a826563d31d9357b1d5fec5"
Sep 08 14:15:35.686501 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:15:35.686483    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"225d80016be318a38d50c20496b0f112c81af4e74a826563d31d9357b1d5fec5\": container with ID starting with 225d80016be318a38d50c20496b0f112c81af4e74a826563d31d9357b1d5fec5 not found: ID does not exist" containerID="225d80016be318a38d50c20496b0f112c81af4e74a826563d31d9357b1d5fec5"
Sep 08 14:15:35.686554 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:35.686510    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"225d80016be318a38d50c20496b0f112c81af4e74a826563d31d9357b1d5fec5"} err="failed to get container status \"225d80016be318a38d50c20496b0f112c81af4e74a826563d31d9357b1d5fec5\": rpc error: code = NotFound desc = could not find container \"225d80016be318a38d50c20496b0f112c81af4e74a826563d31d9357b1d5fec5\": container with ID starting with 225d80016be318a38d50c20496b0f112c81af4e74a826563d31d9357b1d5fec5 not found: ID does not exist"
Sep 08 14:15:35.700195 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:35.700173    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"]
Sep 08 14:15:35.702698 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:35.702680    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-cb068d/test-model-cb068d-kserve-5f8cccf944-lr92t"]
Sep 08 14:15:36.658247 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:36.658219    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf"
Sep 08 14:15:36.974256 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:36.974173    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f81854dd-ce0d-4152-8263-f4b486a905af" path="/var/lib/kubelet/pods/f81854dd-ce0d-4152-8263-f4b486a905af/volumes"
Sep 08 14:15:46.755275 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:15:46.755238    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:16:02.854393 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:02.854359    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:16:21.267633 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:21.267598    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:16:43.487195 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:43.487117    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"]
Sep 08 14:16:43.487589 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:43.487527    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f81854dd-ce0d-4152-8263-f4b486a905af" containerName="main"
Sep 08 14:16:43.487589 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:43.487538    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f81854dd-ce0d-4152-8263-f4b486a905af" containerName="main"
Sep 08 14:16:43.487671 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:43.487615    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f81854dd-ce0d-4152-8263-f4b486a905af" containerName="main"
Sep 08 14:16:43.490646 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:43.490629    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"
Sep 08 14:16:43.494946 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:43.494922    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-ec7c379e\"/\"default-dockercfg-dtblj\""
Sep 08 14:16:43.495116 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:43.494979    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-ec7c379e\"/\"e2e-lifecycle-model-ec7c379e-kserve-self-signed-certs\""
Sep 08 14:16:43.495116 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:43.494999    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-ec7c379e\"/\"openshift-service-ca.crt\""
Sep 08 14:16:43.495116 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:43.494979    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-ec7c379e\"/\"kube-root-ca.crt\""
Sep 08 14:16:43.500842 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:43.500819    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"]
Sep 08 14:16:43.628019 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:43.627988    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-model-cache\") pod \"e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt\" (UID: \"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29\") " pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"
Sep 08 14:16:43.628019 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:43.628022    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-dshm\") pod \"e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt\" (UID: \"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29\") " pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"
Sep 08 14:16:43.628316 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:43.628081    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-tmp-dir\") pod \"e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt\" (UID: \"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29\") " pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"
Sep 08 14:16:43.628316 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:43.628140    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-294kg\" (UniqueName: \"kubernetes.io/projected/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-kube-api-access-294kg\") pod \"e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt\" (UID: \"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29\") " pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"
Sep 08 14:16:43.628316 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:43.628217    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-home\") pod \"e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt\" (UID: \"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29\") " pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"
Sep 08 14:16:43.628316 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:43.628276    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-tls-certs\") pod \"e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt\" (UID: \"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29\") " pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"
Sep 08 14:16:43.729740 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:43.729702    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-model-cache\") pod \"e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt\" (UID: \"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29\") " pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"
Sep 08 14:16:43.729740 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:43.729742    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-dshm\") pod \"e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt\" (UID: \"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29\") " pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"
Sep 08 14:16:43.730004 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:43.729782    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-tmp-dir\") pod \"e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt\" (UID: \"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29\") " pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"
Sep 08 14:16:43.730004 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:43.729833    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-294kg\" (UniqueName: \"kubernetes.io/projected/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-kube-api-access-294kg\") pod \"e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt\" (UID: \"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29\") " pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"
Sep 08 14:16:43.730004 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:43.729884    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-home\") pod \"e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt\" (UID: \"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29\") " pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"
Sep 08 14:16:43.730004 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:43.729920    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-tls-certs\") pod \"e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt\" (UID: \"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29\") " pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"
Sep 08 14:16:43.730262 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:43.730203    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-model-cache\") pod \"e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt\" (UID: \"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29\") " pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"
Sep 08 14:16:43.730262 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:43.730245    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-tmp-dir\") pod \"e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt\" (UID: \"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29\") " pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"
Sep 08 14:16:43.730381 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:43.730293    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-home\") pod \"e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt\" (UID: \"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29\") " pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"
Sep 08 14:16:43.732152 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:43.732129    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-dshm\") pod \"e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt\" (UID: \"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29\") " pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"
Sep 08 14:16:43.732587 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:43.732569    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-tls-certs\") pod \"e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt\" (UID: \"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29\") " pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"
Sep 08 14:16:43.738496 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:43.738447    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-294kg\" (UniqueName: \"kubernetes.io/projected/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-kube-api-access-294kg\") pod \"e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt\" (UID: \"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29\") " pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"
Sep 08 14:16:43.801081 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:43.801036    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"
Sep 08 14:16:44.083316 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:44.083293    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"]
Sep 08 14:16:44.085545 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:16:44.085516    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6dc57f7b_8dd7_4bdb_b93e_2c233b733c29.slice/crio-98785e37f7e10c267867b51c9cac16d1835cdd7851b650b5c446304e29fc0e92 WatchSource:0}: Error finding container 98785e37f7e10c267867b51c9cac16d1835cdd7851b650b5c446304e29fc0e92: Status 404 returned error can't find the container with id 98785e37f7e10c267867b51c9cac16d1835cdd7851b650b5c446304e29fc0e92
Sep 08 14:16:45.082043 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:45.082012    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt" event={"ID":"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29","Type":"ContainerStarted","Data":"debf54396dc7f98ac45c30c1181505e23059b033ad1161703345f0936fc55b3a"}
Sep 08 14:16:45.082459 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:45.082065    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt" event={"ID":"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29","Type":"ContainerStarted","Data":"98785e37f7e10c267867b51c9cac16d1835cdd7851b650b5c446304e29fc0e92"}
Sep 08 14:16:45.099915 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:45.099870    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt" podStartSLOduration=2.099856082 podStartE2EDuration="2.099856082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:16:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:16:45.098121678 +0000 UTC m=+1080.587838724" watchObservedRunningTime="2026-09-08 14:16:45.099856082 +0000 UTC m=+1080.589573134"
Sep 08 14:16:45.802164 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:45.802129    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"
Sep 08 14:16:52.169328 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:52.169289    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:16:53.801707 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:53.801672    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"
Sep 08 14:16:53.813984 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:53.813960    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"
Sep 08 14:16:54.144486 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:16:54.144459    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"
Sep 08 14:20:09.307250 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:09.307166    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"]
Sep 08 14:20:12.269121 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:12.269087    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:20:24.327602 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:24.327561    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt" podUID="6dc57f7b-8dd7-4bdb-b93e-2c233b733c29" containerName="main" containerID="cri-o://debf54396dc7f98ac45c30c1181505e23059b033ad1161703345f0936fc55b3a" gracePeriod=45
Sep 08 14:20:24.588418 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:24.588364    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"
Sep 08 14:20:24.610859 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:24.610824    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-294kg\" (UniqueName: \"kubernetes.io/projected/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-kube-api-access-294kg\") pod \"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29\" (UID: \"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29\") "
Sep 08 14:20:24.611036 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:24.610866    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-home\") pod \"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29\" (UID: \"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29\") "
Sep 08 14:20:24.611036 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:24.610890    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-model-cache\") pod \"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29\" (UID: \"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29\") "
Sep 08 14:20:24.611036 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:24.610924    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-tls-certs\") pod \"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29\" (UID: \"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29\") "
Sep 08 14:20:24.611379 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:24.611172    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-dshm\") pod \"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29\" (UID: \"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29\") "
Sep 08 14:20:24.611379 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:24.611181    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-home" (OuterVolumeSpecName: "home") pod "6dc57f7b-8dd7-4bdb-b93e-2c233b733c29" (UID: "6dc57f7b-8dd7-4bdb-b93e-2c233b733c29"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:20:24.611379 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:24.611218    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-tmp-dir\") pod \"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29\" (UID: \"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29\") "
Sep 08 14:20:24.611379 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:24.611239    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-model-cache" (OuterVolumeSpecName: "model-cache") pod "6dc57f7b-8dd7-4bdb-b93e-2c233b733c29" (UID: "6dc57f7b-8dd7-4bdb-b93e-2c233b733c29"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:20:24.611590 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:24.611569    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6dc57f7b-8dd7-4bdb-b93e-2c233b733c29" (UID: "6dc57f7b-8dd7-4bdb-b93e-2c233b733c29"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:20:24.611645 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:24.611595    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-home\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:20:24.611645 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:24.611612    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-model-cache\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:20:24.613585 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:24.613561    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-kube-api-access-294kg" (OuterVolumeSpecName: "kube-api-access-294kg") pod "6dc57f7b-8dd7-4bdb-b93e-2c233b733c29" (UID: "6dc57f7b-8dd7-4bdb-b93e-2c233b733c29"). InnerVolumeSpecName "kube-api-access-294kg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:20:24.613689 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:24.613591    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6dc57f7b-8dd7-4bdb-b93e-2c233b733c29" (UID: "6dc57f7b-8dd7-4bdb-b93e-2c233b733c29"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:20:24.613689 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:24.613660    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-dshm" (OuterVolumeSpecName: "dshm") pod "6dc57f7b-8dd7-4bdb-b93e-2c233b733c29" (UID: "6dc57f7b-8dd7-4bdb-b93e-2c233b733c29"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:20:24.712390 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:24.712355    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-dshm\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:20:24.712390 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:24.712383    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-tmp-dir\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:20:24.712390 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:24.712395    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-294kg\" (UniqueName: \"kubernetes.io/projected/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-kube-api-access-294kg\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:20:24.712390 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:24.712403    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29-tls-certs\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:20:25.344116 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:25.344080    2575 generic.go:356] "Generic (PLEG): container finished" podID="6dc57f7b-8dd7-4bdb-b93e-2c233b733c29" containerID="debf54396dc7f98ac45c30c1181505e23059b033ad1161703345f0936fc55b3a" exitCode=0
Sep 08 14:20:25.344116 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:25.344123    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"
Sep 08 14:20:25.344613 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:25.344157    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt" event={"ID":"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29","Type":"ContainerDied","Data":"debf54396dc7f98ac45c30c1181505e23059b033ad1161703345f0936fc55b3a"}
Sep 08 14:20:25.344613 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:25.344205    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt" event={"ID":"6dc57f7b-8dd7-4bdb-b93e-2c233b733c29","Type":"ContainerDied","Data":"98785e37f7e10c267867b51c9cac16d1835cdd7851b650b5c446304e29fc0e92"}
Sep 08 14:20:25.344613 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:25.344222    2575 scope.go:117] "RemoveContainer" containerID="debf54396dc7f98ac45c30c1181505e23059b033ad1161703345f0936fc55b3a"
Sep 08 14:20:25.353288 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:25.353272    2575 scope.go:117] "RemoveContainer" containerID="debf54396dc7f98ac45c30c1181505e23059b033ad1161703345f0936fc55b3a"
Sep 08 14:20:25.353567 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:20:25.353534    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"debf54396dc7f98ac45c30c1181505e23059b033ad1161703345f0936fc55b3a\": container with ID starting with debf54396dc7f98ac45c30c1181505e23059b033ad1161703345f0936fc55b3a not found: ID does not exist" containerID="debf54396dc7f98ac45c30c1181505e23059b033ad1161703345f0936fc55b3a"
Sep 08 14:20:25.353654 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:25.353570    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"debf54396dc7f98ac45c30c1181505e23059b033ad1161703345f0936fc55b3a"} err="failed to get container status \"debf54396dc7f98ac45c30c1181505e23059b033ad1161703345f0936fc55b3a\": rpc error: code = NotFound desc = could not find container \"debf54396dc7f98ac45c30c1181505e23059b033ad1161703345f0936fc55b3a\": container with ID starting with debf54396dc7f98ac45c30c1181505e23059b033ad1161703345f0936fc55b3a not found: ID does not exist"
Sep 08 14:20:25.362940 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:25.362912    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"]
Sep 08 14:20:25.368758 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:25.368740    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-ec7c379e/e2e-lifecycle-model-ec7c379e-kserve-67b6c749fb-dgltt"]
Sep 08 14:20:26.974703 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:26.974670    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dc57f7b-8dd7-4bdb-b93e-2c233b733c29" path="/var/lib/kubelet/pods/6dc57f7b-8dd7-4bdb-b93e-2c233b733c29/volumes"
Sep 08 14:20:58.974837 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:20:58.974778    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:21:16.570474 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:21:16.570382    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:22:02.163643 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:22:02.163608    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:22:33.570566 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:22:33.570528    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:23:13.459254 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:13.459155    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:23:35.137773 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:35.137733    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:23:46.738788 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:46.738750    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6"]
Sep 08 14:23:46.739430 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:46.738959    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6" podUID="94df20b9-0c66-494b-9020-5e8e4144dbbf" containerName="maas-api" containerID="cri-o://dc33c0009f9f6495c429e00c81031e72b5bf1bce9ea11f83306f1990c1bfe56c" gracePeriod=30
Sep 08 14:23:46.992689 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:46.992629    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6"
Sep 08 14:23:47.085210 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:47.085176    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94df20b9-0c66-494b-9020-5e8e4144dbbf-metrics-certs\") pod \"94df20b9-0c66-494b-9020-5e8e4144dbbf\" (UID: \"94df20b9-0c66-494b-9020-5e8e4144dbbf\") "
Sep 08 14:23:47.085210 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:47.085215    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87lnc\" (UniqueName: \"kubernetes.io/projected/94df20b9-0c66-494b-9020-5e8e4144dbbf-kube-api-access-87lnc\") pod \"94df20b9-0c66-494b-9020-5e8e4144dbbf\" (UID: \"94df20b9-0c66-494b-9020-5e8e4144dbbf\") "
Sep 08 14:23:47.085419 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:47.085253    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94df20b9-0c66-494b-9020-5e8e4144dbbf-maas-api-tls\") pod \"94df20b9-0c66-494b-9020-5e8e4144dbbf\" (UID: \"94df20b9-0c66-494b-9020-5e8e4144dbbf\") "
Sep 08 14:23:47.085419 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:47.085291    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94df20b9-0c66-494b-9020-5e8e4144dbbf-openshift-service-ca\") pod \"94df20b9-0c66-494b-9020-5e8e4144dbbf\" (UID: \"94df20b9-0c66-494b-9020-5e8e4144dbbf\") "
Sep 08 14:23:47.085802 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:47.085771    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94df20b9-0c66-494b-9020-5e8e4144dbbf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "94df20b9-0c66-494b-9020-5e8e4144dbbf" (UID: "94df20b9-0c66-494b-9020-5e8e4144dbbf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:23:47.087490 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:47.087460    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94df20b9-0c66-494b-9020-5e8e4144dbbf-kube-api-access-87lnc" (OuterVolumeSpecName: "kube-api-access-87lnc") pod "94df20b9-0c66-494b-9020-5e8e4144dbbf" (UID: "94df20b9-0c66-494b-9020-5e8e4144dbbf"). InnerVolumeSpecName "kube-api-access-87lnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:23:47.087855 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:47.087830    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94df20b9-0c66-494b-9020-5e8e4144dbbf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "94df20b9-0c66-494b-9020-5e8e4144dbbf" (UID: "94df20b9-0c66-494b-9020-5e8e4144dbbf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:23:47.087961 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:47.087947    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94df20b9-0c66-494b-9020-5e8e4144dbbf-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "94df20b9-0c66-494b-9020-5e8e4144dbbf" (UID: "94df20b9-0c66-494b-9020-5e8e4144dbbf"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:23:47.186779 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:47.186740    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94df20b9-0c66-494b-9020-5e8e4144dbbf-metrics-certs\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:23:47.186779 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:47.186767    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87lnc\" (UniqueName: \"kubernetes.io/projected/94df20b9-0c66-494b-9020-5e8e4144dbbf-kube-api-access-87lnc\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:23:47.186779 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:47.186778    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94df20b9-0c66-494b-9020-5e8e4144dbbf-maas-api-tls\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:23:47.186779 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:47.186787    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94df20b9-0c66-494b-9020-5e8e4144dbbf-openshift-service-ca\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:23:47.508164 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:47.508129    2575 generic.go:356] "Generic (PLEG): container finished" podID="94df20b9-0c66-494b-9020-5e8e4144dbbf" containerID="dc33c0009f9f6495c429e00c81031e72b5bf1bce9ea11f83306f1990c1bfe56c" exitCode=0
Sep 08 14:23:47.508350 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:47.508186    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6"
Sep 08 14:23:47.508350 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:47.508197    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6" event={"ID":"94df20b9-0c66-494b-9020-5e8e4144dbbf","Type":"ContainerDied","Data":"dc33c0009f9f6495c429e00c81031e72b5bf1bce9ea11f83306f1990c1bfe56c"}
Sep 08 14:23:47.508350 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:47.508280    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6" event={"ID":"94df20b9-0c66-494b-9020-5e8e4144dbbf","Type":"ContainerDied","Data":"06196fff9717e71cc2f0f6c895b3ec177314175ae5c9894a6701773cd8a5f9ea"}
Sep 08 14:23:47.508350 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:47.508310    2575 scope.go:117] "RemoveContainer" containerID="dc33c0009f9f6495c429e00c81031e72b5bf1bce9ea11f83306f1990c1bfe56c"
Sep 08 14:23:47.518787 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:47.518769    2575 scope.go:117] "RemoveContainer" containerID="dc33c0009f9f6495c429e00c81031e72b5bf1bce9ea11f83306f1990c1bfe56c"
Sep 08 14:23:47.519070 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:23:47.519036    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc33c0009f9f6495c429e00c81031e72b5bf1bce9ea11f83306f1990c1bfe56c\": container with ID starting with dc33c0009f9f6495c429e00c81031e72b5bf1bce9ea11f83306f1990c1bfe56c not found: ID does not exist" containerID="dc33c0009f9f6495c429e00c81031e72b5bf1bce9ea11f83306f1990c1bfe56c"
Sep 08 14:23:47.519123 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:47.519080    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc33c0009f9f6495c429e00c81031e72b5bf1bce9ea11f83306f1990c1bfe56c"} err="failed to get container status \"dc33c0009f9f6495c429e00c81031e72b5bf1bce9ea11f83306f1990c1bfe56c\": rpc error: code = NotFound desc = could not find container \"dc33c0009f9f6495c429e00c81031e72b5bf1bce9ea11f83306f1990c1bfe56c\": container with ID starting with dc33c0009f9f6495c429e00c81031e72b5bf1bce9ea11f83306f1990c1bfe56c not found: ID does not exist"
Sep 08 14:23:47.533112 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:47.533088    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6"]
Sep 08 14:23:47.539040 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:47.539017    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2bcb20-5f4f65b7c5-sfvh6"]
Sep 08 14:23:48.975074 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:48.975024    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94df20b9-0c66-494b-9020-5e8e4144dbbf" path="/var/lib/kubelet/pods/94df20b9-0c66-494b-9020-5e8e4144dbbf/volumes"
Sep 08 14:23:52.570014 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:52.569976    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:23:53.888934 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:53.888898    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"]
Sep 08 14:23:53.889755 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:53.889689    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l" podUID="e7040c2e-9fc6-4bf8-85af-649fff2674b8" containerName="istio-proxy" containerID="cri-o://55ba081e2250aae39956e68d05c5b2e2958ac972d6195b3668a37d4c79adf8b3" gracePeriod=30
Sep 08 14:23:58.709485 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:58.709447    2575 patch_prober.go:28] interesting pod/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 14:23:58.709903 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:58.709517    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l" podUID="e7040c2e-9fc6-4bf8-85af-649fff2674b8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 14:23:59.144585 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.144548    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:23:59.201253 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.201213    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7040c2e-9fc6-4bf8-85af-649fff2674b8-istio-token\") pod \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") "
Sep 08 14:23:59.201253 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.201248    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7040c2e-9fc6-4bf8-85af-649fff2674b8-workload-certs\") pod \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") "
Sep 08 14:23:59.201482 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.201276    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7040c2e-9fc6-4bf8-85af-649fff2674b8-istio-envoy\") pod \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") "
Sep 08 14:23:59.201482 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.201328    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7040c2e-9fc6-4bf8-85af-649fff2674b8-istio-data\") pod \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") "
Sep 08 14:23:59.201900 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.201478    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5f4s\" (UniqueName: \"kubernetes.io/projected/e7040c2e-9fc6-4bf8-85af-649fff2674b8-kube-api-access-w5f4s\") pod \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") "
Sep 08 14:23:59.201900 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.201573    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7040c2e-9fc6-4bf8-85af-649fff2674b8-workload-socket\") pod \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") "
Sep 08 14:23:59.201900 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.201600    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7040c2e-9fc6-4bf8-85af-649fff2674b8-istiod-ca-cert\") pod \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") "
Sep 08 14:23:59.201900 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.201642    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7040c2e-9fc6-4bf8-85af-649fff2674b8-istio-podinfo\") pod \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") "
Sep 08 14:23:59.201900 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.201667    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7040c2e-9fc6-4bf8-85af-649fff2674b8-credential-socket\") pod \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\" (UID: \"e7040c2e-9fc6-4bf8-85af-649fff2674b8\") "
Sep 08 14:23:59.201900 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.201693    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7040c2e-9fc6-4bf8-85af-649fff2674b8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e7040c2e-9fc6-4bf8-85af-649fff2674b8" (UID: "e7040c2e-9fc6-4bf8-85af-649fff2674b8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:23:59.202653 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.202026    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7040c2e-9fc6-4bf8-85af-649fff2674b8-workload-certs\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:23:59.202653 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.202453    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7040c2e-9fc6-4bf8-85af-649fff2674b8-istio-data" (OuterVolumeSpecName: "istio-data") pod "e7040c2e-9fc6-4bf8-85af-649fff2674b8" (UID: "e7040c2e-9fc6-4bf8-85af-649fff2674b8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:23:59.203299 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.203273    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7040c2e-9fc6-4bf8-85af-649fff2674b8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e7040c2e-9fc6-4bf8-85af-649fff2674b8" (UID: "e7040c2e-9fc6-4bf8-85af-649fff2674b8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:23:59.204075 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.204027    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7040c2e-9fc6-4bf8-85af-649fff2674b8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e7040c2e-9fc6-4bf8-85af-649fff2674b8" (UID: "e7040c2e-9fc6-4bf8-85af-649fff2674b8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:23:59.204266 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.204244    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7040c2e-9fc6-4bf8-85af-649fff2674b8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e7040c2e-9fc6-4bf8-85af-649fff2674b8" (UID: "e7040c2e-9fc6-4bf8-85af-649fff2674b8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:23:59.204868 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.204828    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7040c2e-9fc6-4bf8-85af-649fff2674b8-kube-api-access-w5f4s" (OuterVolumeSpecName: "kube-api-access-w5f4s") pod "e7040c2e-9fc6-4bf8-85af-649fff2674b8" (UID: "e7040c2e-9fc6-4bf8-85af-649fff2674b8"). InnerVolumeSpecName "kube-api-access-w5f4s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:23:59.204868 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.204841    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7040c2e-9fc6-4bf8-85af-649fff2674b8-istio-token" (OuterVolumeSpecName: "istio-token") pod "e7040c2e-9fc6-4bf8-85af-649fff2674b8" (UID: "e7040c2e-9fc6-4bf8-85af-649fff2674b8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:23:59.205382 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.205352    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e7040c2e-9fc6-4bf8-85af-649fff2674b8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e7040c2e-9fc6-4bf8-85af-649fff2674b8" (UID: "e7040c2e-9fc6-4bf8-85af-649fff2674b8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:23:59.205895 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.205865    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7040c2e-9fc6-4bf8-85af-649fff2674b8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e7040c2e-9fc6-4bf8-85af-649fff2674b8" (UID: "e7040c2e-9fc6-4bf8-85af-649fff2674b8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:23:59.303278 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.303184    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7040c2e-9fc6-4bf8-85af-649fff2674b8-workload-socket\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:23:59.303278 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.303217    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7040c2e-9fc6-4bf8-85af-649fff2674b8-istiod-ca-cert\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:23:59.303278 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.303230    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7040c2e-9fc6-4bf8-85af-649fff2674b8-istio-podinfo\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:23:59.303278 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.303241    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7040c2e-9fc6-4bf8-85af-649fff2674b8-credential-socket\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:23:59.303278 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.303254    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7040c2e-9fc6-4bf8-85af-649fff2674b8-istio-token\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:23:59.303278 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.303265    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7040c2e-9fc6-4bf8-85af-649fff2674b8-istio-envoy\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:23:59.303278 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.303276    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7040c2e-9fc6-4bf8-85af-649fff2674b8-istio-data\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:23:59.303617 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.303287    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5f4s\" (UniqueName: \"kubernetes.io/projected/e7040c2e-9fc6-4bf8-85af-649fff2674b8-kube-api-access-w5f4s\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:23:59.581376 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.581342    2575 generic.go:356] "Generic (PLEG): container finished" podID="e7040c2e-9fc6-4bf8-85af-649fff2674b8" containerID="55ba081e2250aae39956e68d05c5b2e2958ac972d6195b3668a37d4c79adf8b3" exitCode=0
Sep 08 14:23:59.581549 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.581392    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"
Sep 08 14:23:59.581549 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.581427    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l" event={"ID":"e7040c2e-9fc6-4bf8-85af-649fff2674b8","Type":"ContainerDied","Data":"55ba081e2250aae39956e68d05c5b2e2958ac972d6195b3668a37d4c79adf8b3"}
Sep 08 14:23:59.581549 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.581486    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l" event={"ID":"e7040c2e-9fc6-4bf8-85af-649fff2674b8","Type":"ContainerDied","Data":"644ee416cc115f69ddcf41079fe1770ad0881a898e66b473aae5872dfa4e437a"}
Sep 08 14:23:59.581549 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.581521    2575 scope.go:117] "RemoveContainer" containerID="55ba081e2250aae39956e68d05c5b2e2958ac972d6195b3668a37d4c79adf8b3"
Sep 08 14:23:59.593206 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.593186    2575 scope.go:117] "RemoveContainer" containerID="0d74f6d15bca283f2209ab92d380b726bce1898d457169646cc57353959aef49"
Sep 08 14:23:59.601563 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.601529    2575 scope.go:117] "RemoveContainer" containerID="55ba081e2250aae39956e68d05c5b2e2958ac972d6195b3668a37d4c79adf8b3"
Sep 08 14:23:59.602035 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:23:59.601999    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55ba081e2250aae39956e68d05c5b2e2958ac972d6195b3668a37d4c79adf8b3\": container with ID starting with 55ba081e2250aae39956e68d05c5b2e2958ac972d6195b3668a37d4c79adf8b3 not found: ID does not exist" containerID="55ba081e2250aae39956e68d05c5b2e2958ac972d6195b3668a37d4c79adf8b3"
Sep 08 14:23:59.602195 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.602047    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55ba081e2250aae39956e68d05c5b2e2958ac972d6195b3668a37d4c79adf8b3"} err="failed to get container status \"55ba081e2250aae39956e68d05c5b2e2958ac972d6195b3668a37d4c79adf8b3\": rpc error: code = NotFound desc = could not find container \"55ba081e2250aae39956e68d05c5b2e2958ac972d6195b3668a37d4c79adf8b3\": container with ID starting with 55ba081e2250aae39956e68d05c5b2e2958ac972d6195b3668a37d4c79adf8b3 not found: ID does not exist"
Sep 08 14:23:59.602286 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.602200    2575 scope.go:117] "RemoveContainer" containerID="0d74f6d15bca283f2209ab92d380b726bce1898d457169646cc57353959aef49"
Sep 08 14:23:59.602535 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:23:59.602516    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d74f6d15bca283f2209ab92d380b726bce1898d457169646cc57353959aef49\": container with ID starting with 0d74f6d15bca283f2209ab92d380b726bce1898d457169646cc57353959aef49 not found: ID does not exist" containerID="0d74f6d15bca283f2209ab92d380b726bce1898d457169646cc57353959aef49"
Sep 08 14:23:59.602605 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.602540    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d74f6d15bca283f2209ab92d380b726bce1898d457169646cc57353959aef49"} err="failed to get container status \"0d74f6d15bca283f2209ab92d380b726bce1898d457169646cc57353959aef49\": rpc error: code = NotFound desc = could not find container \"0d74f6d15bca283f2209ab92d380b726bce1898d457169646cc57353959aef49\": container with ID starting with 0d74f6d15bca283f2209ab92d380b726bce1898d457169646cc57353959aef49 not found: ID does not exist"
Sep 08 14:23:59.604824 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.604804    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"]
Sep 08 14:23:59.615610 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:23:59.615588    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-2bcb20-openshift-default-754c9c8b4-6wb2l"]
Sep 08 14:24:00.974815 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:24:00.974783    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7040c2e-9fc6-4bf8-85af-649fff2674b8" path="/var/lib/kubelet/pods/e7040c2e-9fc6-4bf8-85af-649fff2674b8/volumes"
Sep 08 14:24:04.842000 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:24:04.841965    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf"]
Sep 08 14:24:04.842511 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:24:04.842221    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf" podUID="f062c99c-8ab2-4bea-b278-de688e0ffd78" containerName="maas-api" containerID="cri-o://37075677959d87538a9e084b1e64f32d63334df044fc6162bee0c83535d28895" gracePeriod=30
Sep 08 14:24:05.112370 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:24:05.112344    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf"
Sep 08 14:24:05.154899 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:24:05.154861    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25tmj\" (UniqueName: \"kubernetes.io/projected/f062c99c-8ab2-4bea-b278-de688e0ffd78-kube-api-access-25tmj\") pod \"f062c99c-8ab2-4bea-b278-de688e0ffd78\" (UID: \"f062c99c-8ab2-4bea-b278-de688e0ffd78\") "
Sep 08 14:24:05.155137 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:24:05.154940    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f062c99c-8ab2-4bea-b278-de688e0ffd78-metrics-certs\") pod \"f062c99c-8ab2-4bea-b278-de688e0ffd78\" (UID: \"f062c99c-8ab2-4bea-b278-de688e0ffd78\") "
Sep 08 14:24:05.155137 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:24:05.154989    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f062c99c-8ab2-4bea-b278-de688e0ffd78-openshift-service-ca\") pod \"f062c99c-8ab2-4bea-b278-de688e0ffd78\" (UID: \"f062c99c-8ab2-4bea-b278-de688e0ffd78\") "
Sep 08 14:24:05.155137 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:24:05.155043    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f062c99c-8ab2-4bea-b278-de688e0ffd78-maas-api-tls\") pod \"f062c99c-8ab2-4bea-b278-de688e0ffd78\" (UID: \"f062c99c-8ab2-4bea-b278-de688e0ffd78\") "
Sep 08 14:24:05.156126 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:24:05.156050    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f062c99c-8ab2-4bea-b278-de688e0ffd78-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f062c99c-8ab2-4bea-b278-de688e0ffd78" (UID: "f062c99c-8ab2-4bea-b278-de688e0ffd78"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:24:05.158412 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:24:05.158375    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f062c99c-8ab2-4bea-b278-de688e0ffd78-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f062c99c-8ab2-4bea-b278-de688e0ffd78" (UID: "f062c99c-8ab2-4bea-b278-de688e0ffd78"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:24:05.159200 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:24:05.159174    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f062c99c-8ab2-4bea-b278-de688e0ffd78-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f062c99c-8ab2-4bea-b278-de688e0ffd78" (UID: "f062c99c-8ab2-4bea-b278-de688e0ffd78"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:24:05.159423 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:24:05.159391    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f062c99c-8ab2-4bea-b278-de688e0ffd78-kube-api-access-25tmj" (OuterVolumeSpecName: "kube-api-access-25tmj") pod "f062c99c-8ab2-4bea-b278-de688e0ffd78" (UID: "f062c99c-8ab2-4bea-b278-de688e0ffd78"). InnerVolumeSpecName "kube-api-access-25tmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:24:05.256537 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:24:05.256482    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25tmj\" (UniqueName: \"kubernetes.io/projected/f062c99c-8ab2-4bea-b278-de688e0ffd78-kube-api-access-25tmj\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:24:05.256537 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:24:05.256521    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f062c99c-8ab2-4bea-b278-de688e0ffd78-metrics-certs\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:24:05.256537 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:24:05.256535    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f062c99c-8ab2-4bea-b278-de688e0ffd78-openshift-service-ca\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:24:05.256893 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:24:05.256550    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f062c99c-8ab2-4bea-b278-de688e0ffd78-maas-api-tls\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:24:05.617457 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:24:05.617420    2575 generic.go:356] "Generic (PLEG): container finished" podID="f062c99c-8ab2-4bea-b278-de688e0ffd78" containerID="37075677959d87538a9e084b1e64f32d63334df044fc6162bee0c83535d28895" exitCode=0
Sep 08 14:24:05.617636 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:24:05.617460    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf"
Sep 08 14:24:05.617636 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:24:05.617514    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf" event={"ID":"f062c99c-8ab2-4bea-b278-de688e0ffd78","Type":"ContainerDied","Data":"37075677959d87538a9e084b1e64f32d63334df044fc6162bee0c83535d28895"}
Sep 08 14:24:05.617636 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:24:05.617565    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf" event={"ID":"f062c99c-8ab2-4bea-b278-de688e0ffd78","Type":"ContainerDied","Data":"798c4ab0c79eb204c648abece2d17320548b398bafe2b8f9ab5be114c8f4719c"}
Sep 08 14:24:05.617636 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:24:05.617590    2575 scope.go:117] "RemoveContainer" containerID="37075677959d87538a9e084b1e64f32d63334df044fc6162bee0c83535d28895"
Sep 08 14:24:05.627322 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:24:05.627303    2575 scope.go:117] "RemoveContainer" containerID="37075677959d87538a9e084b1e64f32d63334df044fc6162bee0c83535d28895"
Sep 08 14:24:05.627601 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:24:05.627581    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37075677959d87538a9e084b1e64f32d63334df044fc6162bee0c83535d28895\": container with ID starting with 37075677959d87538a9e084b1e64f32d63334df044fc6162bee0c83535d28895 not found: ID does not exist" containerID="37075677959d87538a9e084b1e64f32d63334df044fc6162bee0c83535d28895"
Sep 08 14:24:05.627649 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:24:05.627611    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37075677959d87538a9e084b1e64f32d63334df044fc6162bee0c83535d28895"} err="failed to get container status \"37075677959d87538a9e084b1e64f32d63334df044fc6162bee0c83535d28895\": rpc error: code = NotFound desc = could not find container \"37075677959d87538a9e084b1e64f32d63334df044fc6162bee0c83535d28895\": container with ID starting with 37075677959d87538a9e084b1e64f32d63334df044fc6162bee0c83535d28895 not found: ID does not exist"
Sep 08 14:24:05.640535 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:24:05.640514    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf"]
Sep 08 14:24:05.642726 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:24:05.642709    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e2a04d-5564f9f959-wzjpf"]
Sep 08 14:24:06.975081 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:24:06.974987    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f062c99c-8ab2-4bea-b278-de688e0ffd78" path="/var/lib/kubelet/pods/f062c99c-8ab2-4bea-b278-de688e0ffd78/volumes"
Sep 08 14:24:08.561012 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:24:08.560971    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:24:20.360200 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:24:20.360159    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:25:41.512425 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:25:41.512346    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:26:04.556094 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:26:04.556043    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:26:15.655905 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:26:15.655868    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:26:27.447207 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:26:27.447174    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:26:38.457644 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:26:38.457607    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:26:50.568914 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:26:50.568877    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:27:02.570319 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:27:02.570287    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:27:20.751349 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:27:20.751258    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:27:33.546146 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:27:33.546110    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:29:05.369006 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:29:05.368975    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:29:16.888602 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:29:16.888565    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:29:44.259312 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:29:44.259277    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:30:01.253306 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:01.253266    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:30:25.954773 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:25.954735    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:30:38.354933 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:38.354894    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:30:52.452209 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:52.452172    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:30:57.440389 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:57.440349    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7959b4d688-vkxqq"]
Sep 08 14:30:57.440974 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:57.440955    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dc57f7b-8dd7-4bdb-b93e-2c233b733c29" containerName="main"
Sep 08 14:30:57.441020 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:57.440979    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dc57f7b-8dd7-4bdb-b93e-2c233b733c29" containerName="main"
Sep 08 14:30:57.441020 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:57.440994    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7040c2e-9fc6-4bf8-85af-649fff2674b8" containerName="istio-proxy"
Sep 08 14:30:57.441020 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:57.441004    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7040c2e-9fc6-4bf8-85af-649fff2674b8" containerName="istio-proxy"
Sep 08 14:30:57.441145 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:57.441032    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94df20b9-0c66-494b-9020-5e8e4144dbbf" containerName="maas-api"
Sep 08 14:30:57.441145 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:57.441041    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="94df20b9-0c66-494b-9020-5e8e4144dbbf" containerName="maas-api"
Sep 08 14:30:57.441145 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:57.441085    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f062c99c-8ab2-4bea-b278-de688e0ffd78" containerName="maas-api"
Sep 08 14:30:57.441145 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:57.441094    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f062c99c-8ab2-4bea-b278-de688e0ffd78" containerName="maas-api"
Sep 08 14:30:57.441269 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:57.441204    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7040c2e-9fc6-4bf8-85af-649fff2674b8" containerName="istio-proxy"
Sep 08 14:30:57.441269 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:57.441216    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f062c99c-8ab2-4bea-b278-de688e0ffd78" containerName="maas-api"
Sep 08 14:30:57.441269 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:57.441226    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dc57f7b-8dd7-4bdb-b93e-2c233b733c29" containerName="main"
Sep 08 14:30:57.441269 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:57.441238    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="94df20b9-0c66-494b-9020-5e8e4144dbbf" containerName="maas-api"
Sep 08 14:30:57.444669 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:57.444653    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7959b4d688-vkxqq"
Sep 08 14:30:57.452302 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:57.452081    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7959b4d688-vkxqq"]
Sep 08 14:30:57.553916 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:57.553886    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96bba82c-a21a-4a41-92d9-6627a322c5df-maas-api-tls\") pod \"maas-api-7959b4d688-vkxqq\" (UID: \"96bba82c-a21a-4a41-92d9-6627a322c5df\") " pod="odh-ai-gateway-infra/maas-api-7959b4d688-vkxqq"
Sep 08 14:30:57.554151 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:57.553920    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8hdt\" (UniqueName: \"kubernetes.io/projected/96bba82c-a21a-4a41-92d9-6627a322c5df-kube-api-access-p8hdt\") pod \"maas-api-7959b4d688-vkxqq\" (UID: \"96bba82c-a21a-4a41-92d9-6627a322c5df\") " pod="odh-ai-gateway-infra/maas-api-7959b4d688-vkxqq"
Sep 08 14:30:57.554151 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:57.553947    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96bba82c-a21a-4a41-92d9-6627a322c5df-openshift-service-ca\") pod \"maas-api-7959b4d688-vkxqq\" (UID: \"96bba82c-a21a-4a41-92d9-6627a322c5df\") " pod="odh-ai-gateway-infra/maas-api-7959b4d688-vkxqq"
Sep 08 14:30:57.554151 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:57.554089    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96bba82c-a21a-4a41-92d9-6627a322c5df-metrics-certs\") pod \"maas-api-7959b4d688-vkxqq\" (UID: \"96bba82c-a21a-4a41-92d9-6627a322c5df\") " pod="odh-ai-gateway-infra/maas-api-7959b4d688-vkxqq"
Sep 08 14:30:57.654712 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:57.654676    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96bba82c-a21a-4a41-92d9-6627a322c5df-metrics-certs\") pod \"maas-api-7959b4d688-vkxqq\" (UID: \"96bba82c-a21a-4a41-92d9-6627a322c5df\") " pod="odh-ai-gateway-infra/maas-api-7959b4d688-vkxqq"
Sep 08 14:30:57.654891 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:57.654740    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96bba82c-a21a-4a41-92d9-6627a322c5df-maas-api-tls\") pod \"maas-api-7959b4d688-vkxqq\" (UID: \"96bba82c-a21a-4a41-92d9-6627a322c5df\") " pod="odh-ai-gateway-infra/maas-api-7959b4d688-vkxqq"
Sep 08 14:30:57.654891 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:57.654758    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8hdt\" (UniqueName: \"kubernetes.io/projected/96bba82c-a21a-4a41-92d9-6627a322c5df-kube-api-access-p8hdt\") pod \"maas-api-7959b4d688-vkxqq\" (UID: \"96bba82c-a21a-4a41-92d9-6627a322c5df\") " pod="odh-ai-gateway-infra/maas-api-7959b4d688-vkxqq"
Sep 08 14:30:57.654891 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:57.654784    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96bba82c-a21a-4a41-92d9-6627a322c5df-openshift-service-ca\") pod \"maas-api-7959b4d688-vkxqq\" (UID: \"96bba82c-a21a-4a41-92d9-6627a322c5df\") " pod="odh-ai-gateway-infra/maas-api-7959b4d688-vkxqq"
Sep 08 14:30:57.655488 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:57.655423    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96bba82c-a21a-4a41-92d9-6627a322c5df-openshift-service-ca\") pod \"maas-api-7959b4d688-vkxqq\" (UID: \"96bba82c-a21a-4a41-92d9-6627a322c5df\") " pod="odh-ai-gateway-infra/maas-api-7959b4d688-vkxqq"
Sep 08 14:30:57.657424 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:57.657403    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96bba82c-a21a-4a41-92d9-6627a322c5df-maas-api-tls\") pod \"maas-api-7959b4d688-vkxqq\" (UID: \"96bba82c-a21a-4a41-92d9-6627a322c5df\") " pod="odh-ai-gateway-infra/maas-api-7959b4d688-vkxqq"
Sep 08 14:30:57.657515 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:57.657436    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96bba82c-a21a-4a41-92d9-6627a322c5df-metrics-certs\") pod \"maas-api-7959b4d688-vkxqq\" (UID: \"96bba82c-a21a-4a41-92d9-6627a322c5df\") " pod="odh-ai-gateway-infra/maas-api-7959b4d688-vkxqq"
Sep 08 14:30:57.664743 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:57.664723    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8hdt\" (UniqueName: \"kubernetes.io/projected/96bba82c-a21a-4a41-92d9-6627a322c5df-kube-api-access-p8hdt\") pod \"maas-api-7959b4d688-vkxqq\" (UID: \"96bba82c-a21a-4a41-92d9-6627a322c5df\") " pod="odh-ai-gateway-infra/maas-api-7959b4d688-vkxqq"
Sep 08 14:30:57.756363 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:57.756297    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7959b4d688-vkxqq"
Sep 08 14:30:58.031967 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:58.031938    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7959b4d688-vkxqq"]
Sep 08 14:30:58.033686 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:30:58.033646    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96bba82c_a21a_4a41_92d9_6627a322c5df.slice/crio-318c172dbf13def246a5e8386799c84df49e701d2b15afd7eadf2472d3d04008 WatchSource:0}: Error finding container 318c172dbf13def246a5e8386799c84df49e701d2b15afd7eadf2472d3d04008: Status 404 returned error can't find the container with id 318c172dbf13def246a5e8386799c84df49e701d2b15afd7eadf2472d3d04008
Sep 08 14:30:58.035088 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:58.035050    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 14:30:58.975110 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:58.975006    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7959b4d688-vkxqq" event={"ID":"96bba82c-a21a-4a41-92d9-6627a322c5df","Type":"ContainerStarted","Data":"87ad8a2c72f734ad14f354dc38c19dedbf83f59a5e89588d7ef0103385936f57"}
Sep 08 14:30:58.975110 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:58.975069    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7959b4d688-vkxqq" event={"ID":"96bba82c-a21a-4a41-92d9-6627a322c5df","Type":"ContainerStarted","Data":"318c172dbf13def246a5e8386799c84df49e701d2b15afd7eadf2472d3d04008"}
Sep 08 14:30:58.975527 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:58.975167    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7959b4d688-vkxqq"
Sep 08 14:30:58.997819 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:30:58.997776    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7959b4d688-vkxqq" podStartSLOduration=1.5908780550000001 podStartE2EDuration="1.997763871s" totalImagesPullingTime="406.885816ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:30:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:30:58.995270312 +0000 UTC m=+1934.484987364" watchObservedRunningTime="2026-09-08 14:30:58.997763871 +0000 UTC m=+1934.487480960"
Sep 08 14:31:04.955258 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:04.955219    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:31:04.987030 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:04.986997    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7959b4d688-vkxqq"
Sep 08 14:31:05.037029 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:05.036998    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-55f6cffdd8-7hl2f"]
Sep 08 14:31:05.037313 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:05.037282    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-7hl2f" podUID="bf4737ba-baf3-4ac4-9c89-6b0a943df5b7" containerName="maas-api" containerID="cri-o://b5381f3caad25e506bff93c8e6e7c334a658a4a94d8248d423e24009cda0a875" gracePeriod=30
Sep 08 14:31:06.284972 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:06.284946    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-7hl2f"
Sep 08 14:31:06.335506 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:06.335432    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf4737ba-baf3-4ac4-9c89-6b0a943df5b7-metrics-certs\") pod \"bf4737ba-baf3-4ac4-9c89-6b0a943df5b7\" (UID: \"bf4737ba-baf3-4ac4-9c89-6b0a943df5b7\") "
Sep 08 14:31:06.335506 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:06.335499    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf4737ba-baf3-4ac4-9c89-6b0a943df5b7-maas-api-tls\") pod \"bf4737ba-baf3-4ac4-9c89-6b0a943df5b7\" (UID: \"bf4737ba-baf3-4ac4-9c89-6b0a943df5b7\") "
Sep 08 14:31:06.335717 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:06.335525    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5hd8\" (UniqueName: \"kubernetes.io/projected/bf4737ba-baf3-4ac4-9c89-6b0a943df5b7-kube-api-access-r5hd8\") pod \"bf4737ba-baf3-4ac4-9c89-6b0a943df5b7\" (UID: \"bf4737ba-baf3-4ac4-9c89-6b0a943df5b7\") "
Sep 08 14:31:06.335717 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:06.335578    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf4737ba-baf3-4ac4-9c89-6b0a943df5b7-openshift-service-ca\") pod \"bf4737ba-baf3-4ac4-9c89-6b0a943df5b7\" (UID: \"bf4737ba-baf3-4ac4-9c89-6b0a943df5b7\") "
Sep 08 14:31:06.336186 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:06.336143    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf4737ba-baf3-4ac4-9c89-6b0a943df5b7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bf4737ba-baf3-4ac4-9c89-6b0a943df5b7" (UID: "bf4737ba-baf3-4ac4-9c89-6b0a943df5b7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:31:06.338390 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:06.338358    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf4737ba-baf3-4ac4-9c89-6b0a943df5b7-kube-api-access-r5hd8" (OuterVolumeSpecName: "kube-api-access-r5hd8") pod "bf4737ba-baf3-4ac4-9c89-6b0a943df5b7" (UID: "bf4737ba-baf3-4ac4-9c89-6b0a943df5b7"). InnerVolumeSpecName "kube-api-access-r5hd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:31:06.338497 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:06.338404    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf4737ba-baf3-4ac4-9c89-6b0a943df5b7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "bf4737ba-baf3-4ac4-9c89-6b0a943df5b7" (UID: "bf4737ba-baf3-4ac4-9c89-6b0a943df5b7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:31:06.338497 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:06.338432    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf4737ba-baf3-4ac4-9c89-6b0a943df5b7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bf4737ba-baf3-4ac4-9c89-6b0a943df5b7" (UID: "bf4737ba-baf3-4ac4-9c89-6b0a943df5b7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:31:06.436709 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:06.436676    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5hd8\" (UniqueName: \"kubernetes.io/projected/bf4737ba-baf3-4ac4-9c89-6b0a943df5b7-kube-api-access-r5hd8\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:31:06.436709 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:06.436704    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf4737ba-baf3-4ac4-9c89-6b0a943df5b7-openshift-service-ca\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:31:06.436709 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:06.436714    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf4737ba-baf3-4ac4-9c89-6b0a943df5b7-metrics-certs\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:31:06.436912 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:06.436722    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf4737ba-baf3-4ac4-9c89-6b0a943df5b7-maas-api-tls\") on node \"ip-10-0-130-125.ec2.internal\" DevicePath \"\""
Sep 08 14:31:07.021917 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:07.021881    2575 generic.go:356] "Generic (PLEG): container finished" podID="bf4737ba-baf3-4ac4-9c89-6b0a943df5b7" containerID="b5381f3caad25e506bff93c8e6e7c334a658a4a94d8248d423e24009cda0a875" exitCode=0
Sep 08 14:31:07.022138 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:07.021930    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-7hl2f"
Sep 08 14:31:07.022138 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:07.021967    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-7hl2f" event={"ID":"bf4737ba-baf3-4ac4-9c89-6b0a943df5b7","Type":"ContainerDied","Data":"b5381f3caad25e506bff93c8e6e7c334a658a4a94d8248d423e24009cda0a875"}
Sep 08 14:31:07.022138 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:07.022021    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-7hl2f" event={"ID":"bf4737ba-baf3-4ac4-9c89-6b0a943df5b7","Type":"ContainerDied","Data":"2fde124f1fd3b16ee5a4ea0bef9c24e304882644b5d7c91639a83838e757ec1a"}
Sep 08 14:31:07.022138 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:07.022050    2575 scope.go:117] "RemoveContainer" containerID="b5381f3caad25e506bff93c8e6e7c334a658a4a94d8248d423e24009cda0a875"
Sep 08 14:31:07.033642 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:07.033619    2575 scope.go:117] "RemoveContainer" containerID="b5381f3caad25e506bff93c8e6e7c334a658a4a94d8248d423e24009cda0a875"
Sep 08 14:31:07.033990 ip-10-0-130-125 kubenswrapper[2575]: E0908 14:31:07.033968    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5381f3caad25e506bff93c8e6e7c334a658a4a94d8248d423e24009cda0a875\": container with ID starting with b5381f3caad25e506bff93c8e6e7c334a658a4a94d8248d423e24009cda0a875 not found: ID does not exist" containerID="b5381f3caad25e506bff93c8e6e7c334a658a4a94d8248d423e24009cda0a875"
Sep 08 14:31:07.034102 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:07.034004    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5381f3caad25e506bff93c8e6e7c334a658a4a94d8248d423e24009cda0a875"} err="failed to get container status \"b5381f3caad25e506bff93c8e6e7c334a658a4a94d8248d423e24009cda0a875\": rpc error: code = NotFound desc = could not find container \"b5381f3caad25e506bff93c8e6e7c334a658a4a94d8248d423e24009cda0a875\": container with ID starting with b5381f3caad25e506bff93c8e6e7c334a658a4a94d8248d423e24009cda0a875 not found: ID does not exist"
Sep 08 14:31:07.041041 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:07.041018    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-55f6cffdd8-7hl2f"]
Sep 08 14:31:07.045091 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:07.045046    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-55f6cffdd8-7hl2f"]
Sep 08 14:31:08.974913 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:08.974879    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf4737ba-baf3-4ac4-9c89-6b0a943df5b7" path="/var/lib/kubelet/pods/bf4737ba-baf3-4ac4-9c89-6b0a943df5b7/volumes"
Sep 08 14:31:18.955174 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:18.955140    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:31:28.448119 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:28.448086    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:31:38.955192 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:38.955100    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-jmlvn"]
Sep 08 14:31:41.027493 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:41.027449    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-594f4d9c74-htkq7_145a1a6c-be40-4ee0-ae70-255d98de93c0/authorino/0.log"
Sep 08 14:31:46.526223 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:46.526195    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-54765d59fd-jkfkv_012c765a-53d5-45d6-8436-d2e2415e29b0/manager/0.log"
Sep 08 14:31:46.895103 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:46.895075    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-7d6487fcc8-prjwl_fd236640-df86-45d3-b7f9-5f6bcc877c0d/server/0.log"
Sep 08 14:31:47.497690 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:47.497658    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7959b4d688-vkxqq_96bba82c-a21a-4a41-92d9-6627a322c5df/maas-api/0.log"
Sep 08 14:31:47.604396 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:47.604363    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29814615-lgqxq_fd1cec57-4ce6-4147-8558-da5d16319941/cleanup/0.log"
Sep 08 14:31:47.826844 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:47.826818    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-97zc6_981b33bf-e5b5-4c75-a53f-9e52f956adfd/postgres/0.log"
Sep 08 14:31:48.586477 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:48.586445    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-594f4d9c74-htkq7_145a1a6c-be40-4ee0-ae70-255d98de93c0/authorino/0.log"
Sep 08 14:31:48.708515 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:48.708468    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-84d9bfc694-l6dmr_d72465de-118e-4209-be33-c726adcfbb03/manager/0.log"
Sep 08 14:31:48.824007 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:48.823976    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ffcddf5cd-44ttm_42eeff20-c5a8-4e27-9aba-693c9ff3ff65/manager/0.log"
Sep 08 14:31:49.222564 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:49.222532    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-jmlvn_03aa9577-6520-43ed-a73e-113efe413ab2/limitador/0.log"
Sep 08 14:31:49.342691 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:49.342642    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-565895c755-z64ls_919aa0f6-0f64-4e0f-91b4-50dc8baa324c/manager/0.log"
Sep 08 14:31:49.683989 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:49.683964    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s_9fdaa6f4-1805-4368-bc9d-e4db8ac4922d/istio-proxy/0.log"
Sep 08 14:31:50.141814 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:50.141785    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-rvlrc_c96b73a0-662e-4995-b19f-14015a3e664f/istio-proxy/1.log"
Sep 08 14:31:50.253400 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:50.253374    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m_493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad/istio-proxy/0.log"
Sep 08 14:31:50.598483 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:50.598459    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67dfcbc96b-kwbqv_d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5/router/0.log"
Sep 08 14:31:51.275745 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:51.275719    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-5bccb7bbf7-fvd4s_1d127be9-734c-4955-949a-a44a69ac67bd/main/0.log"
Sep 08 14:31:51.647577 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:31:51.647534    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5757f658bb-gp8ph_f771c478-fe48-4918-8e89-d3bafddb0510/main/0.log"
Sep 08 14:32:02.423164 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:02.423118    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wsgdv_a9c2a97a-5054-4839-b0ea-ff5bfa366afc/global-pull-secret-syncer/0.log"
Sep 08 14:32:02.503254 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:02.503220    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-g7btk_b680f42a-aaf7-415e-8045-ea5fccc2ebea/konnectivity-agent/0.log"
Sep 08 14:32:02.563204 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:02.563176    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-125.ec2.internal_24de9fdd7d5b7b48cef3659e9d7d2f6f/haproxy/0.log"
Sep 08 14:32:06.791353 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:06.791313    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-594f4d9c74-htkq7_145a1a6c-be40-4ee0-ae70-255d98de93c0/authorino/0.log"
Sep 08 14:32:06.840416 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:06.840391    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-84d9bfc694-l6dmr_d72465de-118e-4209-be33-c726adcfbb03/manager/0.log"
Sep 08 14:32:06.876223 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:06.876198    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ffcddf5cd-44ttm_42eeff20-c5a8-4e27-9aba-693c9ff3ff65/manager/0.log"
Sep 08 14:32:07.000218 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:07.000189    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-jmlvn_03aa9577-6520-43ed-a73e-113efe413ab2/limitador/0.log"
Sep 08 14:32:07.093368 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:07.093338    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-565895c755-z64ls_919aa0f6-0f64-4e0f-91b4-50dc8baa324c/manager/0.log"
Sep 08 14:32:08.949781 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:08.949746    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-qxlpn_92ea9d31-0c61-4d57-a8ea-cbca2b70b0ad/monitoring-plugin/0.log"
Sep 08 14:32:09.135339 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:09.135310    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h75cb_8ae0feb5-dc9a-4555-9713-d1f0b2b9498e/node-exporter/0.log"
Sep 08 14:32:09.160333 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:09.160313    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h75cb_8ae0feb5-dc9a-4555-9713-d1f0b2b9498e/kube-rbac-proxy/0.log"
Sep 08 14:32:09.187017 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:09.187000    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h75cb_8ae0feb5-dc9a-4555-9713-d1f0b2b9498e/init-textfile/0.log"
Sep 08 14:32:09.841716 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:09.841692    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bfcf7878-bwgpd_57a8279f-b611-46c4-b760-97eba0216597/thanos-query/0.log"
Sep 08 14:32:09.868267 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:09.868243    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bfcf7878-bwgpd_57a8279f-b611-46c4-b760-97eba0216597/kube-rbac-proxy-web/0.log"
Sep 08 14:32:09.890428 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:09.890405    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bfcf7878-bwgpd_57a8279f-b611-46c4-b760-97eba0216597/kube-rbac-proxy/0.log"
Sep 08 14:32:09.916960 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:09.916940    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bfcf7878-bwgpd_57a8279f-b611-46c4-b760-97eba0216597/prom-label-proxy/0.log"
Sep 08 14:32:09.939438 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:09.939423    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bfcf7878-bwgpd_57a8279f-b611-46c4-b760-97eba0216597/kube-rbac-proxy-rules/0.log"
Sep 08 14:32:09.972582 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:09.972560    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bfcf7878-bwgpd_57a8279f-b611-46c4-b760-97eba0216597/kube-rbac-proxy-metrics/0.log"
Sep 08 14:32:12.754262 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:12.754229    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-df66fd975-5rpw7_879573f7-bb58-4b5d-be37-9f7abae495eb/console/0.log"
Sep 08 14:32:13.416193 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:13.416161    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-2kqn8_5a0c4143-3450-44ed-b48b-be0c9a76e6fe/volume-data-source-validator/0.log"
Sep 08 14:32:14.490321 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:14.490288    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8ds62_7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c/dns/0.log"
Sep 08 14:32:14.512889 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:14.512862    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8ds62_7bc7d6ad-c6f2-4614-aeb3-71aaeb3e7f7c/kube-rbac-proxy/0.log"
Sep 08 14:32:14.666984 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:14.666948    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qzvvn_a94658b0-bc07-44bc-a7c8-92d1c7804987/dns-node-resolver/0.log"
Sep 08 14:32:14.930572 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:14.930535    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jjr46/perf-node-gather-daemonset-xhhdp"]
Sep 08 14:32:14.931217 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:14.931186    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7040c2e-9fc6-4bf8-85af-649fff2674b8" containerName="istio-proxy"
Sep 08 14:32:14.931217 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:14.931213    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7040c2e-9fc6-4bf8-85af-649fff2674b8" containerName="istio-proxy"
Sep 08 14:32:14.931437 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:14.931264    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf4737ba-baf3-4ac4-9c89-6b0a943df5b7" containerName="maas-api"
Sep 08 14:32:14.931437 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:14.931274    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf4737ba-baf3-4ac4-9c89-6b0a943df5b7" containerName="maas-api"
Sep 08 14:32:14.931437 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:14.931384    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf4737ba-baf3-4ac4-9c89-6b0a943df5b7" containerName="maas-api"
Sep 08 14:32:14.931437 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:14.931396    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7040c2e-9fc6-4bf8-85af-649fff2674b8" containerName="istio-proxy"
Sep 08 14:32:14.935284 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:14.935254    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-xhhdp"
Sep 08 14:32:14.938009 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:14.937982    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jjr46\"/\"openshift-service-ca.crt\""
Sep 08 14:32:14.938009 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:14.938003    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jjr46\"/\"default-dockercfg-trvv4\""
Sep 08 14:32:14.938239 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:14.937988    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jjr46\"/\"kube-root-ca.crt\""
Sep 08 14:32:14.943136 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:14.943112    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jjr46/perf-node-gather-daemonset-xhhdp"]
Sep 08 14:32:15.045230 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:15.045186    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2v8m\" (UniqueName: \"kubernetes.io/projected/164a2579-ed20-4dac-964d-fd1dade0cbe8-kube-api-access-c2v8m\") pod \"perf-node-gather-daemonset-xhhdp\" (UID: \"164a2579-ed20-4dac-964d-fd1dade0cbe8\") " pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-xhhdp"
Sep 08 14:32:15.045437 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:15.045246    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/164a2579-ed20-4dac-964d-fd1dade0cbe8-proc\") pod \"perf-node-gather-daemonset-xhhdp\" (UID: \"164a2579-ed20-4dac-964d-fd1dade0cbe8\") " pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-xhhdp"
Sep 08 14:32:15.045437 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:15.045309    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/164a2579-ed20-4dac-964d-fd1dade0cbe8-podres\") pod \"perf-node-gather-daemonset-xhhdp\" (UID: \"164a2579-ed20-4dac-964d-fd1dade0cbe8\") " pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-xhhdp"
Sep 08 14:32:15.045437 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:15.045407    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/164a2579-ed20-4dac-964d-fd1dade0cbe8-sys\") pod \"perf-node-gather-daemonset-xhhdp\" (UID: \"164a2579-ed20-4dac-964d-fd1dade0cbe8\") " pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-xhhdp"
Sep 08 14:32:15.045643 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:15.045456    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/164a2579-ed20-4dac-964d-fd1dade0cbe8-lib-modules\") pod \"perf-node-gather-daemonset-xhhdp\" (UID: \"164a2579-ed20-4dac-964d-fd1dade0cbe8\") " pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-xhhdp"
Sep 08 14:32:15.146559 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:15.146517    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2v8m\" (UniqueName: \"kubernetes.io/projected/164a2579-ed20-4dac-964d-fd1dade0cbe8-kube-api-access-c2v8m\") pod \"perf-node-gather-daemonset-xhhdp\" (UID: \"164a2579-ed20-4dac-964d-fd1dade0cbe8\") " pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-xhhdp"
Sep 08 14:32:15.146750 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:15.146584    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/164a2579-ed20-4dac-964d-fd1dade0cbe8-proc\") pod \"perf-node-gather-daemonset-xhhdp\" (UID: \"164a2579-ed20-4dac-964d-fd1dade0cbe8\") " pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-xhhdp"
Sep 08 14:32:15.146750 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:15.146622    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/164a2579-ed20-4dac-964d-fd1dade0cbe8-podres\") pod \"perf-node-gather-daemonset-xhhdp\" (UID: \"164a2579-ed20-4dac-964d-fd1dade0cbe8\") " pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-xhhdp"
Sep 08 14:32:15.146750 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:15.146706    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/164a2579-ed20-4dac-964d-fd1dade0cbe8-sys\") pod \"perf-node-gather-daemonset-xhhdp\" (UID: \"164a2579-ed20-4dac-964d-fd1dade0cbe8\") " pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-xhhdp"
Sep 08 14:32:15.146750 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:15.146732    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/164a2579-ed20-4dac-964d-fd1dade0cbe8-proc\") pod \"perf-node-gather-daemonset-xhhdp\" (UID: \"164a2579-ed20-4dac-964d-fd1dade0cbe8\") " pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-xhhdp"
Sep 08 14:32:15.147031 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:15.146774    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/164a2579-ed20-4dac-964d-fd1dade0cbe8-lib-modules\") pod \"perf-node-gather-daemonset-xhhdp\" (UID: \"164a2579-ed20-4dac-964d-fd1dade0cbe8\") " pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-xhhdp"
Sep 08 14:32:15.147031 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:15.146803    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/164a2579-ed20-4dac-964d-fd1dade0cbe8-sys\") pod \"perf-node-gather-daemonset-xhhdp\" (UID: \"164a2579-ed20-4dac-964d-fd1dade0cbe8\") " pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-xhhdp"
Sep 08 14:32:15.147031 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:15.146852    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/164a2579-ed20-4dac-964d-fd1dade0cbe8-podres\") pod \"perf-node-gather-daemonset-xhhdp\" (UID: \"164a2579-ed20-4dac-964d-fd1dade0cbe8\") " pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-xhhdp"
Sep 08 14:32:15.147031 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:15.146949    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/164a2579-ed20-4dac-964d-fd1dade0cbe8-lib-modules\") pod \"perf-node-gather-daemonset-xhhdp\" (UID: \"164a2579-ed20-4dac-964d-fd1dade0cbe8\") " pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-xhhdp"
Sep 08 14:32:15.156175 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:15.156132    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2v8m\" (UniqueName: \"kubernetes.io/projected/164a2579-ed20-4dac-964d-fd1dade0cbe8-kube-api-access-c2v8m\") pod \"perf-node-gather-daemonset-xhhdp\" (UID: \"164a2579-ed20-4dac-964d-fd1dade0cbe8\") " pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-xhhdp"
Sep 08 14:32:15.249271 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:15.249189    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-xhhdp"
Sep 08 14:32:15.315742 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:15.315571    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7d68f4f4fc-jjp8z_8fe6b9fa-cbcd-41be-8acf-6134156d7d48/registry/0.log"
Sep 08 14:32:15.363375 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:15.363332    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lw6kq_1f1133bf-01cf-46b7-be8d-1272be6dd0da/node-ca/0.log"
Sep 08 14:32:15.527213 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:15.527185    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jjr46/perf-node-gather-daemonset-xhhdp"]
Sep 08 14:32:15.529505 ip-10-0-130-125 kubenswrapper[2575]: W0908 14:32:15.529473    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod164a2579_ed20_4dac_964d_fd1dade0cbe8.slice/crio-a265dd1c616d6691ef09a646a5eac6c9f78c3362c0e3b208e0b8253099d73ddf WatchSource:0}: Error finding container a265dd1c616d6691ef09a646a5eac6c9f78c3362c0e3b208e0b8253099d73ddf: Status 404 returned error can't find the container with id a265dd1c616d6691ef09a646a5eac6c9f78c3362c0e3b208e0b8253099d73ddf
Sep 08 14:32:16.340661 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:16.340620    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s_9fdaa6f4-1805-4368-bc9d-e4db8ac4922d/istio-proxy/0.log"
Sep 08 14:32:16.410024 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:16.409993    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-xhhdp" event={"ID":"164a2579-ed20-4dac-964d-fd1dade0cbe8","Type":"ContainerStarted","Data":"c9c465e907972b6e5c7d1421c1dc2c02b809036b1c96c9918e0ff66fbf0194df"}
Sep 08 14:32:16.410332 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:16.410302    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-xhhdp" event={"ID":"164a2579-ed20-4dac-964d-fd1dade0cbe8","Type":"ContainerStarted","Data":"a265dd1c616d6691ef09a646a5eac6c9f78c3362c0e3b208e0b8253099d73ddf"}
Sep 08 14:32:16.410738 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:16.410716    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-xhhdp"
Sep 08 14:32:16.430587 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:16.430545    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-xhhdp" podStartSLOduration=2.430531484 podStartE2EDuration="2.430531484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:32:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:32:16.428031259 +0000 UTC m=+2011.917748311" watchObservedRunningTime="2026-09-08 14:32:16.430531484 +0000 UTC m=+2011.920248535"
Sep 08 14:32:16.707280 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:16.707200    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-rvlrc_c96b73a0-662e-4995-b19f-14015a3e664f/istio-proxy/0.log"
Sep 08 14:32:16.716639 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:16.716613    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-rvlrc_c96b73a0-662e-4995-b19f-14015a3e664f/istio-proxy/1.log"
Sep 08 14:32:16.742759 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:16.742732    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m_493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad/istio-proxy/0.log"
Sep 08 14:32:16.844344 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:16.844314    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67dfcbc96b-kwbqv_d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5/router/0.log"
Sep 08 14:32:17.719915 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:17.719884    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d5h6j_7c2eb712-1aa9-4d8b-adb5-521fde6a5169/serve-healthcheck-canary/0.log"
Sep 08 14:32:18.245214 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:18.245186    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-xnk8k_b9569fb9-c094-4484-945f-ff275f85fd61/insights-operator/0.log"
Sep 08 14:32:18.245765 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:18.245742    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-xnk8k_b9569fb9-c094-4484-945f-ff275f85fd61/insights-operator/1.log"
Sep 08 14:32:18.334940 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:18.334915    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gf86m_56b92c3b-d5b7-401b-b0e5-ae2cb458af12/kube-rbac-proxy/0.log"
Sep 08 14:32:18.361438 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:18.361411    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gf86m_56b92c3b-d5b7-401b-b0e5-ae2cb458af12/exporter/0.log"
Sep 08 14:32:18.384974 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:18.384954    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gf86m_56b92c3b-d5b7-401b-b0e5-ae2cb458af12/extractor/0.log"
Sep 08 14:32:20.713218 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:20.713191    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-77cd5f6c85-g7hkb_f30c8922-c82c-42fb-b5cc-09179dc8743a/manager/0.log"
Sep 08 14:32:20.742102 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:20.742081    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-77cd5f6c85-g7hkb_f30c8922-c82c-42fb-b5cc-09179dc8743a/copy-manifests/0.log"
Sep 08 14:32:21.920050 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:21.920021    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s_9fdaa6f4-1805-4368-bc9d-e4db8ac4922d/istio-proxy/0.log"
Sep 08 14:32:21.984894 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:21.984863    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-56d489b4b8-wtt8b_71bd32c4-b16c-4fad-bb9c-9affe63f7855/jobset-operator/0.log"
Sep 08 14:32:22.222252 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:22.222173    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-rvlrc_c96b73a0-662e-4995-b19f-14015a3e664f/istio-proxy/0.log"
Sep 08 14:32:22.232310 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:22.232282    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-rvlrc_c96b73a0-662e-4995-b19f-14015a3e664f/istio-proxy/1.log"
Sep 08 14:32:22.247007 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:22.246987    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m_493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad/istio-proxy/0.log"
Sep 08 14:32:22.317956 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:22.317932    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67dfcbc96b-kwbqv_d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5/router/0.log"
Sep 08 14:32:22.425348 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:22.425329    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-xhhdp"
Sep 08 14:32:22.608207 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:22.608181    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-54765d59fd-jkfkv_012c765a-53d5-45d6-8436-d2e2415e29b0/manager/0.log"
Sep 08 14:32:22.833433 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:22.833403    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-7d6487fcc8-prjwl_fd236640-df86-45d3-b7f9-5f6bcc877c0d/server/0.log"
Sep 08 14:32:23.777319 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:23.777292    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-m4w5s_9fdaa6f4-1805-4368-bc9d-e4db8ac4922d/istio-proxy/0.log"
Sep 08 14:32:24.128310 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:24.128282    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-rvlrc_c96b73a0-662e-4995-b19f-14015a3e664f/istio-proxy/0.log"
Sep 08 14:32:24.138420 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:24.138400    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-rvlrc_c96b73a0-662e-4995-b19f-14015a3e664f/istio-proxy/1.log"
Sep 08 14:32:24.154794 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:24.154774    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-r897m_493c38f4-5d0c-44c2-91c0-d0f2d6fde4ad/istio-proxy/0.log"
Sep 08 14:32:24.247917 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:24.247892    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67dfcbc96b-kwbqv_d66fa991-e7aa-4f6b-b9d1-ce161b88bdf5/router/0.log"
Sep 08 14:32:28.171526 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:28.171494    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-8zk7g_10271d13-25a3-4280-95b8-19d200846611/migrator/0.log"
Sep 08 14:32:28.192768 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:28.192743    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-8zk7g_10271d13-25a3-4280-95b8-19d200846611/graceful-termination/0.log"
Sep 08 14:32:29.872750 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:29.872719    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8zb5t_fe124193-60d2-4e5d-adb3-760fe3f0e92a/kube-multus-additional-cni-plugins/0.log"
Sep 08 14:32:29.895841 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:29.895818    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8zb5t_fe124193-60d2-4e5d-adb3-760fe3f0e92a/egress-router-binary-copy/0.log"
Sep 08 14:32:29.917356 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:29.917336    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8zb5t_fe124193-60d2-4e5d-adb3-760fe3f0e92a/cni-plugins/0.log"
Sep 08 14:32:29.938941 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:29.938923    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8zb5t_fe124193-60d2-4e5d-adb3-760fe3f0e92a/bond-cni-plugin/0.log"
Sep 08 14:32:29.958487 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:29.958471    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8zb5t_fe124193-60d2-4e5d-adb3-760fe3f0e92a/routeoverride-cni/0.log"
Sep 08 14:32:29.978234 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:29.978206    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8zb5t_fe124193-60d2-4e5d-adb3-760fe3f0e92a/whereabouts-cni-bincopy/0.log"
Sep 08 14:32:29.997962 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:29.997946    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8zb5t_fe124193-60d2-4e5d-adb3-760fe3f0e92a/whereabouts-cni/0.log"
Sep 08 14:32:30.281584 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:30.281499    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-svxwv_d47cfde2-6162-4179-97d5-985a6b27ca33/kube-multus/0.log"
Sep 08 14:32:30.303564 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:30.303537    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2qkhb_b0323060-7649-4e6c-b078-dbe218838e63/network-metrics-daemon/0.log"
Sep 08 14:32:30.322043 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:30.322023    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2qkhb_b0323060-7649-4e6c-b078-dbe218838e63/kube-rbac-proxy/0.log"
Sep 08 14:32:31.228753 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:31.228726    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncn7g_2d773614-9d8a-4a7d-9a65-bbd560ba1ae7/ovn-controller/0.log"
Sep 08 14:32:31.245746 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:31.245722    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncn7g_2d773614-9d8a-4a7d-9a65-bbd560ba1ae7/ovn-acl-logging/0.log"
Sep 08 14:32:31.268315 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:31.268295    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncn7g_2d773614-9d8a-4a7d-9a65-bbd560ba1ae7/kube-rbac-proxy-node/0.log"
Sep 08 14:32:31.291034 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:31.291013    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncn7g_2d773614-9d8a-4a7d-9a65-bbd560ba1ae7/kube-rbac-proxy-ovn-metrics/0.log"
Sep 08 14:32:31.310632 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:31.310610    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncn7g_2d773614-9d8a-4a7d-9a65-bbd560ba1ae7/northd/0.log"
Sep 08 14:32:31.339859 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:31.339795    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncn7g_2d773614-9d8a-4a7d-9a65-bbd560ba1ae7/nbdb/0.log"
Sep 08 14:32:31.375873 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:31.375849    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncn7g_2d773614-9d8a-4a7d-9a65-bbd560ba1ae7/sbdb/0.log"
Sep 08 14:32:31.430095 ip-10-0-130-125 kubenswrapper[2575]: I0908 14:32:31.430078    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncn7g_2d773614-9d8a-4a7d-9a65-bbd560ba1ae7/ovnkube-controller/0.log"