Sep 11 14:15:07.094999 ip-10-0-133-175 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 14:15:07.463256 ip-10-0-133-175 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 14:15:07.463256 ip-10-0-133-175 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 14:15:07.463256 ip-10-0-133-175 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 14:15:07.463256 ip-10-0-133-175 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 14:15:07.463256 ip-10-0-133-175 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 14:15:07.466064 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.465988    2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 14:15:07.469775 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469749    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 14:15:07.469775 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469767    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 14:15:07.469775 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469771    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 14:15:07.469775 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469777    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 14:15:07.469775 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469780    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 14:15:07.470009 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469787    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 14:15:07.470009 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469791    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 14:15:07.470009 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469795    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 14:15:07.470009 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469798    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 14:15:07.470009 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469801    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 14:15:07.470009 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469805    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 14:15:07.470009 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469808    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 14:15:07.470009 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469811    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 14:15:07.470009 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469814    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 14:15:07.470009 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469817    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 14:15:07.470009 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469822    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 14:15:07.470009 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469826    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 14:15:07.470009 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469829    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 14:15:07.470009 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469836    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 14:15:07.470009 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469839    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 14:15:07.470009 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469842    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 14:15:07.470009 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469846    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 14:15:07.470009 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469849    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 14:15:07.470009 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469852    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 14:15:07.470501 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469855    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 14:15:07.470501 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469858    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 14:15:07.470501 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469861    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 14:15:07.470501 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469864    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 14:15:07.470501 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469867    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 14:15:07.470501 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469869    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 14:15:07.470501 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469875    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 14:15:07.470501 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469878    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 14:15:07.470501 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469880    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 14:15:07.470501 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469884    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 14:15:07.470501 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469886    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 14:15:07.470501 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469889    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 14:15:07.470501 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469892    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 14:15:07.470501 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469896    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 14:15:07.470501 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469900    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 14:15:07.470501 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469903    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 14:15:07.470501 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469906    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 14:15:07.470501 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469909    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 14:15:07.470501 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469915    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 14:15:07.470501 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469918    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 14:15:07.471002 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469921    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 14:15:07.471002 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469924    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 14:15:07.471002 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469926    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 14:15:07.471002 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469929    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 14:15:07.471002 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469932    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 14:15:07.471002 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469935    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 14:15:07.471002 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469938    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 14:15:07.471002 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469940    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 14:15:07.471002 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469943    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 14:15:07.471002 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469946    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 14:15:07.471002 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469949    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 14:15:07.471002 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469954    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 14:15:07.471002 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469957    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 14:15:07.471002 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469960    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 14:15:07.471002 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469962    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 14:15:07.471002 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469967    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 14:15:07.471002 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469970    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 14:15:07.471002 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469975    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 14:15:07.471002 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469979    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 14:15:07.471473 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469982    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 14:15:07.471473 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469986    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 14:15:07.471473 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469989    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 14:15:07.471473 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.469995    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 14:15:07.471473 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470000    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 14:15:07.471473 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470004    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 14:15:07.471473 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470008    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 14:15:07.471473 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470013    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 14:15:07.471473 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470016    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 14:15:07.471473 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470019    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 14:15:07.471473 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470022    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 14:15:07.471473 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470025    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 14:15:07.471473 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470028    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 14:15:07.471473 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470031    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 14:15:07.471473 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470034    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 14:15:07.471473 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470039    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 14:15:07.471473 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470043    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 14:15:07.471473 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470046    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 14:15:07.471473 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470049    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 14:15:07.471473 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470107    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 14:15:07.471979 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470129    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 14:15:07.471979 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470136    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 14:15:07.471979 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470142    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 14:15:07.471979 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470148    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 14:15:07.471979 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470153    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 14:15:07.471979 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470157    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 14:15:07.471979 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470162    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 14:15:07.471979 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470167    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 14:15:07.471979 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470171    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 14:15:07.471979 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470176    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 14:15:07.471979 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470180    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 14:15:07.471979 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470207    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 14:15:07.471979 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470215    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 14:15:07.471979 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470222    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 14:15:07.471979 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470336    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 14:15:07.471979 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.470345    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 14:15:07.472362 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472108    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 14:15:07.472362 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472117    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 14:15:07.472362 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472121    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 14:15:07.472362 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472124    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 14:15:07.472362 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472128    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 14:15:07.472362 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472131    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 14:15:07.472362 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472134    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 14:15:07.472362 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472137    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 14:15:07.472362 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472139    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 14:15:07.472362 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472142    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 14:15:07.472362 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472145    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 14:15:07.472362 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472147    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 14:15:07.472362 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472151    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 14:15:07.472362 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472153    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 14:15:07.472362 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472156    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 14:15:07.472362 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472158    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 14:15:07.472362 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472160    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 14:15:07.472362 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472163    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 14:15:07.472362 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472166    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 14:15:07.472362 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472168    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 14:15:07.472908 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472171    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 14:15:07.472908 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472174    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 14:15:07.472908 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472176    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 14:15:07.472908 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472179    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 14:15:07.472908 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472181    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 14:15:07.472908 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472184    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 14:15:07.472908 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472186    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 14:15:07.472908 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472189    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 14:15:07.472908 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472192    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 14:15:07.472908 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472195    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 14:15:07.472908 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472198    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 14:15:07.472908 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472200    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 14:15:07.472908 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472203    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 14:15:07.472908 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472207    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 14:15:07.472908 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472209    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 14:15:07.472908 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472212    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 14:15:07.472908 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472215    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 14:15:07.472908 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472217    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 14:15:07.472908 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472220    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 14:15:07.472908 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472223    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 14:15:07.473393 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472225    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 14:15:07.473393 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472229    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 14:15:07.473393 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472233    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 14:15:07.473393 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472236    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 14:15:07.473393 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472239    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 14:15:07.473393 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472242    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 14:15:07.473393 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472245    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 14:15:07.473393 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472247    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 14:15:07.473393 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472250    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 14:15:07.473393 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472253    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 14:15:07.473393 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472255    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 14:15:07.473393 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472258    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 14:15:07.473393 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472261    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 14:15:07.473393 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472263    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 14:15:07.473393 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472266    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 14:15:07.473393 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472269    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 14:15:07.473393 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472271    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 14:15:07.473393 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472274    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 14:15:07.473393 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472276    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 14:15:07.473889 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472279    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 14:15:07.473889 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472282    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 14:15:07.473889 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472284    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 14:15:07.473889 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472287    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 14:15:07.473889 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472289    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 14:15:07.473889 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472292    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 14:15:07.473889 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472295    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 14:15:07.473889 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472298    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 14:15:07.473889 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472300    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 14:15:07.473889 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472303    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 14:15:07.473889 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472305    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 14:15:07.473889 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472308    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 14:15:07.473889 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472310    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 14:15:07.473889 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472313    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 14:15:07.473889 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472315    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 14:15:07.473889 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472318    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 14:15:07.473889 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472320    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 14:15:07.473889 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472323    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 14:15:07.473889 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472326    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 14:15:07.473889 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472328    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 14:15:07.474401 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472330    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 14:15:07.474401 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472333    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 14:15:07.474401 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472335    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 14:15:07.474401 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472338    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 14:15:07.474401 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472342    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 14:15:07.474401 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472346    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 14:15:07.474401 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472349    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 14:15:07.474401 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472352    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 14:15:07.474401 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472354    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 14:15:07.474401 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472357    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 14:15:07.474401 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472362    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 14:15:07.474401 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472370    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 14:15:07.474401 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472373    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 14:15:07.474401 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472376    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 14:15:07.474401 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472379    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 14:15:07.474401 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472382    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 14:15:07.474401 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472385    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 14:15:07.474401 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472388    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 14:15:07.474401 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472391    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 14:15:07.474978 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472394    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 14:15:07.474978 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472801    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 14:15:07.474978 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472808    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 14:15:07.474978 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472812    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 14:15:07.474978 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472815    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 14:15:07.474978 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472818    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 14:15:07.474978 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472820    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 14:15:07.474978 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472823    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 14:15:07.474978 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472826    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 14:15:07.474978 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472828    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 14:15:07.474978 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472831    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 14:15:07.474978 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472834    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 14:15:07.474978 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472836    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 14:15:07.474978 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472839    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 14:15:07.474978 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472841    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 14:15:07.474978 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472844    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 14:15:07.474978 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472847    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 14:15:07.474978 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472850    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 14:15:07.474978 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472852    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 14:15:07.474978 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472855    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 14:15:07.475480 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472857    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 14:15:07.475480 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472860    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 14:15:07.475480 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472862    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 14:15:07.475480 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472866    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 14:15:07.475480 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472869    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 14:15:07.475480 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472871    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 14:15:07.475480 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472874    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 14:15:07.475480 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472876    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 14:15:07.475480 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472879    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 14:15:07.475480 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472882    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 14:15:07.475480 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472885    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 14:15:07.475480 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472888    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 14:15:07.475480 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472890    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 14:15:07.475480 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472893    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 14:15:07.475480 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472895    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 14:15:07.475480 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472898    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 14:15:07.475480 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472901    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 14:15:07.475480 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472903    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 14:15:07.475480 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472906    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 14:15:07.475480 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472909    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 14:15:07.475984 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472911    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 14:15:07.475984 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472914    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 14:15:07.475984 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472919    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 14:15:07.475984 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472923    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 14:15:07.475984 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472925    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 14:15:07.475984 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472928    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 14:15:07.475984 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472931    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 14:15:07.475984 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472933    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 14:15:07.475984 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472937    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 14:15:07.475984 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472941    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 14:15:07.475984 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472944    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 14:15:07.475984 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472947    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 14:15:07.475984 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472950    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 14:15:07.475984 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472953    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 14:15:07.475984 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472955    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 14:15:07.475984 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472959    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 14:15:07.475984 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472962    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 14:15:07.475984 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472965    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 14:15:07.475984 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472967    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 14:15:07.476447 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472970    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 14:15:07.476447 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472973    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 14:15:07.476447 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472976    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 14:15:07.476447 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472978    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 14:15:07.476447 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472981    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 14:15:07.476447 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472983    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 14:15:07.476447 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472986    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 14:15:07.476447 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472990    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 14:15:07.476447 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472993    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 14:15:07.476447 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472996    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 14:15:07.476447 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.472999    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 14:15:07.476447 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473001    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 14:15:07.476447 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473004    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 14:15:07.476447 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473007    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 14:15:07.476447 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473010    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 14:15:07.476447 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473012    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 14:15:07.476447 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473015    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 14:15:07.476447 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473018    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 14:15:07.476447 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473020    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 14:15:07.476922 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473023    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 14:15:07.476922 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473025    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 14:15:07.476922 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473028    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 14:15:07.476922 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473030    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 14:15:07.476922 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473033    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 14:15:07.476922 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473036    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 14:15:07.476922 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473038    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 14:15:07.476922 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473041    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 14:15:07.476922 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473043    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 14:15:07.476922 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473046    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 14:15:07.476922 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473048    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 14:15:07.476922 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473051    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 14:15:07.476922 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473054    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 14:15:07.476922 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473057    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 14:15:07.476922 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473060    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 14:15:07.476922 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473062    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 14:15:07.476922 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473065    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 14:15:07.476922 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473068    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 14:15:07.476922 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473070    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 14:15:07.476922 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473073    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 14:15:07.477415 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473076    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 14:15:07.477415 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473078    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 14:15:07.477415 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473152    2584 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 14:15:07.477415 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473200    2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 14:15:07.477415 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473212    2584 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 14:15:07.477415 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473216    2584 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 14:15:07.477415 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473220    2584 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 14:15:07.477415 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473224    2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 14:15:07.477415 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473228    2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 14:15:07.477415 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473232    2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 14:15:07.477415 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473235    2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 14:15:07.477415 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473238    2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 14:15:07.477415 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473242    2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 14:15:07.477415 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473245    2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 14:15:07.477415 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473249    2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 14:15:07.477415 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473252    2584 flags.go:64] FLAG: --cgroup-root=""
Sep 11 14:15:07.477415 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473254    2584 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 14:15:07.477415 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473257    2584 flags.go:64] FLAG: --client-ca-file=""
Sep 11 14:15:07.477415 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473261    2584 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 14:15:07.477415 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473264    2584 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 14:15:07.477415 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473268    2584 flags.go:64] FLAG: --cluster-domain=""
Sep 11 14:15:07.477415 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473271    2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 14:15:07.477415 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473274    2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 14:15:07.477415 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473277    2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 14:15:07.478034 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473281    2584 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 14:15:07.478034 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473285    2584 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 14:15:07.478034 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473287    2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 14:15:07.478034 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473290    2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 14:15:07.478034 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473294    2584 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 14:15:07.478034 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473297    2584 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 14:15:07.478034 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473300    2584 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 14:15:07.478034 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473303    2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 14:15:07.478034 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473306    2584 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 14:15:07.478034 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473309    2584 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 14:15:07.478034 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473313    2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 14:15:07.478034 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473316    2584 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 14:15:07.478034 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473319    2584 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 14:15:07.478034 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473322    2584 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 14:15:07.478034 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473325    2584 flags.go:64] FLAG: --enable-server="true"
Sep 11 14:15:07.478034 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473328    2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 14:15:07.478034 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473333    2584 flags.go:64] FLAG: --event-burst="100"
Sep 11 14:15:07.478034 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473336    2584 flags.go:64] FLAG: --event-qps="50"
Sep 11 14:15:07.478034 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473339    2584 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 14:15:07.478034 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473342    2584 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 14:15:07.478034 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473345    2584 flags.go:64] FLAG: --eviction-hard=""
Sep 11 14:15:07.478034 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473349    2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 14:15:07.478034 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473351    2584 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 14:15:07.478034 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473354    2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 14:15:07.478034 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473357    2584 flags.go:64] FLAG: --eviction-soft=""
Sep 11 14:15:07.478614 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473360    2584 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 14:15:07.478614 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473364    2584 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 14:15:07.478614 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473367    2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 14:15:07.478614 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473370    2584 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 14:15:07.478614 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473373    2584 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 14:15:07.478614 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473376    2584 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 14:15:07.478614 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473379    2584 flags.go:64] FLAG: --feature-gates=""
Sep 11 14:15:07.478614 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473382    2584 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 14:15:07.478614 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473386    2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 14:15:07.478614 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473388    2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 14:15:07.478614 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473392    2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 14:15:07.478614 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473395    2584 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 14:15:07.478614 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473398    2584 flags.go:64] FLAG: --help="false"
Sep 11 14:15:07.478614 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473401    2584 flags.go:64] FLAG: --hostname-override="ip-10-0-133-175.ec2.internal"
Sep 11 14:15:07.478614 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473404    2584 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 14:15:07.478614 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473407    2584 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 14:15:07.478614 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473410    2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 14:15:07.478614 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473413    2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 14:15:07.478614 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473416    2584 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 14:15:07.478614 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473419    2584 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 14:15:07.478614 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473423    2584 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 14:15:07.478614 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473425    2584 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 14:15:07.478614 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473428    2584 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 14:15:07.479255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473431    2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 14:15:07.479255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473434    2584 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 14:15:07.479255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473437    2584 flags.go:64] FLAG: --kube-reserved=""
Sep 11 14:15:07.479255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473440    2584 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 14:15:07.479255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473443    2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 14:15:07.479255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473446    2584 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 14:15:07.479255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473448    2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 14:15:07.479255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473451    2584 flags.go:64] FLAG: --lock-file=""
Sep 11 14:15:07.479255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473454    2584 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 14:15:07.479255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473457    2584 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 14:15:07.479255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473460    2584 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 14:15:07.479255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473465    2584 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 14:15:07.479255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473468    2584 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 14:15:07.479255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473471    2584 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 14:15:07.479255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473474    2584 flags.go:64] FLAG: --logging-format="text"
Sep 11 14:15:07.479255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473476    2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 14:15:07.479255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473482    2584 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 14:15:07.479255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473485    2584 flags.go:64] FLAG: --manifest-url=""
Sep 11 14:15:07.479255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473487    2584 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 14:15:07.479255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473492    2584 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 14:15:07.479255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473495    2584 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 14:15:07.479255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473499    2584 flags.go:64] FLAG: --max-pods="110"
Sep 11 14:15:07.479255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473502    2584 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 14:15:07.479255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473505    2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 14:15:07.479255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473508    2584 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 14:15:07.480133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473511    2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 14:15:07.480133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473514    2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 14:15:07.480133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473517    2584 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 14:15:07.480133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473520    2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 14:15:07.480133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473528    2584 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 14:15:07.480133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473531    2584 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 14:15:07.480133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473534    2584 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 14:15:07.480133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473537    2584 flags.go:64] FLAG: --pod-cidr=""
Sep 11 14:15:07.480133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473540    2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 14:15:07.480133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473545    2584 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 14:15:07.480133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473547    2584 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 14:15:07.480133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473551    2584 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 14:15:07.480133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473554    2584 flags.go:64] FLAG: --port="10250"
Sep 11 14:15:07.480133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473557    2584 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 14:15:07.480133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473559    2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0100c4c43a8375ca1"
Sep 11 14:15:07.480133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473563    2584 flags.go:64] FLAG: --qos-reserved=""
Sep 11 14:15:07.480133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473566    2584 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 14:15:07.480133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473569    2584 flags.go:64] FLAG: --register-node="true"
Sep 11 14:15:07.480133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473571    2584 flags.go:64] FLAG: --register-with-taints=""
Sep 11 14:15:07.480133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473575    2584 flags.go:64] FLAG: --registry-burst="10"
Sep 11 14:15:07.480133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473580    2584 flags.go:64] FLAG: --registry-qps="5"
Sep 11 14:15:07.480133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473583    2584 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 14:15:07.480133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473586    2584 flags.go:64] FLAG: --reserved-memory=""
Sep 11 14:15:07.480133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473590    2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 14:15:07.480133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473595    2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 14:15:07.481196 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473598    2584 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 14:15:07.481196 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473601    2584 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 14:15:07.481196 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473605    2584 flags.go:64] FLAG: --runonce="false"
Sep 11 14:15:07.481196 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473608    2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 14:15:07.481196 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473611    2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 14:15:07.481196 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473614    2584 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 14:15:07.481196 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473617    2584 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 14:15:07.481196 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473620    2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 14:15:07.481196 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473623    2584 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 14:15:07.481196 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473626    2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 14:15:07.481196 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473629    2584 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 14:15:07.481196 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473632    2584 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 14:15:07.481196 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473635    2584 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 14:15:07.481196 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473638    2584 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 14:15:07.481196 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473641    2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 14:15:07.481196 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473644    2584 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 14:15:07.481196 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473647    2584 flags.go:64] FLAG: --system-cgroups=""
Sep 11 14:15:07.481196 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473650    2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 14:15:07.481196 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473655    2584 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 14:15:07.481196 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473658    2584 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 14:15:07.481196 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473661    2584 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 14:15:07.481196 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473666    2584 flags.go:64] FLAG: --tls-min-version=""
Sep 11 14:15:07.481196 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473668    2584 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 14:15:07.481196 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473672    2584 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 14:15:07.481196 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473689    2584 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 14:15:07.482137 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473694    2584 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 14:15:07.482137 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473699    2584 flags.go:64] FLAG: --v="2"
Sep 11 14:15:07.482137 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473705    2584 flags.go:64] FLAG: --version="false"
Sep 11 14:15:07.482137 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473710    2584 flags.go:64] FLAG: --vmodule=""
Sep 11 14:15:07.482137 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473713    2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 14:15:07.482137 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.473717    2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 14:15:07.482137 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473833    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 14:15:07.482137 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473838    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 14:15:07.482137 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473843    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 14:15:07.482137 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473848    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 14:15:07.482137 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473851    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 14:15:07.482137 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473855    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 14:15:07.482137 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473858    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 14:15:07.482137 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473861    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 14:15:07.482137 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473864    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 14:15:07.482137 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473867    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 14:15:07.482137 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473870    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 14:15:07.482137 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473873    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 14:15:07.482137 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473877    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 14:15:07.482137 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473880    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 14:15:07.482137 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473884    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 14:15:07.482827 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473886    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 14:15:07.482827 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473890    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 14:15:07.482827 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473893    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 14:15:07.482827 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473896    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 14:15:07.482827 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473898    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 14:15:07.482827 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473901    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 14:15:07.482827 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473904    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 14:15:07.482827 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473907    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 14:15:07.482827 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473910    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 14:15:07.482827 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473912    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 14:15:07.482827 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473915    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 14:15:07.482827 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473918    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 14:15:07.482827 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473921    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 14:15:07.482827 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473924    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 14:15:07.482827 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473927    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 14:15:07.482827 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473930    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 14:15:07.482827 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473933    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 14:15:07.482827 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473937    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 14:15:07.482827 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473940    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 14:15:07.482827 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473942    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 14:15:07.482827 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473945    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 14:15:07.483744 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473947    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 14:15:07.483744 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473950    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 14:15:07.483744 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473953    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 14:15:07.483744 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473956    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 14:15:07.483744 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473958    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 14:15:07.483744 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473961    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 14:15:07.483744 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473963    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 14:15:07.483744 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473966    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 14:15:07.483744 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473969    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 14:15:07.483744 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473972    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 14:15:07.483744 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473974    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 14:15:07.483744 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473977    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 14:15:07.483744 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473979    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 14:15:07.483744 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473983    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 14:15:07.483744 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473985    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 14:15:07.483744 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473987    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 14:15:07.483744 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473990    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 14:15:07.483744 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473992    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 14:15:07.483744 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473995    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 14:15:07.484367 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.473997    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 14:15:07.484367 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474000    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 14:15:07.484367 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474002    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 14:15:07.484367 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474005    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 14:15:07.484367 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474007    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 14:15:07.484367 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474010    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 14:15:07.484367 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474013    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 14:15:07.484367 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474015    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 14:15:07.484367 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474018    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 14:15:07.484367 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474022    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 14:15:07.484367 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474024    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 14:15:07.484367 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474027    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 14:15:07.484367 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474030    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 14:15:07.484367 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474032    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 14:15:07.484367 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474035    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 14:15:07.484367 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474037    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 14:15:07.484367 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474041    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 14:15:07.484367 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474045    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 14:15:07.484367 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474048    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 14:15:07.485116 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474051    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 14:15:07.485116 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474054    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 14:15:07.485116 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474057    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 14:15:07.485116 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474061    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 14:15:07.485116 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474064    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 14:15:07.485116 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474068    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 14:15:07.485116 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474071    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 14:15:07.485116 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474073    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 14:15:07.485116 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474076    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 14:15:07.485116 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474079    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 14:15:07.485116 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474082    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 14:15:07.485116 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474085    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 14:15:07.485116 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474088    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 14:15:07.485116 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474091    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 14:15:07.485116 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474094    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 14:15:07.485116 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474096    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 14:15:07.485116 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474099    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 14:15:07.485116 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474102    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 14:15:07.485116 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474105    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 14:15:07.485116 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474108    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 14:15:07.486028 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474110    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 14:15:07.486028 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474113    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 14:15:07.486028 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474117    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 14:15:07.486028 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474120    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 14:15:07.486028 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.474122    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 14:15:07.486028 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.474131    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 14:15:07.486028 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.481843    2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 14:15:07.486028 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.481868    2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 14:15:07.486028 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.482592    2584 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 14:15:07.486028 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.482610    2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 14:15:07.486028 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482715    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 14:15:07.486028 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482724    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 14:15:07.486028 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482729    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 14:15:07.486028 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482734    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 14:15:07.486384 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482738    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 14:15:07.486384 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482742    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 14:15:07.486384 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482747    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 14:15:07.486384 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482751    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 14:15:07.486384 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482755    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 14:15:07.486384 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482760    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 14:15:07.486384 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482765    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 14:15:07.486384 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482769    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 14:15:07.486384 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482773    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 14:15:07.486384 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482777    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 14:15:07.486384 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482782    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 14:15:07.486384 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482786    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 14:15:07.486384 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482791    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 14:15:07.486384 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482795    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 14:15:07.486384 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482799    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 14:15:07.486384 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482803    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 14:15:07.486384 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482808    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 14:15:07.486384 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482812    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 14:15:07.486384 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482816    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 14:15:07.486384 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482820    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 14:15:07.487031 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482824    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 14:15:07.487031 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482829    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 14:15:07.487031 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482835    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 14:15:07.487031 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482840    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 14:15:07.487031 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482845    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 14:15:07.487031 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482852    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 14:15:07.487031 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482857    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 14:15:07.487031 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482861    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 14:15:07.487031 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482866    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 14:15:07.487031 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482871    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 14:15:07.487031 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482875    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 14:15:07.487031 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482882    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 14:15:07.487031 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482888    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 14:15:07.487031 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482893    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 14:15:07.487031 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482897    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 14:15:07.487031 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482901    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 14:15:07.487031 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482906    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 14:15:07.487031 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482912    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 14:15:07.487031 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482916    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 14:15:07.487532 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482921    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 14:15:07.487532 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482925    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 14:15:07.487532 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482929    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 14:15:07.487532 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482934    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 14:15:07.487532 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482938    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 14:15:07.487532 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482942    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 14:15:07.487532 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482947    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 14:15:07.487532 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482951    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 14:15:07.487532 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482956    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 14:15:07.487532 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482960    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 14:15:07.487532 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482964    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 14:15:07.487532 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482968    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 14:15:07.487532 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482973    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 14:15:07.487532 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482977    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 14:15:07.487532 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482981    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 14:15:07.487532 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482985    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 14:15:07.487532 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482989    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 14:15:07.487532 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482994    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 14:15:07.487532 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.482999    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 14:15:07.487532 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483005    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 14:15:07.488111 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483009    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 14:15:07.488111 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483013    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 14:15:07.488111 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483018    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 14:15:07.488111 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483022    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 14:15:07.488111 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483026    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 14:15:07.488111 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483030    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 14:15:07.488111 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483034    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 14:15:07.488111 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483039    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 14:15:07.488111 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483043    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 14:15:07.488111 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483047    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 14:15:07.488111 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483051    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 14:15:07.488111 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483055    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 14:15:07.488111 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483059    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 14:15:07.488111 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483063    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 14:15:07.488111 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483068    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 14:15:07.488111 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483072    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 14:15:07.488111 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483076    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 14:15:07.488111 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483080    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 14:15:07.488111 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483085    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 14:15:07.488111 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483089    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 14:15:07.488652 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483093    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 14:15:07.488652 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483097    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 14:15:07.488652 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483101    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 14:15:07.488652 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483105    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 14:15:07.488652 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483109    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 14:15:07.488652 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483113    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 14:15:07.488652 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483118    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 14:15:07.488652 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483125    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 14:15:07.488652 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483130    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 14:15:07.488652 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483135    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 14:15:07.488652 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483139    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 14:15:07.488652 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483143    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 14:15:07.488652 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483148    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 14:15:07.488652 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483152    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 14:15:07.488652 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483156    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 14:15:07.488652 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483161    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 14:15:07.489065 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.483169    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 14:15:07.489065 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483345    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 14:15:07.489065 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483352    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 14:15:07.489065 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483357    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 14:15:07.489065 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483363    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 14:15:07.489065 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483368    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 14:15:07.489065 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483372    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 14:15:07.489065 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483376    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 14:15:07.489065 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483380    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 14:15:07.489065 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483385    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 14:15:07.489065 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483389    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 14:15:07.489065 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483395    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 14:15:07.489065 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483402    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 14:15:07.489065 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483406    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 14:15:07.489453 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483411    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 14:15:07.489453 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483415    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 14:15:07.489453 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483420    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 14:15:07.489453 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483425    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 14:15:07.489453 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483429    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 14:15:07.489453 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483433    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 14:15:07.489453 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483438    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 14:15:07.489453 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483442    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 14:15:07.489453 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483446    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 14:15:07.489453 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483452    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 14:15:07.489453 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483457    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 14:15:07.489453 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483461    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 14:15:07.489453 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483465    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 14:15:07.489453 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483469    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 14:15:07.489453 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483473    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 14:15:07.489453 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483478    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 14:15:07.489453 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483482    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 14:15:07.489453 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483486    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 14:15:07.489453 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483491    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 14:15:07.489453 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483494    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 14:15:07.490079 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483499    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 14:15:07.490079 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483503    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 14:15:07.490079 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483507    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 14:15:07.490079 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483511    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 14:15:07.490079 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483515    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 14:15:07.490079 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483519    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 14:15:07.490079 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483524    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 14:15:07.490079 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483528    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 14:15:07.490079 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483532    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 14:15:07.490079 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483537    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 14:15:07.490079 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483540    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 14:15:07.490079 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483545    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 14:15:07.490079 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483549    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 14:15:07.490079 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483553    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 14:15:07.490079 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483557    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 14:15:07.490079 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483561    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 14:15:07.490079 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483566    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 14:15:07.490079 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483570    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 14:15:07.490079 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483574    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 14:15:07.490079 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483578    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 14:15:07.490929 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483583    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 14:15:07.490929 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483587    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 14:15:07.490929 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483591    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 14:15:07.490929 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483595    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 14:15:07.490929 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483599    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 14:15:07.490929 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483604    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 14:15:07.490929 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483608    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 14:15:07.490929 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483612    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 14:15:07.490929 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483617    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 14:15:07.490929 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483621    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 14:15:07.490929 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483626    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 14:15:07.490929 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483630    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 14:15:07.490929 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483634    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 14:15:07.490929 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483638    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 14:15:07.490929 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483642    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 14:15:07.490929 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483647    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 14:15:07.490929 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483651    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 14:15:07.490929 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483655    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 14:15:07.490929 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483659    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 14:15:07.490929 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483663    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 14:15:07.491662 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483668    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 14:15:07.491662 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483672    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 14:15:07.491662 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483694    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 14:15:07.491662 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483700    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 14:15:07.491662 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483704    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 14:15:07.491662 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483711    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 14:15:07.491662 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483716    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 14:15:07.491662 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483721    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 14:15:07.491662 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483726    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 14:15:07.491662 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483730    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 14:15:07.491662 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483734    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 14:15:07.491662 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483745    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 14:15:07.491662 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483749    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 14:15:07.491662 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483753    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 14:15:07.491662 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483758    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 14:15:07.491662 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483762    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 14:15:07.491662 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483767    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 14:15:07.491662 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483771    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 14:15:07.491662 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483775    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 14:15:07.491662 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483780    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 14:15:07.492197 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483784    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 14:15:07.492197 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483789    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 14:15:07.492197 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483792    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 14:15:07.492197 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483797    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 14:15:07.492197 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483801    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 14:15:07.492197 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:07.483805    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 14:15:07.492197 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.483813    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 14:15:07.492197 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.483967    2584 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 14:15:07.492197 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.486509    2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 14:15:07.492197 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.487733    2584 server.go:1019] "Starting client certificate rotation"
Sep 11 14:15:07.492197 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.487837    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 14:15:07.492197 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.488662    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 14:15:07.492197 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.490554    2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 14:15:07.493156 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.493134    2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 14:15:07.504091 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.504074    2584 log.go:25] "Validated CRI v1 runtime API"
Sep 11 14:15:07.507091 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.507077    2584 log.go:25] "Validated CRI v1 image API"
Sep 11 14:15:07.507831 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.507818    2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 14:15:07.511953 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.511935    2584 fs.go:135] Filesystem UUIDs: map[1e0a2147-a872-46da-8462-e04c8da35bcf:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8503be00-5dff-4685-898f-dcd9e4a7d98c:/dev/nvme0n1p4]
Sep 11 14:15:07.512031 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.511952    2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 14:15:07.517628 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.517501    2584 manager.go:216] Machine: {Timestamp:2026-09-11 14:15:07.516248516 +0000 UTC m=+0.314883288 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3131200 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec200a298bb88e59a3f88101bf50aebc SystemUUID:ec200a29-8bb8-8e59-a3f8-8101bf50aebc BootID:ac75faa4-10cf-4ba8-a452-c3e93f8c5d2f Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8a:6d:22:fb:d3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8a:6d:22:fb:d3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:a9:d5:db:44:10 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 14:15:07.517628 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.517624    2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 14:15:07.517751 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.517713    2584 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 14:15:07.520886 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.520858    2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 14:15:07.521015 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.520890    2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-175.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 14:15:07.521540 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.521531    2584 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 14:15:07.521569 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.521543    2584 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 14:15:07.521569 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.521550    2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 14:15:07.521569 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.521562    2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 14:15:07.522333 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.522323    2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 14:15:07.525200 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.525189    2584 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 14:15:07.525316 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.525307    2584 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 14:15:07.525348 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.525339    2584 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 14:15:07.525381 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.525353    2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 14:15:07.525381 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.525363    2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 14:15:07.525381 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.525372    2584 kubelet.go:398] "Adding apiserver pod source"
Sep 11 14:15:07.525381 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.525381    2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 14:15:07.525704 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.525693    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 14:15:07.525741 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.525711    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 14:15:07.528725 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.528705    2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 14:15:07.530405 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.530390    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 14:15:07.531421 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.531405    2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 14:15:07.531508 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.531443    2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 14:15:07.533546 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.533531    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 14:15:07.533623 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.533558    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 14:15:07.533623 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.533569    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 14:15:07.533623 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.533577    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 14:15:07.533623 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.533588    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 14:15:07.533623 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.533596    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 14:15:07.533623 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.533615    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 14:15:07.533623 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.533623    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 14:15:07.533856 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.533633    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 14:15:07.533856 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.533641    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 14:15:07.533856 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.533654    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 14:15:07.533856 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.533663    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 14:15:07.535059 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.535042    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 14:15:07.535059 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.535060    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 14:15:07.538667 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.538653    2584 server.go:1268] "Started kubelet"
Sep 11 14:15:07.538784 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.538756    2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 14:15:07.539694 ip-10-0-133-175 systemd[1]: Started Kubernetes Kubelet.
Sep 11 14:15:07.539912 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.539616    2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 14:15:07.540654 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.540633    2584 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 14:15:07.542156 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.542135    2584 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 14:15:07.543615 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.542347    2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-175.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 14:15:07.543615 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:07.542367    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 14:15:07.543615 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:07.542945    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-175.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 14:15:07.544332 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.544313    2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 14:15:07.546248 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:07.543408    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-175.ec2.internal.18d449cf80aa3158  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-175.ec2.internal,UID:ip-10-0-133-175.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-175.ec2.internal,},FirstTimestamp:2026-09-11 14:15:07.538624856 +0000 UTC m=+0.337259628,LastTimestamp:2026-09-11 14:15:07.538624856 +0000 UTC m=+0.337259628,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-175.ec2.internal,}"
Sep 11 14:15:07.546869 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:07.546843    2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 14:15:07.548319 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.548302    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 14:15:07.548943 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.548929    2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 14:15:07.549025 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:07.549003    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-175.ec2.internal\" not found"
Sep 11 14:15:07.549494 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.549478    2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 14:15:07.549494 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.549483    2584 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 14:15:07.549622 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.549501    2584 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 14:15:07.549622 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.549564    2584 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 14:15:07.549622 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.549573    2584 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 14:15:07.549752 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.549703    2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 14:15:07.549752 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.549713    2584 factory.go:55] Registering systemd factory
Sep 11 14:15:07.549752 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.549720    2584 factory.go:223] Registration of the systemd container factory successfully
Sep 11 14:15:07.549916 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.549903    2584 factory.go:153] Registering CRI-O factory
Sep 11 14:15:07.549916 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.549914    2584 factory.go:223] Registration of the crio container factory successfully
Sep 11 14:15:07.550065 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.549926    2584 factory.go:103] Registering Raw factory
Sep 11 14:15:07.550065 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.549935    2584 manager.go:1196] Started watching for new ooms in manager
Sep 11 14:15:07.550241 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.550231    2584 manager.go:349] Starting recovery of all containers
Sep 11 14:15:07.556174 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:07.556144    2584 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-175.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 14:15:07.556265 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:07.556239    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 14:15:07.561520 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.561385    2584 manager.go:354] Recovery completed
Sep 11 14:15:07.562984 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:07.562965    2584 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 11 14:15:07.566372 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.566355    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 14:15:07.568744 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.568722    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-175.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 14:15:07.568808 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.568758    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-175.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 14:15:07.568808 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.568777    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-175.ec2.internal" event="NodeHasSufficientPID"
Sep 11 14:15:07.569352 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.569333    2584 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 14:15:07.569352 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.569339    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 14:15:07.569457 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.569354    2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 14:15:07.569457 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.569400    2584 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 14:15:07.570105 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.570090    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-175.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 14:15:07.570162 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.570118    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-175.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 14:15:07.570162 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.570133    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-175.ec2.internal" event="NodeHasSufficientPID"
Sep 11 14:15:07.570800 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.570785    2584 policy_none.go:49] "None policy: Start"
Sep 11 14:15:07.570851 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.570805    2584 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 14:15:07.570851 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.570818    2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 14:15:07.571874 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.571861    2584 policy_none.go:47] "Start"
Sep 11 14:15:07.572989 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.572975    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kskzs"
Sep 11 14:15:07.581900 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:07.581824    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-175.ec2.internal.18d449cf8275c75f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-175.ec2.internal,UID:ip-10-0-133-175.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-175.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-175.ec2.internal,},FirstTimestamp:2026-09-11 14:15:07.568744287 +0000 UTC m=+0.367379069,LastTimestamp:2026-09-11 14:15:07.568744287 +0000 UTC m=+0.367379069,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-175.ec2.internal,}"
Sep 11 14:15:07.582493 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.582478    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kskzs"
Sep 11 14:15:07.612131 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.611293    2584 manager.go:337] "Starting Device Plugin manager"
Sep 11 14:15:07.612131 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:07.611322    2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 14:15:07.612131 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.611331    2584 server.go:87] "Starting device plugin registration server"
Sep 11 14:15:07.612131 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.611610    2584 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 14:15:07.612131 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.611624    2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 14:15:07.612131 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.612033    2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 14:15:07.612131 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.612101    2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 14:15:07.612131 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.612108    2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 14:15:07.612755 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:07.612727    2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 14:15:07.612836 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:07.612782    2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-175.ec2.internal\" not found"
Sep 11 14:15:07.671426 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.671407    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 14:15:07.672545 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.672529    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 14:15:07.672613 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.672583    2584 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 14:15:07.672613 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.672605    2584 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 14:15:07.672714 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:07.672697    2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 14:15:07.675111 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.675092    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 14:15:07.712426 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.712409    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 14:15:07.713208 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.713193    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-175.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 14:15:07.713300 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.713223    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-175.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 14:15:07.713300 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.713234    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-175.ec2.internal" event="NodeHasSufficientPID"
Sep 11 14:15:07.713300 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.713253    2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-175.ec2.internal"
Sep 11 14:15:07.724885 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.724870    2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-175.ec2.internal"
Sep 11 14:15:07.724952 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:07.724889    2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-175.ec2.internal\": node \"ip-10-0-133-175.ec2.internal\" not found"
Sep 11 14:15:07.758423 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:07.758408    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-175.ec2.internal\" not found"
Sep 11 14:15:07.773351 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.773328    2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-175.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-175.ec2.internal"]
Sep 11 14:15:07.773433 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.773385    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 14:15:07.774754 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.774738    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-175.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 14:15:07.774834 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.774764    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-175.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 14:15:07.774834 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.774774    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-175.ec2.internal" event="NodeHasSufficientPID"
Sep 11 14:15:07.776214 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.776202    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 14:15:07.776324 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.776309    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-175.ec2.internal"
Sep 11 14:15:07.776370 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.776338    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 14:15:07.777093 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.777078    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-175.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 14:15:07.777093 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.777084    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-175.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 14:15:07.777188 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.777106    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-175.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 14:15:07.777188 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.777119    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-175.ec2.internal" event="NodeHasSufficientPID"
Sep 11 14:15:07.777247 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.777107    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-175.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 14:15:07.777279 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.777252    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-175.ec2.internal" event="NodeHasSufficientPID"
Sep 11 14:15:07.778270 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.778254    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-175.ec2.internal"
Sep 11 14:15:07.778356 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.778279    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 14:15:07.784835 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.784819    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-175.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 14:15:07.784918 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.784845    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-175.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 14:15:07.784918 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.784857    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-175.ec2.internal" event="NodeHasSufficientPID"
Sep 11 14:15:07.791247 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:07.791231    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-175.ec2.internal\" not found" node="ip-10-0-133-175.ec2.internal"
Sep 11 14:15:07.796643 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:07.796628    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-175.ec2.internal\" not found" node="ip-10-0-133-175.ec2.internal"
Sep 11 14:15:07.851157 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.851135    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/40b92ede76a0d26bc61d1d418aecb2fa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-175.ec2.internal\" (UID: \"40b92ede76a0d26bc61d1d418aecb2fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-175.ec2.internal"
Sep 11 14:15:07.851244 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.851164    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40b92ede76a0d26bc61d1d418aecb2fa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-175.ec2.internal\" (UID: \"40b92ede76a0d26bc61d1d418aecb2fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-175.ec2.internal"
Sep 11 14:15:07.851244 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.851188    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/03736b57a79149ed7e63d2686d1a25d5-config\") pod \"kube-apiserver-proxy-ip-10-0-133-175.ec2.internal\" (UID: \"03736b57a79149ed7e63d2686d1a25d5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-175.ec2.internal"
Sep 11 14:15:07.859218 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:07.859199    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-175.ec2.internal\" not found"
Sep 11 14:15:07.952260 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.952237    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/03736b57a79149ed7e63d2686d1a25d5-config\") pod \"kube-apiserver-proxy-ip-10-0-133-175.ec2.internal\" (UID: \"03736b57a79149ed7e63d2686d1a25d5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-175.ec2.internal"
Sep 11 14:15:07.952359 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.952264    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/40b92ede76a0d26bc61d1d418aecb2fa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-175.ec2.internal\" (UID: \"40b92ede76a0d26bc61d1d418aecb2fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-175.ec2.internal"
Sep 11 14:15:07.952359 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.952288    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40b92ede76a0d26bc61d1d418aecb2fa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-175.ec2.internal\" (UID: \"40b92ede76a0d26bc61d1d418aecb2fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-175.ec2.internal"
Sep 11 14:15:07.952359 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.952337    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40b92ede76a0d26bc61d1d418aecb2fa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-175.ec2.internal\" (UID: \"40b92ede76a0d26bc61d1d418aecb2fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-175.ec2.internal"
Sep 11 14:15:07.952359 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.952349    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/40b92ede76a0d26bc61d1d418aecb2fa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-175.ec2.internal\" (UID: \"40b92ede76a0d26bc61d1d418aecb2fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-175.ec2.internal"
Sep 11 14:15:07.952539 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:07.952353    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/03736b57a79149ed7e63d2686d1a25d5-config\") pod \"kube-apiserver-proxy-ip-10-0-133-175.ec2.internal\" (UID: \"03736b57a79149ed7e63d2686d1a25d5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-175.ec2.internal"
Sep 11 14:15:07.959470 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:07.959449    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-175.ec2.internal\" not found"
Sep 11 14:15:08.060519 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:08.060471    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-175.ec2.internal\" not found"
Sep 11 14:15:08.093655 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:08.093635    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-175.ec2.internal"
Sep 11 14:15:08.099462 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:08.099448    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-175.ec2.internal"
Sep 11 14:15:08.161440 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:08.161412    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-175.ec2.internal\" not found"
Sep 11 14:15:08.261763 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:08.261728    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-175.ec2.internal\" not found"
Sep 11 14:15:08.362204 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:08.362138    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-175.ec2.internal\" not found"
Sep 11 14:15:08.446603 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:08.446568    2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 14:15:08.462843 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:08.462821    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-175.ec2.internal\" not found"
Sep 11 14:15:08.486944 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:08.486925    2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 14:15:08.487304 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:08.487071    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 14:15:08.487304 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:08.487083    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 14:15:08.563051 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:08.563028    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-175.ec2.internal\" not found"
Sep 11 14:15:08.573913 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:08.573890    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40b92ede76a0d26bc61d1d418aecb2fa.slice/crio-8518d7dd126e9992fd242066f9790068d8ec940cf48a4432df0775cc54acbaa8 WatchSource:0}: Error finding container 8518d7dd126e9992fd242066f9790068d8ec940cf48a4432df0775cc54acbaa8: Status 404 returned error can't find the container with id 8518d7dd126e9992fd242066f9790068d8ec940cf48a4432df0775cc54acbaa8
Sep 11 14:15:08.574143 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:08.574123    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03736b57a79149ed7e63d2686d1a25d5.slice/crio-b9cdd33c8a0cfd7bdc2805f167b1f714468382468ef675efc15c7fe059606157 WatchSource:0}: Error finding container b9cdd33c8a0cfd7bdc2805f167b1f714468382468ef675efc15c7fe059606157: Status 404 returned error can't find the container with id b9cdd33c8a0cfd7bdc2805f167b1f714468382468ef675efc15c7fe059606157
Sep 11 14:15:08.578873 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:08.578855    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 14:15:08.586031 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:08.586007    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 14:10:07 +0000 UTC" deadline="2028-05-31 04:01:07.344228402 +0000 UTC"
Sep 11 14:15:08.586031 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:08.586030    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15061h45m58.758201254s"
Sep 11 14:15:08.607475 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:08.607461    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 14:15:08.608154 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:08.608140    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-175.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 14:15:08.608219 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:08.608168    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-175.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 14:15:08.608219 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:08.608178    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-175.ec2.internal" event="NodeHasSufficientPID"
Sep 11 14:15:08.663364 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:08.663310    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-175.ec2.internal\" not found"
Sep 11 14:15:08.675191 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:08.675155    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-175.ec2.internal" event={"ID":"03736b57a79149ed7e63d2686d1a25d5","Type":"ContainerStarted","Data":"b9cdd33c8a0cfd7bdc2805f167b1f714468382468ef675efc15c7fe059606157"}
Sep 11 14:15:08.676170 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:08.676153    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-175.ec2.internal" event={"ID":"40b92ede76a0d26bc61d1d418aecb2fa","Type":"ContainerStarted","Data":"8518d7dd126e9992fd242066f9790068d8ec940cf48a4432df0775cc54acbaa8"}
Sep 11 14:15:08.763562 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:08.763542    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-175.ec2.internal\" not found"
Sep 11 14:15:08.780062 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:08.780047    2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 14:15:08.849936 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:08.849920    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-175.ec2.internal"
Sep 11 14:15:08.862781 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:08.862764    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 14:15:08.863608 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:08.863598    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-175.ec2.internal"
Sep 11 14:15:08.873672 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:08.873655    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 14:15:09.101348 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.101186    2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 14:15:09.420988 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.420930    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 14:15:09.527036 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.527014    2584 apiserver.go:52] "Watching apiserver"
Sep 11 14:15:09.534652 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.534625    2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 14:15:09.536209 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.536183    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-952fp","openshift-dns/node-resolver-77vcp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-175.ec2.internal","openshift-multus/multus-qqfdv","openshift-multus/network-metrics-daemon-dqhsk","openshift-network-diagnostics/network-check-target-wqqzl","kube-system/konnectivity-agent-7gt5x","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgsjj","openshift-image-registry/node-ca-2rhc2","openshift-multus/multus-additional-cni-plugins-5xfdr","openshift-network-operator/iptables-alerter-hm4qt","openshift-ovn-kubernetes/ovnkube-node-bft2j","kube-system/global-pull-secret-syncer-dwq8z","kube-system/kube-apiserver-proxy-ip-10-0-133-175.ec2.internal"]
Sep 11 14:15:09.537450 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.537431    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7gt5x"
Sep 11 14:15:09.538407 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.538390    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:09.538492 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:09.538457    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwq8z" podUID="1550d3f8-d568-4b3b-80c5-34a9ddfb0e10"
Sep 11 14:15:09.539990 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.539968    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgsjj"
Sep 11 14:15:09.540075 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.540035    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bmlww\""
Sep 11 14:15:09.540075 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.540049    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 14:15:09.540283 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.540270    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 14:15:09.541483 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.541428    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.542176 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.542161    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 14:15:09.542359 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.542345    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g7f7b\""
Sep 11 14:15:09.542525 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.542509    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:15:09.542612 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:09.542560    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqhsk" podUID="69446d2a-2163-4a00-8b2d-02c7dee348e3"
Sep 11 14:15:09.543346 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.543329    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 14:15:09.543419 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.543398    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 14:15:09.543846 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.543831    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 14:15:09.543953 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.543846    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 14:15:09.543953 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.543879    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:15:09.543953 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:09.543928    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqqzl" podUID="96099d3a-c51d-4599-b015-a30ff4c09bc6"
Sep 11 14:15:09.544129 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.544053    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 14:15:09.544129 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.544080    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 14:15:09.544225 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.544055    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-h65r4\""
Sep 11 14:15:09.544927 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.544911    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2rhc2"
Sep 11 14:15:09.546165 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.546148    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.547419 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.547215    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 14:15:09.547419 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.547235    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-77vcp"
Sep 11 14:15:09.547419 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.547269    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 14:15:09.547419 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.547282    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 14:15:09.547419 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.547287    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hq7h7\""
Sep 11 14:15:09.548603 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.548588    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dwfz2\""
Sep 11 14:15:09.548944 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.548927    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 14:15:09.549059 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.549046    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5xfdr"
Sep 11 14:15:09.549317 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.549207    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 14:15:09.549466 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.549451    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 14:15:09.549527 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.549484    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 14:15:09.549527 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.549509    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-z27gd\""
Sep 11 14:15:09.549844 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.549823    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 14:15:09.550856 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.550478    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hm4qt"
Sep 11 14:15:09.551945 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.551917    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xqtkw\""
Sep 11 14:15:09.552176 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.552071    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.552176 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.552096    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 14:15:09.552635 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.552488    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 14:15:09.553187 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.553168    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 14:15:09.553350 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.553336    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 14:15:09.553437 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.553413    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 14:15:09.553494 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.553466    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qzrvc\""
Sep 11 14:15:09.553986 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.553967    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 14:15:09.554284 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.554269    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 14:15:09.555749 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.555733    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 14:15:09.555930 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.555910    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 14:15:09.556026 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.555967    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 14:15:09.556161 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.556142    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 14:15:09.556161 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.556155    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8qnb5\""
Sep 11 14:15:09.561808 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.561790    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69446d2a-2163-4a00-8b2d-02c7dee348e3-metrics-certs\") pod \"network-metrics-daemon-dqhsk\" (UID: \"69446d2a-2163-4a00-8b2d-02c7dee348e3\") " pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:15:09.561893 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.561814    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt6px\" (UniqueName: \"kubernetes.io/projected/69446d2a-2163-4a00-8b2d-02c7dee348e3-kube-api-access-vt6px\") pod \"network-metrics-daemon-dqhsk\" (UID: \"69446d2a-2163-4a00-8b2d-02c7dee348e3\") " pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:15:09.561893 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.561829    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cd82c8bb-0bd0-4dfb-941c-1c3a5b727425-agent-certs\") pod \"konnectivity-agent-7gt5x\" (UID: \"cd82c8bb-0bd0-4dfb-941c-1c3a5b727425\") " pod="kube-system/konnectivity-agent-7gt5x"
Sep 11 14:15:09.561893 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.561842    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cd82c8bb-0bd0-4dfb-941c-1c3a5b727425-konnectivity-ca\") pod \"konnectivity-agent-7gt5x\" (UID: \"cd82c8bb-0bd0-4dfb-941c-1c3a5b727425\") " pod="kube-system/konnectivity-agent-7gt5x"
Sep 11 14:15:09.561893 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.561857    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-etc-systemd\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.561893 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.561885    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/132a3582-58a8-497f-a537-e38bde288795-host\") pod \"node-ca-2rhc2\" (UID: \"132a3582-58a8-497f-a537-e38bde288795\") " pod="openshift-image-registry/node-ca-2rhc2"
Sep 11 14:15:09.562115 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.561913    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3629f229-7ef5-4a0f-a90e-7b8de102ed1a-system-cni-dir\") pod \"multus-additional-cni-plugins-5xfdr\" (UID: \"3629f229-7ef5-4a0f-a90e-7b8de102ed1a\") " pod="openshift-multus/multus-additional-cni-plugins-5xfdr"
Sep 11 14:15:09.562115 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.561938    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-etc-kubernetes\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.562115 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.561966    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-etc-sysctl-d\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.562115 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.561993    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qssj\" (UniqueName: \"kubernetes.io/projected/3629f229-7ef5-4a0f-a90e-7b8de102ed1a-kube-api-access-7qssj\") pod \"multus-additional-cni-plugins-5xfdr\" (UID: \"3629f229-7ef5-4a0f-a90e-7b8de102ed1a\") " pod="openshift-multus/multus-additional-cni-plugins-5xfdr"
Sep 11 14:15:09.562115 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562017    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-host-var-lib-cni-multus\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.562115 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562030    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-hostroot\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.562115 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562062    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-multus-conf-dir\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.562115 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562071    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 14:15:09.562115 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562082    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq2dt\" (UniqueName: \"kubernetes.io/projected/e0f53898-0fed-452b-bca9-d8e064b83f2a-kube-api-access-sq2dt\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.562115 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562103    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45dsn\" (UniqueName: \"kubernetes.io/projected/060ec342-6ae9-4023-aec0-b08232216325-kube-api-access-45dsn\") pod \"aws-ebs-csi-driver-node-wgsjj\" (UID: \"060ec342-6ae9-4023-aec0-b08232216325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgsjj"
Sep 11 14:15:09.562483 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562126    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3629f229-7ef5-4a0f-a90e-7b8de102ed1a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5xfdr\" (UID: \"3629f229-7ef5-4a0f-a90e-7b8de102ed1a\") " pod="openshift-multus/multus-additional-cni-plugins-5xfdr"
Sep 11 14:15:09.562483 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562157    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mskf\" (UniqueName: \"kubernetes.io/projected/132a3582-58a8-497f-a537-e38bde288795-kube-api-access-2mskf\") pod \"node-ca-2rhc2\" (UID: \"132a3582-58a8-497f-a537-e38bde288795\") " pod="openshift-image-registry/node-ca-2rhc2"
Sep 11 14:15:09.562483 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562207    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3629f229-7ef5-4a0f-a90e-7b8de102ed1a-cnibin\") pod \"multus-additional-cni-plugins-5xfdr\" (UID: \"3629f229-7ef5-4a0f-a90e-7b8de102ed1a\") " pod="openshift-multus/multus-additional-cni-plugins-5xfdr"
Sep 11 14:15:09.562483 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562250    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-host-run-multus-certs\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.562483 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562297    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3629f229-7ef5-4a0f-a90e-7b8de102ed1a-cni-binary-copy\") pod \"multus-additional-cni-plugins-5xfdr\" (UID: \"3629f229-7ef5-4a0f-a90e-7b8de102ed1a\") " pod="openshift-multus/multus-additional-cni-plugins-5xfdr"
Sep 11 14:15:09.562483 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562323    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3629f229-7ef5-4a0f-a90e-7b8de102ed1a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5xfdr\" (UID: \"3629f229-7ef5-4a0f-a90e-7b8de102ed1a\") " pod="openshift-multus/multus-additional-cni-plugins-5xfdr"
Sep 11 14:15:09.562483 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562342    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-host-run-k8s-cni-cncf-io\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.562483 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562359    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-run\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.562483 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562375    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/060ec342-6ae9-4023-aec0-b08232216325-device-dir\") pod \"aws-ebs-csi-driver-node-wgsjj\" (UID: \"060ec342-6ae9-4023-aec0-b08232216325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgsjj"
Sep 11 14:15:09.562483 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562397    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-multus-socket-dir-parent\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.562483 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562416    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-host-run-netns\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.562483 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562429    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-host-var-lib-cni-bin\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.562483 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562442    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e0f53898-0fed-452b-bca9-d8e064b83f2a-multus-daemon-config\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.562483 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562455    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-etc-sysconfig\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.562483 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562473    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3568ecb4-6204-4702-abdc-8223f51dfd46-tmp\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.562483 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562492    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee16b430-307c-4f64-8ed7-ec59ad34f117-host-slash\") pod \"iptables-alerter-hm4qt\" (UID: \"ee16b430-307c-4f64-8ed7-ec59ad34f117\") " pod="openshift-network-operator/iptables-alerter-hm4qt"
Sep 11 14:15:09.563080 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562516    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-host-var-lib-kubelet\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.563080 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562535    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdgdc\" (UniqueName: \"kubernetes.io/projected/3568ecb4-6204-4702-abdc-8223f51dfd46-kube-api-access-vdgdc\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.563080 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562557    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ee16b430-307c-4f64-8ed7-ec59ad34f117-iptables-alerter-script\") pod \"iptables-alerter-hm4qt\" (UID: \"ee16b430-307c-4f64-8ed7-ec59ad34f117\") " pod="openshift-network-operator/iptables-alerter-hm4qt"
Sep 11 14:15:09.563080 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562577    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxt6f\" (UniqueName: \"kubernetes.io/projected/9528abdc-9478-4485-ab39-a8c576fef301-kube-api-access-rxt6f\") pod \"node-resolver-77vcp\" (UID: \"9528abdc-9478-4485-ab39-a8c576fef301\") " pod="openshift-dns/node-resolver-77vcp"
Sep 11 14:15:09.563080 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562597    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-cnibin\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.563080 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562618    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0f53898-0fed-452b-bca9-d8e064b83f2a-cni-binary-copy\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.563080 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562635    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-sys\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.563080 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562667    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3568ecb4-6204-4702-abdc-8223f51dfd46-etc-tuned\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.563080 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562719    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1550d3f8-d568-4b3b-80c5-34a9ddfb0e10-original-pull-secret\") pod \"global-pull-secret-syncer-dwq8z\" (UID: \"1550d3f8-d568-4b3b-80c5-34a9ddfb0e10\") " pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:09.563080 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562744    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/132a3582-58a8-497f-a537-e38bde288795-serviceca\") pod \"node-ca-2rhc2\" (UID: \"132a3582-58a8-497f-a537-e38bde288795\") " pod="openshift-image-registry/node-ca-2rhc2"
Sep 11 14:15:09.563080 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562759    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3629f229-7ef5-4a0f-a90e-7b8de102ed1a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5xfdr\" (UID: \"3629f229-7ef5-4a0f-a90e-7b8de102ed1a\") " pod="openshift-multus/multus-additional-cni-plugins-5xfdr"
Sep 11 14:15:09.563080 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562805    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-system-cni-dir\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.563080 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.562850    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9528abdc-9478-4485-ab39-a8c576fef301-hosts-file\") pod \"node-resolver-77vcp\" (UID: \"9528abdc-9478-4485-ab39-a8c576fef301\") " pod="openshift-dns/node-resolver-77vcp"
Sep 11 14:15:09.563629 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.563137    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-etc-kubernetes\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.563629 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.563173    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-multus-cni-dir\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.563629 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.563203    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-var-lib-kubelet\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.563629 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.563232    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/060ec342-6ae9-4023-aec0-b08232216325-registration-dir\") pod \"aws-ebs-csi-driver-node-wgsjj\" (UID: \"060ec342-6ae9-4023-aec0-b08232216325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgsjj"
Sep 11 14:15:09.563629 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.563256    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-host\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.563629 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.563285    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1550d3f8-d568-4b3b-80c5-34a9ddfb0e10-kubelet-config\") pod \"global-pull-secret-syncer-dwq8z\" (UID: \"1550d3f8-d568-4b3b-80c5-34a9ddfb0e10\") " pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:09.563629 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.563313    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/060ec342-6ae9-4023-aec0-b08232216325-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wgsjj\" (UID: \"060ec342-6ae9-4023-aec0-b08232216325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgsjj"
Sep 11 14:15:09.563629 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.563341    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/060ec342-6ae9-4023-aec0-b08232216325-socket-dir\") pod \"aws-ebs-csi-driver-node-wgsjj\" (UID: \"060ec342-6ae9-4023-aec0-b08232216325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgsjj"
Sep 11 14:15:09.563629 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.563368    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stdj9\" (UniqueName: \"kubernetes.io/projected/ee16b430-307c-4f64-8ed7-ec59ad34f117-kube-api-access-stdj9\") pod \"iptables-alerter-hm4qt\" (UID: \"ee16b430-307c-4f64-8ed7-ec59ad34f117\") " pod="openshift-network-operator/iptables-alerter-hm4qt"
Sep 11 14:15:09.563629 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.563391    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1550d3f8-d568-4b3b-80c5-34a9ddfb0e10-dbus\") pod \"global-pull-secret-syncer-dwq8z\" (UID: \"1550d3f8-d568-4b3b-80c5-34a9ddfb0e10\") " pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:09.563629 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.563421    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7gb4\" (UniqueName: \"kubernetes.io/projected/96099d3a-c51d-4599-b015-a30ff4c09bc6-kube-api-access-l7gb4\") pod \"network-check-target-wqqzl\" (UID: \"96099d3a-c51d-4599-b015-a30ff4c09bc6\") " pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:15:09.565702 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.564796    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-etc-modprobe-d\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.565702 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.564844    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-lib-modules\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.565702 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.564876    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/060ec342-6ae9-4023-aec0-b08232216325-etc-selinux\") pod \"aws-ebs-csi-driver-node-wgsjj\" (UID: \"060ec342-6ae9-4023-aec0-b08232216325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgsjj"
Sep 11 14:15:09.565702 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.564899    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-etc-sysctl-conf\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.565702 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.564927    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/060ec342-6ae9-4023-aec0-b08232216325-sys-fs\") pod \"aws-ebs-csi-driver-node-wgsjj\" (UID: \"060ec342-6ae9-4023-aec0-b08232216325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgsjj"
Sep 11 14:15:09.565702 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.564957    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9528abdc-9478-4485-ab39-a8c576fef301-tmp-dir\") pod \"node-resolver-77vcp\" (UID: \"9528abdc-9478-4485-ab39-a8c576fef301\") " pod="openshift-dns/node-resolver-77vcp"
Sep 11 14:15:09.585599 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.585580    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-khv8c"
Sep 11 14:15:09.595576 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.595559    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-khv8c"
Sep 11 14:15:09.650327 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.650304    2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 14:15:09.665516 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.665496    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mskf\" (UniqueName: \"kubernetes.io/projected/132a3582-58a8-497f-a537-e38bde288795-kube-api-access-2mskf\") pod \"node-ca-2rhc2\" (UID: \"132a3582-58a8-497f-a537-e38bde288795\") " pod="openshift-image-registry/node-ca-2rhc2"
Sep 11 14:15:09.665603 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.665521    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3629f229-7ef5-4a0f-a90e-7b8de102ed1a-cnibin\") pod \"multus-additional-cni-plugins-5xfdr\" (UID: \"3629f229-7ef5-4a0f-a90e-7b8de102ed1a\") " pod="openshift-multus/multus-additional-cni-plugins-5xfdr"
Sep 11 14:15:09.665603 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.665538    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-host-run-multus-certs\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.665603 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.665551    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3629f229-7ef5-4a0f-a90e-7b8de102ed1a-cni-binary-copy\") pod \"multus-additional-cni-plugins-5xfdr\" (UID: \"3629f229-7ef5-4a0f-a90e-7b8de102ed1a\") " pod="openshift-multus/multus-additional-cni-plugins-5xfdr"
Sep 11 14:15:09.665734 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.665609    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3629f229-7ef5-4a0f-a90e-7b8de102ed1a-cnibin\") pod \"multus-additional-cni-plugins-5xfdr\" (UID: \"3629f229-7ef5-4a0f-a90e-7b8de102ed1a\") " pod="openshift-multus/multus-additional-cni-plugins-5xfdr"
Sep 11 14:15:09.665734 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.665648    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-host-run-multus-certs\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.665824 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.665787    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3629f229-7ef5-4a0f-a90e-7b8de102ed1a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5xfdr\" (UID: \"3629f229-7ef5-4a0f-a90e-7b8de102ed1a\") " pod="openshift-multus/multus-additional-cni-plugins-5xfdr"
Sep 11 14:15:09.665873 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.665824    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-host-run-k8s-cni-cncf-io\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.665873 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.665848    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-run\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.665964 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.665870    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/060ec342-6ae9-4023-aec0-b08232216325-device-dir\") pod \"aws-ebs-csi-driver-node-wgsjj\" (UID: \"060ec342-6ae9-4023-aec0-b08232216325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgsjj"
Sep 11 14:15:09.665964 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.665896    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgrr5\" (UniqueName: \"kubernetes.io/projected/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-kube-api-access-mgrr5\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.665964 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.665919    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-multus-socket-dir-parent\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.665964 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.665943    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-host-run-netns\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.665964 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.665948    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-run\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.666170 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.665964    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-host-var-lib-cni-bin\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.666170 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.665987    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e0f53898-0fed-452b-bca9-d8e064b83f2a-multus-daemon-config\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.666170 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.666023    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-multus-socket-dir-parent\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.666170 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.666031    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-host-run-k8s-cni-cncf-io\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.666583 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.666037    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/060ec342-6ae9-4023-aec0-b08232216325-device-dir\") pod \"aws-ebs-csi-driver-node-wgsjj\" (UID: \"060ec342-6ae9-4023-aec0-b08232216325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgsjj"
Sep 11 14:15:09.666692 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.666067    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-etc-sysconfig\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.666692 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.666602    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e0f53898-0fed-452b-bca9-d8e064b83f2a-multus-daemon-config\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.666692 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.666616    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3568ecb4-6204-4702-abdc-8223f51dfd46-tmp\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.666692 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.666633    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee16b430-307c-4f64-8ed7-ec59ad34f117-host-slash\") pod \"iptables-alerter-hm4qt\" (UID: \"ee16b430-307c-4f64-8ed7-ec59ad34f117\") " pod="openshift-network-operator/iptables-alerter-hm4qt"
Sep 11 14:15:09.666692 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.666649    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-systemd-units\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.666692 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.666095    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-host-run-netns\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.666692 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.666123    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-host-var-lib-cni-bin\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.666692 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.666672    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-host-var-lib-kubelet\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.666692 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.666217    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3629f229-7ef5-4a0f-a90e-7b8de102ed1a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5xfdr\" (UID: \"3629f229-7ef5-4a0f-a90e-7b8de102ed1a\") " pod="openshift-multus/multus-additional-cni-plugins-5xfdr"
Sep 11 14:15:09.667050 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.666096    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-etc-sysconfig\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.667050 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.666491    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3629f229-7ef5-4a0f-a90e-7b8de102ed1a-cni-binary-copy\") pod \"multus-additional-cni-plugins-5xfdr\" (UID: \"3629f229-7ef5-4a0f-a90e-7b8de102ed1a\") " pod="openshift-multus/multus-additional-cni-plugins-5xfdr"
Sep 11 14:15:09.667050 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.666714    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdgdc\" (UniqueName: \"kubernetes.io/projected/3568ecb4-6204-4702-abdc-8223f51dfd46-kube-api-access-vdgdc\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.667050 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.666722    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-host-var-lib-kubelet\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.667050 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.666714    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee16b430-307c-4f64-8ed7-ec59ad34f117-host-slash\") pod \"iptables-alerter-hm4qt\" (UID: \"ee16b430-307c-4f64-8ed7-ec59ad34f117\") " pod="openshift-network-operator/iptables-alerter-hm4qt"
Sep 11 14:15:09.667050 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.666740    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ee16b430-307c-4f64-8ed7-ec59ad34f117-iptables-alerter-script\") pod \"iptables-alerter-hm4qt\" (UID: \"ee16b430-307c-4f64-8ed7-ec59ad34f117\") " pod="openshift-network-operator/iptables-alerter-hm4qt"
Sep 11 14:15:09.667050 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.666767    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-etc-openvswitch\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.667050 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.666789    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-host-run-ovn-kubernetes\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.667050 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.666809    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-host-cni-bin\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.667050 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.666830    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-ovn-node-metrics-cert\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.667050 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.666874    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxt6f\" (UniqueName: \"kubernetes.io/projected/9528abdc-9478-4485-ab39-a8c576fef301-kube-api-access-rxt6f\") pod \"node-resolver-77vcp\" (UID: \"9528abdc-9478-4485-ab39-a8c576fef301\") " pod="openshift-dns/node-resolver-77vcp"
Sep 11 14:15:09.667050 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.666897    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-cnibin\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.667050 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.666922    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0f53898-0fed-452b-bca9-d8e064b83f2a-cni-binary-copy\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.667050 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.666944    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-sys\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.667050 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.666958    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-cnibin\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.667050 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.666966    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3568ecb4-6204-4702-abdc-8223f51dfd46-etc-tuned\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.667050 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.666989    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1550d3f8-d568-4b3b-80c5-34a9ddfb0e10-original-pull-secret\") pod \"global-pull-secret-syncer-dwq8z\" (UID: \"1550d3f8-d568-4b3b-80c5-34a9ddfb0e10\") " pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:09.667744 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667000    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-sys\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.667744 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667009    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-host-slash\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.667744 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667031    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-run-systemd\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.667744 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667053    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/132a3582-58a8-497f-a537-e38bde288795-serviceca\") pod \"node-ca-2rhc2\" (UID: \"132a3582-58a8-497f-a537-e38bde288795\") " pod="openshift-image-registry/node-ca-2rhc2"
Sep 11 14:15:09.667744 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667074    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3629f229-7ef5-4a0f-a90e-7b8de102ed1a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5xfdr\" (UID: \"3629f229-7ef5-4a0f-a90e-7b8de102ed1a\") " pod="openshift-multus/multus-additional-cni-plugins-5xfdr"
Sep 11 14:15:09.667744 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667097    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-system-cni-dir\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.667744 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:09.667153    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:09.667744 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667202    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-system-cni-dir\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.667744 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:09.667227    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1550d3f8-d568-4b3b-80c5-34a9ddfb0e10-original-pull-secret podName:1550d3f8-d568-4b3b-80c5-34a9ddfb0e10 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:10.167204034 +0000 UTC m=+2.965838793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1550d3f8-d568-4b3b-80c5-34a9ddfb0e10-original-pull-secret") pod "global-pull-secret-syncer-dwq8z" (UID: "1550d3f8-d568-4b3b-80c5-34a9ddfb0e10") : object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:09.667744 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667264    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.667744 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667262    2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 14:15:09.667744 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667302    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-ovnkube-config\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.667744 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667325    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-env-overrides\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.667744 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667348    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-ovnkube-script-lib\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.667744 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667375    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9528abdc-9478-4485-ab39-a8c576fef301-hosts-file\") pod \"node-resolver-77vcp\" (UID: \"9528abdc-9478-4485-ab39-a8c576fef301\") " pod="openshift-dns/node-resolver-77vcp"
Sep 11 14:15:09.667744 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667382    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3629f229-7ef5-4a0f-a90e-7b8de102ed1a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5xfdr\" (UID: \"3629f229-7ef5-4a0f-a90e-7b8de102ed1a\") " pod="openshift-multus/multus-additional-cni-plugins-5xfdr"
Sep 11 14:15:09.667744 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667412    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-etc-kubernetes\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.668436 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667469    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9528abdc-9478-4485-ab39-a8c576fef301-hosts-file\") pod \"node-resolver-77vcp\" (UID: \"9528abdc-9478-4485-ab39-a8c576fef301\") " pod="openshift-dns/node-resolver-77vcp"
Sep 11 14:15:09.668436 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667475    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/132a3582-58a8-497f-a537-e38bde288795-serviceca\") pod \"node-ca-2rhc2\" (UID: \"132a3582-58a8-497f-a537-e38bde288795\") " pod="openshift-image-registry/node-ca-2rhc2"
Sep 11 14:15:09.668436 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667498    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-multus-cni-dir\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.668436 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667509    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-etc-kubernetes\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.668436 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667525    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-var-lib-kubelet\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.668436 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667558    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ee16b430-307c-4f64-8ed7-ec59ad34f117-iptables-alerter-script\") pod \"iptables-alerter-hm4qt\" (UID: \"ee16b430-307c-4f64-8ed7-ec59ad34f117\") " pod="openshift-network-operator/iptables-alerter-hm4qt"
Sep 11 14:15:09.668436 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667566    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-multus-cni-dir\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.668436 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667602    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/060ec342-6ae9-4023-aec0-b08232216325-registration-dir\") pod \"aws-ebs-csi-driver-node-wgsjj\" (UID: \"060ec342-6ae9-4023-aec0-b08232216325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgsjj"
Sep 11 14:15:09.668436 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667641    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-var-lib-kubelet\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.668436 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667703    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-host\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.668436 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667721    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/060ec342-6ae9-4023-aec0-b08232216325-registration-dir\") pod \"aws-ebs-csi-driver-node-wgsjj\" (UID: \"060ec342-6ae9-4023-aec0-b08232216325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgsjj"
Sep 11 14:15:09.668436 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667752    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1550d3f8-d568-4b3b-80c5-34a9ddfb0e10-kubelet-config\") pod \"global-pull-secret-syncer-dwq8z\" (UID: \"1550d3f8-d568-4b3b-80c5-34a9ddfb0e10\") " pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:09.668436 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667776    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-host\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.668436 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667816    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/060ec342-6ae9-4023-aec0-b08232216325-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wgsjj\" (UID: \"060ec342-6ae9-4023-aec0-b08232216325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgsjj"
Sep 11 14:15:09.668436 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667852    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1550d3f8-d568-4b3b-80c5-34a9ddfb0e10-kubelet-config\") pod \"global-pull-secret-syncer-dwq8z\" (UID: \"1550d3f8-d568-4b3b-80c5-34a9ddfb0e10\") " pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:09.668436 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667860    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/060ec342-6ae9-4023-aec0-b08232216325-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wgsjj\" (UID: \"060ec342-6ae9-4023-aec0-b08232216325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgsjj"
Sep 11 14:15:09.668436 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667888    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/060ec342-6ae9-4023-aec0-b08232216325-socket-dir\") pod \"aws-ebs-csi-driver-node-wgsjj\" (UID: \"060ec342-6ae9-4023-aec0-b08232216325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgsjj"
Sep 11 14:15:09.669179 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667914    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-run-openvswitch\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.669179 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667919    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0f53898-0fed-452b-bca9-d8e064b83f2a-cni-binary-copy\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.669179 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667938    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stdj9\" (UniqueName: \"kubernetes.io/projected/ee16b430-307c-4f64-8ed7-ec59ad34f117-kube-api-access-stdj9\") pod \"iptables-alerter-hm4qt\" (UID: \"ee16b430-307c-4f64-8ed7-ec59ad34f117\") " pod="openshift-network-operator/iptables-alerter-hm4qt"
Sep 11 14:15:09.669179 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667959    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1550d3f8-d568-4b3b-80c5-34a9ddfb0e10-dbus\") pod \"global-pull-secret-syncer-dwq8z\" (UID: \"1550d3f8-d568-4b3b-80c5-34a9ddfb0e10\") " pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:09.669179 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667983    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7gb4\" (UniqueName: \"kubernetes.io/projected/96099d3a-c51d-4599-b015-a30ff4c09bc6-kube-api-access-l7gb4\") pod \"network-check-target-wqqzl\" (UID: \"96099d3a-c51d-4599-b015-a30ff4c09bc6\") " pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:15:09.669179 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.667996    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/060ec342-6ae9-4023-aec0-b08232216325-socket-dir\") pod \"aws-ebs-csi-driver-node-wgsjj\" (UID: \"060ec342-6ae9-4023-aec0-b08232216325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgsjj"
Sep 11 14:15:09.669179 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668004    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-etc-modprobe-d\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.669179 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668025    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-lib-modules\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.669179 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668046    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/060ec342-6ae9-4023-aec0-b08232216325-etc-selinux\") pod \"aws-ebs-csi-driver-node-wgsjj\" (UID: \"060ec342-6ae9-4023-aec0-b08232216325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgsjj"
Sep 11 14:15:09.669179 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668049    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1550d3f8-d568-4b3b-80c5-34a9ddfb0e10-dbus\") pod \"global-pull-secret-syncer-dwq8z\" (UID: \"1550d3f8-d568-4b3b-80c5-34a9ddfb0e10\") " pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:09.669179 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668071    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-log-socket\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.669179 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668094    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-etc-sysctl-conf\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.669179 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668110    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/060ec342-6ae9-4023-aec0-b08232216325-sys-fs\") pod \"aws-ebs-csi-driver-node-wgsjj\" (UID: \"060ec342-6ae9-4023-aec0-b08232216325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgsjj"
Sep 11 14:15:09.669179 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668123    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-host-cni-netd\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.669179 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668140    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-lib-modules\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.669179 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668158    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9528abdc-9478-4485-ab39-a8c576fef301-tmp-dir\") pod \"node-resolver-77vcp\" (UID: \"9528abdc-9478-4485-ab39-a8c576fef301\") " pod="openshift-dns/node-resolver-77vcp"
Sep 11 14:15:09.669179 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668161    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-etc-modprobe-d\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.670002 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668175    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-host-kubelet\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.670002 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668193    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69446d2a-2163-4a00-8b2d-02c7dee348e3-metrics-certs\") pod \"network-metrics-daemon-dqhsk\" (UID: \"69446d2a-2163-4a00-8b2d-02c7dee348e3\") " pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:15:09.670002 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668210    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/060ec342-6ae9-4023-aec0-b08232216325-sys-fs\") pod \"aws-ebs-csi-driver-node-wgsjj\" (UID: \"060ec342-6ae9-4023-aec0-b08232216325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgsjj"
Sep 11 14:15:09.670002 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668212    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt6px\" (UniqueName: \"kubernetes.io/projected/69446d2a-2163-4a00-8b2d-02c7dee348e3-kube-api-access-vt6px\") pod \"network-metrics-daemon-dqhsk\" (UID: \"69446d2a-2163-4a00-8b2d-02c7dee348e3\") " pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:15:09.670002 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668228    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-etc-sysctl-conf\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.670002 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668243    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cd82c8bb-0bd0-4dfb-941c-1c3a5b727425-agent-certs\") pod \"konnectivity-agent-7gt5x\" (UID: \"cd82c8bb-0bd0-4dfb-941c-1c3a5b727425\") " pod="kube-system/konnectivity-agent-7gt5x"
Sep 11 14:15:09.670002 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668264    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cd82c8bb-0bd0-4dfb-941c-1c3a5b727425-konnectivity-ca\") pod \"konnectivity-agent-7gt5x\" (UID: \"cd82c8bb-0bd0-4dfb-941c-1c3a5b727425\") " pod="kube-system/konnectivity-agent-7gt5x"
Sep 11 14:15:09.670002 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668287    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-etc-systemd\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.670002 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668302    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/060ec342-6ae9-4023-aec0-b08232216325-etc-selinux\") pod \"aws-ebs-csi-driver-node-wgsjj\" (UID: \"060ec342-6ae9-4023-aec0-b08232216325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgsjj"
Sep 11 14:15:09.670002 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668311    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-var-lib-openvswitch\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.670002 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668362    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-etc-systemd\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.670002 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668389    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/132a3582-58a8-497f-a537-e38bde288795-host\") pod \"node-ca-2rhc2\" (UID: \"132a3582-58a8-497f-a537-e38bde288795\") " pod="openshift-image-registry/node-ca-2rhc2"
Sep 11 14:15:09.670002 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668412    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3629f229-7ef5-4a0f-a90e-7b8de102ed1a-system-cni-dir\") pod \"multus-additional-cni-plugins-5xfdr\" (UID: \"3629f229-7ef5-4a0f-a90e-7b8de102ed1a\") " pod="openshift-multus/multus-additional-cni-plugins-5xfdr"
Sep 11 14:15:09.670002 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:09.668422    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:09.670002 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668433    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-etc-kubernetes\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.670002 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668455    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-etc-sysctl-d\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.670002 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668461    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/132a3582-58a8-497f-a537-e38bde288795-host\") pod \"node-ca-2rhc2\" (UID: \"132a3582-58a8-497f-a537-e38bde288795\") " pod="openshift-image-registry/node-ca-2rhc2"
Sep 11 14:15:09.670002 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668468    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9528abdc-9478-4485-ab39-a8c576fef301-tmp-dir\") pod \"node-resolver-77vcp\" (UID: \"9528abdc-9478-4485-ab39-a8c576fef301\") " pod="openshift-dns/node-resolver-77vcp"
Sep 11 14:15:09.670790 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668480    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-host-run-netns\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.670790 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:09.668489    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69446d2a-2163-4a00-8b2d-02c7dee348e3-metrics-certs podName:69446d2a-2163-4a00-8b2d-02c7dee348e3 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:10.168475776 +0000 UTC m=+2.967110576 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69446d2a-2163-4a00-8b2d-02c7dee348e3-metrics-certs") pod "network-metrics-daemon-dqhsk" (UID: "69446d2a-2163-4a00-8b2d-02c7dee348e3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:09.670790 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668504    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-etc-kubernetes\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.670790 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668527    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qssj\" (UniqueName: \"kubernetes.io/projected/3629f229-7ef5-4a0f-a90e-7b8de102ed1a-kube-api-access-7qssj\") pod \"multus-additional-cni-plugins-5xfdr\" (UID: \"3629f229-7ef5-4a0f-a90e-7b8de102ed1a\") " pod="openshift-multus/multus-additional-cni-plugins-5xfdr"
Sep 11 14:15:09.670790 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668540    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3629f229-7ef5-4a0f-a90e-7b8de102ed1a-system-cni-dir\") pod \"multus-additional-cni-plugins-5xfdr\" (UID: \"3629f229-7ef5-4a0f-a90e-7b8de102ed1a\") " pod="openshift-multus/multus-additional-cni-plugins-5xfdr"
Sep 11 14:15:09.670790 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668554    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-host-var-lib-cni-multus\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.670790 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668576    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-hostroot\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.670790 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668593    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-host-var-lib-cni-multus\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.670790 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668597    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-multus-conf-dir\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.670790 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668556    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3568ecb4-6204-4702-abdc-8223f51dfd46-etc-sysctl-d\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.670790 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668625    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq2dt\" (UniqueName: \"kubernetes.io/projected/e0f53898-0fed-452b-bca9-d8e064b83f2a-kube-api-access-sq2dt\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.670790 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668647    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-multus-conf-dir\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.670790 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668706    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e0f53898-0fed-452b-bca9-d8e064b83f2a-hostroot\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.670790 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668647    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45dsn\" (UniqueName: \"kubernetes.io/projected/060ec342-6ae9-4023-aec0-b08232216325-kube-api-access-45dsn\") pod \"aws-ebs-csi-driver-node-wgsjj\" (UID: \"060ec342-6ae9-4023-aec0-b08232216325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgsjj"
Sep 11 14:15:09.670790 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668740    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-node-log\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.670790 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668764    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3629f229-7ef5-4a0f-a90e-7b8de102ed1a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5xfdr\" (UID: \"3629f229-7ef5-4a0f-a90e-7b8de102ed1a\") " pod="openshift-multus/multus-additional-cni-plugins-5xfdr"
Sep 11 14:15:09.671303 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.668788    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-run-ovn\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.671303 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.669261    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3629f229-7ef5-4a0f-a90e-7b8de102ed1a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5xfdr\" (UID: \"3629f229-7ef5-4a0f-a90e-7b8de102ed1a\") " pod="openshift-multus/multus-additional-cni-plugins-5xfdr"
Sep 11 14:15:09.671303 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.669692    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cd82c8bb-0bd0-4dfb-941c-1c3a5b727425-konnectivity-ca\") pod \"konnectivity-agent-7gt5x\" (UID: \"cd82c8bb-0bd0-4dfb-941c-1c3a5b727425\") " pod="kube-system/konnectivity-agent-7gt5x"
Sep 11 14:15:09.671303 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.670997    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3568ecb4-6204-4702-abdc-8223f51dfd46-tmp\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.671303 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.671054    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3568ecb4-6204-4702-abdc-8223f51dfd46-etc-tuned\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.671303 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.671090    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cd82c8bb-0bd0-4dfb-941c-1c3a5b727425-agent-certs\") pod \"konnectivity-agent-7gt5x\" (UID: \"cd82c8bb-0bd0-4dfb-941c-1c3a5b727425\") " pod="kube-system/konnectivity-agent-7gt5x"
Sep 11 14:15:09.674579 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.674560    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mskf\" (UniqueName: \"kubernetes.io/projected/132a3582-58a8-497f-a537-e38bde288795-kube-api-access-2mskf\") pod \"node-ca-2rhc2\" (UID: \"132a3582-58a8-497f-a537-e38bde288795\") " pod="openshift-image-registry/node-ca-2rhc2"
Sep 11 14:15:09.678087 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.678071    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdgdc\" (UniqueName: \"kubernetes.io/projected/3568ecb4-6204-4702-abdc-8223f51dfd46-kube-api-access-vdgdc\") pod \"tuned-952fp\" (UID: \"3568ecb4-6204-4702-abdc-8223f51dfd46\") " pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.681293 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.681272    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxt6f\" (UniqueName: \"kubernetes.io/projected/9528abdc-9478-4485-ab39-a8c576fef301-kube-api-access-rxt6f\") pod \"node-resolver-77vcp\" (UID: \"9528abdc-9478-4485-ab39-a8c576fef301\") " pod="openshift-dns/node-resolver-77vcp"
Sep 11 14:15:09.682154 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:09.681910    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 14:15:09.682154 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:09.681930    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 14:15:09.682154 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:09.681957    2584 projected.go:196] Error preparing data for projected volume kube-api-access-l7gb4 for pod openshift-network-diagnostics/network-check-target-wqqzl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:09.682154 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:09.682013    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96099d3a-c51d-4599-b015-a30ff4c09bc6-kube-api-access-l7gb4 podName:96099d3a-c51d-4599-b015-a30ff4c09bc6 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:10.181998576 +0000 UTC m=+2.980633353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l7gb4" (UniqueName: "kubernetes.io/projected/96099d3a-c51d-4599-b015-a30ff4c09bc6-kube-api-access-l7gb4") pod "network-check-target-wqqzl" (UID: "96099d3a-c51d-4599-b015-a30ff4c09bc6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:09.683891 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.683840    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stdj9\" (UniqueName: \"kubernetes.io/projected/ee16b430-307c-4f64-8ed7-ec59ad34f117-kube-api-access-stdj9\") pod \"iptables-alerter-hm4qt\" (UID: \"ee16b430-307c-4f64-8ed7-ec59ad34f117\") " pod="openshift-network-operator/iptables-alerter-hm4qt"
Sep 11 14:15:09.684337 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.684317    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt6px\" (UniqueName: \"kubernetes.io/projected/69446d2a-2163-4a00-8b2d-02c7dee348e3-kube-api-access-vt6px\") pod \"network-metrics-daemon-dqhsk\" (UID: \"69446d2a-2163-4a00-8b2d-02c7dee348e3\") " pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:15:09.684455 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.684345    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq2dt\" (UniqueName: \"kubernetes.io/projected/e0f53898-0fed-452b-bca9-d8e064b83f2a-kube-api-access-sq2dt\") pod \"multus-qqfdv\" (UID: \"e0f53898-0fed-452b-bca9-d8e064b83f2a\") " pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.684803 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.684723    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qssj\" (UniqueName: \"kubernetes.io/projected/3629f229-7ef5-4a0f-a90e-7b8de102ed1a-kube-api-access-7qssj\") pod \"multus-additional-cni-plugins-5xfdr\" (UID: \"3629f229-7ef5-4a0f-a90e-7b8de102ed1a\") " pod="openshift-multus/multus-additional-cni-plugins-5xfdr"
Sep 11 14:15:09.684887 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.684818    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45dsn\" (UniqueName: \"kubernetes.io/projected/060ec342-6ae9-4023-aec0-b08232216325-kube-api-access-45dsn\") pod \"aws-ebs-csi-driver-node-wgsjj\" (UID: \"060ec342-6ae9-4023-aec0-b08232216325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgsjj"
Sep 11 14:15:09.770315 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.769170    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-node-log\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.770315 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.769207    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-run-ovn\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.770315 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.769240    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgrr5\" (UniqueName: \"kubernetes.io/projected/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-kube-api-access-mgrr5\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.770315 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.769261    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-node-log\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.770315 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.769281    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-systemd-units\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.770315 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.769310    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-etc-openvswitch\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.770315 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.769339    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-host-run-ovn-kubernetes\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.770315 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.769362    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-host-cni-bin\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.770315 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.769389    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-ovn-node-metrics-cert\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.770315 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.769429    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-host-slash\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.770315 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.769454    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-run-systemd\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.770315 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.769486    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.770315 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.769534    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-ovnkube-config\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.770315 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.769559    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-env-overrides\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.770315 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.769583    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-ovnkube-script-lib\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.770315 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.769624    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-run-openvswitch\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.770315 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.769693    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-log-socket\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.771075 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.769718    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-host-cni-netd\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.771075 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.769743    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-host-kubelet\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.771075 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.769786    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-var-lib-openvswitch\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.771075 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.769811    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-host-run-netns\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.771075 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.769914    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-host-run-netns\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.771075 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.769960    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-run-ovn\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.771075 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.770217    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-systemd-units\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.771075 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.770268    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-etc-openvswitch\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.771075 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.770304    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-host-run-ovn-kubernetes\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.771075 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.770366    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.771075 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.770387    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-log-socket\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.771075 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.770401    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-host-cni-bin\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.771075 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.770444    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-var-lib-openvswitch\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.771075 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.770451    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-run-openvswitch\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.771075 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.770493    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-host-kubelet\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.771075 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.770720    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-host-cni-netd\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.771075 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.770799    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-run-systemd\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.771075 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.770871    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-host-slash\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.771767 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.770960    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-env-overrides\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.771767 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.771009    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-ovnkube-config\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.771767 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.771432    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-ovnkube-script-lib\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.773483 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.773466    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-ovn-node-metrics-cert\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.780235 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.780219    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgrr5\" (UniqueName: \"kubernetes.io/projected/7438d9b7-3a2b-4548-85c2-a66cd5055dfb-kube-api-access-mgrr5\") pod \"ovnkube-node-bft2j\" (UID: \"7438d9b7-3a2b-4548-85c2-a66cd5055dfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:09.849131 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.849102    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7gt5x"
Sep 11 14:15:09.854551 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.854535    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgsjj"
Sep 11 14:15:09.863072 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.863054    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qqfdv"
Sep 11 14:15:09.869540 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.869524    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2rhc2"
Sep 11 14:15:09.875975 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.875957    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-952fp"
Sep 11 14:15:09.881795 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.881779    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-77vcp"
Sep 11 14:15:09.887617 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.887598    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5xfdr"
Sep 11 14:15:09.896307 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.896286    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hm4qt"
Sep 11 14:15:09.900696 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:09.900670    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:10.172423 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:10.172387    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69446d2a-2163-4a00-8b2d-02c7dee348e3-metrics-certs\") pod \"network-metrics-daemon-dqhsk\" (UID: \"69446d2a-2163-4a00-8b2d-02c7dee348e3\") " pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:15:10.172587 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:10.172464    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1550d3f8-d568-4b3b-80c5-34a9ddfb0e10-original-pull-secret\") pod \"global-pull-secret-syncer-dwq8z\" (UID: \"1550d3f8-d568-4b3b-80c5-34a9ddfb0e10\") " pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:10.172587 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:10.172564    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:10.172751 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:10.172640    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69446d2a-2163-4a00-8b2d-02c7dee348e3-metrics-certs podName:69446d2a-2163-4a00-8b2d-02c7dee348e3 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:11.172618593 +0000 UTC m=+3.971253361 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69446d2a-2163-4a00-8b2d-02c7dee348e3-metrics-certs") pod "network-metrics-daemon-dqhsk" (UID: "69446d2a-2163-4a00-8b2d-02c7dee348e3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:10.172751 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:10.172573    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:10.172751 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:10.172730    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1550d3f8-d568-4b3b-80c5-34a9ddfb0e10-original-pull-secret podName:1550d3f8-d568-4b3b-80c5-34a9ddfb0e10 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:11.172710437 +0000 UTC m=+3.971345225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1550d3f8-d568-4b3b-80c5-34a9ddfb0e10-original-pull-secret") pod "global-pull-secret-syncer-dwq8z" (UID: "1550d3f8-d568-4b3b-80c5-34a9ddfb0e10") : object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:10.225610 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:10.225471    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3568ecb4_6204_4702_abdc_8223f51dfd46.slice/crio-08d6dac0b8fef80249127d62afa249207a10d29a5c296b7d6aadb37367650c3b WatchSource:0}: Error finding container 08d6dac0b8fef80249127d62afa249207a10d29a5c296b7d6aadb37367650c3b: Status 404 returned error can't find the container with id 08d6dac0b8fef80249127d62afa249207a10d29a5c296b7d6aadb37367650c3b
Sep 11 14:15:10.226505 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:10.226480    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3629f229_7ef5_4a0f_a90e_7b8de102ed1a.slice/crio-eca1b3ccb8db5037a02b71521e73a290433c3827fc796d1d5851bc0b374a7bb5 WatchSource:0}: Error finding container eca1b3ccb8db5037a02b71521e73a290433c3827fc796d1d5851bc0b374a7bb5: Status 404 returned error can't find the container with id eca1b3ccb8db5037a02b71521e73a290433c3827fc796d1d5851bc0b374a7bb5
Sep 11 14:15:10.229277 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:10.229251    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0f53898_0fed_452b_bca9_d8e064b83f2a.slice/crio-b50ba55774974d7add75ec1225ac821dfc22e2168d8d7397217de02f13873412 WatchSource:0}: Error finding container b50ba55774974d7add75ec1225ac821dfc22e2168d8d7397217de02f13873412: Status 404 returned error can't find the container with id b50ba55774974d7add75ec1225ac821dfc22e2168d8d7397217de02f13873412
Sep 11 14:15:10.230054 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:10.230028    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod132a3582_58a8_497f_a537_e38bde288795.slice/crio-1404053afab9ce554099fd9900d60db93523bdc1446ed446c737616d3d6f1119 WatchSource:0}: Error finding container 1404053afab9ce554099fd9900d60db93523bdc1446ed446c737616d3d6f1119: Status 404 returned error can't find the container with id 1404053afab9ce554099fd9900d60db93523bdc1446ed446c737616d3d6f1119
Sep 11 14:15:10.231109 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:10.231090    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd82c8bb_0bd0_4dfb_941c_1c3a5b727425.slice/crio-3875d41178412960e746b4110e6bd6281dae7f7d8dacda508db07aa5aea11c90 WatchSource:0}: Error finding container 3875d41178412960e746b4110e6bd6281dae7f7d8dacda508db07aa5aea11c90: Status 404 returned error can't find the container with id 3875d41178412960e746b4110e6bd6281dae7f7d8dacda508db07aa5aea11c90
Sep 11 14:15:10.232755 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:10.232643    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7438d9b7_3a2b_4548_85c2_a66cd5055dfb.slice/crio-a1f3394d1c395b6b1f713d191137d87e944816dc3a2052077953fbcb2fcadd8a WatchSource:0}: Error finding container a1f3394d1c395b6b1f713d191137d87e944816dc3a2052077953fbcb2fcadd8a: Status 404 returned error can't find the container with id a1f3394d1c395b6b1f713d191137d87e944816dc3a2052077953fbcb2fcadd8a
Sep 11 14:15:10.233060 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:10.233039    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod060ec342_6ae9_4023_aec0_b08232216325.slice/crio-4de87e43af055a7a30bcbfbfb89174180b3575cca7d275eb7b5e7badf498b9cf WatchSource:0}: Error finding container 4de87e43af055a7a30bcbfbfb89174180b3575cca7d275eb7b5e7badf498b9cf: Status 404 returned error can't find the container with id 4de87e43af055a7a30bcbfbfb89174180b3575cca7d275eb7b5e7badf498b9cf
Sep 11 14:15:10.234323 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:10.234246    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee16b430_307c_4f64_8ed7_ec59ad34f117.slice/crio-11cec7d609c6ed35224b4a9fb937128c132cda6ba4410479197be1c9f2d44dc1 WatchSource:0}: Error finding container 11cec7d609c6ed35224b4a9fb937128c132cda6ba4410479197be1c9f2d44dc1: Status 404 returned error can't find the container with id 11cec7d609c6ed35224b4a9fb937128c132cda6ba4410479197be1c9f2d44dc1
Sep 11 14:15:10.236015 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:10.235286    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9528abdc_9478_4485_ab39_a8c576fef301.slice/crio-1fb1167600c2683d539917c0be38dcd80aad792f1054a6277c0344c72e399932 WatchSource:0}: Error finding container 1fb1167600c2683d539917c0be38dcd80aad792f1054a6277c0344c72e399932: Status 404 returned error can't find the container with id 1fb1167600c2683d539917c0be38dcd80aad792f1054a6277c0344c72e399932
Sep 11 14:15:10.273524 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:10.273504    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7gb4\" (UniqueName: \"kubernetes.io/projected/96099d3a-c51d-4599-b015-a30ff4c09bc6-kube-api-access-l7gb4\") pod \"network-check-target-wqqzl\" (UID: \"96099d3a-c51d-4599-b015-a30ff4c09bc6\") " pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:15:10.273644 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:10.273630    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 14:15:10.273703 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:10.273649    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 14:15:10.273703 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:10.273657    2584 projected.go:196] Error preparing data for projected volume kube-api-access-l7gb4 for pod openshift-network-diagnostics/network-check-target-wqqzl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:10.273796 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:10.273713    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96099d3a-c51d-4599-b015-a30ff4c09bc6-kube-api-access-l7gb4 podName:96099d3a-c51d-4599-b015-a30ff4c09bc6 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:11.273701021 +0000 UTC m=+4.072335795 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-l7gb4" (UniqueName: "kubernetes.io/projected/96099d3a-c51d-4599-b015-a30ff4c09bc6-kube-api-access-l7gb4") pod "network-check-target-wqqzl" (UID: "96099d3a-c51d-4599-b015-a30ff4c09bc6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:10.322793 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:10.322768    2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 14:15:10.597550 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:10.597512    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 14:10:09 +0000 UTC" deadline="2028-04-06 07:40:57.539405174 +0000 UTC"
Sep 11 14:15:10.597550 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:10.597550    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13745h25m46.941859821s"
Sep 11 14:15:10.682175 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:10.682106    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-77vcp" event={"ID":"9528abdc-9478-4485-ab39-a8c576fef301","Type":"ContainerStarted","Data":"1fb1167600c2683d539917c0be38dcd80aad792f1054a6277c0344c72e399932"}
Sep 11 14:15:10.686632 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:10.686602    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgsjj" event={"ID":"060ec342-6ae9-4023-aec0-b08232216325","Type":"ContainerStarted","Data":"4de87e43af055a7a30bcbfbfb89174180b3575cca7d275eb7b5e7badf498b9cf"}
Sep 11 14:15:10.688337 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:10.688312    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bft2j" event={"ID":"7438d9b7-3a2b-4548-85c2-a66cd5055dfb","Type":"ContainerStarted","Data":"a1f3394d1c395b6b1f713d191137d87e944816dc3a2052077953fbcb2fcadd8a"}
Sep 11 14:15:10.691562 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:10.691535    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2rhc2" event={"ID":"132a3582-58a8-497f-a537-e38bde288795","Type":"ContainerStarted","Data":"1404053afab9ce554099fd9900d60db93523bdc1446ed446c737616d3d6f1119"}
Sep 11 14:15:10.693955 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:10.693931    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qqfdv" event={"ID":"e0f53898-0fed-452b-bca9-d8e064b83f2a","Type":"ContainerStarted","Data":"b50ba55774974d7add75ec1225ac821dfc22e2168d8d7397217de02f13873412"}
Sep 11 14:15:10.696912 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:10.696888    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xfdr" event={"ID":"3629f229-7ef5-4a0f-a90e-7b8de102ed1a","Type":"ContainerStarted","Data":"eca1b3ccb8db5037a02b71521e73a290433c3827fc796d1d5851bc0b374a7bb5"}
Sep 11 14:15:10.700903 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:10.700878    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-952fp" event={"ID":"3568ecb4-6204-4702-abdc-8223f51dfd46","Type":"ContainerStarted","Data":"08d6dac0b8fef80249127d62afa249207a10d29a5c296b7d6aadb37367650c3b"}
Sep 11 14:15:10.703832 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:10.703806    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-175.ec2.internal" event={"ID":"03736b57a79149ed7e63d2686d1a25d5","Type":"ContainerStarted","Data":"12a2ab3c335367233407a9cd5a9285fd012dab2db26f21bb9254a5ec7ca56c5a"}
Sep 11 14:15:10.707098 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:10.707074    2584 generic.go:356] "Generic (PLEG): container finished" podID="40b92ede76a0d26bc61d1d418aecb2fa" containerID="2c83cccb659d2a6196b92973d0a7dacde844317f8a3272d48150174936b2c565" exitCode=0
Sep 11 14:15:10.707179 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:10.707158    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-175.ec2.internal" event={"ID":"40b92ede76a0d26bc61d1d418aecb2fa","Type":"ContainerDied","Data":"2c83cccb659d2a6196b92973d0a7dacde844317f8a3272d48150174936b2c565"}
Sep 11 14:15:10.714813 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:10.714791    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hm4qt" event={"ID":"ee16b430-307c-4f64-8ed7-ec59ad34f117","Type":"ContainerStarted","Data":"11cec7d609c6ed35224b4a9fb937128c132cda6ba4410479197be1c9f2d44dc1"}
Sep 11 14:15:10.718696 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:10.718506    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7gt5x" event={"ID":"cd82c8bb-0bd0-4dfb-941c-1c3a5b727425","Type":"ContainerStarted","Data":"3875d41178412960e746b4110e6bd6281dae7f7d8dacda508db07aa5aea11c90"}
Sep 11 14:15:10.742717 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:10.742657    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-175.ec2.internal" podStartSLOduration=2.742638119 podStartE2EDuration="2.742638119s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:10.72281097 +0000 UTC m=+3.521445760" watchObservedRunningTime="2026-09-11 14:15:10.742638119 +0000 UTC m=+3.541272902"
Sep 11 14:15:11.180768 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:11.180667    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1550d3f8-d568-4b3b-80c5-34a9ddfb0e10-original-pull-secret\") pod \"global-pull-secret-syncer-dwq8z\" (UID: \"1550d3f8-d568-4b3b-80c5-34a9ddfb0e10\") " pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:11.180768 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:11.180764    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69446d2a-2163-4a00-8b2d-02c7dee348e3-metrics-certs\") pod \"network-metrics-daemon-dqhsk\" (UID: \"69446d2a-2163-4a00-8b2d-02c7dee348e3\") " pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:15:11.180980 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:11.180886    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:11.180980 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:11.180943    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69446d2a-2163-4a00-8b2d-02c7dee348e3-metrics-certs podName:69446d2a-2163-4a00-8b2d-02c7dee348e3 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:13.180925051 +0000 UTC m=+5.979559827 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69446d2a-2163-4a00-8b2d-02c7dee348e3-metrics-certs") pod "network-metrics-daemon-dqhsk" (UID: "69446d2a-2163-4a00-8b2d-02c7dee348e3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:11.181389 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:11.181360    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:11.181485 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:11.181413    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1550d3f8-d568-4b3b-80c5-34a9ddfb0e10-original-pull-secret podName:1550d3f8-d568-4b3b-80c5-34a9ddfb0e10 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:13.181398359 +0000 UTC m=+5.980033143 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1550d3f8-d568-4b3b-80c5-34a9ddfb0e10-original-pull-secret") pod "global-pull-secret-syncer-dwq8z" (UID: "1550d3f8-d568-4b3b-80c5-34a9ddfb0e10") : object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:11.281098 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:11.281058    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7gb4\" (UniqueName: \"kubernetes.io/projected/96099d3a-c51d-4599-b015-a30ff4c09bc6-kube-api-access-l7gb4\") pod \"network-check-target-wqqzl\" (UID: \"96099d3a-c51d-4599-b015-a30ff4c09bc6\") " pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:15:11.281266 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:11.281249    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 14:15:11.281304 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:11.281274    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 14:15:11.281304 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:11.281286    2584 projected.go:196] Error preparing data for projected volume kube-api-access-l7gb4 for pod openshift-network-diagnostics/network-check-target-wqqzl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:11.281379 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:11.281343    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96099d3a-c51d-4599-b015-a30ff4c09bc6-kube-api-access-l7gb4 podName:96099d3a-c51d-4599-b015-a30ff4c09bc6 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:13.28132267 +0000 UTC m=+6.079957445 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-l7gb4" (UniqueName: "kubernetes.io/projected/96099d3a-c51d-4599-b015-a30ff4c09bc6-kube-api-access-l7gb4") pod "network-check-target-wqqzl" (UID: "96099d3a-c51d-4599-b015-a30ff4c09bc6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:11.597805 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:11.597661    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 14:10:09 +0000 UTC" deadline="2028-02-26 15:13:59.204101169 +0000 UTC"
Sep 11 14:15:11.597805 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:11.597733    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12792h58m47.606372493s"
Sep 11 14:15:11.674470 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:11.673786    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:11.674470 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:11.673932    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwq8z" podUID="1550d3f8-d568-4b3b-80c5-34a9ddfb0e10"
Sep 11 14:15:11.674470 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:11.674310    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:15:11.674470 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:11.674426    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqhsk" podUID="69446d2a-2163-4a00-8b2d-02c7dee348e3"
Sep 11 14:15:11.674470 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:11.674468    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:15:11.674840 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:11.674569    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqqzl" podUID="96099d3a-c51d-4599-b015-a30ff4c09bc6"
Sep 11 14:15:11.734247 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:11.734213    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-175.ec2.internal" event={"ID":"40b92ede76a0d26bc61d1d418aecb2fa","Type":"ContainerStarted","Data":"6c748c0a2e81af1e2d6d65f37986156a49d64fba2938971180e769eb462f9c78"}
Sep 11 14:15:11.754380 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:11.753945    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-175.ec2.internal" podStartSLOduration=3.753925804 podStartE2EDuration="3.753925804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:11.749332166 +0000 UTC m=+4.547966949" watchObservedRunningTime="2026-09-11 14:15:11.753925804 +0000 UTC m=+4.552560590"
Sep 11 14:15:13.199801 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:13.199764    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69446d2a-2163-4a00-8b2d-02c7dee348e3-metrics-certs\") pod \"network-metrics-daemon-dqhsk\" (UID: \"69446d2a-2163-4a00-8b2d-02c7dee348e3\") " pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:15:13.200244 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:13.199840    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1550d3f8-d568-4b3b-80c5-34a9ddfb0e10-original-pull-secret\") pod \"global-pull-secret-syncer-dwq8z\" (UID: \"1550d3f8-d568-4b3b-80c5-34a9ddfb0e10\") " pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:13.200244 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:13.199981    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:13.200244 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:13.200043    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1550d3f8-d568-4b3b-80c5-34a9ddfb0e10-original-pull-secret podName:1550d3f8-d568-4b3b-80c5-34a9ddfb0e10 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:17.200025011 +0000 UTC m=+9.998659795 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1550d3f8-d568-4b3b-80c5-34a9ddfb0e10-original-pull-secret") pod "global-pull-secret-syncer-dwq8z" (UID: "1550d3f8-d568-4b3b-80c5-34a9ddfb0e10") : object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:13.200472 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:13.200454    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:13.200542 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:13.200510    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69446d2a-2163-4a00-8b2d-02c7dee348e3-metrics-certs podName:69446d2a-2163-4a00-8b2d-02c7dee348e3 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:17.200493398 +0000 UTC m=+9.999128180 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69446d2a-2163-4a00-8b2d-02c7dee348e3-metrics-certs") pod "network-metrics-daemon-dqhsk" (UID: "69446d2a-2163-4a00-8b2d-02c7dee348e3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:13.300435 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:13.300399    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7gb4\" (UniqueName: \"kubernetes.io/projected/96099d3a-c51d-4599-b015-a30ff4c09bc6-kube-api-access-l7gb4\") pod \"network-check-target-wqqzl\" (UID: \"96099d3a-c51d-4599-b015-a30ff4c09bc6\") " pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:15:13.300651 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:13.300551    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 14:15:13.300651 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:13.300569    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 14:15:13.300651 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:13.300581    2584 projected.go:196] Error preparing data for projected volume kube-api-access-l7gb4 for pod openshift-network-diagnostics/network-check-target-wqqzl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:13.300651 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:13.300636    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96099d3a-c51d-4599-b015-a30ff4c09bc6-kube-api-access-l7gb4 podName:96099d3a-c51d-4599-b015-a30ff4c09bc6 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:17.30061964 +0000 UTC m=+10.099254417 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-l7gb4" (UniqueName: "kubernetes.io/projected/96099d3a-c51d-4599-b015-a30ff4c09bc6-kube-api-access-l7gb4") pod "network-check-target-wqqzl" (UID: "96099d3a-c51d-4599-b015-a30ff4c09bc6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:13.674551 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:13.673771    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:15:13.674551 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:13.673901    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqqzl" podUID="96099d3a-c51d-4599-b015-a30ff4c09bc6"
Sep 11 14:15:13.674551 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:13.674249    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:15:13.674551 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:13.674351    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqhsk" podUID="69446d2a-2163-4a00-8b2d-02c7dee348e3"
Sep 11 14:15:13.674551 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:13.674389    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:13.674551 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:13.674456    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwq8z" podUID="1550d3f8-d568-4b3b-80c5-34a9ddfb0e10"
Sep 11 14:15:15.674279 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:15.673588    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:15:15.674279 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:15.673736    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqhsk" podUID="69446d2a-2163-4a00-8b2d-02c7dee348e3"
Sep 11 14:15:15.674279 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:15.673962    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:15.674279 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:15.674070    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwq8z" podUID="1550d3f8-d568-4b3b-80c5-34a9ddfb0e10"
Sep 11 14:15:15.674279 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:15.674128    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:15:15.674279 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:15.674208    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqqzl" podUID="96099d3a-c51d-4599-b015-a30ff4c09bc6"
Sep 11 14:15:17.237285 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:17.236952    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1550d3f8-d568-4b3b-80c5-34a9ddfb0e10-original-pull-secret\") pod \"global-pull-secret-syncer-dwq8z\" (UID: \"1550d3f8-d568-4b3b-80c5-34a9ddfb0e10\") " pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:17.237285 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:17.237041    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69446d2a-2163-4a00-8b2d-02c7dee348e3-metrics-certs\") pod \"network-metrics-daemon-dqhsk\" (UID: \"69446d2a-2163-4a00-8b2d-02c7dee348e3\") " pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:15:17.237285 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:17.237080    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:17.237285 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:17.237151    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1550d3f8-d568-4b3b-80c5-34a9ddfb0e10-original-pull-secret podName:1550d3f8-d568-4b3b-80c5-34a9ddfb0e10 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:25.237130874 +0000 UTC m=+18.035765647 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1550d3f8-d568-4b3b-80c5-34a9ddfb0e10-original-pull-secret") pod "global-pull-secret-syncer-dwq8z" (UID: "1550d3f8-d568-4b3b-80c5-34a9ddfb0e10") : object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:17.237285 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:17.237170    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:17.237285 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:17.237249    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69446d2a-2163-4a00-8b2d-02c7dee348e3-metrics-certs podName:69446d2a-2163-4a00-8b2d-02c7dee348e3 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:25.237203558 +0000 UTC m=+18.035838333 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69446d2a-2163-4a00-8b2d-02c7dee348e3-metrics-certs") pod "network-metrics-daemon-dqhsk" (UID: "69446d2a-2163-4a00-8b2d-02c7dee348e3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:17.337739 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:17.337708    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7gb4\" (UniqueName: \"kubernetes.io/projected/96099d3a-c51d-4599-b015-a30ff4c09bc6-kube-api-access-l7gb4\") pod \"network-check-target-wqqzl\" (UID: \"96099d3a-c51d-4599-b015-a30ff4c09bc6\") " pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:15:17.337916 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:17.337851    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 14:15:17.337916 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:17.337867    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 14:15:17.337916 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:17.337883    2584 projected.go:196] Error preparing data for projected volume kube-api-access-l7gb4 for pod openshift-network-diagnostics/network-check-target-wqqzl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:17.338070 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:17.337923    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96099d3a-c51d-4599-b015-a30ff4c09bc6-kube-api-access-l7gb4 podName:96099d3a-c51d-4599-b015-a30ff4c09bc6 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:25.337911538 +0000 UTC m=+18.136546313 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-l7gb4" (UniqueName: "kubernetes.io/projected/96099d3a-c51d-4599-b015-a30ff4c09bc6-kube-api-access-l7gb4") pod "network-check-target-wqqzl" (UID: "96099d3a-c51d-4599-b015-a30ff4c09bc6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:17.674956 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:17.674205    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:15:17.674956 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:17.674311    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqqzl" podUID="96099d3a-c51d-4599-b015-a30ff4c09bc6"
Sep 11 14:15:17.674956 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:17.674638    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:17.674956 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:17.674746    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwq8z" podUID="1550d3f8-d568-4b3b-80c5-34a9ddfb0e10"
Sep 11 14:15:17.674956 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:17.674795    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:15:17.674956 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:17.674874    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqhsk" podUID="69446d2a-2163-4a00-8b2d-02c7dee348e3"
Sep 11 14:15:19.675949 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:19.675706    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:15:19.676353 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:19.675748    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:15:19.676353 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:19.676039    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqqzl" podUID="96099d3a-c51d-4599-b015-a30ff4c09bc6"
Sep 11 14:15:19.676353 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:19.675750    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:19.676353 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:19.676138    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqhsk" podUID="69446d2a-2163-4a00-8b2d-02c7dee348e3"
Sep 11 14:15:19.676353 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:19.676223    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwq8z" podUID="1550d3f8-d568-4b3b-80c5-34a9ddfb0e10"
Sep 11 14:15:21.673287 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:21.673251    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:21.673760 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:21.673255    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:15:21.673760 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:21.673372    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwq8z" podUID="1550d3f8-d568-4b3b-80c5-34a9ddfb0e10"
Sep 11 14:15:21.673760 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:21.673263    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:15:21.673760 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:21.673444    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqqzl" podUID="96099d3a-c51d-4599-b015-a30ff4c09bc6"
Sep 11 14:15:21.673760 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:21.673579    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqhsk" podUID="69446d2a-2163-4a00-8b2d-02c7dee348e3"
Sep 11 14:15:23.672919 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:23.672887    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:23.672919 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:23.672906    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:15:23.673355 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:23.672905    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:15:23.673355 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:23.673006    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwq8z" podUID="1550d3f8-d568-4b3b-80c5-34a9ddfb0e10"
Sep 11 14:15:23.673355 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:23.673108    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqhsk" podUID="69446d2a-2163-4a00-8b2d-02c7dee348e3"
Sep 11 14:15:23.673355 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:23.673253    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqqzl" podUID="96099d3a-c51d-4599-b015-a30ff4c09bc6"
Sep 11 14:15:25.294077 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:25.294043    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1550d3f8-d568-4b3b-80c5-34a9ddfb0e10-original-pull-secret\") pod \"global-pull-secret-syncer-dwq8z\" (UID: \"1550d3f8-d568-4b3b-80c5-34a9ddfb0e10\") " pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:25.294585 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:25.294108    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69446d2a-2163-4a00-8b2d-02c7dee348e3-metrics-certs\") pod \"network-metrics-daemon-dqhsk\" (UID: \"69446d2a-2163-4a00-8b2d-02c7dee348e3\") " pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:15:25.294585 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:25.294198    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:25.294585 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:25.294204    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:25.294585 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:25.294254    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69446d2a-2163-4a00-8b2d-02c7dee348e3-metrics-certs podName:69446d2a-2163-4a00-8b2d-02c7dee348e3 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:41.294239357 +0000 UTC m=+34.092874124 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69446d2a-2163-4a00-8b2d-02c7dee348e3-metrics-certs") pod "network-metrics-daemon-dqhsk" (UID: "69446d2a-2163-4a00-8b2d-02c7dee348e3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:25.294585 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:25.294271    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1550d3f8-d568-4b3b-80c5-34a9ddfb0e10-original-pull-secret podName:1550d3f8-d568-4b3b-80c5-34a9ddfb0e10 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:41.294262866 +0000 UTC m=+34.092897627 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1550d3f8-d568-4b3b-80c5-34a9ddfb0e10-original-pull-secret") pod "global-pull-secret-syncer-dwq8z" (UID: "1550d3f8-d568-4b3b-80c5-34a9ddfb0e10") : object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:25.394374 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:25.394340    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7gb4\" (UniqueName: \"kubernetes.io/projected/96099d3a-c51d-4599-b015-a30ff4c09bc6-kube-api-access-l7gb4\") pod \"network-check-target-wqqzl\" (UID: \"96099d3a-c51d-4599-b015-a30ff4c09bc6\") " pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:15:25.394546 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:25.394499    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 14:15:25.394546 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:25.394521    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 14:15:25.394546 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:25.394535    2584 projected.go:196] Error preparing data for projected volume kube-api-access-l7gb4 for pod openshift-network-diagnostics/network-check-target-wqqzl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:25.394717 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:25.394596    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96099d3a-c51d-4599-b015-a30ff4c09bc6-kube-api-access-l7gb4 podName:96099d3a-c51d-4599-b015-a30ff4c09bc6 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:41.394576484 +0000 UTC m=+34.193211261 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-l7gb4" (UniqueName: "kubernetes.io/projected/96099d3a-c51d-4599-b015-a30ff4c09bc6-kube-api-access-l7gb4") pod "network-check-target-wqqzl" (UID: "96099d3a-c51d-4599-b015-a30ff4c09bc6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:25.676702 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:25.676620    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:15:25.676702 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:25.676659    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:15:25.676702 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:25.676659    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:25.676917 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:25.676743    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqhsk" podUID="69446d2a-2163-4a00-8b2d-02c7dee348e3"
Sep 11 14:15:25.676917 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:25.676834    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqqzl" podUID="96099d3a-c51d-4599-b015-a30ff4c09bc6"
Sep 11 14:15:25.676917 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:25.676902    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwq8z" podUID="1550d3f8-d568-4b3b-80c5-34a9ddfb0e10"
Sep 11 14:15:27.675633 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:27.675604    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:27.676039 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:27.675604    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:15:27.676039 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:27.675702    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwq8z" podUID="1550d3f8-d568-4b3b-80c5-34a9ddfb0e10"
Sep 11 14:15:27.676039 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:27.675811    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqhsk" podUID="69446d2a-2163-4a00-8b2d-02c7dee348e3"
Sep 11 14:15:27.676039 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:27.675604    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:15:27.676039 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:27.675906    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqqzl" podUID="96099d3a-c51d-4599-b015-a30ff4c09bc6"
Sep 11 14:15:28.768964 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:28.768764    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-77vcp" event={"ID":"9528abdc-9478-4485-ab39-a8c576fef301","Type":"ContainerStarted","Data":"57635cbf6868a9df783cb44b2cbe4f88d52c056c52c1c6551459cde93e31c394"}
Sep 11 14:15:28.770865 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:28.770840    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgsjj" event={"ID":"060ec342-6ae9-4023-aec0-b08232216325","Type":"ContainerStarted","Data":"ab1166334d04f90c3680734971f28d4f198f22c6ec04049c40d47a752289c691"}
Sep 11 14:15:28.773628 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:28.773602    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bft2j" event={"ID":"7438d9b7-3a2b-4548-85c2-a66cd5055dfb","Type":"ContainerStarted","Data":"93b4a5eb86d4b0b8b4095483853c2e6e75b30412fee4e045c5c9199e72884d5e"}
Sep 11 14:15:28.773719 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:28.773692    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bft2j" event={"ID":"7438d9b7-3a2b-4548-85c2-a66cd5055dfb","Type":"ContainerStarted","Data":"c218052e943b7c9c8b1f1545de9b46081f8307ec0c824b636d092005a3093bd9"}
Sep 11 14:15:28.773780 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:28.773747    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bft2j" event={"ID":"7438d9b7-3a2b-4548-85c2-a66cd5055dfb","Type":"ContainerStarted","Data":"7c9587396a81d4ee8130845f89d4e204d2b09c2e3c58a28081e0ce40b728cb75"}
Sep 11 14:15:28.773832 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:28.773795    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bft2j" event={"ID":"7438d9b7-3a2b-4548-85c2-a66cd5055dfb","Type":"ContainerStarted","Data":"c0f6bb04c264559a522f30c6fb202e2dd133c4d6ccdf033beec3596705f19ac5"}
Sep 11 14:15:28.773895 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:28.773843    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bft2j" event={"ID":"7438d9b7-3a2b-4548-85c2-a66cd5055dfb","Type":"ContainerStarted","Data":"ad3cc6e2f720dae47599e2b80427701540a4dea69122c775b32e872af9fa5975"}
Sep 11 14:15:28.775188 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:28.775170    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2rhc2" event={"ID":"132a3582-58a8-497f-a537-e38bde288795","Type":"ContainerStarted","Data":"929b64e3dacdea4b68c38bc2b16449e170b8d4c87701bf7785f5bf1bd56835c9"}
Sep 11 14:15:28.776833 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:28.776806    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qqfdv" event={"ID":"e0f53898-0fed-452b-bca9-d8e064b83f2a","Type":"ContainerStarted","Data":"d543a7a2a585b638c5131f1cfa4b549653cc9c42e5dfd23a1dbd768b3587991c"}
Sep 11 14:15:28.778545 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:28.778462    2584 generic.go:356] "Generic (PLEG): container finished" podID="3629f229-7ef5-4a0f-a90e-7b8de102ed1a" containerID="4d50cc54517145d34a83766d69a10baf82e40472804fd28d0f795515c9c0670b" exitCode=0
Sep 11 14:15:28.778545 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:28.778523    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xfdr" event={"ID":"3629f229-7ef5-4a0f-a90e-7b8de102ed1a","Type":"ContainerDied","Data":"4d50cc54517145d34a83766d69a10baf82e40472804fd28d0f795515c9c0670b"}
Sep 11 14:15:28.780343 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:28.780289    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-952fp" event={"ID":"3568ecb4-6204-4702-abdc-8223f51dfd46","Type":"ContainerStarted","Data":"b0edb23c9c96c2f012739e63577b97d861b1fe7002e0c9b34efcc6f0d02b9aba"}
Sep 11 14:15:28.782174 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:28.782154    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7gt5x" event={"ID":"cd82c8bb-0bd0-4dfb-941c-1c3a5b727425","Type":"ContainerStarted","Data":"a49a737cce5d9248bd07760fedcd2ac2b5d67ce3026e728f0dfd1bb5b904522e"}
Sep 11 14:15:28.816921 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:28.816871    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-77vcp" podStartSLOduration=4.076688664 podStartE2EDuration="21.816859024s" totalImagesPullingTime="17.74017036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:28.816659773 +0000 UTC m=+21.615294554" watchObservedRunningTime="2026-09-11 14:15:28.816859024 +0000 UTC m=+21.615493805"
Sep 11 14:15:28.847689 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:28.847649    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-952fp" podStartSLOduration=4.093041141 podStartE2EDuration="21.847634403s" totalImagesPullingTime="17.754593262s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:28.84744614 +0000 UTC m=+21.646080914" watchObservedRunningTime="2026-09-11 14:15:28.847634403 +0000 UTC m=+21.646269185"
Sep 11 14:15:28.983398 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:28.983288    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qqfdv" podStartSLOduration=4.192855479 podStartE2EDuration="21.983269872s" totalImagesPullingTime="17.790414393s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:28.983054345 +0000 UTC m=+21.781689129" watchObservedRunningTime="2026-09-11 14:15:28.983269872 +0000 UTC m=+21.781904655"
Sep 11 14:15:28.983656 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:28.983613    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7gt5x" podStartSLOduration=11.741902893 podStartE2EDuration="21.983594793s" totalImagesPullingTime="10.2416919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:28.951520679 +0000 UTC m=+21.750155461" watchObservedRunningTime="2026-09-11 14:15:28.983594793 +0000 UTC m=+21.782229575"
Sep 11 14:15:29.065839 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:29.065811    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:15:29.138457 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:29.138434    2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 14:15:29.156102 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:29.156079    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:15:29.245252 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:29.245194    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:15:29.345194 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:29.345153    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:15:29.624142 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:29.623978    2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T14:15:29.13845454Z","UUID":"f6a7e8e2-40a5-4398-aafd-dd1967639d63","Handler":null,"Name":"","Endpoint":""}
Sep 11 14:15:29.625783 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:29.625752    2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 14:15:29.625910 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:29.625797    2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 14:15:29.673672 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:29.673642    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:15:29.673843 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:29.673643    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:29.673843 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:29.673778    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqqzl" podUID="96099d3a-c51d-4599-b015-a30ff4c09bc6"
Sep 11 14:15:29.673943 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:29.673886    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwq8z" podUID="1550d3f8-d568-4b3b-80c5-34a9ddfb0e10"
Sep 11 14:15:29.673990 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:29.673945    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:15:29.674043 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:29.674029    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqhsk" podUID="69446d2a-2163-4a00-8b2d-02c7dee348e3"
Sep 11 14:15:29.787191 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:29.786936    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hm4qt" event={"ID":"ee16b430-307c-4f64-8ed7-ec59ad34f117","Type":"ContainerStarted","Data":"8668283a7996a140489084a82d8651b43c023608997477e0768058f7ed8868d1"}
Sep 11 14:15:29.789557 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:29.789528    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgsjj" event={"ID":"060ec342-6ae9-4023-aec0-b08232216325","Type":"ContainerStarted","Data":"e65e81bb651a2fe71f7535b15f12d32f2587080f95e5869e0c289b37f3fedaa2"}
Sep 11 14:15:29.793472 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:29.793448    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bft2j" event={"ID":"7438d9b7-3a2b-4548-85c2-a66cd5055dfb","Type":"ContainerStarted","Data":"bf8228b61f29d7bd50cc96b73f3e38b489b4b2f326a3a6ab58b9d87ae8f4caae"}
Sep 11 14:15:29.821141 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:29.821097    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2rhc2" podStartSLOduration=5.074704704 podStartE2EDuration="22.821076273s" totalImagesPullingTime="17.746371569s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:29.007908233 +0000 UTC m=+21.806543026" watchObservedRunningTime="2026-09-11 14:15:29.821076273 +0000 UTC m=+22.619711055"
Sep 11 14:15:30.075422 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:30.075365    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:15:30.399998 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:30.399891    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:15:30.498503 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:30.498471    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:15:30.800999 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:30.800912    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgsjj" event={"ID":"060ec342-6ae9-4023-aec0-b08232216325","Type":"ContainerStarted","Data":"39df7d3af2df9aabadde4d46f15386b860ff41e9acb999708b81ff3e7eabdb24"}
Sep 11 14:15:30.821595 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:30.821540    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgsjj" podStartSLOduration=4.463393282 podStartE2EDuration="23.821524091s" totalImagesPullingTime="19.358130809s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:30.820921444 +0000 UTC m=+23.619556226" watchObservedRunningTime="2026-09-11 14:15:30.821524091 +0000 UTC m=+23.620158873"
Sep 11 14:15:30.821786 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:30.821760    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hm4qt" podStartSLOduration=6.097866248 podStartE2EDuration="23.821754366s" totalImagesPullingTime="17.723888118s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:29.820823744 +0000 UTC m=+22.619458528" watchObservedRunningTime="2026-09-11 14:15:30.821754366 +0000 UTC m=+23.620389147"
Sep 11 14:15:31.676948 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:31.676919    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:15:31.677138 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:31.676959    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:31.677138 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:31.676960    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:15:31.677138 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:31.677036    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqqzl" podUID="96099d3a-c51d-4599-b015-a30ff4c09bc6"
Sep 11 14:15:31.677303 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:31.677149    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwq8z" podUID="1550d3f8-d568-4b3b-80c5-34a9ddfb0e10"
Sep 11 14:15:31.677303 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:31.677249    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqhsk" podUID="69446d2a-2163-4a00-8b2d-02c7dee348e3"
Sep 11 14:15:31.806835 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:31.806804    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bft2j" event={"ID":"7438d9b7-3a2b-4548-85c2-a66cd5055dfb","Type":"ContainerStarted","Data":"f3ba27db605065ee7c2ec59053eedc6f01797c438adf5f511f57a2f9a1b186b3"}
Sep 11 14:15:32.968327 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:32.968305    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7gt5x"
Sep 11 14:15:32.968774 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:32.968754    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7gt5x"
Sep 11 14:15:33.676456 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:33.676245    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:15:33.676595 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:33.676278    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:15:33.676595 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:33.676497    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqhsk" podUID="69446d2a-2163-4a00-8b2d-02c7dee348e3"
Sep 11 14:15:33.676595 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:33.676303    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:33.676595 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:33.676576    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqqzl" podUID="96099d3a-c51d-4599-b015-a30ff4c09bc6"
Sep 11 14:15:33.676779 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:33.676656    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwq8z" podUID="1550d3f8-d568-4b3b-80c5-34a9ddfb0e10"
Sep 11 14:15:33.813890 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:33.813854    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bft2j" event={"ID":"7438d9b7-3a2b-4548-85c2-a66cd5055dfb","Type":"ContainerStarted","Data":"5c4437d3d40d35efa94ad524a123d90d7a6cc8a2429d999ac7bfd0e56972b35c"}
Sep 11 14:15:33.814183 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:33.814109    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:33.814183 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:33.814180    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:33.815911 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:33.815889    2584 generic.go:356] "Generic (PLEG): container finished" podID="3629f229-7ef5-4a0f-a90e-7b8de102ed1a" containerID="bae56466ef3ac8640a494a293284ea19d2a5f80c39abab0f53cb0961ad12d321" exitCode=0
Sep 11 14:15:33.816013 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:33.815918    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xfdr" event={"ID":"3629f229-7ef5-4a0f-a90e-7b8de102ed1a","Type":"ContainerDied","Data":"bae56466ef3ac8640a494a293284ea19d2a5f80c39abab0f53cb0961ad12d321"}
Sep 11 14:15:33.829278 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:33.829256    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:33.829357 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:33.829341    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:33.845274 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:33.845233    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bft2j" podStartSLOduration=8.63116442 podStartE2EDuration="26.845218645s" totalImagesPullingTime="18.214054225s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:33.844322655 +0000 UTC m=+26.642957436" watchObservedRunningTime="2026-09-11 14:15:33.845218645 +0000 UTC m=+26.643853427"
Sep 11 14:15:34.309009 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:34.308971    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:15:34.820519 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:34.820487    2584 generic.go:356] "Generic (PLEG): container finished" podID="3629f229-7ef5-4a0f-a90e-7b8de102ed1a" containerID="eb35c0d3c2a2848b320309e03226b0f8135f588421a191e843cc67097540a4b1" exitCode=0
Sep 11 14:15:34.820657 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:34.820547    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xfdr" event={"ID":"3629f229-7ef5-4a0f-a90e-7b8de102ed1a","Type":"ContainerDied","Data":"eb35c0d3c2a2848b320309e03226b0f8135f588421a191e843cc67097540a4b1"}
Sep 11 14:15:34.820657 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:34.820638    2584 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 11 14:15:35.314727 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:35.314695    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7gt5x"
Sep 11 14:15:35.315420 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:35.314867    2584 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 11 14:15:35.315420 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:35.315357    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7gt5x"
Sep 11 14:15:35.355949 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:35.355922    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dqhsk"]
Sep 11 14:15:35.356102 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:35.356057    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:15:35.356211 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:35.356188    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqhsk" podUID="69446d2a-2163-4a00-8b2d-02c7dee348e3"
Sep 11 14:15:35.359127 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:35.359102    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dwq8z"]
Sep 11 14:15:35.359232 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:35.359206    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:35.359316 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:35.359298    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwq8z" podUID="1550d3f8-d568-4b3b-80c5-34a9ddfb0e10"
Sep 11 14:15:35.386274 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:35.386219    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wqqzl"]
Sep 11 14:15:35.386375 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:35.386327    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:15:35.386430 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:35.386414    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqqzl" podUID="96099d3a-c51d-4599-b015-a30ff4c09bc6"
Sep 11 14:15:35.404917 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:35.404889    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:15:35.825554 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:35.825323    2584 generic.go:356] "Generic (PLEG): container finished" podID="3629f229-7ef5-4a0f-a90e-7b8de102ed1a" containerID="a4a061beac987dbc4c0e520a8c9c62d2de91b99630d3fd22be5e04507e19ac8d" exitCode=0
Sep 11 14:15:35.825554 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:35.825400    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xfdr" event={"ID":"3629f229-7ef5-4a0f-a90e-7b8de102ed1a","Type":"ContainerDied","Data":"a4a061beac987dbc4c0e520a8c9c62d2de91b99630d3fd22be5e04507e19ac8d"}
Sep 11 14:15:35.825802 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:35.825785    2584 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 11 14:15:36.673095 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:36.673022    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:36.673525 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:36.673022    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:15:36.673525 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:36.673150    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwq8z" podUID="1550d3f8-d568-4b3b-80c5-34a9ddfb0e10"
Sep 11 14:15:36.673525 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:36.673206    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqqzl" podUID="96099d3a-c51d-4599-b015-a30ff4c09bc6"
Sep 11 14:15:37.674814 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:37.674739    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:15:37.675279 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:37.674863    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqhsk" podUID="69446d2a-2163-4a00-8b2d-02c7dee348e3"
Sep 11 14:15:38.673134 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:38.673099    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:38.673297 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:38.673207    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwq8z" podUID="1550d3f8-d568-4b3b-80c5-34a9ddfb0e10"
Sep 11 14:15:38.673297 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:38.673267    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:15:38.673386 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:38.673371    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqqzl" podUID="96099d3a-c51d-4599-b015-a30ff4c09bc6"
Sep 11 14:15:38.881320 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:38.881281    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:15:38.982669 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:38.982596    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:15:39.489304 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:39.489258    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:39.489525 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:39.489511    2584 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 11 14:15:39.506130 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:39.506106    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bft2j"
Sep 11 14:15:39.673492 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:39.673415    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:15:39.673653 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:39.673556    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqhsk" podUID="69446d2a-2163-4a00-8b2d-02c7dee348e3"
Sep 11 14:15:40.227298 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:40.227261    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:15:40.328284 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:40.328227    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:15:40.673311 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:40.673248    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:40.673479 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:40.673248    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:15:40.673479 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:40.673408    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqqzl" podUID="96099d3a-c51d-4599-b015-a30ff4c09bc6"
Sep 11 14:15:40.673479 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:40.673333    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwq8z" podUID="1550d3f8-d568-4b3b-80c5-34a9ddfb0e10"
Sep 11 14:15:40.839997 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:40.839967    2584 generic.go:356] "Generic (PLEG): container finished" podID="3629f229-7ef5-4a0f-a90e-7b8de102ed1a" containerID="92fc10b4bbd4e7c740dd4d34693d979ed302cb3bc93095756697c35dfb16d24d" exitCode=0
Sep 11 14:15:40.840153 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:40.840011    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xfdr" event={"ID":"3629f229-7ef5-4a0f-a90e-7b8de102ed1a","Type":"ContainerDied","Data":"92fc10b4bbd4e7c740dd4d34693d979ed302cb3bc93095756697c35dfb16d24d"}
Sep 11 14:15:40.960919 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:40.960901    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-175.ec2.internal" event="NodeReady"
Sep 11 14:15:40.961021 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:40.961004    2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 14:15:41.017287 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.017257    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mc48z"]
Sep 11 14:15:41.031179 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.031150    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w4tcc"]
Sep 11 14:15:41.031292 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.031270    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mc48z"
Sep 11 14:15:41.033462 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.033442    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xblvp\""
Sep 11 14:15:41.034002 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.033969    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 14:15:41.034002 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.033980    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 14:15:41.044079 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.044061    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mc48z"]
Sep 11 14:15:41.044170 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.044093    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w4tcc"]
Sep 11 14:15:41.044170 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.044153    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w4tcc"
Sep 11 14:15:41.046438 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.046416    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 14:15:41.046947 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.046930    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 14:15:41.046947 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.046940    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 14:15:41.047037 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.046998    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bjq4z\""
Sep 11 14:15:41.112195 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.112171    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ffe0180e-2a90-4d97-8575-1d44acd6b790-config-volume\") pod \"dns-default-mc48z\" (UID: \"ffe0180e-2a90-4d97-8575-1d44acd6b790\") " pod="openshift-dns/dns-default-mc48z"
Sep 11 14:15:41.112282 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.112213    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffe0180e-2a90-4d97-8575-1d44acd6b790-tmp-dir\") pod \"dns-default-mc48z\" (UID: \"ffe0180e-2a90-4d97-8575-1d44acd6b790\") " pod="openshift-dns/dns-default-mc48z"
Sep 11 14:15:41.112282 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.112262    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gp97\" (UniqueName: \"kubernetes.io/projected/ffe0180e-2a90-4d97-8575-1d44acd6b790-kube-api-access-9gp97\") pod \"dns-default-mc48z\" (UID: \"ffe0180e-2a90-4d97-8575-1d44acd6b790\") " pod="openshift-dns/dns-default-mc48z"
Sep 11 14:15:41.112355 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.112292    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffe0180e-2a90-4d97-8575-1d44acd6b790-metrics-tls\") pod \"dns-default-mc48z\" (UID: \"ffe0180e-2a90-4d97-8575-1d44acd6b790\") " pod="openshift-dns/dns-default-mc48z"
Sep 11 14:15:41.155633 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.155608    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:15:41.213080 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.213030    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffe0180e-2a90-4d97-8575-1d44acd6b790-tmp-dir\") pod \"dns-default-mc48z\" (UID: \"ffe0180e-2a90-4d97-8575-1d44acd6b790\") " pod="openshift-dns/dns-default-mc48z"
Sep 11 14:15:41.213080 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.213066    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gp97\" (UniqueName: \"kubernetes.io/projected/ffe0180e-2a90-4d97-8575-1d44acd6b790-kube-api-access-9gp97\") pod \"dns-default-mc48z\" (UID: \"ffe0180e-2a90-4d97-8575-1d44acd6b790\") " pod="openshift-dns/dns-default-mc48z"
Sep 11 14:15:41.213228 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.213086    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffe0180e-2a90-4d97-8575-1d44acd6b790-metrics-tls\") pod \"dns-default-mc48z\" (UID: \"ffe0180e-2a90-4d97-8575-1d44acd6b790\") " pod="openshift-dns/dns-default-mc48z"
Sep 11 14:15:41.213228 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.213121    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ffe0180e-2a90-4d97-8575-1d44acd6b790-config-volume\") pod \"dns-default-mc48z\" (UID: \"ffe0180e-2a90-4d97-8575-1d44acd6b790\") " pod="openshift-dns/dns-default-mc48z"
Sep 11 14:15:41.213228 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.213140    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj9cw\" (UniqueName: \"kubernetes.io/projected/70ac1cfe-b296-49ad-925d-7b64e662395c-kube-api-access-wj9cw\") pod \"ingress-canary-w4tcc\" (UID: \"70ac1cfe-b296-49ad-925d-7b64e662395c\") " pod="openshift-ingress-canary/ingress-canary-w4tcc"
Sep 11 14:15:41.213228 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.213155    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70ac1cfe-b296-49ad-925d-7b64e662395c-cert\") pod \"ingress-canary-w4tcc\" (UID: \"70ac1cfe-b296-49ad-925d-7b64e662395c\") " pod="openshift-ingress-canary/ingress-canary-w4tcc"
Sep 11 14:15:41.213413 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:41.213263    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 14:15:41.213413 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:41.213309    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffe0180e-2a90-4d97-8575-1d44acd6b790-metrics-tls podName:ffe0180e-2a90-4d97-8575-1d44acd6b790 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:41.713296888 +0000 UTC m=+34.511931652 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ffe0180e-2a90-4d97-8575-1d44acd6b790-metrics-tls") pod "dns-default-mc48z" (UID: "ffe0180e-2a90-4d97-8575-1d44acd6b790") : secret "dns-default-metrics-tls" not found
Sep 11 14:15:41.213413 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.213359    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffe0180e-2a90-4d97-8575-1d44acd6b790-tmp-dir\") pod \"dns-default-mc48z\" (UID: \"ffe0180e-2a90-4d97-8575-1d44acd6b790\") " pod="openshift-dns/dns-default-mc48z"
Sep 11 14:15:41.213586 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.213570    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ffe0180e-2a90-4d97-8575-1d44acd6b790-config-volume\") pod \"dns-default-mc48z\" (UID: \"ffe0180e-2a90-4d97-8575-1d44acd6b790\") " pod="openshift-dns/dns-default-mc48z"
Sep 11 14:15:41.223025 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.222910    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gp97\" (UniqueName: \"kubernetes.io/projected/ffe0180e-2a90-4d97-8575-1d44acd6b790-kube-api-access-9gp97\") pod \"dns-default-mc48z\" (UID: \"ffe0180e-2a90-4d97-8575-1d44acd6b790\") " pod="openshift-dns/dns-default-mc48z"
Sep 11 14:15:41.314021 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.314003    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1550d3f8-d568-4b3b-80c5-34a9ddfb0e10-original-pull-secret\") pod \"global-pull-secret-syncer-dwq8z\" (UID: \"1550d3f8-d568-4b3b-80c5-34a9ddfb0e10\") " pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:41.314335 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.314033    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj9cw\" (UniqueName: \"kubernetes.io/projected/70ac1cfe-b296-49ad-925d-7b64e662395c-kube-api-access-wj9cw\") pod \"ingress-canary-w4tcc\" (UID: \"70ac1cfe-b296-49ad-925d-7b64e662395c\") " pod="openshift-ingress-canary/ingress-canary-w4tcc"
Sep 11 14:15:41.314335 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.314048    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70ac1cfe-b296-49ad-925d-7b64e662395c-cert\") pod \"ingress-canary-w4tcc\" (UID: \"70ac1cfe-b296-49ad-925d-7b64e662395c\") " pod="openshift-ingress-canary/ingress-canary-w4tcc"
Sep 11 14:15:41.314335 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.314076    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69446d2a-2163-4a00-8b2d-02c7dee348e3-metrics-certs\") pod \"network-metrics-daemon-dqhsk\" (UID: \"69446d2a-2163-4a00-8b2d-02c7dee348e3\") " pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:15:41.314335 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:41.314114    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:41.314335 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:41.314159    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1550d3f8-d568-4b3b-80c5-34a9ddfb0e10-original-pull-secret podName:1550d3f8-d568-4b3b-80c5-34a9ddfb0e10 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:13.314147196 +0000 UTC m=+66.112781955 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1550d3f8-d568-4b3b-80c5-34a9ddfb0e10-original-pull-secret") pod "global-pull-secret-syncer-dwq8z" (UID: "1550d3f8-d568-4b3b-80c5-34a9ddfb0e10") : object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:41.314335 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:41.314163    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:41.314335 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:41.314205    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69446d2a-2163-4a00-8b2d-02c7dee348e3-metrics-certs podName:69446d2a-2163-4a00-8b2d-02c7dee348e3 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:13.314192043 +0000 UTC m=+66.112826818 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69446d2a-2163-4a00-8b2d-02c7dee348e3-metrics-certs") pod "network-metrics-daemon-dqhsk" (UID: "69446d2a-2163-4a00-8b2d-02c7dee348e3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:41.316295 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.316278    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70ac1cfe-b296-49ad-925d-7b64e662395c-cert\") pod \"ingress-canary-w4tcc\" (UID: \"70ac1cfe-b296-49ad-925d-7b64e662395c\") " pod="openshift-ingress-canary/ingress-canary-w4tcc"
Sep 11 14:15:41.321551 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.321531    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj9cw\" (UniqueName: \"kubernetes.io/projected/70ac1cfe-b296-49ad-925d-7b64e662395c-kube-api-access-wj9cw\") pod \"ingress-canary-w4tcc\" (UID: \"70ac1cfe-b296-49ad-925d-7b64e662395c\") " pod="openshift-ingress-canary/ingress-canary-w4tcc"
Sep 11 14:15:41.357602 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.357575    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:15:41.379579 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.379561    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w4tcc"
Sep 11 14:15:41.415162 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.415138    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7gb4\" (UniqueName: \"kubernetes.io/projected/96099d3a-c51d-4599-b015-a30ff4c09bc6-kube-api-access-l7gb4\") pod \"network-check-target-wqqzl\" (UID: \"96099d3a-c51d-4599-b015-a30ff4c09bc6\") " pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:15:41.415289 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:41.415276    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 14:15:41.415329 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:41.415292    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 14:15:41.415329 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:41.415301    2584 projected.go:196] Error preparing data for projected volume kube-api-access-l7gb4 for pod openshift-network-diagnostics/network-check-target-wqqzl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:41.415389 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:41.415347    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96099d3a-c51d-4599-b015-a30ff4c09bc6-kube-api-access-l7gb4 podName:96099d3a-c51d-4599-b015-a30ff4c09bc6 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:13.415331344 +0000 UTC m=+66.213966119 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-l7gb4" (UniqueName: "kubernetes.io/projected/96099d3a-c51d-4599-b015-a30ff4c09bc6-kube-api-access-l7gb4") pod "network-check-target-wqqzl" (UID: "96099d3a-c51d-4599-b015-a30ff4c09bc6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:41.424252 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.424233    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:15:41.673054 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.673022    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:15:41.675851 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.675829    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vtjb2\""
Sep 11 14:15:41.676212 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.676199    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 14:15:41.717493 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.717473    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffe0180e-2a90-4d97-8575-1d44acd6b790-metrics-tls\") pod \"dns-default-mc48z\" (UID: \"ffe0180e-2a90-4d97-8575-1d44acd6b790\") " pod="openshift-dns/dns-default-mc48z"
Sep 11 14:15:41.717595 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:41.717583    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 14:15:41.717645 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:41.717636    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffe0180e-2a90-4d97-8575-1d44acd6b790-metrics-tls podName:ffe0180e-2a90-4d97-8575-1d44acd6b790 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:42.717623583 +0000 UTC m=+35.516258343 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ffe0180e-2a90-4d97-8575-1d44acd6b790-metrics-tls") pod "dns-default-mc48z" (UID: "ffe0180e-2a90-4d97-8575-1d44acd6b790") : secret "dns-default-metrics-tls" not found
Sep 11 14:15:41.725859 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.725841    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w4tcc"]
Sep 11 14:15:41.731521 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:15:41.731501    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70ac1cfe_b296_49ad_925d_7b64e662395c.slice/crio-fb0530aec0dedd01cb19cf86caf80bd286fc2740c28218489abcb8d2dfe4d7a7 WatchSource:0}: Error finding container fb0530aec0dedd01cb19cf86caf80bd286fc2740c28218489abcb8d2dfe4d7a7: Status 404 returned error can't find the container with id fb0530aec0dedd01cb19cf86caf80bd286fc2740c28218489abcb8d2dfe4d7a7
Sep 11 14:15:41.843164 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.843139    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w4tcc" event={"ID":"70ac1cfe-b296-49ad-925d-7b64e662395c","Type":"ContainerStarted","Data":"fb0530aec0dedd01cb19cf86caf80bd286fc2740c28218489abcb8d2dfe4d7a7"}
Sep 11 14:15:41.846096 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.846070    2584 generic.go:356] "Generic (PLEG): container finished" podID="3629f229-7ef5-4a0f-a90e-7b8de102ed1a" containerID="728c1514d892daf4b6538896808eb835d1500592f2d6cf024dffe4324703af54" exitCode=0
Sep 11 14:15:41.846173 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:41.846102    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xfdr" event={"ID":"3629f229-7ef5-4a0f-a90e-7b8de102ed1a","Type":"ContainerDied","Data":"728c1514d892daf4b6538896808eb835d1500592f2d6cf024dffe4324703af54"}
Sep 11 14:15:42.673276 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:42.673246    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:15:42.674320 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:42.673245    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:15:42.680034 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:42.680008    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 14:15:42.680890 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:42.680869    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lc92k\""
Sep 11 14:15:42.680890 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:42.680880    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 14:15:42.682248 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:42.682228    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 14:15:42.724591 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:42.724567    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffe0180e-2a90-4d97-8575-1d44acd6b790-metrics-tls\") pod \"dns-default-mc48z\" (UID: \"ffe0180e-2a90-4d97-8575-1d44acd6b790\") " pod="openshift-dns/dns-default-mc48z"
Sep 11 14:15:42.724743 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:42.724727    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 14:15:42.724800 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:42.724790    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffe0180e-2a90-4d97-8575-1d44acd6b790-metrics-tls podName:ffe0180e-2a90-4d97-8575-1d44acd6b790 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:44.724772496 +0000 UTC m=+37.523407259 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ffe0180e-2a90-4d97-8575-1d44acd6b790-metrics-tls") pod "dns-default-mc48z" (UID: "ffe0180e-2a90-4d97-8575-1d44acd6b790") : secret "dns-default-metrics-tls" not found
Sep 11 14:15:42.764764 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:42.764739    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:15:42.852386 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:42.852356    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xfdr" event={"ID":"3629f229-7ef5-4a0f-a90e-7b8de102ed1a","Type":"ContainerStarted","Data":"8576181b2b04173366404babcf8423f11318a95783e57261295edd51f3597dfc"}
Sep 11 14:15:42.877717 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:42.877540    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5xfdr" podStartSLOduration=8.353069971 podStartE2EDuration="35.877520751s" totalImagesPullingTime="27.52445078s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:42.876245543 +0000 UTC m=+35.674880340" watchObservedRunningTime="2026-09-11 14:15:42.877520751 +0000 UTC m=+35.676155534"
Sep 11 14:15:43.562711 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:43.562658    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:15:43.638690 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:43.638448    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:15:44.737165 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:44.737131    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffe0180e-2a90-4d97-8575-1d44acd6b790-metrics-tls\") pod \"dns-default-mc48z\" (UID: \"ffe0180e-2a90-4d97-8575-1d44acd6b790\") " pod="openshift-dns/dns-default-mc48z"
Sep 11 14:15:44.737663 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:44.737237    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 14:15:44.737663 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:44.737285    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffe0180e-2a90-4d97-8575-1d44acd6b790-metrics-tls podName:ffe0180e-2a90-4d97-8575-1d44acd6b790 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:48.737272976 +0000 UTC m=+41.535907735 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ffe0180e-2a90-4d97-8575-1d44acd6b790-metrics-tls") pod "dns-default-mc48z" (UID: "ffe0180e-2a90-4d97-8575-1d44acd6b790") : secret "dns-default-metrics-tls" not found
Sep 11 14:15:44.858393 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:44.858360    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w4tcc" event={"ID":"70ac1cfe-b296-49ad-925d-7b64e662395c","Type":"ContainerStarted","Data":"1aa64855182ee5b78f5b10e2a1cf46d56f454918fb48a6963fe2eacbb5378260"}
Sep 11 14:15:44.882307 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:44.882262    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w4tcc" podStartSLOduration=1.577968389 podStartE2EDuration="3.882248164s" totalImagesPullingTime="2.304279775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:15:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:44.881905935 +0000 UTC m=+37.680540719" watchObservedRunningTime="2026-09-11 14:15:44.882248164 +0000 UTC m=+37.680882940"
Sep 11 14:15:46.137900 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:46.137870    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:15:46.242179 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:46.242156    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:15:48.522571 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:48.522532    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:15:48.599848 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:48.599815    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:15:48.766238 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:48.766211    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffe0180e-2a90-4d97-8575-1d44acd6b790-metrics-tls\") pod \"dns-default-mc48z\" (UID: \"ffe0180e-2a90-4d97-8575-1d44acd6b790\") " pod="openshift-dns/dns-default-mc48z"
Sep 11 14:15:48.766377 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:48.766346    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 14:15:48.766424 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:48.766402    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffe0180e-2a90-4d97-8575-1d44acd6b790-metrics-tls podName:ffe0180e-2a90-4d97-8575-1d44acd6b790 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:56.766386686 +0000 UTC m=+49.565021468 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ffe0180e-2a90-4d97-8575-1d44acd6b790-metrics-tls") pod "dns-default-mc48z" (UID: "ffe0180e-2a90-4d97-8575-1d44acd6b790") : secret "dns-default-metrics-tls" not found
Sep 11 14:15:56.822516 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:15:56.822476    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffe0180e-2a90-4d97-8575-1d44acd6b790-metrics-tls\") pod \"dns-default-mc48z\" (UID: \"ffe0180e-2a90-4d97-8575-1d44acd6b790\") " pod="openshift-dns/dns-default-mc48z"
Sep 11 14:15:56.822909 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:56.822616    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 14:15:56.822909 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:15:56.822700    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffe0180e-2a90-4d97-8575-1d44acd6b790-metrics-tls podName:ffe0180e-2a90-4d97-8575-1d44acd6b790 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:12.822670963 +0000 UTC m=+65.621305727 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ffe0180e-2a90-4d97-8575-1d44acd6b790-metrics-tls") pod "dns-default-mc48z" (UID: "ffe0180e-2a90-4d97-8575-1d44acd6b790") : secret "dns-default-metrics-tls" not found
Sep 11 14:16:01.570444 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.570406    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4skv"]
Sep 11 14:16:01.572131 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.572109    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4skv"
Sep 11 14:16:01.575671 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.575638    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 11 14:16:01.575671 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.575641    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4fsln\""
Sep 11 14:16:01.575882 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.575708    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 14:16:01.576857 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.576834    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 14:16:01.577135 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.577114    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 11 14:16:01.584627 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.584598    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4skv"]
Sep 11 14:16:01.679202 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.679153    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-87d46c48b-7pb8n"]
Sep 11 14:16:01.680982 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.680962    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:01.683900 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.683876    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 11 14:16:01.684772 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.684755    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 11 14:16:01.684884 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.684772    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 11 14:16:01.684884 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.684772    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 11 14:16:01.684884 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.684758    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 14:16:01.685025 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.684778    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-z2gpf\""
Sep 11 14:16:01.685156 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.685141    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 14:16:01.733133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.733114    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-87d46c48b-7pb8n"]
Sep 11 14:16:01.756668 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.756647    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf06917f-caf2-4af5-9f3b-c0da05de5d9c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g4skv\" (UID: \"cf06917f-caf2-4af5-9f3b-c0da05de5d9c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4skv"
Sep 11 14:16:01.756758 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.756673    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmjl9\" (UniqueName: \"kubernetes.io/projected/cf06917f-caf2-4af5-9f3b-c0da05de5d9c-kube-api-access-dmjl9\") pod \"cluster-monitoring-operator-6cd954b897-g4skv\" (UID: \"cf06917f-caf2-4af5-9f3b-c0da05de5d9c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4skv"
Sep 11 14:16:01.756758 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.756743    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cf06917f-caf2-4af5-9f3b-c0da05de5d9c-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-g4skv\" (UID: \"cf06917f-caf2-4af5-9f3b-c0da05de5d9c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4skv"
Sep 11 14:16:01.809306 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.809280    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7smvp"]
Sep 11 14:16:01.810927 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.810910    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7smvp"
Sep 11 14:16:01.813986 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.813962    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 11 14:16:01.814420 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.814400    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-g7rw9\""
Sep 11 14:16:01.814560 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.814544    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 11 14:16:01.814826 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.814810    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 11 14:16:01.815220 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.815204    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 11 14:16:01.824866 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.824823    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7smvp"]
Sep 11 14:16:01.857806 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.857784    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf06917f-caf2-4af5-9f3b-c0da05de5d9c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g4skv\" (UID: \"cf06917f-caf2-4af5-9f3b-c0da05de5d9c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4skv"
Sep 11 14:16:01.857900 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.857808    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmjl9\" (UniqueName: \"kubernetes.io/projected/cf06917f-caf2-4af5-9f3b-c0da05de5d9c-kube-api-access-dmjl9\") pod \"cluster-monitoring-operator-6cd954b897-g4skv\" (UID: \"cf06917f-caf2-4af5-9f3b-c0da05de5d9c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4skv"
Sep 11 14:16:01.857900 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.857830    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a7f60369-696c-4f9c-93dc-8ff217a04fc1-default-certificate\") pod \"router-default-87d46c48b-7pb8n\" (UID: \"a7f60369-696c-4f9c-93dc-8ff217a04fc1\") " pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:01.857982 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:01.857914    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 14:16:01.857982 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.857937    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cf06917f-caf2-4af5-9f3b-c0da05de5d9c-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-g4skv\" (UID: \"cf06917f-caf2-4af5-9f3b-c0da05de5d9c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4skv"
Sep 11 14:16:01.857982 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:01.857962    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf06917f-caf2-4af5-9f3b-c0da05de5d9c-cluster-monitoring-operator-tls podName:cf06917f-caf2-4af5-9f3b-c0da05de5d9c nodeName:}" failed. No retries permitted until 2026-09-11 14:16:02.357948313 +0000 UTC m=+55.156583088 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cf06917f-caf2-4af5-9f3b-c0da05de5d9c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-g4skv" (UID: "cf06917f-caf2-4af5-9f3b-c0da05de5d9c") : secret "cluster-monitoring-operator-tls" not found
Sep 11 14:16:01.857982 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.857977    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7f60369-696c-4f9c-93dc-8ff217a04fc1-service-ca-bundle\") pod \"router-default-87d46c48b-7pb8n\" (UID: \"a7f60369-696c-4f9c-93dc-8ff217a04fc1\") " pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:01.858171 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.858000    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a7f60369-696c-4f9c-93dc-8ff217a04fc1-stats-auth\") pod \"router-default-87d46c48b-7pb8n\" (UID: \"a7f60369-696c-4f9c-93dc-8ff217a04fc1\") " pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:01.858171 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.858014    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7f60369-696c-4f9c-93dc-8ff217a04fc1-metrics-certs\") pod \"router-default-87d46c48b-7pb8n\" (UID: \"a7f60369-696c-4f9c-93dc-8ff217a04fc1\") " pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:01.858171 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.858060    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4zj6\" (UniqueName: \"kubernetes.io/projected/a7f60369-696c-4f9c-93dc-8ff217a04fc1-kube-api-access-c4zj6\") pod \"router-default-87d46c48b-7pb8n\" (UID: \"a7f60369-696c-4f9c-93dc-8ff217a04fc1\") " pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:01.858517 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.858499    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cf06917f-caf2-4af5-9f3b-c0da05de5d9c-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-g4skv\" (UID: \"cf06917f-caf2-4af5-9f3b-c0da05de5d9c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4skv"
Sep 11 14:16:01.875935 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.875911    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmjl9\" (UniqueName: \"kubernetes.io/projected/cf06917f-caf2-4af5-9f3b-c0da05de5d9c-kube-api-access-dmjl9\") pod \"cluster-monitoring-operator-6cd954b897-g4skv\" (UID: \"cf06917f-caf2-4af5-9f3b-c0da05de5d9c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4skv"
Sep 11 14:16:01.885652 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.885633    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-m5knk"]
Sep 11 14:16:01.887354 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.887340    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-m5knk"
Sep 11 14:16:01.900284 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.900263    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-2jkxp\""
Sep 11 14:16:01.904600 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.904579    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-m5knk"]
Sep 11 14:16:01.958438 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.958418    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7f60369-696c-4f9c-93dc-8ff217a04fc1-service-ca-bundle\") pod \"router-default-87d46c48b-7pb8n\" (UID: \"a7f60369-696c-4f9c-93dc-8ff217a04fc1\") " pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:01.958533 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.958446    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a7f60369-696c-4f9c-93dc-8ff217a04fc1-stats-auth\") pod \"router-default-87d46c48b-7pb8n\" (UID: \"a7f60369-696c-4f9c-93dc-8ff217a04fc1\") " pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:01.958533 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.958461    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7f60369-696c-4f9c-93dc-8ff217a04fc1-metrics-certs\") pod \"router-default-87d46c48b-7pb8n\" (UID: \"a7f60369-696c-4f9c-93dc-8ff217a04fc1\") " pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:01.958533 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.958489    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4zj6\" (UniqueName: \"kubernetes.io/projected/a7f60369-696c-4f9c-93dc-8ff217a04fc1-kube-api-access-c4zj6\") pod \"router-default-87d46c48b-7pb8n\" (UID: \"a7f60369-696c-4f9c-93dc-8ff217a04fc1\") " pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:01.958714 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.958556    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c861bafb-8a3f-47cc-ab78-0d783b860739-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7smvp\" (UID: \"c861bafb-8a3f-47cc-ab78-0d783b860739\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7smvp"
Sep 11 14:16:01.958714 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.958590    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a7f60369-696c-4f9c-93dc-8ff217a04fc1-default-certificate\") pod \"router-default-87d46c48b-7pb8n\" (UID: \"a7f60369-696c-4f9c-93dc-8ff217a04fc1\") " pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:01.958714 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:01.958611    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 14:16:01.958714 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:01.958631    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a7f60369-696c-4f9c-93dc-8ff217a04fc1-service-ca-bundle podName:a7f60369-696c-4f9c-93dc-8ff217a04fc1 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:02.458610208 +0000 UTC m=+55.257244967 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a7f60369-696c-4f9c-93dc-8ff217a04fc1-service-ca-bundle") pod "router-default-87d46c48b-7pb8n" (UID: "a7f60369-696c-4f9c-93dc-8ff217a04fc1") : configmap references non-existent config key: service-ca.crt
Sep 11 14:16:01.958714 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:01.958666    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7f60369-696c-4f9c-93dc-8ff217a04fc1-metrics-certs podName:a7f60369-696c-4f9c-93dc-8ff217a04fc1 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:02.458648962 +0000 UTC m=+55.257283741 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7f60369-696c-4f9c-93dc-8ff217a04fc1-metrics-certs") pod "router-default-87d46c48b-7pb8n" (UID: "a7f60369-696c-4f9c-93dc-8ff217a04fc1") : secret "router-metrics-certs-default" not found
Sep 11 14:16:01.958949 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.958729    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c861bafb-8a3f-47cc-ab78-0d783b860739-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7smvp\" (UID: \"c861bafb-8a3f-47cc-ab78-0d783b860739\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7smvp"
Sep 11 14:16:01.958949 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.958760    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n65j9\" (UniqueName: \"kubernetes.io/projected/c861bafb-8a3f-47cc-ab78-0d783b860739-kube-api-access-n65j9\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7smvp\" (UID: \"c861bafb-8a3f-47cc-ab78-0d783b860739\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7smvp"
Sep 11 14:16:01.960190 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.960168    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:01.960970 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.960953    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a7f60369-696c-4f9c-93dc-8ff217a04fc1-stats-auth\") pod \"router-default-87d46c48b-7pb8n\" (UID: \"a7f60369-696c-4f9c-93dc-8ff217a04fc1\") " pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:01.961064 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.961046    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a7f60369-696c-4f9c-93dc-8ff217a04fc1-default-certificate\") pod \"router-default-87d46c48b-7pb8n\" (UID: \"a7f60369-696c-4f9c-93dc-8ff217a04fc1\") " pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:01.971695 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:01.971661    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4zj6\" (UniqueName: \"kubernetes.io/projected/a7f60369-696c-4f9c-93dc-8ff217a04fc1-kube-api-access-c4zj6\") pod \"router-default-87d46c48b-7pb8n\" (UID: \"a7f60369-696c-4f9c-93dc-8ff217a04fc1\") " pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:02.057439 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:02.057412    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:02.059324 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:02.059306    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n65j9\" (UniqueName: \"kubernetes.io/projected/c861bafb-8a3f-47cc-ab78-0d783b860739-kube-api-access-n65j9\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7smvp\" (UID: \"c861bafb-8a3f-47cc-ab78-0d783b860739\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7smvp"
Sep 11 14:16:02.059437 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:02.059424    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c861bafb-8a3f-47cc-ab78-0d783b860739-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7smvp\" (UID: \"c861bafb-8a3f-47cc-ab78-0d783b860739\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7smvp"
Sep 11 14:16:02.059479 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:02.059449    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f84ll\" (UniqueName: \"kubernetes.io/projected/8eeee13e-225c-4303-abc1-42b1af68b0a5-kube-api-access-f84ll\") pod \"network-check-source-6f8b768455-m5knk\" (UID: \"8eeee13e-225c-4303-abc1-42b1af68b0a5\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-m5knk"
Sep 11 14:16:02.059519 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:02.059479    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c861bafb-8a3f-47cc-ab78-0d783b860739-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7smvp\" (UID: \"c861bafb-8a3f-47cc-ab78-0d783b860739\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7smvp"
Sep 11 14:16:02.059981 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:02.059963    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c861bafb-8a3f-47cc-ab78-0d783b860739-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7smvp\" (UID: \"c861bafb-8a3f-47cc-ab78-0d783b860739\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7smvp"
Sep 11 14:16:02.061279 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:02.061260    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c861bafb-8a3f-47cc-ab78-0d783b860739-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7smvp\" (UID: \"c861bafb-8a3f-47cc-ab78-0d783b860739\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7smvp"
Sep 11 14:16:02.067553 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:02.067530    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n65j9\" (UniqueName: \"kubernetes.io/projected/c861bafb-8a3f-47cc-ab78-0d783b860739-kube-api-access-n65j9\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7smvp\" (UID: \"c861bafb-8a3f-47cc-ab78-0d783b860739\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7smvp"
Sep 11 14:16:02.118716 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:02.118654    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7smvp"
Sep 11 14:16:02.160781 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:02.160746    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f84ll\" (UniqueName: \"kubernetes.io/projected/8eeee13e-225c-4303-abc1-42b1af68b0a5-kube-api-access-f84ll\") pod \"network-check-source-6f8b768455-m5knk\" (UID: \"8eeee13e-225c-4303-abc1-42b1af68b0a5\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-m5knk"
Sep 11 14:16:02.182046 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:02.182024    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f84ll\" (UniqueName: \"kubernetes.io/projected/8eeee13e-225c-4303-abc1-42b1af68b0a5-kube-api-access-f84ll\") pod \"network-check-source-6f8b768455-m5knk\" (UID: \"8eeee13e-225c-4303-abc1-42b1af68b0a5\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-m5knk"
Sep 11 14:16:02.195019 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:02.194999    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-m5knk"
Sep 11 14:16:02.361863 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:02.361837    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf06917f-caf2-4af5-9f3b-c0da05de5d9c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g4skv\" (UID: \"cf06917f-caf2-4af5-9f3b-c0da05de5d9c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4skv"
Sep 11 14:16:02.362010 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:02.361991    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 14:16:02.362066 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:02.362057    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf06917f-caf2-4af5-9f3b-c0da05de5d9c-cluster-monitoring-operator-tls podName:cf06917f-caf2-4af5-9f3b-c0da05de5d9c nodeName:}" failed. No retries permitted until 2026-09-11 14:16:03.362040278 +0000 UTC m=+56.160675042 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cf06917f-caf2-4af5-9f3b-c0da05de5d9c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-g4skv" (UID: "cf06917f-caf2-4af5-9f3b-c0da05de5d9c") : secret "cluster-monitoring-operator-tls" not found
Sep 11 14:16:02.387253 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:02.387202    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7smvp"]
Sep 11 14:16:02.390274 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:16:02.390250    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc861bafb_8a3f_47cc_ab78_0d783b860739.slice/crio-6dcd1c8a9fb7b6dc7fc2b75d9020921221c1711bffb84b5bfe5ce6af0940d60e WatchSource:0}: Error finding container 6dcd1c8a9fb7b6dc7fc2b75d9020921221c1711bffb84b5bfe5ce6af0940d60e: Status 404 returned error can't find the container with id 6dcd1c8a9fb7b6dc7fc2b75d9020921221c1711bffb84b5bfe5ce6af0940d60e
Sep 11 14:16:02.458180 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:02.458158    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-m5knk"]
Sep 11 14:16:02.460825 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:16:02.460806    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eeee13e_225c_4303_abc1_42b1af68b0a5.slice/crio-f6f59fcef4f4463a7c79883109eccc409cb439b876c93c25827b96dece4b06fd WatchSource:0}: Error finding container f6f59fcef4f4463a7c79883109eccc409cb439b876c93c25827b96dece4b06fd: Status 404 returned error can't find the container with id f6f59fcef4f4463a7c79883109eccc409cb439b876c93c25827b96dece4b06fd
Sep 11 14:16:02.462337 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:02.462319    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7f60369-696c-4f9c-93dc-8ff217a04fc1-service-ca-bundle\") pod \"router-default-87d46c48b-7pb8n\" (UID: \"a7f60369-696c-4f9c-93dc-8ff217a04fc1\") " pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:02.462390 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:02.462353    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7f60369-696c-4f9c-93dc-8ff217a04fc1-metrics-certs\") pod \"router-default-87d46c48b-7pb8n\" (UID: \"a7f60369-696c-4f9c-93dc-8ff217a04fc1\") " pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:02.462513 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:02.462449    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 14:16:02.462513 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:02.462450    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a7f60369-696c-4f9c-93dc-8ff217a04fc1-service-ca-bundle podName:a7f60369-696c-4f9c-93dc-8ff217a04fc1 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:03.462435935 +0000 UTC m=+56.261070707 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a7f60369-696c-4f9c-93dc-8ff217a04fc1-service-ca-bundle") pod "router-default-87d46c48b-7pb8n" (UID: "a7f60369-696c-4f9c-93dc-8ff217a04fc1") : configmap references non-existent config key: service-ca.crt
Sep 11 14:16:02.462513 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:02.462503    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7f60369-696c-4f9c-93dc-8ff217a04fc1-metrics-certs podName:a7f60369-696c-4f9c-93dc-8ff217a04fc1 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:03.462487892 +0000 UTC m=+56.261122655 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7f60369-696c-4f9c-93dc-8ff217a04fc1-metrics-certs") pod "router-default-87d46c48b-7pb8n" (UID: "a7f60369-696c-4f9c-93dc-8ff217a04fc1") : secret "router-metrics-certs-default" not found
Sep 11 14:16:02.899227 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:02.899198    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-m5knk" event={"ID":"8eeee13e-225c-4303-abc1-42b1af68b0a5","Type":"ContainerStarted","Data":"f6f59fcef4f4463a7c79883109eccc409cb439b876c93c25827b96dece4b06fd"}
Sep 11 14:16:02.900488 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:02.900465    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7smvp" event={"ID":"c861bafb-8a3f-47cc-ab78-0d783b860739","Type":"ContainerStarted","Data":"6dcd1c8a9fb7b6dc7fc2b75d9020921221c1711bffb84b5bfe5ce6af0940d60e"}
Sep 11 14:16:03.302208 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:03.302169    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:03.368218 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:03.368191    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf06917f-caf2-4af5-9f3b-c0da05de5d9c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g4skv\" (UID: \"cf06917f-caf2-4af5-9f3b-c0da05de5d9c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4skv"
Sep 11 14:16:03.368354 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:03.368328    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 14:16:03.368409 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:03.368390    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf06917f-caf2-4af5-9f3b-c0da05de5d9c-cluster-monitoring-operator-tls podName:cf06917f-caf2-4af5-9f3b-c0da05de5d9c nodeName:}" failed. No retries permitted until 2026-09-11 14:16:05.368371847 +0000 UTC m=+58.167006627 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cf06917f-caf2-4af5-9f3b-c0da05de5d9c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-g4skv" (UID: "cf06917f-caf2-4af5-9f3b-c0da05de5d9c") : secret "cluster-monitoring-operator-tls" not found
Sep 11 14:16:03.369934 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:03.369902    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:03.469421 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:03.469394    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7f60369-696c-4f9c-93dc-8ff217a04fc1-service-ca-bundle\") pod \"router-default-87d46c48b-7pb8n\" (UID: \"a7f60369-696c-4f9c-93dc-8ff217a04fc1\") " pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:03.469546 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:03.469429    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7f60369-696c-4f9c-93dc-8ff217a04fc1-metrics-certs\") pod \"router-default-87d46c48b-7pb8n\" (UID: \"a7f60369-696c-4f9c-93dc-8ff217a04fc1\") " pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:03.469609 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:03.469555    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 14:16:03.469609 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:03.469575    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a7f60369-696c-4f9c-93dc-8ff217a04fc1-service-ca-bundle podName:a7f60369-696c-4f9c-93dc-8ff217a04fc1 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:05.469557013 +0000 UTC m=+58.268191778 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a7f60369-696c-4f9c-93dc-8ff217a04fc1-service-ca-bundle") pod "router-default-87d46c48b-7pb8n" (UID: "a7f60369-696c-4f9c-93dc-8ff217a04fc1") : configmap references non-existent config key: service-ca.crt
Sep 11 14:16:03.469609 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:03.469604    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7f60369-696c-4f9c-93dc-8ff217a04fc1-metrics-certs podName:a7f60369-696c-4f9c-93dc-8ff217a04fc1 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:05.469588018 +0000 UTC m=+58.268222793 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7f60369-696c-4f9c-93dc-8ff217a04fc1-metrics-certs") pod "router-default-87d46c48b-7pb8n" (UID: "a7f60369-696c-4f9c-93dc-8ff217a04fc1") : secret "router-metrics-certs-default" not found
Sep 11 14:16:05.371928 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:05.371896    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:05.382973 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:05.382940    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf06917f-caf2-4af5-9f3b-c0da05de5d9c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g4skv\" (UID: \"cf06917f-caf2-4af5-9f3b-c0da05de5d9c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4skv"
Sep 11 14:16:05.383102 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:05.383077    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 14:16:05.383156 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:05.383138    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf06917f-caf2-4af5-9f3b-c0da05de5d9c-cluster-monitoring-operator-tls podName:cf06917f-caf2-4af5-9f3b-c0da05de5d9c nodeName:}" failed. No retries permitted until 2026-09-11 14:16:09.383120294 +0000 UTC m=+62.181755067 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cf06917f-caf2-4af5-9f3b-c0da05de5d9c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-g4skv" (UID: "cf06917f-caf2-4af5-9f3b-c0da05de5d9c") : secret "cluster-monitoring-operator-tls" not found
Sep 11 14:16:05.472976 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:05.472947    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:05.484126 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:05.484093    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7f60369-696c-4f9c-93dc-8ff217a04fc1-service-ca-bundle\") pod \"router-default-87d46c48b-7pb8n\" (UID: \"a7f60369-696c-4f9c-93dc-8ff217a04fc1\") " pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:05.484243 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:05.484137    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7f60369-696c-4f9c-93dc-8ff217a04fc1-metrics-certs\") pod \"router-default-87d46c48b-7pb8n\" (UID: \"a7f60369-696c-4f9c-93dc-8ff217a04fc1\") " pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:05.484295 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:05.484248    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 14:16:05.484295 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:05.484274    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a7f60369-696c-4f9c-93dc-8ff217a04fc1-service-ca-bundle podName:a7f60369-696c-4f9c-93dc-8ff217a04fc1 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:09.484252453 +0000 UTC m=+62.282887234 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a7f60369-696c-4f9c-93dc-8ff217a04fc1-service-ca-bundle") pod "router-default-87d46c48b-7pb8n" (UID: "a7f60369-696c-4f9c-93dc-8ff217a04fc1") : configmap references non-existent config key: service-ca.crt
Sep 11 14:16:05.484404 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:05.484302    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7f60369-696c-4f9c-93dc-8ff217a04fc1-metrics-certs podName:a7f60369-696c-4f9c-93dc-8ff217a04fc1 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:09.4842921 +0000 UTC m=+62.282926873 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7f60369-696c-4f9c-93dc-8ff217a04fc1-metrics-certs") pod "router-default-87d46c48b-7pb8n" (UID: "a7f60369-696c-4f9c-93dc-8ff217a04fc1") : secret "router-metrics-certs-default" not found
Sep 11 14:16:05.911202 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:05.911164    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-m5knk" event={"ID":"8eeee13e-225c-4303-abc1-42b1af68b0a5","Type":"ContainerStarted","Data":"7a2e282f54b5dbfc0b84a434fe386966062982b286dd877869656b9ff6d8ed27"}
Sep 11 14:16:05.912899 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:05.912876    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7smvp" event={"ID":"c861bafb-8a3f-47cc-ab78-0d783b860739","Type":"ContainerStarted","Data":"a28dbe51028be5174b93c3b7acb54b90ba5c414b43a78bee1d5d8fa4c51838f9"}
Sep 11 14:16:05.931944 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:05.931899    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-m5knk" podStartSLOduration=1.68475996 podStartE2EDuration="4.931884685s" totalImagesPullingTime="3.247124725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:05.930841909 +0000 UTC m=+58.729476691" watchObservedRunningTime="2026-09-11 14:16:05.931884685 +0000 UTC m=+58.730519484"
Sep 11 14:16:05.956176 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:05.956114    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7smvp" podStartSLOduration=1.663788953 podStartE2EDuration="4.956102208s" totalImagesPullingTime="3.292313255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:05.956086923 +0000 UTC m=+58.754721703" watchObservedRunningTime="2026-09-11 14:16:05.956102208 +0000 UTC m=+58.754736989"
Sep 11 14:16:06.130186 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:06.130156    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:06.523586 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:06.523544    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:06.558244 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:06.558219    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-22p4j"]
Sep 11 14:16:06.560661 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:06.560643    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-22p4j"
Sep 11 14:16:06.563213 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:06.563190    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 14:16:06.563325 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:06.563221    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6n4gf\""
Sep 11 14:16:06.563325 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:06.563293    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 14:16:06.564223 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:06.564204    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 14:16:06.564223 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:06.564218    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 14:16:06.578249 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:06.578228    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-22p4j"]
Sep 11 14:16:06.590652 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:06.590620    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c37d429a-4f32-4478-94ac-a2d84a9c0685-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-22p4j\" (UID: \"c37d429a-4f32-4478-94ac-a2d84a9c0685\") " pod="openshift-insights/insights-runtime-extractor-22p4j"
Sep 11 14:16:06.590775 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:06.590705    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c37d429a-4f32-4478-94ac-a2d84a9c0685-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-22p4j\" (UID: \"c37d429a-4f32-4478-94ac-a2d84a9c0685\") " pod="openshift-insights/insights-runtime-extractor-22p4j"
Sep 11 14:16:06.590775 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:06.590725    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c37d429a-4f32-4478-94ac-a2d84a9c0685-crio-socket\") pod \"insights-runtime-extractor-22p4j\" (UID: \"c37d429a-4f32-4478-94ac-a2d84a9c0685\") " pod="openshift-insights/insights-runtime-extractor-22p4j"
Sep 11 14:16:06.590775 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:06.590741    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c37d429a-4f32-4478-94ac-a2d84a9c0685-data-volume\") pod \"insights-runtime-extractor-22p4j\" (UID: \"c37d429a-4f32-4478-94ac-a2d84a9c0685\") " pod="openshift-insights/insights-runtime-extractor-22p4j"
Sep 11 14:16:06.590775 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:06.590764    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lchvd\" (UniqueName: \"kubernetes.io/projected/c37d429a-4f32-4478-94ac-a2d84a9c0685-kube-api-access-lchvd\") pod \"insights-runtime-extractor-22p4j\" (UID: \"c37d429a-4f32-4478-94ac-a2d84a9c0685\") " pod="openshift-insights/insights-runtime-extractor-22p4j"
Sep 11 14:16:06.691642 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:06.691618    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c37d429a-4f32-4478-94ac-a2d84a9c0685-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-22p4j\" (UID: \"c37d429a-4f32-4478-94ac-a2d84a9c0685\") " pod="openshift-insights/insights-runtime-extractor-22p4j"
Sep 11 14:16:06.691760 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:06.691650    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c37d429a-4f32-4478-94ac-a2d84a9c0685-crio-socket\") pod \"insights-runtime-extractor-22p4j\" (UID: \"c37d429a-4f32-4478-94ac-a2d84a9c0685\") " pod="openshift-insights/insights-runtime-extractor-22p4j"
Sep 11 14:16:06.691760 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:06.691693    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c37d429a-4f32-4478-94ac-a2d84a9c0685-data-volume\") pod \"insights-runtime-extractor-22p4j\" (UID: \"c37d429a-4f32-4478-94ac-a2d84a9c0685\") " pod="openshift-insights/insights-runtime-extractor-22p4j"
Sep 11 14:16:06.691869 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:06.691759    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:06.691869 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:06.691774    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c37d429a-4f32-4478-94ac-a2d84a9c0685-crio-socket\") pod \"insights-runtime-extractor-22p4j\" (UID: \"c37d429a-4f32-4478-94ac-a2d84a9c0685\") " pod="openshift-insights/insights-runtime-extractor-22p4j"
Sep 11 14:16:06.691869 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:06.691810    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c37d429a-4f32-4478-94ac-a2d84a9c0685-insights-runtime-extractor-tls podName:c37d429a-4f32-4478-94ac-a2d84a9c0685 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:07.19179404 +0000 UTC m=+59.990428814 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c37d429a-4f32-4478-94ac-a2d84a9c0685-insights-runtime-extractor-tls") pod "insights-runtime-extractor-22p4j" (UID: "c37d429a-4f32-4478-94ac-a2d84a9c0685") : secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:06.691869 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:06.691825    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lchvd\" (UniqueName: \"kubernetes.io/projected/c37d429a-4f32-4478-94ac-a2d84a9c0685-kube-api-access-lchvd\") pod \"insights-runtime-extractor-22p4j\" (UID: \"c37d429a-4f32-4478-94ac-a2d84a9c0685\") " pod="openshift-insights/insights-runtime-extractor-22p4j"
Sep 11 14:16:06.692069 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:06.691973    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c37d429a-4f32-4478-94ac-a2d84a9c0685-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-22p4j\" (UID: \"c37d429a-4f32-4478-94ac-a2d84a9c0685\") " pod="openshift-insights/insights-runtime-extractor-22p4j"
Sep 11 14:16:06.692069 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:06.692002    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c37d429a-4f32-4478-94ac-a2d84a9c0685-data-volume\") pod \"insights-runtime-extractor-22p4j\" (UID: \"c37d429a-4f32-4478-94ac-a2d84a9c0685\") " pod="openshift-insights/insights-runtime-extractor-22p4j"
Sep 11 14:16:06.692069 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:06.692049    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 14:16:06.692160 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:06.692084    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c37d429a-4f32-4478-94ac-a2d84a9c0685-kube-rbac-proxy-cm podName:c37d429a-4f32-4478-94ac-a2d84a9c0685 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:07.192072975 +0000 UTC m=+59.990707740 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c37d429a-4f32-4478-94ac-a2d84a9c0685-kube-rbac-proxy-cm") pod "insights-runtime-extractor-22p4j" (UID: "c37d429a-4f32-4478-94ac-a2d84a9c0685") : configmap "kube-rbac-proxy" not found
Sep 11 14:16:06.700626 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:06.700608    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lchvd\" (UniqueName: \"kubernetes.io/projected/c37d429a-4f32-4478-94ac-a2d84a9c0685-kube-api-access-lchvd\") pod \"insights-runtime-extractor-22p4j\" (UID: \"c37d429a-4f32-4478-94ac-a2d84a9c0685\") " pod="openshift-insights/insights-runtime-extractor-22p4j"
Sep 11 14:16:07.195985 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:07.195939    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c37d429a-4f32-4478-94ac-a2d84a9c0685-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-22p4j\" (UID: \"c37d429a-4f32-4478-94ac-a2d84a9c0685\") " pod="openshift-insights/insights-runtime-extractor-22p4j"
Sep 11 14:16:07.196245 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:07.196052    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c37d429a-4f32-4478-94ac-a2d84a9c0685-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-22p4j\" (UID: \"c37d429a-4f32-4478-94ac-a2d84a9c0685\") " pod="openshift-insights/insights-runtime-extractor-22p4j"
Sep 11 14:16:07.196245 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:07.196089    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:07.196245 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:07.196138    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 14:16:07.196245 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:07.196160    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c37d429a-4f32-4478-94ac-a2d84a9c0685-insights-runtime-extractor-tls podName:c37d429a-4f32-4478-94ac-a2d84a9c0685 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:08.196139373 +0000 UTC m=+60.994774149 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c37d429a-4f32-4478-94ac-a2d84a9c0685-insights-runtime-extractor-tls") pod "insights-runtime-extractor-22p4j" (UID: "c37d429a-4f32-4478-94ac-a2d84a9c0685") : secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:07.196245 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:07.196177    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c37d429a-4f32-4478-94ac-a2d84a9c0685-kube-rbac-proxy-cm podName:c37d429a-4f32-4478-94ac-a2d84a9c0685 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:08.196167131 +0000 UTC m=+60.994801894 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c37d429a-4f32-4478-94ac-a2d84a9c0685-kube-rbac-proxy-cm") pod "insights-runtime-extractor-22p4j" (UID: "c37d429a-4f32-4478-94ac-a2d84a9c0685") : configmap "kube-rbac-proxy" not found
Sep 11 14:16:07.610019 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:07.609989    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-ns88x"]
Sep 11 14:16:07.612916 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:07.612898    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-ns88x"
Sep 11 14:16:07.615527 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:07.615508    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-2knvf\""
Sep 11 14:16:07.615614 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:07.615532    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 11 14:16:07.616410 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:07.616395    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 11 14:16:07.629749 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:07.629730    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-ns88x"]
Sep 11 14:16:07.646965 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:07.646937    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:07.699992 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:07.699969    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shlz8\" (UniqueName: \"kubernetes.io/projected/c00d0c28-e051-40d9-af53-6896bdc3e83d-kube-api-access-shlz8\") pod \"migrator-8b4d697c5-ns88x\" (UID: \"c00d0c28-e051-40d9-af53-6896bdc3e83d\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-ns88x"
Sep 11 14:16:07.745160 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:07.745137    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:07.800706 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:07.800669    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shlz8\" (UniqueName: \"kubernetes.io/projected/c00d0c28-e051-40d9-af53-6896bdc3e83d-kube-api-access-shlz8\") pod \"migrator-8b4d697c5-ns88x\" (UID: \"c00d0c28-e051-40d9-af53-6896bdc3e83d\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-ns88x"
Sep 11 14:16:07.809435 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:07.809413    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shlz8\" (UniqueName: \"kubernetes.io/projected/c00d0c28-e051-40d9-af53-6896bdc3e83d-kube-api-access-shlz8\") pod \"migrator-8b4d697c5-ns88x\" (UID: \"c00d0c28-e051-40d9-af53-6896bdc3e83d\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-ns88x"
Sep 11 14:16:07.923333 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:07.923286    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-ns88x"
Sep 11 14:16:08.193880 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:08.193808    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-ns88x"]
Sep 11 14:16:08.196529 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:16:08.196504    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc00d0c28_e051_40d9_af53_6896bdc3e83d.slice/crio-4c169ea074631405756315894e2be56f629ecbb3f7636895feb997915d774f0a WatchSource:0}: Error finding container 4c169ea074631405756315894e2be56f629ecbb3f7636895feb997915d774f0a: Status 404 returned error can't find the container with id 4c169ea074631405756315894e2be56f629ecbb3f7636895feb997915d774f0a
Sep 11 14:16:08.204295 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:08.204272    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c37d429a-4f32-4478-94ac-a2d84a9c0685-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-22p4j\" (UID: \"c37d429a-4f32-4478-94ac-a2d84a9c0685\") " pod="openshift-insights/insights-runtime-extractor-22p4j"
Sep 11 14:16:08.204367 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:08.204354    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c37d429a-4f32-4478-94ac-a2d84a9c0685-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-22p4j\" (UID: \"c37d429a-4f32-4478-94ac-a2d84a9c0685\") " pod="openshift-insights/insights-runtime-extractor-22p4j"
Sep 11 14:16:08.204435 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:08.204420    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:08.204482 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:08.204461    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 14:16:08.204482 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:08.204471    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c37d429a-4f32-4478-94ac-a2d84a9c0685-insights-runtime-extractor-tls podName:c37d429a-4f32-4478-94ac-a2d84a9c0685 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:10.204457625 +0000 UTC m=+63.003092386 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c37d429a-4f32-4478-94ac-a2d84a9c0685-insights-runtime-extractor-tls") pod "insights-runtime-extractor-22p4j" (UID: "c37d429a-4f32-4478-94ac-a2d84a9c0685") : secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:08.204561 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:08.204509    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c37d429a-4f32-4478-94ac-a2d84a9c0685-kube-rbac-proxy-cm podName:c37d429a-4f32-4478-94ac-a2d84a9c0685 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:10.204495118 +0000 UTC m=+63.003129898 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c37d429a-4f32-4478-94ac-a2d84a9c0685-kube-rbac-proxy-cm") pod "insights-runtime-extractor-22p4j" (UID: "c37d429a-4f32-4478-94ac-a2d84a9c0685") : configmap "kube-rbac-proxy" not found
Sep 11 14:16:08.256339 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:08.256322    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-77vcp_9528abdc-9478-4485-ab39-a8c576fef301/dns-node-resolver/0.log"
Sep 11 14:16:08.504284 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:08.504220    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:08.566357 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:08.566329    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:08.921348 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:08.921314    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-ns88x" event={"ID":"c00d0c28-e051-40d9-af53-6896bdc3e83d","Type":"ContainerStarted","Data":"4c169ea074631405756315894e2be56f629ecbb3f7636895feb997915d774f0a"}
Sep 11 14:16:09.261511 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:09.261451    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2rhc2_132a3582-58a8-497f-a537-e38bde288795/node-ca/0.log"
Sep 11 14:16:09.412315 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:09.412272    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf06917f-caf2-4af5-9f3b-c0da05de5d9c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g4skv\" (UID: \"cf06917f-caf2-4af5-9f3b-c0da05de5d9c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4skv"
Sep 11 14:16:09.412487 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:09.412445    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 14:16:09.412553 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:09.412519    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf06917f-caf2-4af5-9f3b-c0da05de5d9c-cluster-monitoring-operator-tls podName:cf06917f-caf2-4af5-9f3b-c0da05de5d9c nodeName:}" failed. No retries permitted until 2026-09-11 14:16:17.412497984 +0000 UTC m=+70.211132763 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cf06917f-caf2-4af5-9f3b-c0da05de5d9c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-g4skv" (UID: "cf06917f-caf2-4af5-9f3b-c0da05de5d9c") : secret "cluster-monitoring-operator-tls" not found
Sep 11 14:16:09.513335 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:09.513311    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7f60369-696c-4f9c-93dc-8ff217a04fc1-service-ca-bundle\") pod \"router-default-87d46c48b-7pb8n\" (UID: \"a7f60369-696c-4f9c-93dc-8ff217a04fc1\") " pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:09.513450 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:09.513343    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7f60369-696c-4f9c-93dc-8ff217a04fc1-metrics-certs\") pod \"router-default-87d46c48b-7pb8n\" (UID: \"a7f60369-696c-4f9c-93dc-8ff217a04fc1\") " pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:09.513509 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:09.513460    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 14:16:09.513509 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:09.513489    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a7f60369-696c-4f9c-93dc-8ff217a04fc1-service-ca-bundle podName:a7f60369-696c-4f9c-93dc-8ff217a04fc1 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:17.513465279 +0000 UTC m=+70.312100060 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a7f60369-696c-4f9c-93dc-8ff217a04fc1-service-ca-bundle") pod "router-default-87d46c48b-7pb8n" (UID: "a7f60369-696c-4f9c-93dc-8ff217a04fc1") : configmap references non-existent config key: service-ca.crt
Sep 11 14:16:09.513620 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:09.513519    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7f60369-696c-4f9c-93dc-8ff217a04fc1-metrics-certs podName:a7f60369-696c-4f9c-93dc-8ff217a04fc1 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:17.513506246 +0000 UTC m=+70.312141011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7f60369-696c-4f9c-93dc-8ff217a04fc1-metrics-certs") pod "router-default-87d46c48b-7pb8n" (UID: "a7f60369-696c-4f9c-93dc-8ff217a04fc1") : secret "router-metrics-certs-default" not found
Sep 11 14:16:09.828037 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:09.828009    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:09.925895 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:09.925857    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-ns88x" event={"ID":"c00d0c28-e051-40d9-af53-6896bdc3e83d","Type":"ContainerStarted","Data":"981d0d7624a2a7e095dc72ed8e93ff444ee41352d44a1513f180119a91692203"}
Sep 11 14:16:09.926195 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:09.925921    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-ns88x" event={"ID":"c00d0c28-e051-40d9-af53-6896bdc3e83d","Type":"ContainerStarted","Data":"81bd1e5a18d843007f9f244981e2b1d89e014f8a073cd576e6d436437f78748f"}
Sep 11 14:16:09.943793 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:09.943621    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-ns88x" podStartSLOduration=1.69817865 podStartE2EDuration="2.943602416s" totalImagesPullingTime="1.245423766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:09.943302463 +0000 UTC m=+62.741937246" watchObservedRunningTime="2026-09-11 14:16:09.943602416 +0000 UTC m=+62.742237200"
Sep 11 14:16:10.219334 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:10.219256    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c37d429a-4f32-4478-94ac-a2d84a9c0685-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-22p4j\" (UID: \"c37d429a-4f32-4478-94ac-a2d84a9c0685\") " pod="openshift-insights/insights-runtime-extractor-22p4j"
Sep 11 14:16:10.219435 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:10.219338    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c37d429a-4f32-4478-94ac-a2d84a9c0685-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-22p4j\" (UID: \"c37d429a-4f32-4478-94ac-a2d84a9c0685\") " pod="openshift-insights/insights-runtime-extractor-22p4j"
Sep 11 14:16:10.219435 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:10.219404    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 14:16:10.219498 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:10.219426    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:10.219498 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:10.219468    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c37d429a-4f32-4478-94ac-a2d84a9c0685-kube-rbac-proxy-cm podName:c37d429a-4f32-4478-94ac-a2d84a9c0685 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:14.21945282 +0000 UTC m=+67.018087610 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c37d429a-4f32-4478-94ac-a2d84a9c0685-kube-rbac-proxy-cm") pod "insights-runtime-extractor-22p4j" (UID: "c37d429a-4f32-4478-94ac-a2d84a9c0685") : configmap "kube-rbac-proxy" not found
Sep 11 14:16:10.219498 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:10.219484    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c37d429a-4f32-4478-94ac-a2d84a9c0685-insights-runtime-extractor-tls podName:c37d429a-4f32-4478-94ac-a2d84a9c0685 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:14.219476881 +0000 UTC m=+67.018111644 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c37d429a-4f32-4478-94ac-a2d84a9c0685-insights-runtime-extractor-tls") pod "insights-runtime-extractor-22p4j" (UID: "c37d429a-4f32-4478-94ac-a2d84a9c0685") : secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:10.330537 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:10.330504    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:10.456819 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:10.456796    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w4tcc_70ac1cfe-b296-49ad-925d-7b64e662395c/serve-healthcheck-canary/0.log"
Sep 11 14:16:10.541882 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:10.541851    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:10.646932 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:10.646903    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:10.747778 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:10.747756    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:10.853242 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:10.853190    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:11.058126 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:11.058082    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:11.845353 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:11.845309    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:12.190193 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:12.190119    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:12.435466 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:12.435423    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:12.645097 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:12.645062    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:12.838210 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:12.838169    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffe0180e-2a90-4d97-8575-1d44acd6b790-metrics-tls\") pod \"dns-default-mc48z\" (UID: \"ffe0180e-2a90-4d97-8575-1d44acd6b790\") " pod="openshift-dns/dns-default-mc48z"
Sep 11 14:16:12.838377 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:12.838312    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 14:16:12.838377 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:12.838375    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffe0180e-2a90-4d97-8575-1d44acd6b790-metrics-tls podName:ffe0180e-2a90-4d97-8575-1d44acd6b790 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:44.838358384 +0000 UTC m=+97.636993158 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ffe0180e-2a90-4d97-8575-1d44acd6b790-metrics-tls") pod "dns-default-mc48z" (UID: "ffe0180e-2a90-4d97-8575-1d44acd6b790") : secret "dns-default-metrics-tls" not found
Sep 11 14:16:13.049135 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:13.049106    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:13.235381 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:13.235352    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:13.340832 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:13.340764    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1550d3f8-d568-4b3b-80c5-34a9ddfb0e10-original-pull-secret\") pod \"global-pull-secret-syncer-dwq8z\" (UID: \"1550d3f8-d568-4b3b-80c5-34a9ddfb0e10\") " pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:16:13.340832 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:13.340831    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69446d2a-2163-4a00-8b2d-02c7dee348e3-metrics-certs\") pod \"network-metrics-daemon-dqhsk\" (UID: \"69446d2a-2163-4a00-8b2d-02c7dee348e3\") " pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:16:13.343828 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:13.343810    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 14:16:13.344618 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:13.344603    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 14:16:13.351162 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:13.351140    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 14:16:13.351224 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:13.351205    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69446d2a-2163-4a00-8b2d-02c7dee348e3-metrics-certs podName:69446d2a-2163-4a00-8b2d-02c7dee348e3 nodeName:}" failed. No retries permitted until 2026-09-11 14:17:17.351189688 +0000 UTC m=+130.149824452 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69446d2a-2163-4a00-8b2d-02c7dee348e3-metrics-certs") pod "network-metrics-daemon-dqhsk" (UID: "69446d2a-2163-4a00-8b2d-02c7dee348e3") : secret "metrics-daemon-secret" not found
Sep 11 14:16:13.353494 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:13.353472    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1550d3f8-d568-4b3b-80c5-34a9ddfb0e10-original-pull-secret\") pod \"global-pull-secret-syncer-dwq8z\" (UID: \"1550d3f8-d568-4b3b-80c5-34a9ddfb0e10\") " pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:16:13.441441 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:13.441408    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7gb4\" (UniqueName: \"kubernetes.io/projected/96099d3a-c51d-4599-b015-a30ff4c09bc6-kube-api-access-l7gb4\") pod \"network-check-target-wqqzl\" (UID: \"96099d3a-c51d-4599-b015-a30ff4c09bc6\") " pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:16:13.443904 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:13.443880    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7gb4\" (UniqueName: \"kubernetes.io/projected/96099d3a-c51d-4599-b015-a30ff4c09bc6-kube-api-access-l7gb4\") pod \"network-check-target-wqqzl\" (UID: \"96099d3a-c51d-4599-b015-a30ff4c09bc6\") " pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:16:13.475779 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:13.475740    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:13.589034 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:13.589008    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lc92k\""
Sep 11 14:16:13.592185 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:13.592144    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwq8z"
Sep 11 14:16:13.596691 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:13.596653    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:16:13.882468 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:13.882407    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dwq8z"]
Sep 11 14:16:13.885228 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:16:13.885205    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1550d3f8_d568_4b3b_80c5_34a9ddfb0e10.slice/crio-b5451ee6cf8b8464d5c82c5a2c8c18bf72ced08ff489d0dc4d01d9f3d6121106 WatchSource:0}: Error finding container b5451ee6cf8b8464d5c82c5a2c8c18bf72ced08ff489d0dc4d01d9f3d6121106: Status 404 returned error can't find the container with id b5451ee6cf8b8464d5c82c5a2c8c18bf72ced08ff489d0dc4d01d9f3d6121106
Sep 11 14:16:13.889085 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:13.889065    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wqqzl"]
Sep 11 14:16:13.895413 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:16:13.895389    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96099d3a_c51d_4599_b015_a30ff4c09bc6.slice/crio-2ca6cd98cdd0e20d75db948578b2b697b73fbe1bb7f24762afcda8a4625205d4 WatchSource:0}: Error finding container 2ca6cd98cdd0e20d75db948578b2b697b73fbe1bb7f24762afcda8a4625205d4: Status 404 returned error can't find the container with id 2ca6cd98cdd0e20d75db948578b2b697b73fbe1bb7f24762afcda8a4625205d4
Sep 11 14:16:13.938022 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:13.937997    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dwq8z" event={"ID":"1550d3f8-d568-4b3b-80c5-34a9ddfb0e10","Type":"ContainerStarted","Data":"b5451ee6cf8b8464d5c82c5a2c8c18bf72ced08ff489d0dc4d01d9f3d6121106"}
Sep 11 14:16:13.939456 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:13.939437    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wqqzl" event={"ID":"96099d3a-c51d-4599-b015-a30ff4c09bc6","Type":"ContainerStarted","Data":"2ca6cd98cdd0e20d75db948578b2b697b73fbe1bb7f24762afcda8a4625205d4"}
Sep 11 14:16:14.077312 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:14.077268    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:14.246547 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:14.246487    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c37d429a-4f32-4478-94ac-a2d84a9c0685-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-22p4j\" (UID: \"c37d429a-4f32-4478-94ac-a2d84a9c0685\") " pod="openshift-insights/insights-runtime-extractor-22p4j"
Sep 11 14:16:14.246869 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:14.246550    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c37d429a-4f32-4478-94ac-a2d84a9c0685-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-22p4j\" (UID: \"c37d429a-4f32-4478-94ac-a2d84a9c0685\") " pod="openshift-insights/insights-runtime-extractor-22p4j"
Sep 11 14:16:14.246869 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:14.246624    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 14:16:14.246869 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:14.246699    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c37d429a-4f32-4478-94ac-a2d84a9c0685-kube-rbac-proxy-cm podName:c37d429a-4f32-4478-94ac-a2d84a9c0685 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:22.246663819 +0000 UTC m=+75.045298584 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c37d429a-4f32-4478-94ac-a2d84a9c0685-kube-rbac-proxy-cm") pod "insights-runtime-extractor-22p4j" (UID: "c37d429a-4f32-4478-94ac-a2d84a9c0685") : configmap "kube-rbac-proxy" not found
Sep 11 14:16:14.246869 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:14.246715    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:14.246869 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:16:14.246772    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c37d429a-4f32-4478-94ac-a2d84a9c0685-insights-runtime-extractor-tls podName:c37d429a-4f32-4478-94ac-a2d84a9c0685 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:22.24675724 +0000 UTC m=+75.045392004 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c37d429a-4f32-4478-94ac-a2d84a9c0685-insights-runtime-extractor-tls") pod "insights-runtime-extractor-22p4j" (UID: "c37d429a-4f32-4478-94ac-a2d84a9c0685") : secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:14.454817 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:14.454790    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:14.646938 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:14.646906    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:14.840862 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:14.840833    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:14.944667 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:14.944609    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wqqzl" event={"ID":"96099d3a-c51d-4599-b015-a30ff4c09bc6","Type":"ContainerStarted","Data":"1d0dad175f68f94282544ff67a6a3a73fd51167abebaf987a713aa404627198c"}
Sep 11 14:16:14.944779 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:14.944740    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:16:14.965056 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:14.965013    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wqqzl" podStartSLOduration=67.964999348 podStartE2EDuration="1m7.964999348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:15:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:14.963435937 +0000 UTC m=+67.762070710" watchObservedRunningTime="2026-09-11 14:16:14.964999348 +0000 UTC m=+67.763634129"
Sep 11 14:16:15.027534 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:15.027495    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:15.237453 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:15.237391    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:15.351781 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:15.351748    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:15.427314 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:15.427285    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:16.243714 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:16.243663    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:16.439470 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:16.439438    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:17.469376 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:17.469342    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf06917f-caf2-4af5-9f3b-c0da05de5d9c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g4skv\" (UID: \"cf06917f-caf2-4af5-9f3b-c0da05de5d9c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4skv"
Sep 11 14:16:17.471964 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:17.471938    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf06917f-caf2-4af5-9f3b-c0da05de5d9c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g4skv\" (UID: \"cf06917f-caf2-4af5-9f3b-c0da05de5d9c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4skv"
Sep 11 14:16:17.495743 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:17.495718    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4fsln\""
Sep 11 14:16:17.502554 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:17.502532    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4skv"
Sep 11 14:16:17.569926 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:17.569903    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7f60369-696c-4f9c-93dc-8ff217a04fc1-service-ca-bundle\") pod \"router-default-87d46c48b-7pb8n\" (UID: \"a7f60369-696c-4f9c-93dc-8ff217a04fc1\") " pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:17.570059 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:17.569937    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7f60369-696c-4f9c-93dc-8ff217a04fc1-metrics-certs\") pod \"router-default-87d46c48b-7pb8n\" (UID: \"a7f60369-696c-4f9c-93dc-8ff217a04fc1\") " pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:17.570640 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:17.570614    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7f60369-696c-4f9c-93dc-8ff217a04fc1-service-ca-bundle\") pod \"router-default-87d46c48b-7pb8n\" (UID: \"a7f60369-696c-4f9c-93dc-8ff217a04fc1\") " pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:17.572430 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:17.572409    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7f60369-696c-4f9c-93dc-8ff217a04fc1-metrics-certs\") pod \"router-default-87d46c48b-7pb8n\" (UID: \"a7f60369-696c-4f9c-93dc-8ff217a04fc1\") " pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:17.592843 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:17.592818    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-z2gpf\""
Sep 11 14:16:17.600334 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:17.600310    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:17.725165 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:17.725087    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:17.820011 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:17.819977    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:18.227625 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:18.227588    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:18.621433 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:18.621366    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:18.824341 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:18.824303    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:18.850420 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:18.850388    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4skv"]
Sep 11 14:16:18.852992 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:16:18.852961    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf06917f_caf2_4af5_9f3b_c0da05de5d9c.slice/crio-8333501e60a4ad18a33b40ce519e7fb7a18b0e5db6d471180fbf6e76da0de054 WatchSource:0}: Error finding container 8333501e60a4ad18a33b40ce519e7fb7a18b0e5db6d471180fbf6e76da0de054: Status 404 returned error can't find the container with id 8333501e60a4ad18a33b40ce519e7fb7a18b0e5db6d471180fbf6e76da0de054
Sep 11 14:16:18.853669 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:18.853651    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-87d46c48b-7pb8n"]
Sep 11 14:16:18.855644 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:16:18.855622    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7f60369_696c_4f9c_93dc_8ff217a04fc1.slice/crio-30f3613d86a5a814c49f00812bfb9c60f44f78a34715ae9e2a0c1c3d75c633a5 WatchSource:0}: Error finding container 30f3613d86a5a814c49f00812bfb9c60f44f78a34715ae9e2a0c1c3d75c633a5: Status 404 returned error can't find the container with id 30f3613d86a5a814c49f00812bfb9c60f44f78a34715ae9e2a0c1c3d75c633a5
Sep 11 14:16:18.961344 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:18.961305    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dwq8z" event={"ID":"1550d3f8-d568-4b3b-80c5-34a9ddfb0e10","Type":"ContainerStarted","Data":"2c74d8722be8e1b08ac4d8f4c432776aede4484b35726e514d53373f73f51e4c"}
Sep 11 14:16:18.962482 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:18.962461    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4skv" event={"ID":"cf06917f-caf2-4af5-9f3b-c0da05de5d9c","Type":"ContainerStarted","Data":"8333501e60a4ad18a33b40ce519e7fb7a18b0e5db6d471180fbf6e76da0de054"}
Sep 11 14:16:18.963734 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:18.963712    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-87d46c48b-7pb8n" event={"ID":"a7f60369-696c-4f9c-93dc-8ff217a04fc1","Type":"ContainerStarted","Data":"81d0a3a1bb942cef71dfc2e199b15a93eaa55092f18018de1bb4e91be17f21e7"}
Sep 11 14:16:18.963805 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:18.963755    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-87d46c48b-7pb8n" event={"ID":"a7f60369-696c-4f9c-93dc-8ff217a04fc1","Type":"ContainerStarted","Data":"30f3613d86a5a814c49f00812bfb9c60f44f78a34715ae9e2a0c1c3d75c633a5"}
Sep 11 14:16:18.979039 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:18.978995    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dwq8z" podStartSLOduration=67.237424523 podStartE2EDuration="1m11.978980592s" totalImagesPullingTime="4.741556069s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:18.978433217 +0000 UTC m=+71.777067998" watchObservedRunningTime="2026-09-11 14:16:18.978980592 +0000 UTC m=+71.777615374"
Sep 11 14:16:19.007396 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:19.007361    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-87d46c48b-7pb8n" podStartSLOduration=18.007348458 podStartE2EDuration="18.007348458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:19.006260694 +0000 UTC m=+71.804895475" watchObservedRunningTime="2026-09-11 14:16:19.007348458 +0000 UTC m=+71.805983241"
Sep 11 14:16:19.231554 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:19.231476    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:19.601318 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:19.601288    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:19.603906 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:19.603873    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:19.786572 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:19.786542    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:19.967520 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:19.967444    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:19.968708 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:19.968668    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-87d46c48b-7pb8n"
Sep 11 14:16:20.037638 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:20.037605    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:20.267957 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:20.267878    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:20.424092 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:20.424063    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:20.647249 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:20.647218    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:20.923143 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:20.923106    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:20.971966 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:20.971912    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4skv" event={"ID":"cf06917f-caf2-4af5-9f3b-c0da05de5d9c","Type":"ContainerStarted","Data":"62cf66e1c84a4719ad707e49c1623f6b01cdae883159bc0cd2b970085dc4589b"}
Sep 11 14:16:21.010673 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:21.010634    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4skv" podStartSLOduration=18.335196969 podStartE2EDuration="20.010620516s" totalImagesPullingTime="1.675423547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:21.009955259 +0000 UTC m=+73.808590044" watchObservedRunningTime="2026-09-11 14:16:21.010620516 +0000 UTC m=+73.809255298"
Sep 11 14:16:21.019650 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:21.019623    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:21.128249 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:21.128221    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:21.216197 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:21.216116    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:21.501796 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:21.501723    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:22.303989 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:22.303948    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c37d429a-4f32-4478-94ac-a2d84a9c0685-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-22p4j\" (UID: \"c37d429a-4f32-4478-94ac-a2d84a9c0685\") " pod="openshift-insights/insights-runtime-extractor-22p4j"
Sep 11 14:16:22.304436 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:22.304015    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c37d429a-4f32-4478-94ac-a2d84a9c0685-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-22p4j\" (UID: \"c37d429a-4f32-4478-94ac-a2d84a9c0685\") " pod="openshift-insights/insights-runtime-extractor-22p4j"
Sep 11 14:16:22.304536 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:22.304515    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c37d429a-4f32-4478-94ac-a2d84a9c0685-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-22p4j\" (UID: \"c37d429a-4f32-4478-94ac-a2d84a9c0685\") " pod="openshift-insights/insights-runtime-extractor-22p4j"
Sep 11 14:16:22.306649 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:22.306624    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c37d429a-4f32-4478-94ac-a2d84a9c0685-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-22p4j\" (UID: \"c37d429a-4f32-4478-94ac-a2d84a9c0685\") " pod="openshift-insights/insights-runtime-extractor-22p4j"
Sep 11 14:16:22.474056 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:22.474029    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6n4gf\""
Sep 11 14:16:22.480562 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:22.480540    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-22p4j"
Sep 11 14:16:22.761722 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:22.761649    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-22p4j"]
Sep 11 14:16:22.765935 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:16:22.765906    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc37d429a_4f32_4478_94ac_a2d84a9c0685.slice/crio-6dc363a8e4cb1596883aa92b9860cb4b5c739b7ee6afc99596a104ae640f2d68 WatchSource:0}: Error finding container 6dc363a8e4cb1596883aa92b9860cb4b5c739b7ee6afc99596a104ae640f2d68: Status 404 returned error can't find the container with id 6dc363a8e4cb1596883aa92b9860cb4b5c739b7ee6afc99596a104ae640f2d68
Sep 11 14:16:22.979388 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:22.979357    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-22p4j" event={"ID":"c37d429a-4f32-4478-94ac-a2d84a9c0685","Type":"ContainerStarted","Data":"e153c6068794e09a03662f135b348cc4e5cc525815250b8a12f27459c43ffed2"}
Sep 11 14:16:22.979492 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:22.979418    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-22p4j" event={"ID":"c37d429a-4f32-4478-94ac-a2d84a9c0685","Type":"ContainerStarted","Data":"6dc363a8e4cb1596883aa92b9860cb4b5c739b7ee6afc99596a104ae640f2d68"}
Sep 11 14:16:23.983752 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:23.983669    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-22p4j" event={"ID":"c37d429a-4f32-4478-94ac-a2d84a9c0685","Type":"ContainerStarted","Data":"57dfbf73d19fb83af86bfc1ac253125a0721f6a54813c99b059cb60dcb5886ab"}
Sep 11 14:16:24.252419 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:24.252320    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:24.317301 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:24.317230    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:24.988935 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:24.988908    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-22p4j" event={"ID":"c37d429a-4f32-4478-94ac-a2d84a9c0685","Type":"ContainerStarted","Data":"f81766b58e80caeee095b5fbdaf4efd79b9c7b8f9d02e54ac0cb6c0d7d77d59c"}
Sep 11 14:16:25.035172 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:25.035130    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-22p4j" podStartSLOduration=17.097462664 podStartE2EDuration="19.035114246s" totalImagesPullingTime="1.937651582s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:16:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:25.034349109 +0000 UTC m=+77.832983890" watchObservedRunningTime="2026-09-11 14:16:25.035114246 +0000 UTC m=+77.833749027"
Sep 11 14:16:30.338313 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.338198    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-784865c694-984dk"]
Sep 11 14:16:30.341283 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.341264    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-784865c694-984dk"
Sep 11 14:16:30.348458 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.348437    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 11 14:16:30.348546 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.348518    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 11 14:16:30.348815 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.348792    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 11 14:16:30.348938 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.348827    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-p6hf7\""
Sep 11 14:16:30.353361 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.353343    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 11 14:16:30.370656 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.370630    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-784865c694-984dk"]
Sep 11 14:16:30.397123 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.397102    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-p9j96"]
Sep 11 14:16:30.399706 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.399673    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-p9j96"
Sep 11 14:16:30.403287 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.403270    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6x9fs\""
Sep 11 14:16:30.403983 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.403968    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 11 14:16:30.458064 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.458042    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/364bcbed-f44c-4636-abc8-cc66a91222b3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-784865c694-984dk\" (UID: \"364bcbed-f44c-4636-abc8-cc66a91222b3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-784865c694-984dk"
Sep 11 14:16:30.458164 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.458078    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kx2f\" (UniqueName: \"kubernetes.io/projected/364bcbed-f44c-4636-abc8-cc66a91222b3-kube-api-access-6kx2f\") pod \"managed-serviceaccount-addon-agent-784865c694-984dk\" (UID: \"364bcbed-f44c-4636-abc8-cc66a91222b3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-784865c694-984dk"
Sep 11 14:16:30.458221 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.458163    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3fbcf1a4-4ab3-4f68-972c-84ef518fab8a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-p9j96\" (UID: \"3fbcf1a4-4ab3-4f68-972c-84ef518fab8a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-p9j96"
Sep 11 14:16:30.477559 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.477537    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-p9j96"]
Sep 11 14:16:30.511367 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.511343    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:30.549271 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.549245    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-85fb7687cf-b6q6v"]
Sep 11 14:16:30.552085 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.552068    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v"
Sep 11 14:16:30.556073 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.556054    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 14:16:30.556392 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.556378    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 14:16:30.557844 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.557811    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 14:16:30.558573 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.558555    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3fbcf1a4-4ab3-4f68-972c-84ef518fab8a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-p9j96\" (UID: \"3fbcf1a4-4ab3-4f68-972c-84ef518fab8a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-p9j96"
Sep 11 14:16:30.558653 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.558606    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/364bcbed-f44c-4636-abc8-cc66a91222b3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-784865c694-984dk\" (UID: \"364bcbed-f44c-4636-abc8-cc66a91222b3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-784865c694-984dk"
Sep 11 14:16:30.558653 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.558624    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kx2f\" (UniqueName: \"kubernetes.io/projected/364bcbed-f44c-4636-abc8-cc66a91222b3-kube-api-access-6kx2f\") pod \"managed-serviceaccount-addon-agent-784865c694-984dk\" (UID: \"364bcbed-f44c-4636-abc8-cc66a91222b3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-784865c694-984dk"
Sep 11 14:16:30.560956 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.560933    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3fbcf1a4-4ab3-4f68-972c-84ef518fab8a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-p9j96\" (UID: \"3fbcf1a4-4ab3-4f68-972c-84ef518fab8a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-p9j96"
Sep 11 14:16:30.561422 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.561404    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/364bcbed-f44c-4636-abc8-cc66a91222b3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-784865c694-984dk\" (UID: \"364bcbed-f44c-4636-abc8-cc66a91222b3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-784865c694-984dk"
Sep 11 14:16:30.562016 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.562000    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jb4sz\""
Sep 11 14:16:30.562544 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.562530    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 14:16:30.586309 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.586289    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85fb7687cf-b6q6v"]
Sep 11 14:16:30.588794 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.588756    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kx2f\" (UniqueName: \"kubernetes.io/projected/364bcbed-f44c-4636-abc8-cc66a91222b3-kube-api-access-6kx2f\") pod \"managed-serviceaccount-addon-agent-784865c694-984dk\" (UID: \"364bcbed-f44c-4636-abc8-cc66a91222b3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-784865c694-984dk"
Sep 11 14:16:30.659074 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.659050    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ec01808a-ac18-4a02-9e59-d4c9bb312006-image-registry-private-configuration\") pod \"image-registry-85fb7687cf-b6q6v\" (UID: \"ec01808a-ac18-4a02-9e59-d4c9bb312006\") " pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v"
Sep 11 14:16:30.659172 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.659085    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ec01808a-ac18-4a02-9e59-d4c9bb312006-bound-sa-token\") pod \"image-registry-85fb7687cf-b6q6v\" (UID: \"ec01808a-ac18-4a02-9e59-d4c9bb312006\") " pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v"
Sep 11 14:16:30.659172 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.659106    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88bj5\" (UniqueName: \"kubernetes.io/projected/ec01808a-ac18-4a02-9e59-d4c9bb312006-kube-api-access-88bj5\") pod \"image-registry-85fb7687cf-b6q6v\" (UID: \"ec01808a-ac18-4a02-9e59-d4c9bb312006\") " pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v"
Sep 11 14:16:30.659172 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.659122    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ec01808a-ac18-4a02-9e59-d4c9bb312006-registry-tls\") pod \"image-registry-85fb7687cf-b6q6v\" (UID: \"ec01808a-ac18-4a02-9e59-d4c9bb312006\") " pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v"
Sep 11 14:16:30.659330 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.659165    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ec01808a-ac18-4a02-9e59-d4c9bb312006-trusted-ca\") pod \"image-registry-85fb7687cf-b6q6v\" (UID: \"ec01808a-ac18-4a02-9e59-d4c9bb312006\") " pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v"
Sep 11 14:16:30.659330 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.659242    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ec01808a-ac18-4a02-9e59-d4c9bb312006-installation-pull-secrets\") pod \"image-registry-85fb7687cf-b6q6v\" (UID: \"ec01808a-ac18-4a02-9e59-d4c9bb312006\") " pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v"
Sep 11 14:16:30.659330 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.659277    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ec01808a-ac18-4a02-9e59-d4c9bb312006-registry-certificates\") pod \"image-registry-85fb7687cf-b6q6v\" (UID: \"ec01808a-ac18-4a02-9e59-d4c9bb312006\") " pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v"
Sep 11 14:16:30.659330 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.659305    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ec01808a-ac18-4a02-9e59-d4c9bb312006-ca-trust-extracted\") pod \"image-registry-85fb7687cf-b6q6v\" (UID: \"ec01808a-ac18-4a02-9e59-d4c9bb312006\") " pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v"
Sep 11 14:16:30.667198 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.667176    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-784865c694-984dk"
Sep 11 14:16:30.707723 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.707695    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-p9j96"
Sep 11 14:16:30.759802 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.759775    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ec01808a-ac18-4a02-9e59-d4c9bb312006-ca-trust-extracted\") pod \"image-registry-85fb7687cf-b6q6v\" (UID: \"ec01808a-ac18-4a02-9e59-d4c9bb312006\") " pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v"
Sep 11 14:16:30.759907 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.759825    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ec01808a-ac18-4a02-9e59-d4c9bb312006-image-registry-private-configuration\") pod \"image-registry-85fb7687cf-b6q6v\" (UID: \"ec01808a-ac18-4a02-9e59-d4c9bb312006\") " pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v"
Sep 11 14:16:30.759907 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.759851    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ec01808a-ac18-4a02-9e59-d4c9bb312006-bound-sa-token\") pod \"image-registry-85fb7687cf-b6q6v\" (UID: \"ec01808a-ac18-4a02-9e59-d4c9bb312006\") " pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v"
Sep 11 14:16:30.759907 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.759873    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88bj5\" (UniqueName: \"kubernetes.io/projected/ec01808a-ac18-4a02-9e59-d4c9bb312006-kube-api-access-88bj5\") pod \"image-registry-85fb7687cf-b6q6v\" (UID: \"ec01808a-ac18-4a02-9e59-d4c9bb312006\") " pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v"
Sep 11 14:16:30.759907 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.759890    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ec01808a-ac18-4a02-9e59-d4c9bb312006-registry-tls\") pod \"image-registry-85fb7687cf-b6q6v\" (UID: \"ec01808a-ac18-4a02-9e59-d4c9bb312006\") " pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v"
Sep 11 14:16:30.759907 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.759907    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ec01808a-ac18-4a02-9e59-d4c9bb312006-trusted-ca\") pod \"image-registry-85fb7687cf-b6q6v\" (UID: \"ec01808a-ac18-4a02-9e59-d4c9bb312006\") " pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v"
Sep 11 14:16:30.760143 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.759955    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ec01808a-ac18-4a02-9e59-d4c9bb312006-installation-pull-secrets\") pod \"image-registry-85fb7687cf-b6q6v\" (UID: \"ec01808a-ac18-4a02-9e59-d4c9bb312006\") " pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v"
Sep 11 14:16:30.760143 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.759984    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ec01808a-ac18-4a02-9e59-d4c9bb312006-registry-certificates\") pod \"image-registry-85fb7687cf-b6q6v\" (UID: \"ec01808a-ac18-4a02-9e59-d4c9bb312006\") " pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v"
Sep 11 14:16:30.760242 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.760169    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ec01808a-ac18-4a02-9e59-d4c9bb312006-ca-trust-extracted\") pod \"image-registry-85fb7687cf-b6q6v\" (UID: \"ec01808a-ac18-4a02-9e59-d4c9bb312006\") " pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v"
Sep 11 14:16:30.760924 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.760896    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ec01808a-ac18-4a02-9e59-d4c9bb312006-registry-certificates\") pod \"image-registry-85fb7687cf-b6q6v\" (UID: \"ec01808a-ac18-4a02-9e59-d4c9bb312006\") " pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v"
Sep 11 14:16:30.761246 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.761222    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ec01808a-ac18-4a02-9e59-d4c9bb312006-trusted-ca\") pod \"image-registry-85fb7687cf-b6q6v\" (UID: \"ec01808a-ac18-4a02-9e59-d4c9bb312006\") " pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v"
Sep 11 14:16:30.762421 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.762379    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ec01808a-ac18-4a02-9e59-d4c9bb312006-registry-tls\") pod \"image-registry-85fb7687cf-b6q6v\" (UID: \"ec01808a-ac18-4a02-9e59-d4c9bb312006\") " pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v"
Sep 11 14:16:30.762421 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.762400    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ec01808a-ac18-4a02-9e59-d4c9bb312006-image-registry-private-configuration\") pod \"image-registry-85fb7687cf-b6q6v\" (UID: \"ec01808a-ac18-4a02-9e59-d4c9bb312006\") " pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v"
Sep 11 14:16:30.762526 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.762460    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ec01808a-ac18-4a02-9e59-d4c9bb312006-installation-pull-secrets\") pod \"image-registry-85fb7687cf-b6q6v\" (UID: \"ec01808a-ac18-4a02-9e59-d4c9bb312006\") " pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v"
Sep 11 14:16:30.780864 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.780848    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ec01808a-ac18-4a02-9e59-d4c9bb312006-bound-sa-token\") pod \"image-registry-85fb7687cf-b6q6v\" (UID: \"ec01808a-ac18-4a02-9e59-d4c9bb312006\") " pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v"
Sep 11 14:16:30.788734 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.788712    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88bj5\" (UniqueName: \"kubernetes.io/projected/ec01808a-ac18-4a02-9e59-d4c9bb312006-kube-api-access-88bj5\") pod \"image-registry-85fb7687cf-b6q6v\" (UID: \"ec01808a-ac18-4a02-9e59-d4c9bb312006\") " pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v"
Sep 11 14:16:30.860403 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.860350    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v"
Sep 11 14:16:30.947926 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:30.947900    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-784865c694-984dk"]
Sep 11 14:16:30.950332 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:16:30.950310    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod364bcbed_f44c_4636_abc8_cc66a91222b3.slice/crio-b8e499e71b49afeff377c65fa27030c432403ba91bbb6af376f7fe57df6e1e35 WatchSource:0}: Error finding container b8e499e71b49afeff377c65fa27030c432403ba91bbb6af376f7fe57df6e1e35: Status 404 returned error can't find the container with id b8e499e71b49afeff377c65fa27030c432403ba91bbb6af376f7fe57df6e1e35
Sep 11 14:16:31.012706 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:31.011896    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-p9j96"]
Sep 11 14:16:31.015097 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:31.015073    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-784865c694-984dk" event={"ID":"364bcbed-f44c-4636-abc8-cc66a91222b3","Type":"ContainerStarted","Data":"b8e499e71b49afeff377c65fa27030c432403ba91bbb6af376f7fe57df6e1e35"}
Sep 11 14:16:31.017252 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:16:31.017226    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fbcf1a4_4ab3_4f68_972c_84ef518fab8a.slice/crio-7c0e7e3cc7647eb11ab125269600c3ccc7a95076f00adfd79508585cb00e4a4f WatchSource:0}: Error finding container 7c0e7e3cc7647eb11ab125269600c3ccc7a95076f00adfd79508585cb00e4a4f: Status 404 returned error can't find the container with id 7c0e7e3cc7647eb11ab125269600c3ccc7a95076f00adfd79508585cb00e4a4f
Sep 11 14:16:31.129024 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:31.129004    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85fb7687cf-b6q6v"]
Sep 11 14:16:31.131126 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:16:31.131105    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec01808a_ac18_4a02_9e59_d4c9bb312006.slice/crio-62e400827bef8bcef6c86f84806f7898de408c4781c2d13f1cd473b29fed351e WatchSource:0}: Error finding container 62e400827bef8bcef6c86f84806f7898de408c4781c2d13f1cd473b29fed351e: Status 404 returned error can't find the container with id 62e400827bef8bcef6c86f84806f7898de408c4781c2d13f1cd473b29fed351e
Sep 11 14:16:31.860609 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:31.860575    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:31.940168 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:31.940088    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:32.019453 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:32.019362    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-p9j96" event={"ID":"3fbcf1a4-4ab3-4f68-972c-84ef518fab8a","Type":"ContainerStarted","Data":"7c0e7e3cc7647eb11ab125269600c3ccc7a95076f00adfd79508585cb00e4a4f"}
Sep 11 14:16:32.021047 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:32.021024    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v" event={"ID":"ec01808a-ac18-4a02-9e59-d4c9bb312006","Type":"ContainerStarted","Data":"e46edf3e0673763d8aadc4fbe767b8f98051d761854b210b6cdb7c21b5f4dff9"}
Sep 11 14:16:32.021146 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:32.021071    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v" event={"ID":"ec01808a-ac18-4a02-9e59-d4c9bb312006","Type":"ContainerStarted","Data":"62e400827bef8bcef6c86f84806f7898de408c4781c2d13f1cd473b29fed351e"}
Sep 11 14:16:32.021146 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:32.021119    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v"
Sep 11 14:16:32.108061 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:32.108018    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v" podStartSLOduration=2.108003904 podStartE2EDuration="2.108003904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:32.106913624 +0000 UTC m=+84.905548406" watchObservedRunningTime="2026-09-11 14:16:32.108003904 +0000 UTC m=+84.906638685"
Sep 11 14:16:33.027178 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:33.027145    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-p9j96" event={"ID":"3fbcf1a4-4ab3-4f68-972c-84ef518fab8a","Type":"ContainerStarted","Data":"f3ff2d5c3f2a6c634f433b098113deebfbb3abb2e4f86251482e952f9a68e1d0"}
Sep 11 14:16:33.027596 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:33.027555    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-p9j96"
Sep 11 14:16:33.032766 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:33.032739    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-p9j96"
Sep 11 14:16:33.050542 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:33.050502    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-p9j96" podStartSLOduration=2.062549887 podStartE2EDuration="3.050489787s" totalImagesPullingTime="987.9399ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:33.049857786 +0000 UTC m=+85.848492567" watchObservedRunningTime="2026-09-11 14:16:33.050489787 +0000 UTC m=+85.849124568"
Sep 11 14:16:33.260428 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:33.260382    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:33.346640 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:33.346605    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:33.434536 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:33.434490    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:35.035801 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:35.035754    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-784865c694-984dk" event={"ID":"364bcbed-f44c-4636-abc8-cc66a91222b3","Type":"ContainerStarted","Data":"f624a1d80e25a3254a44a179334027bd0ef6c52323a58275e8abdc6dde450eca"}
Sep 11 14:16:35.058591 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:35.058539    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-784865c694-984dk" podStartSLOduration=1.775847895 podStartE2EDuration="5.058523951s" totalImagesPullingTime="3.282676056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:35.057803243 +0000 UTC m=+87.856438025" watchObservedRunningTime="2026-09-11 14:16:35.058523951 +0000 UTC m=+87.857158816"
Sep 11 14:16:36.873853 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:36.873819    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:36.973519 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:36.973481    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:37.343516 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:37.343479    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:39.636785 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:39.636739    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:39.751551 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:39.751525    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:40.023622 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.023556    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:40.138688 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.138662    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-lbm74"]
Sep 11 14:16:40.158973 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.158943    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:40.160036 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.160021    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-lbm74"
Sep 11 14:16:40.163705 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.163668    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 11 14:16:40.163861 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.163842    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 11 14:16:40.163973 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.163955    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-9q2wh\""
Sep 11 14:16:40.171410 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.171392    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 14:16:40.172873 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.172856    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-lbm74"]
Sep 11 14:16:40.218728 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.218708    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sqshp"]
Sep 11 14:16:40.232089 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.232066    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b1f59c6-e587-4bf3-811e-2dad8bffca78-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-lbm74\" (UID: \"1b1f59c6-e587-4bf3-811e-2dad8bffca78\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-lbm74"
Sep 11 14:16:40.232164 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.232099    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76prv\" (UniqueName: \"kubernetes.io/projected/1b1f59c6-e587-4bf3-811e-2dad8bffca78-kube-api-access-76prv\") pod \"openshift-state-metrics-67dcf8c979-lbm74\" (UID: \"1b1f59c6-e587-4bf3-811e-2dad8bffca78\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-lbm74"
Sep 11 14:16:40.232164 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.232135    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b1f59c6-e587-4bf3-811e-2dad8bffca78-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-lbm74\" (UID: \"1b1f59c6-e587-4bf3-811e-2dad8bffca78\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-lbm74"
Sep 11 14:16:40.232235 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.232173    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b1f59c6-e587-4bf3-811e-2dad8bffca78-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-lbm74\" (UID: \"1b1f59c6-e587-4bf3-811e-2dad8bffca78\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-lbm74"
Sep 11 14:16:40.239757 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.239740    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sqshp"
Sep 11 14:16:40.243287 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.243272    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 14:16:40.243361 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.243275    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 14:16:40.244366 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.244346    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 14:16:40.245831 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.245812    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9rrqh\""
Sep 11 14:16:40.278531 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.278486    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:40.333183 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.333163    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4-sys\") pod \"node-exporter-sqshp\" (UID: \"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4\") " pod="openshift-monitoring/node-exporter-sqshp"
Sep 11 14:16:40.333278 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.333189    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4-node-exporter-textfile\") pod \"node-exporter-sqshp\" (UID: \"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4\") " pod="openshift-monitoring/node-exporter-sqshp"
Sep 11 14:16:40.333278 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.333205    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4-node-exporter-tls\") pod \"node-exporter-sqshp\" (UID: \"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4\") " pod="openshift-monitoring/node-exporter-sqshp"
Sep 11 14:16:40.333278 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.333257    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjg2p\" (UniqueName: \"kubernetes.io/projected/82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4-kube-api-access-wjg2p\") pod \"node-exporter-sqshp\" (UID: \"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4\") " pod="openshift-monitoring/node-exporter-sqshp"
Sep 11 14:16:40.333384 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.333295    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b1f59c6-e587-4bf3-811e-2dad8bffca78-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-lbm74\" (UID: \"1b1f59c6-e587-4bf3-811e-2dad8bffca78\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-lbm74"
Sep 11 14:16:40.333384 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.333316    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sqshp\" (UID: \"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4\") " pod="openshift-monitoring/node-exporter-sqshp"
Sep 11 14:16:40.333384 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.333339    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76prv\" (UniqueName: \"kubernetes.io/projected/1b1f59c6-e587-4bf3-811e-2dad8bffca78-kube-api-access-76prv\") pod \"openshift-state-metrics-67dcf8c979-lbm74\" (UID: \"1b1f59c6-e587-4bf3-811e-2dad8bffca78\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-lbm74"
Sep 11 14:16:40.333384 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.333359    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4-node-exporter-wtmp\") pod \"node-exporter-sqshp\" (UID: \"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4\") " pod="openshift-monitoring/node-exporter-sqshp"
Sep 11 14:16:40.333384 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.333378    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4-node-exporter-accelerators-collector-config\") pod \"node-exporter-sqshp\" (UID: \"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4\") " pod="openshift-monitoring/node-exporter-sqshp"
Sep 11 14:16:40.333629 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.333422    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4-metrics-client-ca\") pod \"node-exporter-sqshp\" (UID: \"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4\") " pod="openshift-monitoring/node-exporter-sqshp"
Sep 11 14:16:40.333629 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.333446    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b1f59c6-e587-4bf3-811e-2dad8bffca78-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-lbm74\" (UID: \"1b1f59c6-e587-4bf3-811e-2dad8bffca78\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-lbm74"
Sep 11 14:16:40.333629 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.333472    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b1f59c6-e587-4bf3-811e-2dad8bffca78-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-lbm74\" (UID: \"1b1f59c6-e587-4bf3-811e-2dad8bffca78\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-lbm74"
Sep 11 14:16:40.333629 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.333511    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4-root\") pod \"node-exporter-sqshp\" (UID: \"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4\") " pod="openshift-monitoring/node-exporter-sqshp"
Sep 11 14:16:40.334067 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.334049    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b1f59c6-e587-4bf3-811e-2dad8bffca78-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-lbm74\" (UID: \"1b1f59c6-e587-4bf3-811e-2dad8bffca78\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-lbm74"
Sep 11 14:16:40.335771 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.335749    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b1f59c6-e587-4bf3-811e-2dad8bffca78-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-lbm74\" (UID: \"1b1f59c6-e587-4bf3-811e-2dad8bffca78\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-lbm74"
Sep 11 14:16:40.335867 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.335850    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b1f59c6-e587-4bf3-811e-2dad8bffca78-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-lbm74\" (UID: \"1b1f59c6-e587-4bf3-811e-2dad8bffca78\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-lbm74"
Sep 11 14:16:40.344120 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.344097    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76prv\" (UniqueName: \"kubernetes.io/projected/1b1f59c6-e587-4bf3-811e-2dad8bffca78-kube-api-access-76prv\") pod \"openshift-state-metrics-67dcf8c979-lbm74\" (UID: \"1b1f59c6-e587-4bf3-811e-2dad8bffca78\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-lbm74"
Sep 11 14:16:40.353838 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.353819    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:40.434255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.434237    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4-root\") pod \"node-exporter-sqshp\" (UID: \"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4\") " pod="openshift-monitoring/node-exporter-sqshp"
Sep 11 14:16:40.434348 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.434264    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4-sys\") pod \"node-exporter-sqshp\" (UID: \"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4\") " pod="openshift-monitoring/node-exporter-sqshp"
Sep 11 14:16:40.434348 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.434280    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4-node-exporter-textfile\") pod \"node-exporter-sqshp\" (UID: \"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4\") " pod="openshift-monitoring/node-exporter-sqshp"
Sep 11 14:16:40.434348 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.434311    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4-node-exporter-tls\") pod \"node-exporter-sqshp\" (UID: \"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4\") " pod="openshift-monitoring/node-exporter-sqshp"
Sep 11 14:16:40.434453 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.434343    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4-root\") pod \"node-exporter-sqshp\" (UID: \"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4\") " pod="openshift-monitoring/node-exporter-sqshp"
Sep 11 14:16:40.434453 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.434359    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4-sys\") pod \"node-exporter-sqshp\" (UID: \"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4\") " pod="openshift-monitoring/node-exporter-sqshp"
Sep 11 14:16:40.434453 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.434379    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjg2p\" (UniqueName: \"kubernetes.io/projected/82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4-kube-api-access-wjg2p\") pod \"node-exporter-sqshp\" (UID: \"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4\") " pod="openshift-monitoring/node-exporter-sqshp"
Sep 11 14:16:40.434453 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.434410    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sqshp\" (UID: \"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4\") " pod="openshift-monitoring/node-exporter-sqshp"
Sep 11 14:16:40.434453 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.434446    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4-node-exporter-wtmp\") pod \"node-exporter-sqshp\" (UID: \"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4\") " pod="openshift-monitoring/node-exporter-sqshp"
Sep 11 14:16:40.434655 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.434470    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4-node-exporter-accelerators-collector-config\") pod \"node-exporter-sqshp\" (UID: \"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4\") " pod="openshift-monitoring/node-exporter-sqshp"
Sep 11 14:16:40.434655 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.434597    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4-node-exporter-wtmp\") pod \"node-exporter-sqshp\" (UID: \"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4\") " pod="openshift-monitoring/node-exporter-sqshp"
Sep 11 14:16:40.434655 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.434604    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4-node-exporter-textfile\") pod \"node-exporter-sqshp\" (UID: \"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4\") " pod="openshift-monitoring/node-exporter-sqshp"
Sep 11 14:16:40.434655 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.434636    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4-metrics-client-ca\") pod \"node-exporter-sqshp\" (UID: \"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4\") " pod="openshift-monitoring/node-exporter-sqshp"
Sep 11 14:16:40.434993 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.434972    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4-node-exporter-accelerators-collector-config\") pod \"node-exporter-sqshp\" (UID: \"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4\") " pod="openshift-monitoring/node-exporter-sqshp"
Sep 11 14:16:40.435097 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.435082    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4-metrics-client-ca\") pod \"node-exporter-sqshp\" (UID: \"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4\") " pod="openshift-monitoring/node-exporter-sqshp"
Sep 11 14:16:40.436198 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.436179    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4-node-exporter-tls\") pod \"node-exporter-sqshp\" (UID: \"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4\") " pod="openshift-monitoring/node-exporter-sqshp"
Sep 11 14:16:40.436374 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.436356    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sqshp\" (UID: \"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4\") " pod="openshift-monitoring/node-exporter-sqshp"
Sep 11 14:16:40.449296 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.449276    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjg2p\" (UniqueName: \"kubernetes.io/projected/82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4-kube-api-access-wjg2p\") pod \"node-exporter-sqshp\" (UID: \"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4\") " pod="openshift-monitoring/node-exporter-sqshp"
Sep 11 14:16:40.459168 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.459143    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:40.469002 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.468984    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-lbm74"
Sep 11 14:16:40.547973 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.547945    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sqshp"
Sep 11 14:16:40.550548 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.550516    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:40.571550 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:16:40.571527    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82aa1feb_927d_4cfe_aa68_6cec0d7fd5a4.slice/crio-938e9dae078d7c19bdd52ce95feebe9deb08a78a821d6de12c3d20594c114ab0 WatchSource:0}: Error finding container 938e9dae078d7c19bdd52ce95feebe9deb08a78a821d6de12c3d20594c114ab0: Status 404 returned error can't find the container with id 938e9dae078d7c19bdd52ce95feebe9deb08a78a821d6de12c3d20594c114ab0
Sep 11 14:16:40.772033 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.772008    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-lbm74"]
Sep 11 14:16:40.775229 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:16:40.775205    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b1f59c6_e587_4bf3_811e_2dad8bffca78.slice/crio-7ba69f790ca710d01cdff67e22d0307df25fc98940b9c5e1550cab56eaf60c86 WatchSource:0}: Error finding container 7ba69f790ca710d01cdff67e22d0307df25fc98940b9c5e1550cab56eaf60c86: Status 404 returned error can't find the container with id 7ba69f790ca710d01cdff67e22d0307df25fc98940b9c5e1550cab56eaf60c86
Sep 11 14:16:40.844651 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.844626    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:40.943418 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:40.943369    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:41.056047 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:41.055964    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:41.058482 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:41.058445    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sqshp" event={"ID":"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4","Type":"ContainerStarted","Data":"938e9dae078d7c19bdd52ce95feebe9deb08a78a821d6de12c3d20594c114ab0"}
Sep 11 14:16:41.060504 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:41.060481    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-lbm74" event={"ID":"1b1f59c6-e587-4bf3-811e-2dad8bffca78","Type":"ContainerStarted","Data":"e4af465b65590df0c8a7a2bebaa3aae5e92b36811e8166eeca0e2cd8d974b4e6"}
Sep 11 14:16:41.060596 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:41.060529    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-lbm74" event={"ID":"1b1f59c6-e587-4bf3-811e-2dad8bffca78","Type":"ContainerStarted","Data":"b7452d087228e94db13b04c003ca8ecc7286a49f030b41a3196fd2872141dcbd"}
Sep 11 14:16:41.060596 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:41.060553    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-lbm74" event={"ID":"1b1f59c6-e587-4bf3-811e-2dad8bffca78","Type":"ContainerStarted","Data":"7ba69f790ca710d01cdff67e22d0307df25fc98940b9c5e1550cab56eaf60c86"}
Sep 11 14:16:41.565976 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:41.565932    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:42.065437 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:42.065407    2584 generic.go:356] "Generic (PLEG): container finished" podID="82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4" containerID="d90b8e9601adefb1424aad7d0027ce80319d3d7c166b74732e8f877fbb1127b5" exitCode=0
Sep 11 14:16:42.065834 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:42.065452    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sqshp" event={"ID":"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4","Type":"ContainerDied","Data":"d90b8e9601adefb1424aad7d0027ce80319d3d7c166b74732e8f877fbb1127b5"}
Sep 11 14:16:43.056581 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:43.056547    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:43.071756 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:43.071723    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sqshp" event={"ID":"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4","Type":"ContainerStarted","Data":"3805ee4355ce64ffd507adb8e07f8c6f45870ba534e512fd4b2780bcd23a3f88"}
Sep 11 14:16:43.072089 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:43.071811    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sqshp" event={"ID":"82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4","Type":"ContainerStarted","Data":"472b5d61937bd028c5a4193a12d77fd84dd42206c7282a2306dda16cb1801e96"}
Sep 11 14:16:43.073928 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:43.073905    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-lbm74" event={"ID":"1b1f59c6-e587-4bf3-811e-2dad8bffca78","Type":"ContainerStarted","Data":"f368a995e02643b0d0392c7a2974d12163f3b6a8b9b56aa7e570e00dbb9be8ef"}
Sep 11 14:16:43.110673 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:43.110628    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sqshp" podStartSLOduration=1.957070339 podStartE2EDuration="3.110612167s" totalImagesPullingTime="1.092876798s" totalInitContainerRuntime="60.66503ms" isStatefulPod=true podCreationTimestamp="2026-09-11 14:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:43.110105526 +0000 UTC m=+95.908740308" watchObservedRunningTime="2026-09-11 14:16:43.110612167 +0000 UTC m=+95.909246945"
Sep 11 14:16:43.242605 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:43.242580    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:43.621387 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:43.621351    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:43.719718 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:43.719690    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:44.053211 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:44.053183    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:44.185244 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:44.185211    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:44.746929 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:44.746897    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:44.869140 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:44.869109    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffe0180e-2a90-4d97-8575-1d44acd6b790-metrics-tls\") pod \"dns-default-mc48z\" (UID: \"ffe0180e-2a90-4d97-8575-1d44acd6b790\") " pod="openshift-dns/dns-default-mc48z"
Sep 11 14:16:44.871395 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:44.871376    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffe0180e-2a90-4d97-8575-1d44acd6b790-metrics-tls\") pod \"dns-default-mc48z\" (UID: \"ffe0180e-2a90-4d97-8575-1d44acd6b790\") " pod="openshift-dns/dns-default-mc48z"
Sep 11 14:16:44.989453 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:44.989432    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xblvp\""
Sep 11 14:16:44.995691 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:44.995663    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mc48z"
Sep 11 14:16:45.073571 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:45.073541    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:45.084608 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:45.084567    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-lbm74" podStartSLOduration=3.234507621 podStartE2EDuration="5.084551559s" totalImagesPullingTime="1.850043938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:43.17149457 +0000 UTC m=+95.970129354" watchObservedRunningTime="2026-09-11 14:16:45.084551559 +0000 UTC m=+97.883186340"
Sep 11 14:16:45.084733 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:45.084702    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-v2gbj"]
Sep 11 14:16:45.087273 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:45.087254    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-v2gbj"
Sep 11 14:16:45.101361 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:45.101344    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 11 14:16:45.102065 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:45.102052    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-28spj\""
Sep 11 14:16:45.171954 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:45.171930    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/86fe579e-bbe6-4e45-ab35-06150430bd23-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-v2gbj\" (UID: \"86fe579e-bbe6-4e45-ab35-06150430bd23\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-v2gbj"
Sep 11 14:16:45.172025 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:45.171983    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2qwv\" (UniqueName: \"kubernetes.io/projected/86fe579e-bbe6-4e45-ab35-06150430bd23-kube-api-access-t2qwv\") pod \"monitoring-plugin-5d85778b9d-v2gbj\" (UID: \"86fe579e-bbe6-4e45-ab35-06150430bd23\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-v2gbj"
Sep 11 14:16:45.273256 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:45.273203    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/86fe579e-bbe6-4e45-ab35-06150430bd23-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-v2gbj\" (UID: \"86fe579e-bbe6-4e45-ab35-06150430bd23\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-v2gbj"
Sep 11 14:16:45.273514 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:45.273256    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2qwv\" (UniqueName: \"kubernetes.io/projected/86fe579e-bbe6-4e45-ab35-06150430bd23-kube-api-access-t2qwv\") pod \"monitoring-plugin-5d85778b9d-v2gbj\" (UID: \"86fe579e-bbe6-4e45-ab35-06150430bd23\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-v2gbj"
Sep 11 14:16:45.275506 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:45.275486    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/86fe579e-bbe6-4e45-ab35-06150430bd23-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-v2gbj\" (UID: \"86fe579e-bbe6-4e45-ab35-06150430bd23\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-v2gbj"
Sep 11 14:16:45.467808 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:45.467784    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2qwv\" (UniqueName: \"kubernetes.io/projected/86fe579e-bbe6-4e45-ab35-06150430bd23-kube-api-access-t2qwv\") pod \"monitoring-plugin-5d85778b9d-v2gbj\" (UID: \"86fe579e-bbe6-4e45-ab35-06150430bd23\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-v2gbj"
Sep 11 14:16:45.571418 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:45.571398    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mc48z"]
Sep 11 14:16:45.572250 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:16:45.572226    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffe0180e_2a90_4d97_8575_1d44acd6b790.slice/crio-164db2711ed2ae39a768a48bf7d4fba6193562b17bd1ac140f2ac705ee7b9adc WatchSource:0}: Error finding container 164db2711ed2ae39a768a48bf7d4fba6193562b17bd1ac140f2ac705ee7b9adc: Status 404 returned error can't find the container with id 164db2711ed2ae39a768a48bf7d4fba6193562b17bd1ac140f2ac705ee7b9adc
Sep 11 14:16:45.666973 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:45.666952    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-v2gbj"]
Sep 11 14:16:45.696336 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:45.696301    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-v2gbj"
Sep 11 14:16:45.950503 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:45.950435    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wqqzl"
Sep 11 14:16:46.067808 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:16:46.067777    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86fe579e_bbe6_4e45_ab35_06150430bd23.slice/crio-3eaebad7d95cfc0cfa4abf4809f42293493ae30e0fdf53e17ce964d9ddb5bf4e WatchSource:0}: Error finding container 3eaebad7d95cfc0cfa4abf4809f42293493ae30e0fdf53e17ce964d9ddb5bf4e: Status 404 returned error can't find the container with id 3eaebad7d95cfc0cfa4abf4809f42293493ae30e0fdf53e17ce964d9ddb5bf4e
Sep 11 14:16:46.067965 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:46.067950    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-v2gbj"]
Sep 11 14:16:46.086387 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:46.086358    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-v2gbj" event={"ID":"86fe579e-bbe6-4e45-ab35-06150430bd23","Type":"ContainerStarted","Data":"3eaebad7d95cfc0cfa4abf4809f42293493ae30e0fdf53e17ce964d9ddb5bf4e"}
Sep 11 14:16:46.087445 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:46.087413    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mc48z" event={"ID":"ffe0180e-2a90-4d97-8575-1d44acd6b790","Type":"ContainerStarted","Data":"164db2711ed2ae39a768a48bf7d4fba6193562b17bd1ac140f2ac705ee7b9adc"}
Sep 11 14:16:47.684957 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.684884    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 14:16:47.687618 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.687590    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.689060 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.689034    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:47.696492 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.696463    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 11 14:16:47.729133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.729109    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 11 14:16:47.729237 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.729209    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2tdg2\""
Sep 11 14:16:47.729736 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.729722    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 11 14:16:47.730202 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.730188    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 11 14:16:47.736587 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.736566    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 11 14:16:47.736763 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.736743    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 11 14:16:47.737942 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.737922    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2sk0l3nlh59hp\""
Sep 11 14:16:47.738037 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.737927    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 11 14:16:47.738872 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.738823    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 11 14:16:47.739049 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.739029    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 11 14:16:47.740257 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.740230    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 11 14:16:47.742393 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.742371    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 11 14:16:47.744909 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.744890    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 11 14:16:47.750126 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.750104    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 11 14:16:47.751165 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.751146    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 11 14:16:47.755481 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.755461    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 11 14:16:47.794345 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.791671    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 14:16:47.797004 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.796978    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.797112 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.797015    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.797112 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.797046    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.797112 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.797072    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.797112 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.797094    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-web-config\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.797316 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.797122    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.797316 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.797218    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.797316 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.797264    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.797316 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.797289    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xq98\" (UniqueName: \"kubernetes.io/projected/18223011-60f5-48b8-8ddc-613485a14637-kube-api-access-5xq98\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.797493 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.797315    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.797493 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.797364    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-config\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.797493 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.797389    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.797493 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.797414    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.797493 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.797444    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18223011-60f5-48b8-8ddc-613485a14637-config-out\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.797493 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.797478    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.797797 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.797517    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.797797 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.797722    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18223011-60f5-48b8-8ddc-613485a14637-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.797797 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.797751    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.797797 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.797773    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.797797 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.797790    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/18223011-60f5-48b8-8ddc-613485a14637-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.899062 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.898617    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-config\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.899062 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.898661    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.899062 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.898703    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.899062 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.898733    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18223011-60f5-48b8-8ddc-613485a14637-config-out\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.899062 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.898757    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.899062 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.898782    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.899062 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.898843    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18223011-60f5-48b8-8ddc-613485a14637-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.899062 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.898868    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.899062 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.898892    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.899062 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.898918    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/18223011-60f5-48b8-8ddc-613485a14637-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.899062 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.898947    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.899062 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.898991    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.899062 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.899022    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.899062 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.899047    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.899062 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.899070    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-web-config\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.899848 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.899095    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.899848 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.899139    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.899848 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.899183    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.899848 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.899209    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xq98\" (UniqueName: \"kubernetes.io/projected/18223011-60f5-48b8-8ddc-613485a14637-kube-api-access-5xq98\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.899848 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.899236    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.900095 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.899893    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.900851 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.900465    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.900851 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.900733    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/18223011-60f5-48b8-8ddc-613485a14637-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.901470 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.901445    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.901723 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.901667    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.902481 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.902451    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.903096 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.903071    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18223011-60f5-48b8-8ddc-613485a14637-config-out\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.903172 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.903142    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.903990 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.903579    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.903990 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.903666    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18223011-60f5-48b8-8ddc-613485a14637-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.905307 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.905282    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.905580 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.905548    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.906919 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.906879    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.906919 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.906895    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-web-config\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.907056 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.906997    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.907659 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.907626    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.908320 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.908038    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-config\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.908493 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.908442    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.908823 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.908800    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.950845 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.950824    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xq98\" (UniqueName: \"kubernetes.io/projected/18223011-60f5-48b8-8ddc-613485a14637-kube-api-access-5xq98\") pod \"prometheus-k8s-0\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:47.998063 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:47.998036    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:48.097925 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:48.097898    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-v2gbj" event={"ID":"86fe579e-bbe6-4e45-ab35-06150430bd23","Type":"ContainerStarted","Data":"0331ed3f2455cd01532c0ea5128289ca7429a638798e28f8490925828005ea29"}
Sep 11 14:16:48.098133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:48.098087    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-v2gbj"
Sep 11 14:16:48.099870 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:48.099847    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mc48z" event={"ID":"ffe0180e-2a90-4d97-8575-1d44acd6b790","Type":"ContainerStarted","Data":"25593a22312f8e7d1976c5493f4f8cd6d9fc15314f954662376dface58b17129"}
Sep 11 14:16:48.099955 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:48.099886    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mc48z" event={"ID":"ffe0180e-2a90-4d97-8575-1d44acd6b790","Type":"ContainerStarted","Data":"f74d5e63a1d3f749387f6764e8669daa16fcd72498c3d4741c02c0b34b386628"}
Sep 11 14:16:48.099998 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:48.099986    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mc48z"
Sep 11 14:16:48.103567 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:48.103542    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-v2gbj"
Sep 11 14:16:48.172778 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:48.172734    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-v2gbj" podStartSLOduration=1.843358062 podStartE2EDuration="3.172717368s" totalImagesPullingTime="1.329359306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:48.172090702 +0000 UTC m=+100.970725484" watchObservedRunningTime="2026-09-11 14:16:48.172717368 +0000 UTC m=+100.971352150"
Sep 11 14:16:48.263615 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:48.263547    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mc48z" podStartSLOduration=64.95218817 podStartE2EDuration="1m7.263534004s" totalImagesPullingTime="2.311345834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:15:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:48.244751164 +0000 UTC m=+101.043385945" watchObservedRunningTime="2026-09-11 14:16:48.263534004 +0000 UTC m=+101.062168815"
Sep 11 14:16:48.360792 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:48.360752    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 14:16:48.363768 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:16:48.363737    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18223011_60f5_48b8_8ddc_613485a14637.slice/crio-5e3bf9bc68c3ddbda1fde516fe58beeded66fb85fc5aee340861154b38823a80 WatchSource:0}: Error finding container 5e3bf9bc68c3ddbda1fde516fe58beeded66fb85fc5aee340861154b38823a80: Status 404 returned error can't find the container with id 5e3bf9bc68c3ddbda1fde516fe58beeded66fb85fc5aee340861154b38823a80
Sep 11 14:16:48.910982 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:48.910947    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:49.105043 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:49.105003    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18223011-60f5-48b8-8ddc-613485a14637","Type":"ContainerStarted","Data":"5e3bf9bc68c3ddbda1fde516fe58beeded66fb85fc5aee340861154b38823a80"}
Sep 11 14:16:49.133560 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:49.133530    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:49.289017 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:49.288988    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:49.572958 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:49.572912    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:49.783995 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:49.783950    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:50.114951 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:50.114916    2584 generic.go:356] "Generic (PLEG): container finished" podID="18223011-60f5-48b8-8ddc-613485a14637" containerID="4a74fa7dbf424995b36262cf90204dc08e9abd671179ac0f7b69b6a6bea0bc6c" exitCode=0
Sep 11 14:16:50.115397 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:50.115006    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18223011-60f5-48b8-8ddc-613485a14637","Type":"ContainerDied","Data":"4a74fa7dbf424995b36262cf90204dc08e9abd671179ac0f7b69b6a6bea0bc6c"}
Sep 11 14:16:53.032897 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:53.032866    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-85fb7687cf-b6q6v"
Sep 11 14:16:53.415293 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:53.415257    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:53.656017 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:53.655989    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:54.134630 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:54.134597    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18223011-60f5-48b8-8ddc-613485a14637","Type":"ContainerStarted","Data":"db486c67fa862d7819155327bb331d3b24167e0d88924a5158a5c4b1eb328da2"}
Sep 11 14:16:54.134990 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:54.134711    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18223011-60f5-48b8-8ddc-613485a14637","Type":"ContainerStarted","Data":"3a4a34c5ff2b94a966671f22b04869311bddf6bf5de96127963b49d7e93b6d09"}
Sep 11 14:16:54.186149 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:54.186113    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:54.399734 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:54.399610    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:16:56.146493 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:56.146465    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18223011-60f5-48b8-8ddc-613485a14637","Type":"ContainerStarted","Data":"694165eedce956554cd9a62278a657453d8990716019613ed3aa949c268905c0"}
Sep 11 14:16:56.146864 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:56.146529    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18223011-60f5-48b8-8ddc-613485a14637","Type":"ContainerStarted","Data":"6271b102522ee29a5b3fd6dca841a16feb1cecac67d8e24b993c63b2cc232626"}
Sep 11 14:16:56.146864 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:56.146562    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18223011-60f5-48b8-8ddc-613485a14637","Type":"ContainerStarted","Data":"db38846bb3a512672c8c63a3341fd82ea1c2c8e9d66b121052db605fb1fd51f0"}
Sep 11 14:16:56.146864 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:56.146589    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18223011-60f5-48b8-8ddc-613485a14637","Type":"ContainerStarted","Data":"c7181470fafc26b134043cbeb963d355fbe40ed947f5ba55aee557dd69ceff59"}
Sep 11 14:16:56.250717 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:56.250651    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.067275432 podStartE2EDuration="9.250633585s" totalImagesPullingTime="6.161650783s" totalInitContainerRuntime="21.70737ms" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:56.249328099 +0000 UTC m=+109.047962882" watchObservedRunningTime="2026-09-11 14:16:56.250633585 +0000 UTC m=+109.049268368"
Sep 11 14:16:57.998518 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:57.998484    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:16:58.107359 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:16:58.107334    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mc48z"
Sep 11 14:17:00.442255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:00.442220    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:00.803149 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:00.803114    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:01.015067 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:01.015029    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:01.116379 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:01.116316    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:01.286325 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:01.286299    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:01.463997 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:01.463938    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:02.122208 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:02.122172    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:02.209110 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:02.209079    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:04.814149 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:04.814110    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:04.934422 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:04.934379    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:09.251302 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:09.251259    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:09.354635 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:09.354596    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:13.761820 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:13.761782    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:13.839409 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:13.839372    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:14.185144 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:14.185111    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:14.330867 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:14.330832    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:15.684187 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:15.684154    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:15.791114 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:15.791081    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:15.886963 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:15.886931    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:15.957229 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:15.957163    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:16.066349 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:16.066317    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:16.195183 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:16.195161    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:16.228774 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:16.228717    2584 generic.go:356] "Generic (PLEG): container finished" podID="c861bafb-8a3f-47cc-ab78-0d783b860739" containerID="a28dbe51028be5174b93c3b7acb54b90ba5c414b43a78bee1d5d8fa4c51838f9" exitCode=0
Sep 11 14:17:16.228862 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:16.228791    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7smvp" event={"ID":"c861bafb-8a3f-47cc-ab78-0d783b860739","Type":"ContainerDied","Data":"a28dbe51028be5174b93c3b7acb54b90ba5c414b43a78bee1d5d8fa4c51838f9"}
Sep 11 14:17:16.229055 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:16.229040    2584 scope.go:117] "RemoveContainer" containerID="a28dbe51028be5174b93c3b7acb54b90ba5c414b43a78bee1d5d8fa4c51838f9"
Sep 11 14:17:17.233737 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:17.233702    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7smvp" event={"ID":"c861bafb-8a3f-47cc-ab78-0d783b860739","Type":"ContainerStarted","Data":"20c2c858720d00ea7d7646cda9e3146c5d710058d9d8f21440cc22de95b66684"}
Sep 11 14:17:17.427870 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:17.427839    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69446d2a-2163-4a00-8b2d-02c7dee348e3-metrics-certs\") pod \"network-metrics-daemon-dqhsk\" (UID: \"69446d2a-2163-4a00-8b2d-02c7dee348e3\") " pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:17:17.429970 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:17.429950    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69446d2a-2163-4a00-8b2d-02c7dee348e3-metrics-certs\") pod \"network-metrics-daemon-dqhsk\" (UID: \"69446d2a-2163-4a00-8b2d-02c7dee348e3\") " pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:17:17.686630 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:17.686605    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vtjb2\""
Sep 11 14:17:17.692795 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:17.692778    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqhsk"
Sep 11 14:17:17.979022 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:17.978939    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dqhsk"]
Sep 11 14:17:17.986337 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:17:17.986308    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69446d2a_2163_4a00_8b2d_02c7dee348e3.slice/crio-9a6e55dbc549b47a0ff9ebc357c26f209ac436c3571d10b62d32c9833b380906 WatchSource:0}: Error finding container 9a6e55dbc549b47a0ff9ebc357c26f209ac436c3571d10b62d32c9833b380906: Status 404 returned error can't find the container with id 9a6e55dbc549b47a0ff9ebc357c26f209ac436c3571d10b62d32c9833b380906
Sep 11 14:17:18.238393 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:18.238311    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dqhsk" event={"ID":"69446d2a-2163-4a00-8b2d-02c7dee348e3","Type":"ContainerStarted","Data":"9a6e55dbc549b47a0ff9ebc357c26f209ac436c3571d10b62d32c9833b380906"}
Sep 11 14:17:18.407985 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:18.407954    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:18.571266 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:18.571232    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:19.243927 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:19.243860    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dqhsk" event={"ID":"69446d2a-2163-4a00-8b2d-02c7dee348e3","Type":"ContainerStarted","Data":"c5da05fe1bd7c5901bad1277bc1a4b6b65790797d63fa51e548643c065e738e8"}
Sep 11 14:17:19.244348 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:19.243924    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dqhsk" event={"ID":"69446d2a-2163-4a00-8b2d-02c7dee348e3","Type":"ContainerStarted","Data":"c68cba9b63352ac69b7b4de01c359cecf7d310ed8890b4cea7fa86231d14b1ab"}
Sep 11 14:17:19.448310 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:19.448281    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:19.532653 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:19.532591    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:24.092382 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:24.092344    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:31.194178 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:31.194140    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:31.273845 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:31.273808    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:31.737951 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:31.737918    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:31.811118 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:31.811087    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:39.254656 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:39.254598    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:39.358220 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:39.358182    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:47.998199 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:47.998166    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:17:48.015065 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:48.015041    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:17:48.065523 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:48.065477    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dqhsk" podStartSLOduration=160.148202783 podStartE2EDuration="2m41.065461456s" totalImagesPullingTime="917.258673ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:17:19.277542976 +0000 UTC m=+132.076177757" watchObservedRunningTime="2026-09-11 14:17:48.065461456 +0000 UTC m=+160.864096238"
Sep 11 14:17:48.382376 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:48.382343    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:17:54.329590 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:54.329553    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:54.491165 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:54.491129    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:57.132697 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:57.132641    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:17:57.237535 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:17:57.237494    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:18:00.759219 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:00.759142    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:18:00.832817 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:00.832783    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:18:06.000422 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:06.000383    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 14:18:06.000968 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:06.000813    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="18223011-60f5-48b8-8ddc-613485a14637" containerName="prometheus" containerID="cri-o://3a4a34c5ff2b94a966671f22b04869311bddf6bf5de96127963b49d7e93b6d09" gracePeriod=600
Sep 11 14:18:06.001100 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:06.000854    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="18223011-60f5-48b8-8ddc-613485a14637" containerName="thanos-sidecar" containerID="cri-o://c7181470fafc26b134043cbeb963d355fbe40ed947f5ba55aee557dd69ceff59" gracePeriod=600
Sep 11 14:18:06.001145 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:06.000854    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="18223011-60f5-48b8-8ddc-613485a14637" containerName="config-reloader" containerID="cri-o://db486c67fa862d7819155327bb331d3b24167e0d88924a5158a5c4b1eb328da2" gracePeriod=600
Sep 11 14:18:06.001193 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:06.000847    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="18223011-60f5-48b8-8ddc-613485a14637" containerName="kube-rbac-proxy-web" containerID="cri-o://db38846bb3a512672c8c63a3341fd82ea1c2c8e9d66b121052db605fb1fd51f0" gracePeriod=600
Sep 11 14:18:06.001248 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:06.000868    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="18223011-60f5-48b8-8ddc-613485a14637" containerName="kube-rbac-proxy-thanos" containerID="cri-o://694165eedce956554cd9a62278a657453d8990716019613ed3aa949c268905c0" gracePeriod=600
Sep 11 14:18:06.001296 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:06.000900    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="18223011-60f5-48b8-8ddc-613485a14637" containerName="kube-rbac-proxy" containerID="cri-o://6271b102522ee29a5b3fd6dca841a16feb1cecac67d8e24b993c63b2cc232626" gracePeriod=600
Sep 11 14:18:06.441478 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:06.441446    2584 generic.go:356] "Generic (PLEG): container finished" podID="18223011-60f5-48b8-8ddc-613485a14637" containerID="694165eedce956554cd9a62278a657453d8990716019613ed3aa949c268905c0" exitCode=0
Sep 11 14:18:06.441478 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:06.441474    2584 generic.go:356] "Generic (PLEG): container finished" podID="18223011-60f5-48b8-8ddc-613485a14637" containerID="6271b102522ee29a5b3fd6dca841a16feb1cecac67d8e24b993c63b2cc232626" exitCode=0
Sep 11 14:18:06.441478 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:06.441482    2584 generic.go:356] "Generic (PLEG): container finished" podID="18223011-60f5-48b8-8ddc-613485a14637" containerID="c7181470fafc26b134043cbeb963d355fbe40ed947f5ba55aee557dd69ceff59" exitCode=0
Sep 11 14:18:06.441705 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:06.441490    2584 generic.go:356] "Generic (PLEG): container finished" podID="18223011-60f5-48b8-8ddc-613485a14637" containerID="db486c67fa862d7819155327bb331d3b24167e0d88924a5158a5c4b1eb328da2" exitCode=0
Sep 11 14:18:06.441705 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:06.441499    2584 generic.go:356] "Generic (PLEG): container finished" podID="18223011-60f5-48b8-8ddc-613485a14637" containerID="3a4a34c5ff2b94a966671f22b04869311bddf6bf5de96127963b49d7e93b6d09" exitCode=0
Sep 11 14:18:06.441705 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:06.441518    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18223011-60f5-48b8-8ddc-613485a14637","Type":"ContainerDied","Data":"694165eedce956554cd9a62278a657453d8990716019613ed3aa949c268905c0"}
Sep 11 14:18:06.441705 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:06.441583    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18223011-60f5-48b8-8ddc-613485a14637","Type":"ContainerDied","Data":"6271b102522ee29a5b3fd6dca841a16feb1cecac67d8e24b993c63b2cc232626"}
Sep 11 14:18:06.441705 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:06.441609    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18223011-60f5-48b8-8ddc-613485a14637","Type":"ContainerDied","Data":"c7181470fafc26b134043cbeb963d355fbe40ed947f5ba55aee557dd69ceff59"}
Sep 11 14:18:06.441705 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:06.441634    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18223011-60f5-48b8-8ddc-613485a14637","Type":"ContainerDied","Data":"db486c67fa862d7819155327bb331d3b24167e0d88924a5158a5c4b1eb328da2"}
Sep 11 14:18:06.441705 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:06.441658    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18223011-60f5-48b8-8ddc-613485a14637","Type":"ContainerDied","Data":"3a4a34c5ff2b94a966671f22b04869311bddf6bf5de96127963b49d7e93b6d09"}
Sep 11 14:18:06.781366 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:06.781277    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:18:07.242601 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.242569    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.301288 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.301263    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"18223011-60f5-48b8-8ddc-613485a14637\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") "
Sep 11 14:18:07.301408 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.301292    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-metrics-client-certs\") pod \"18223011-60f5-48b8-8ddc-613485a14637\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") "
Sep 11 14:18:07.301408 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.301311    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-prometheus-k8s-rulefiles-0\") pod \"18223011-60f5-48b8-8ddc-613485a14637\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") "
Sep 11 14:18:07.301408 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.301327    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-prometheus-k8s-rulefiles-1\") pod \"18223011-60f5-48b8-8ddc-613485a14637\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") "
Sep 11 14:18:07.301408 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.301350    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-config\") pod \"18223011-60f5-48b8-8ddc-613485a14637\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") "
Sep 11 14:18:07.301620 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.301509    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-configmap-kubelet-serving-ca-bundle\") pod \"18223011-60f5-48b8-8ddc-613485a14637\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") "
Sep 11 14:18:07.301620 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.301591    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-web-config\") pod \"18223011-60f5-48b8-8ddc-613485a14637\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") "
Sep 11 14:18:07.301736 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.301619    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"18223011-60f5-48b8-8ddc-613485a14637\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") "
Sep 11 14:18:07.301736 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.301652    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-kube-rbac-proxy\") pod \"18223011-60f5-48b8-8ddc-613485a14637\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") "
Sep 11 14:18:07.301736 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.301694    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-prometheus-k8s-tls\") pod \"18223011-60f5-48b8-8ddc-613485a14637\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") "
Sep 11 14:18:07.301736 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.301692    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "18223011-60f5-48b8-8ddc-613485a14637" (UID: "18223011-60f5-48b8-8ddc-613485a14637"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:18:07.301736 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.301724    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18223011-60f5-48b8-8ddc-613485a14637-config-out\") pod \"18223011-60f5-48b8-8ddc-613485a14637\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") "
Sep 11 14:18:07.301991 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.301749    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xq98\" (UniqueName: \"kubernetes.io/projected/18223011-60f5-48b8-8ddc-613485a14637-kube-api-access-5xq98\") pod \"18223011-60f5-48b8-8ddc-613485a14637\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") "
Sep 11 14:18:07.301991 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.301779    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-prometheus-k8s-rulefiles-2\") pod \"18223011-60f5-48b8-8ddc-613485a14637\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") "
Sep 11 14:18:07.301991 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.301802    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18223011-60f5-48b8-8ddc-613485a14637-tls-assets\") pod \"18223011-60f5-48b8-8ddc-613485a14637\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") "
Sep 11 14:18:07.301991 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.301828    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-thanos-prometheus-http-client-file\") pod \"18223011-60f5-48b8-8ddc-613485a14637\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") "
Sep 11 14:18:07.301991 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.301898    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-configmap-serving-certs-ca-bundle\") pod \"18223011-60f5-48b8-8ddc-613485a14637\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") "
Sep 11 14:18:07.301991 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.301929    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-grpc-tls\") pod \"18223011-60f5-48b8-8ddc-613485a14637\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") "
Sep 11 14:18:07.301991 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.301954    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-configmap-metrics-client-ca\") pod \"18223011-60f5-48b8-8ddc-613485a14637\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") "
Sep 11 14:18:07.301991 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.301982    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/18223011-60f5-48b8-8ddc-613485a14637-prometheus-k8s-db\") pod \"18223011-60f5-48b8-8ddc-613485a14637\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") "
Sep 11 14:18:07.302370 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.302022    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-prometheus-trusted-ca-bundle\") pod \"18223011-60f5-48b8-8ddc-613485a14637\" (UID: \"18223011-60f5-48b8-8ddc-613485a14637\") "
Sep 11 14:18:07.302370 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.302279    2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:18:07.303111 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.302839    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "18223011-60f5-48b8-8ddc-613485a14637" (UID: "18223011-60f5-48b8-8ddc-613485a14637"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:18:07.304078 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.303801    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "18223011-60f5-48b8-8ddc-613485a14637" (UID: "18223011-60f5-48b8-8ddc-613485a14637"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:18:07.304078 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.303811    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "18223011-60f5-48b8-8ddc-613485a14637" (UID: "18223011-60f5-48b8-8ddc-613485a14637"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:18:07.304361 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.304336    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "18223011-60f5-48b8-8ddc-613485a14637" (UID: "18223011-60f5-48b8-8ddc-613485a14637"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:18:07.305109 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.304787    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "18223011-60f5-48b8-8ddc-613485a14637" (UID: "18223011-60f5-48b8-8ddc-613485a14637"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:18:07.305109 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.304858    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "18223011-60f5-48b8-8ddc-613485a14637" (UID: "18223011-60f5-48b8-8ddc-613485a14637"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:18:07.305109 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.304993    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "18223011-60f5-48b8-8ddc-613485a14637" (UID: "18223011-60f5-48b8-8ddc-613485a14637"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:18:07.305109 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.305009    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18223011-60f5-48b8-8ddc-613485a14637-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "18223011-60f5-48b8-8ddc-613485a14637" (UID: "18223011-60f5-48b8-8ddc-613485a14637"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:18:07.305477 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.305335    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "18223011-60f5-48b8-8ddc-613485a14637" (UID: "18223011-60f5-48b8-8ddc-613485a14637"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:18:07.306906 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.306872    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18223011-60f5-48b8-8ddc-613485a14637-config-out" (OuterVolumeSpecName: "config-out") pod "18223011-60f5-48b8-8ddc-613485a14637" (UID: "18223011-60f5-48b8-8ddc-613485a14637"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:18:07.307099 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.307062    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18223011-60f5-48b8-8ddc-613485a14637-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "18223011-60f5-48b8-8ddc-613485a14637" (UID: "18223011-60f5-48b8-8ddc-613485a14637"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:18:07.307193 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.307127    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-config" (OuterVolumeSpecName: "config") pod "18223011-60f5-48b8-8ddc-613485a14637" (UID: "18223011-60f5-48b8-8ddc-613485a14637"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:18:07.307282 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.307262    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "18223011-60f5-48b8-8ddc-613485a14637" (UID: "18223011-60f5-48b8-8ddc-613485a14637"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:18:07.307419 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.307292    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "18223011-60f5-48b8-8ddc-613485a14637" (UID: "18223011-60f5-48b8-8ddc-613485a14637"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:18:07.307889 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.307866    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "18223011-60f5-48b8-8ddc-613485a14637" (UID: "18223011-60f5-48b8-8ddc-613485a14637"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:18:07.307986 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.307883    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "18223011-60f5-48b8-8ddc-613485a14637" (UID: "18223011-60f5-48b8-8ddc-613485a14637"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:18:07.308261 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.308239    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18223011-60f5-48b8-8ddc-613485a14637-kube-api-access-5xq98" (OuterVolumeSpecName: "kube-api-access-5xq98") pod "18223011-60f5-48b8-8ddc-613485a14637" (UID: "18223011-60f5-48b8-8ddc-613485a14637"). InnerVolumeSpecName "kube-api-access-5xq98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:18:07.308708 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.308659    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "18223011-60f5-48b8-8ddc-613485a14637" (UID: "18223011-60f5-48b8-8ddc-613485a14637"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:18:07.316184 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.316104    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-web-config" (OuterVolumeSpecName: "web-config") pod "18223011-60f5-48b8-8ddc-613485a14637" (UID: "18223011-60f5-48b8-8ddc-613485a14637"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:18:07.403097 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.403050    2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:18:07.403097 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.403071    2584 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-metrics-client-certs\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:18:07.403097 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.403081    2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:18:07.403097 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.403090    2584 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-config\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:18:07.403097 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.403098    2584 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:18:07.403279 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.403108    2584 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-web-config\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:18:07.403279 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.403116    2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:18:07.403279 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.403124    2584 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-kube-rbac-proxy\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:18:07.403279 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.403132    2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:18:07.403279 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.403140    2584 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18223011-60f5-48b8-8ddc-613485a14637-config-out\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:18:07.403279 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.403148    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xq98\" (UniqueName: \"kubernetes.io/projected/18223011-60f5-48b8-8ddc-613485a14637-kube-api-access-5xq98\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:18:07.403279 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.403155    2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:18:07.403279 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.403162    2584 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18223011-60f5-48b8-8ddc-613485a14637-tls-assets\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:18:07.403279 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.403170    2584 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:18:07.403279 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.403177    2584 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:18:07.403279 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.403186    2584 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/18223011-60f5-48b8-8ddc-613485a14637-secret-grpc-tls\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:18:07.403279 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.403194    2584 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-configmap-metrics-client-ca\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:18:07.403279 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.403202    2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/18223011-60f5-48b8-8ddc-613485a14637-prometheus-k8s-db\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:18:07.403279 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.403209    2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18223011-60f5-48b8-8ddc-613485a14637-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:18:07.448062 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.448035    2584 generic.go:356] "Generic (PLEG): container finished" podID="18223011-60f5-48b8-8ddc-613485a14637" containerID="db38846bb3a512672c8c63a3341fd82ea1c2c8e9d66b121052db605fb1fd51f0" exitCode=0
Sep 11 14:18:07.448136 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.448122    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.448207 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.448117    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18223011-60f5-48b8-8ddc-613485a14637","Type":"ContainerDied","Data":"db38846bb3a512672c8c63a3341fd82ea1c2c8e9d66b121052db605fb1fd51f0"}
Sep 11 14:18:07.448309 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.448295    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18223011-60f5-48b8-8ddc-613485a14637","Type":"ContainerDied","Data":"5e3bf9bc68c3ddbda1fde516fe58beeded66fb85fc5aee340861154b38823a80"}
Sep 11 14:18:07.448360 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.448349    2584 scope.go:117] "RemoveContainer" containerID="694165eedce956554cd9a62278a657453d8990716019613ed3aa949c268905c0"
Sep 11 14:18:07.455690 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.455664    2584 scope.go:117] "RemoveContainer" containerID="6271b102522ee29a5b3fd6dca841a16feb1cecac67d8e24b993c63b2cc232626"
Sep 11 14:18:07.463124 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.463095    2584 scope.go:117] "RemoveContainer" containerID="db38846bb3a512672c8c63a3341fd82ea1c2c8e9d66b121052db605fb1fd51f0"
Sep 11 14:18:07.469068 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.469054    2584 scope.go:117] "RemoveContainer" containerID="c7181470fafc26b134043cbeb963d355fbe40ed947f5ba55aee557dd69ceff59"
Sep 11 14:18:07.475586 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.475568    2584 scope.go:117] "RemoveContainer" containerID="db486c67fa862d7819155327bb331d3b24167e0d88924a5158a5c4b1eb328da2"
Sep 11 14:18:07.477306 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.477286    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 14:18:07.482165 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.482148    2584 scope.go:117] "RemoveContainer" containerID="3a4a34c5ff2b94a966671f22b04869311bddf6bf5de96127963b49d7e93b6d09"
Sep 11 14:18:07.483096 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.483062    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 14:18:07.488648 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.488632    2584 scope.go:117] "RemoveContainer" containerID="4a74fa7dbf424995b36262cf90204dc08e9abd671179ac0f7b69b6a6bea0bc6c"
Sep 11 14:18:07.494559 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.494541    2584 scope.go:117] "RemoveContainer" containerID="694165eedce956554cd9a62278a657453d8990716019613ed3aa949c268905c0"
Sep 11 14:18:07.494899 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:18:07.494879    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"694165eedce956554cd9a62278a657453d8990716019613ed3aa949c268905c0\": container with ID starting with 694165eedce956554cd9a62278a657453d8990716019613ed3aa949c268905c0 not found: ID does not exist" containerID="694165eedce956554cd9a62278a657453d8990716019613ed3aa949c268905c0"
Sep 11 14:18:07.494962 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.494907    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"694165eedce956554cd9a62278a657453d8990716019613ed3aa949c268905c0"} err="failed to get container status \"694165eedce956554cd9a62278a657453d8990716019613ed3aa949c268905c0\": rpc error: code = NotFound desc = could not find container \"694165eedce956554cd9a62278a657453d8990716019613ed3aa949c268905c0\": container with ID starting with 694165eedce956554cd9a62278a657453d8990716019613ed3aa949c268905c0 not found: ID does not exist"
Sep 11 14:18:07.494962 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.494934    2584 scope.go:117] "RemoveContainer" containerID="6271b102522ee29a5b3fd6dca841a16feb1cecac67d8e24b993c63b2cc232626"
Sep 11 14:18:07.495217 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:18:07.495200    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6271b102522ee29a5b3fd6dca841a16feb1cecac67d8e24b993c63b2cc232626\": container with ID starting with 6271b102522ee29a5b3fd6dca841a16feb1cecac67d8e24b993c63b2cc232626 not found: ID does not exist" containerID="6271b102522ee29a5b3fd6dca841a16feb1cecac67d8e24b993c63b2cc232626"
Sep 11 14:18:07.495264 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.495222    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6271b102522ee29a5b3fd6dca841a16feb1cecac67d8e24b993c63b2cc232626"} err="failed to get container status \"6271b102522ee29a5b3fd6dca841a16feb1cecac67d8e24b993c63b2cc232626\": rpc error: code = NotFound desc = could not find container \"6271b102522ee29a5b3fd6dca841a16feb1cecac67d8e24b993c63b2cc232626\": container with ID starting with 6271b102522ee29a5b3fd6dca841a16feb1cecac67d8e24b993c63b2cc232626 not found: ID does not exist"
Sep 11 14:18:07.495264 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.495236    2584 scope.go:117] "RemoveContainer" containerID="db38846bb3a512672c8c63a3341fd82ea1c2c8e9d66b121052db605fb1fd51f0"
Sep 11 14:18:07.495468 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:18:07.495452    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db38846bb3a512672c8c63a3341fd82ea1c2c8e9d66b121052db605fb1fd51f0\": container with ID starting with db38846bb3a512672c8c63a3341fd82ea1c2c8e9d66b121052db605fb1fd51f0 not found: ID does not exist" containerID="db38846bb3a512672c8c63a3341fd82ea1c2c8e9d66b121052db605fb1fd51f0"
Sep 11 14:18:07.495514 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.495473    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db38846bb3a512672c8c63a3341fd82ea1c2c8e9d66b121052db605fb1fd51f0"} err="failed to get container status \"db38846bb3a512672c8c63a3341fd82ea1c2c8e9d66b121052db605fb1fd51f0\": rpc error: code = NotFound desc = could not find container \"db38846bb3a512672c8c63a3341fd82ea1c2c8e9d66b121052db605fb1fd51f0\": container with ID starting with db38846bb3a512672c8c63a3341fd82ea1c2c8e9d66b121052db605fb1fd51f0 not found: ID does not exist"
Sep 11 14:18:07.495514 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.495486    2584 scope.go:117] "RemoveContainer" containerID="c7181470fafc26b134043cbeb963d355fbe40ed947f5ba55aee557dd69ceff59"
Sep 11 14:18:07.495744 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:18:07.495724    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7181470fafc26b134043cbeb963d355fbe40ed947f5ba55aee557dd69ceff59\": container with ID starting with c7181470fafc26b134043cbeb963d355fbe40ed947f5ba55aee557dd69ceff59 not found: ID does not exist" containerID="c7181470fafc26b134043cbeb963d355fbe40ed947f5ba55aee557dd69ceff59"
Sep 11 14:18:07.495799 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.495752    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7181470fafc26b134043cbeb963d355fbe40ed947f5ba55aee557dd69ceff59"} err="failed to get container status \"c7181470fafc26b134043cbeb963d355fbe40ed947f5ba55aee557dd69ceff59\": rpc error: code = NotFound desc = could not find container \"c7181470fafc26b134043cbeb963d355fbe40ed947f5ba55aee557dd69ceff59\": container with ID starting with c7181470fafc26b134043cbeb963d355fbe40ed947f5ba55aee557dd69ceff59 not found: ID does not exist"
Sep 11 14:18:07.495799 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.495771    2584 scope.go:117] "RemoveContainer" containerID="db486c67fa862d7819155327bb331d3b24167e0d88924a5158a5c4b1eb328da2"
Sep 11 14:18:07.496008 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:18:07.495992    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db486c67fa862d7819155327bb331d3b24167e0d88924a5158a5c4b1eb328da2\": container with ID starting with db486c67fa862d7819155327bb331d3b24167e0d88924a5158a5c4b1eb328da2 not found: ID does not exist" containerID="db486c67fa862d7819155327bb331d3b24167e0d88924a5158a5c4b1eb328da2"
Sep 11 14:18:07.496046 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.496012    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db486c67fa862d7819155327bb331d3b24167e0d88924a5158a5c4b1eb328da2"} err="failed to get container status \"db486c67fa862d7819155327bb331d3b24167e0d88924a5158a5c4b1eb328da2\": rpc error: code = NotFound desc = could not find container \"db486c67fa862d7819155327bb331d3b24167e0d88924a5158a5c4b1eb328da2\": container with ID starting with db486c67fa862d7819155327bb331d3b24167e0d88924a5158a5c4b1eb328da2 not found: ID does not exist"
Sep 11 14:18:07.496046 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.496025    2584 scope.go:117] "RemoveContainer" containerID="3a4a34c5ff2b94a966671f22b04869311bddf6bf5de96127963b49d7e93b6d09"
Sep 11 14:18:07.496250 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:18:07.496235    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a4a34c5ff2b94a966671f22b04869311bddf6bf5de96127963b49d7e93b6d09\": container with ID starting with 3a4a34c5ff2b94a966671f22b04869311bddf6bf5de96127963b49d7e93b6d09 not found: ID does not exist" containerID="3a4a34c5ff2b94a966671f22b04869311bddf6bf5de96127963b49d7e93b6d09"
Sep 11 14:18:07.496295 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.496253    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a4a34c5ff2b94a966671f22b04869311bddf6bf5de96127963b49d7e93b6d09"} err="failed to get container status \"3a4a34c5ff2b94a966671f22b04869311bddf6bf5de96127963b49d7e93b6d09\": rpc error: code = NotFound desc = could not find container \"3a4a34c5ff2b94a966671f22b04869311bddf6bf5de96127963b49d7e93b6d09\": container with ID starting with 3a4a34c5ff2b94a966671f22b04869311bddf6bf5de96127963b49d7e93b6d09 not found: ID does not exist"
Sep 11 14:18:07.496295 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.496265    2584 scope.go:117] "RemoveContainer" containerID="4a74fa7dbf424995b36262cf90204dc08e9abd671179ac0f7b69b6a6bea0bc6c"
Sep 11 14:18:07.496446 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:18:07.496432    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a74fa7dbf424995b36262cf90204dc08e9abd671179ac0f7b69b6a6bea0bc6c\": container with ID starting with 4a74fa7dbf424995b36262cf90204dc08e9abd671179ac0f7b69b6a6bea0bc6c not found: ID does not exist" containerID="4a74fa7dbf424995b36262cf90204dc08e9abd671179ac0f7b69b6a6bea0bc6c"
Sep 11 14:18:07.496483 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.496449    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a74fa7dbf424995b36262cf90204dc08e9abd671179ac0f7b69b6a6bea0bc6c"} err="failed to get container status \"4a74fa7dbf424995b36262cf90204dc08e9abd671179ac0f7b69b6a6bea0bc6c\": rpc error: code = NotFound desc = could not find container \"4a74fa7dbf424995b36262cf90204dc08e9abd671179ac0f7b69b6a6bea0bc6c\": container with ID starting with 4a74fa7dbf424995b36262cf90204dc08e9abd671179ac0f7b69b6a6bea0bc6c not found: ID does not exist"
Sep 11 14:18:07.512354 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.512332    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 14:18:07.512578 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.512567    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18223011-60f5-48b8-8ddc-613485a14637" containerName="prometheus"
Sep 11 14:18:07.512624 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.512580    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="18223011-60f5-48b8-8ddc-613485a14637" containerName="prometheus"
Sep 11 14:18:07.512624 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.512588    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18223011-60f5-48b8-8ddc-613485a14637" containerName="thanos-sidecar"
Sep 11 14:18:07.512624 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.512593    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="18223011-60f5-48b8-8ddc-613485a14637" containerName="thanos-sidecar"
Sep 11 14:18:07.512624 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.512601    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18223011-60f5-48b8-8ddc-613485a14637" containerName="kube-rbac-proxy-web"
Sep 11 14:18:07.512624 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.512607    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="18223011-60f5-48b8-8ddc-613485a14637" containerName="kube-rbac-proxy-web"
Sep 11 14:18:07.512624 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.512615    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18223011-60f5-48b8-8ddc-613485a14637" containerName="init-config-reloader"
Sep 11 14:18:07.512624 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.512620    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="18223011-60f5-48b8-8ddc-613485a14637" containerName="init-config-reloader"
Sep 11 14:18:07.512839 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.512630    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18223011-60f5-48b8-8ddc-613485a14637" containerName="config-reloader"
Sep 11 14:18:07.512839 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.512635    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="18223011-60f5-48b8-8ddc-613485a14637" containerName="config-reloader"
Sep 11 14:18:07.512839 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.512642    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18223011-60f5-48b8-8ddc-613485a14637" containerName="kube-rbac-proxy"
Sep 11 14:18:07.512839 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.512647    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="18223011-60f5-48b8-8ddc-613485a14637" containerName="kube-rbac-proxy"
Sep 11 14:18:07.512839 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.512658    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18223011-60f5-48b8-8ddc-613485a14637" containerName="kube-rbac-proxy-thanos"
Sep 11 14:18:07.512839 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.512663    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="18223011-60f5-48b8-8ddc-613485a14637" containerName="kube-rbac-proxy-thanos"
Sep 11 14:18:07.512839 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.512724    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="18223011-60f5-48b8-8ddc-613485a14637" containerName="thanos-sidecar"
Sep 11 14:18:07.512839 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.512731    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="18223011-60f5-48b8-8ddc-613485a14637" containerName="prometheus"
Sep 11 14:18:07.512839 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.512737    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="18223011-60f5-48b8-8ddc-613485a14637" containerName="kube-rbac-proxy-thanos"
Sep 11 14:18:07.512839 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.512744    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="18223011-60f5-48b8-8ddc-613485a14637" containerName="config-reloader"
Sep 11 14:18:07.512839 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.512749    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="18223011-60f5-48b8-8ddc-613485a14637" containerName="kube-rbac-proxy-web"
Sep 11 14:18:07.512839 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.512755    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="18223011-60f5-48b8-8ddc-613485a14637" containerName="kube-rbac-proxy"
Sep 11 14:18:07.517503 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.517488    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.519817 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.519799    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 11 14:18:07.520735 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.520720    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 11 14:18:07.520821 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.520758    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 11 14:18:07.522861 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.522663    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 11 14:18:07.522861 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.522701    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 11 14:18:07.522861 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.522722    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 11 14:18:07.522861 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.522730    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 11 14:18:07.522861 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.522704    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 11 14:18:07.523144 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.523066    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 11 14:18:07.523382 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.523355    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 11 14:18:07.523382 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.523370    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 11 14:18:07.523508 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.523418    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2sk0l3nlh59hp\""
Sep 11 14:18:07.523508 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.523418    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 11 14:18:07.523508 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.523479    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2tdg2\""
Sep 11 14:18:07.524023 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.524010    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 11 14:18:07.528094 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.528075    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 11 14:18:07.530982 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.530968    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 11 14:18:07.538671 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.538650    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 14:18:07.604962 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.604944    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4159f438-d8d3-4359-b22c-61104ca1d5ba-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.605041 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.604968    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4159f438-d8d3-4359-b22c-61104ca1d5ba-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.605041 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.604986    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4159f438-d8d3-4359-b22c-61104ca1d5ba-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.605041 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.605002    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4159f438-d8d3-4359-b22c-61104ca1d5ba-config-out\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.605133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.605045    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4159f438-d8d3-4359-b22c-61104ca1d5ba-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.605133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.605073    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4159f438-d8d3-4359-b22c-61104ca1d5ba-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.605195 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.605139    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4159f438-d8d3-4359-b22c-61104ca1d5ba-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.605195 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.605153    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4159f438-d8d3-4359-b22c-61104ca1d5ba-web-config\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.605195 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.605174    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-994gq\" (UniqueName: \"kubernetes.io/projected/4159f438-d8d3-4359-b22c-61104ca1d5ba-kube-api-access-994gq\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.605279 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.605211    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4159f438-d8d3-4359-b22c-61104ca1d5ba-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.605279 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.605236    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4159f438-d8d3-4359-b22c-61104ca1d5ba-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.605337 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.605282    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4159f438-d8d3-4359-b22c-61104ca1d5ba-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.605337 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.605304    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4159f438-d8d3-4359-b22c-61104ca1d5ba-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.605337 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.605321    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4159f438-d8d3-4359-b22c-61104ca1d5ba-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.605422 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.605344    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4159f438-d8d3-4359-b22c-61104ca1d5ba-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.605422 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.605375    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4159f438-d8d3-4359-b22c-61104ca1d5ba-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.605422 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.605400    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4159f438-d8d3-4359-b22c-61104ca1d5ba-config\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.605508 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.605420    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4159f438-d8d3-4359-b22c-61104ca1d5ba-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.605508 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.605450    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4159f438-d8d3-4359-b22c-61104ca1d5ba-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.605508 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.605468    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4159f438-d8d3-4359-b22c-61104ca1d5ba-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.678835 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.678771    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18223011-60f5-48b8-8ddc-613485a14637" path="/var/lib/kubelet/pods/18223011-60f5-48b8-8ddc-613485a14637/volumes"
Sep 11 14:18:07.706053 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.706032    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4159f438-d8d3-4359-b22c-61104ca1d5ba-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.706147 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.706061    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4159f438-d8d3-4359-b22c-61104ca1d5ba-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.706147 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.706087    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4159f438-d8d3-4359-b22c-61104ca1d5ba-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.706147 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.706111    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4159f438-d8d3-4359-b22c-61104ca1d5ba-config-out\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.706301 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.706220    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4159f438-d8d3-4359-b22c-61104ca1d5ba-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.706301 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.706245    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4159f438-d8d3-4359-b22c-61104ca1d5ba-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.706301 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.706287    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4159f438-d8d3-4359-b22c-61104ca1d5ba-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.706446 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.706396    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4159f438-d8d3-4359-b22c-61104ca1d5ba-web-config\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.706446 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.706428    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-994gq\" (UniqueName: \"kubernetes.io/projected/4159f438-d8d3-4359-b22c-61104ca1d5ba-kube-api-access-994gq\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.706553 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.706476    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4159f438-d8d3-4359-b22c-61104ca1d5ba-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.706553 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.706501    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4159f438-d8d3-4359-b22c-61104ca1d5ba-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.706553 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.706531    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4159f438-d8d3-4359-b22c-61104ca1d5ba-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.706713 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.706560    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4159f438-d8d3-4359-b22c-61104ca1d5ba-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.706713 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.706589    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4159f438-d8d3-4359-b22c-61104ca1d5ba-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.706713 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.706626    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4159f438-d8d3-4359-b22c-61104ca1d5ba-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.706713 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.706656    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4159f438-d8d3-4359-b22c-61104ca1d5ba-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.706894 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.706718    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4159f438-d8d3-4359-b22c-61104ca1d5ba-config\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.706894 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.706748    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4159f438-d8d3-4359-b22c-61104ca1d5ba-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.706894 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.706785    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4159f438-d8d3-4359-b22c-61104ca1d5ba-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.706894 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.706793    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4159f438-d8d3-4359-b22c-61104ca1d5ba-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.706894 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.706815    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4159f438-d8d3-4359-b22c-61104ca1d5ba-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.707594 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.707568    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4159f438-d8d3-4359-b22c-61104ca1d5ba-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.707863 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.706928    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4159f438-d8d3-4359-b22c-61104ca1d5ba-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.708956 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.708924    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4159f438-d8d3-4359-b22c-61104ca1d5ba-config-out\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.712807 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.709905    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 11 14:18:07.712807 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.710179    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 11 14:18:07.712807 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.710797    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 11 14:18:07.712807 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.711030    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 11 14:18:07.712807 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.711068    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 11 14:18:07.712807 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.711151    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 11 14:18:07.712807 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.711329    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4159f438-d8d3-4359-b22c-61104ca1d5ba-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.712807 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.712099    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 11 14:18:07.712807 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.712371    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 11 14:18:07.712807 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.712603    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 11 14:18:07.712807 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.712799    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 11 14:18:07.713219 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.712867    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 11 14:18:07.713219 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.712900    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 11 14:18:07.713219 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.712872    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2sk0l3nlh59hp\""
Sep 11 14:18:07.713219 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.712870    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 11 14:18:07.716931 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.716906    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4159f438-d8d3-4359-b22c-61104ca1d5ba-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.717266 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.717242    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4159f438-d8d3-4359-b22c-61104ca1d5ba-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.717656 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.717638    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4159f438-d8d3-4359-b22c-61104ca1d5ba-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.718479 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.718451    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4159f438-d8d3-4359-b22c-61104ca1d5ba-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.719235 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.719179    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4159f438-d8d3-4359-b22c-61104ca1d5ba-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.719495 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.719470    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4159f438-d8d3-4359-b22c-61104ca1d5ba-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.720103 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.719663    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4159f438-d8d3-4359-b22c-61104ca1d5ba-web-config\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.720103 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.719863    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4159f438-d8d3-4359-b22c-61104ca1d5ba-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.720103 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.720064    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4159f438-d8d3-4359-b22c-61104ca1d5ba-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.720837 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.720812    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4159f438-d8d3-4359-b22c-61104ca1d5ba-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.720928 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.720859    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4159f438-d8d3-4359-b22c-61104ca1d5ba-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.720995 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.720969    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4159f438-d8d3-4359-b22c-61104ca1d5ba-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.721049 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.721022    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4159f438-d8d3-4359-b22c-61104ca1d5ba-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.721184 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.721167    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4159f438-d8d3-4359-b22c-61104ca1d5ba-config\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.722590 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.722574    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-994gq\" (UniqueName: \"kubernetes.io/projected/4159f438-d8d3-4359-b22c-61104ca1d5ba-kube-api-access-994gq\") pod \"prometheus-k8s-0\" (UID: \"4159f438-d8d3-4359-b22c-61104ca1d5ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:07.830002 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.829979    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2tdg2\""
Sep 11 14:18:07.837601 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:07.837586    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:08.136995 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:08.136968    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 14:18:08.137720 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:18:08.137697    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4159f438_d8d3_4359_b22c_61104ca1d5ba.slice/crio-8cafa761b9504f569ca30f289b966d1f3c00326cb905cb7dfcba79bb39543f2a WatchSource:0}: Error finding container 8cafa761b9504f569ca30f289b966d1f3c00326cb905cb7dfcba79bb39543f2a: Status 404 returned error can't find the container with id 8cafa761b9504f569ca30f289b966d1f3c00326cb905cb7dfcba79bb39543f2a
Sep 11 14:18:08.454351 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:08.454282    2584 generic.go:356] "Generic (PLEG): container finished" podID="4159f438-d8d3-4359-b22c-61104ca1d5ba" containerID="9ee9af4caf6082555b298a0fb4054d4ee3a2ae6b55eaf2fce6aacf7cbdd0eec5" exitCode=0
Sep 11 14:18:08.454351 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:08.454343    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4159f438-d8d3-4359-b22c-61104ca1d5ba","Type":"ContainerDied","Data":"9ee9af4caf6082555b298a0fb4054d4ee3a2ae6b55eaf2fce6aacf7cbdd0eec5"}
Sep 11 14:18:08.454820 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:08.454397    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4159f438-d8d3-4359-b22c-61104ca1d5ba","Type":"ContainerStarted","Data":"8cafa761b9504f569ca30f289b966d1f3c00326cb905cb7dfcba79bb39543f2a"}
Sep 11 14:18:09.462495 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:09.462435    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4159f438-d8d3-4359-b22c-61104ca1d5ba","Type":"ContainerStarted","Data":"55c3357beff6b3f549ffcd0eff5867ffa3079108ef28be00437d720c84701eb5"}
Sep 11 14:18:09.462898 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:09.462496    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4159f438-d8d3-4359-b22c-61104ca1d5ba","Type":"ContainerStarted","Data":"ec11497c457cde7cbaa61903b61efbeef03d9efcfb3e02e346e03ecaf54eb3f0"}
Sep 11 14:18:09.462898 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:09.462522    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4159f438-d8d3-4359-b22c-61104ca1d5ba","Type":"ContainerStarted","Data":"b187fd16c746e02f7ca8c0314e13ce65fae8d860c276f8c74a80bf32fb820bf6"}
Sep 11 14:18:09.462898 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:09.462547    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4159f438-d8d3-4359-b22c-61104ca1d5ba","Type":"ContainerStarted","Data":"67f36601a8e8390ea10ba9e42b61343fc36c80f6e008ca85439b58069d948d8f"}
Sep 11 14:18:09.462898 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:09.462571    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4159f438-d8d3-4359-b22c-61104ca1d5ba","Type":"ContainerStarted","Data":"4011863ce79f9ae1c6820de8c0049d7b858863088ce48bdf6615f201eecf57ac"}
Sep 11 14:18:09.462898 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:09.462598    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4159f438-d8d3-4359-b22c-61104ca1d5ba","Type":"ContainerStarted","Data":"6ec3f77e45f5e54efc70d7d05a7cd5b5ad454c06980bf34e442226e982b44f91"}
Sep 11 14:18:09.528928 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:09.528881    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.51124245 podStartE2EDuration="2.528835258s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.592808ms" isStatefulPod=false podCreationTimestamp="2026-09-11 14:18:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:18:09.528529205 +0000 UTC m=+182.327163999" watchObservedRunningTime="2026-09-11 14:18:09.528835258 +0000 UTC m=+182.327470093"
Sep 11 14:18:09.995207 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:09.995169    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:18:10.054356 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:10.054323    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:18:12.019664 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:12.019628    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:18:12.117632 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:12.117595    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:18:12.196786 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:12.196766    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:18:12.838755 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:12.838733    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:18:24.269378 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:24.269339    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:18:24.396111 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:24.396076    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:18:24.470789 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:24.470754    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:18:50.334673 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:50.334632    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:18:50.438031 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:18:50.438000    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:19:07.462343 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:19:07.462281    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:19:07.540276 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:19:07.540242    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:19:07.838032 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:19:07.837998    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:19:07.853134 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:19:07.853113    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:19:08.690362 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:19:08.690336    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 14:19:17.350904 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:19:17.350870    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:19:18.362095 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:19:18.362053    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:19:22.595018 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:19:22.594979    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:19:22.729400 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:19:22.729356    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:19:25.958979 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:19:25.958945    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:19:26.132085 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:19:26.132045    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:19:26.329924 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:19:26.329888    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:19:27.605418 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:19:27.605385    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:19:28.466085 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:19:28.466049    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:19:29.599748 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:19:29.599715    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:19:29.721748 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:19:29.721713    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:19:34.831479 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:19:34.831438    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:19:36.959991 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:19:36.959953    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:19:38.627822 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:19:38.627787    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:19:38.788119 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:19:38.788083    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:19:44.948808 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:19:44.948768    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:19:45.051170 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:19:45.051138    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:19:47.326520 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:19:47.326490    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:19:47.470176 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:19:47.470134    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:19:55.022489 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:19:55.022450    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:19:55.123318 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:19:55.123282    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:19:59.780588 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:19:59.780544    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:00.318670 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:00.318632    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:00.518123 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:00.518089    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:01.467811 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:01.467772    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:01.729331 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:01.729242    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:01.875340 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:01.875307    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs"]
Sep 11 14:20:01.878437 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:01.878421    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs"
Sep 11 14:20:01.881999 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:01.881973    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 14:20:01.885374 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:01.885352    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 14:20:01.885490 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:01.885358    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rpcgr\""
Sep 11 14:20:01.885490 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:01.885404    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 14:20:01.888968 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:01.888952    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 14:20:01.933086 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:01.933053    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs"]
Sep 11 14:20:02.003431 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:02.003342    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/025f6490-ce00-4263-8836-6782fbe82a49-tmp\") pod \"opendatahub-operator-controller-manager-74798b5f56-p4zrs\" (UID: \"025f6490-ce00-4263-8836-6782fbe82a49\") " pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs"
Sep 11 14:20:02.003431 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:02.003398    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/025f6490-ce00-4263-8836-6782fbe82a49-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74798b5f56-p4zrs\" (UID: \"025f6490-ce00-4263-8836-6782fbe82a49\") " pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs"
Sep 11 14:20:02.003644 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:02.003453    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmpsw\" (UniqueName: \"kubernetes.io/projected/025f6490-ce00-4263-8836-6782fbe82a49-kube-api-access-rmpsw\") pod \"opendatahub-operator-controller-manager-74798b5f56-p4zrs\" (UID: \"025f6490-ce00-4263-8836-6782fbe82a49\") " pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs"
Sep 11 14:20:02.003644 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:02.003497    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/025f6490-ce00-4263-8836-6782fbe82a49-manifests\") pod \"opendatahub-operator-controller-manager-74798b5f56-p4zrs\" (UID: \"025f6490-ce00-4263-8836-6782fbe82a49\") " pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs"
Sep 11 14:20:02.003644 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:02.003514    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/025f6490-ce00-4263-8836-6782fbe82a49-webhook-cert\") pod \"opendatahub-operator-controller-manager-74798b5f56-p4zrs\" (UID: \"025f6490-ce00-4263-8836-6782fbe82a49\") " pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs"
Sep 11 14:20:02.104848 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:02.104797    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/025f6490-ce00-4263-8836-6782fbe82a49-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74798b5f56-p4zrs\" (UID: \"025f6490-ce00-4263-8836-6782fbe82a49\") " pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs"
Sep 11 14:20:02.105043 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:02.104872    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmpsw\" (UniqueName: \"kubernetes.io/projected/025f6490-ce00-4263-8836-6782fbe82a49-kube-api-access-rmpsw\") pod \"opendatahub-operator-controller-manager-74798b5f56-p4zrs\" (UID: \"025f6490-ce00-4263-8836-6782fbe82a49\") " pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs"
Sep 11 14:20:02.105043 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:02.104921    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/025f6490-ce00-4263-8836-6782fbe82a49-manifests\") pod \"opendatahub-operator-controller-manager-74798b5f56-p4zrs\" (UID: \"025f6490-ce00-4263-8836-6782fbe82a49\") " pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs"
Sep 11 14:20:02.105043 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:02.104944    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/025f6490-ce00-4263-8836-6782fbe82a49-webhook-cert\") pod \"opendatahub-operator-controller-manager-74798b5f56-p4zrs\" (UID: \"025f6490-ce00-4263-8836-6782fbe82a49\") " pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs"
Sep 11 14:20:02.105043 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:02.105026    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/025f6490-ce00-4263-8836-6782fbe82a49-tmp\") pod \"opendatahub-operator-controller-manager-74798b5f56-p4zrs\" (UID: \"025f6490-ce00-4263-8836-6782fbe82a49\") " pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs"
Sep 11 14:20:02.105365 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:02.105339    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/025f6490-ce00-4263-8836-6782fbe82a49-manifests\") pod \"opendatahub-operator-controller-manager-74798b5f56-p4zrs\" (UID: \"025f6490-ce00-4263-8836-6782fbe82a49\") " pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs"
Sep 11 14:20:02.107162 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:02.107142    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/025f6490-ce00-4263-8836-6782fbe82a49-tmp\") pod \"opendatahub-operator-controller-manager-74798b5f56-p4zrs\" (UID: \"025f6490-ce00-4263-8836-6782fbe82a49\") " pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs"
Sep 11 14:20:02.107294 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:02.107276    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/025f6490-ce00-4263-8836-6782fbe82a49-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74798b5f56-p4zrs\" (UID: \"025f6490-ce00-4263-8836-6782fbe82a49\") " pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs"
Sep 11 14:20:02.107401 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:02.107381    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/025f6490-ce00-4263-8836-6782fbe82a49-webhook-cert\") pod \"opendatahub-operator-controller-manager-74798b5f56-p4zrs\" (UID: \"025f6490-ce00-4263-8836-6782fbe82a49\") " pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs"
Sep 11 14:20:02.125582 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:02.125548    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmpsw\" (UniqueName: \"kubernetes.io/projected/025f6490-ce00-4263-8836-6782fbe82a49-kube-api-access-rmpsw\") pod \"opendatahub-operator-controller-manager-74798b5f56-p4zrs\" (UID: \"025f6490-ce00-4263-8836-6782fbe82a49\") " pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs"
Sep 11 14:20:02.188323 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:02.188277    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs"
Sep 11 14:20:02.368800 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:02.368758    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:02.487438 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:02.487404    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs"]
Sep 11 14:20:02.490909 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:20:02.490886    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod025f6490_ce00_4263_8836_6782fbe82a49.slice/crio-d29535c1f64c71452e2747f5b98c018c3d5101229f5da8d87ced706619dc95fb WatchSource:0}: Error finding container d29535c1f64c71452e2747f5b98c018c3d5101229f5da8d87ced706619dc95fb: Status 404 returned error can't find the container with id d29535c1f64c71452e2747f5b98c018c3d5101229f5da8d87ced706619dc95fb
Sep 11 14:20:02.584705 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:02.582487    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:02.753360 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:02.753268    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:02.880250 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:02.880214    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs" event={"ID":"025f6490-ce00-4263-8836-6782fbe82a49","Type":"ContainerStarted","Data":"d29535c1f64c71452e2747f5b98c018c3d5101229f5da8d87ced706619dc95fb"}
Sep 11 14:20:03.070368 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:03.070326    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:03.287250 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:03.287210    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:05.856141 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:05.856100    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:05.895670 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:05.895632    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs" event={"ID":"025f6490-ce00-4263-8836-6782fbe82a49","Type":"ContainerStarted","Data":"b72d6f6e1da5d289299f9ec550e380ec4dfd6bbe7243e00301c364711d7a08b4"}
Sep 11 14:20:05.980553 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:05.980507    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:06.900801 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:06.900709    2584 generic.go:356] "Generic (PLEG): container finished" podID="025f6490-ce00-4263-8836-6782fbe82a49" containerID="b72d6f6e1da5d289299f9ec550e380ec4dfd6bbe7243e00301c364711d7a08b4" exitCode=0
Sep 11 14:20:06.900801 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:06.900749    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs" event={"ID":"025f6490-ce00-4263-8836-6782fbe82a49","Type":"ContainerDied","Data":"b72d6f6e1da5d289299f9ec550e380ec4dfd6bbe7243e00301c364711d7a08b4"}
Sep 11 14:20:07.575022 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:07.574996    2584 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 14:20:07.906877 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:07.906794    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs" event={"ID":"025f6490-ce00-4263-8836-6782fbe82a49","Type":"ContainerStarted","Data":"927a84e2655b1e0cc39e3064086250b2e5e7b09e5258c1264cebf99f285a8746"}
Sep 11 14:20:07.909114 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:07.906925    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs"
Sep 11 14:20:08.084983 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:08.084929    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs" podStartSLOduration=2.669129293 podStartE2EDuration="7.08491052s" totalImagesPullingTime="3.369622089s" totalInitContainerRuntime="1.046159138s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:20:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:20:08.069949816 +0000 UTC m=+300.868584598" watchObservedRunningTime="2026-09-11 14:20:08.08491052 +0000 UTC m=+300.883545302"
Sep 11 14:20:13.029072 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:13.029036    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:13.148255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:13.148211    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:18.912968 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:18.912930    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs"
Sep 11 14:20:22.176652 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:22.176603    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:22.321373 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:22.321328    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:28.215567 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:28.215517    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:29.487084 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:29.487049    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:29.987023 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:29.986987    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:30.181868 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:30.181823    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:30.355809 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:30.355772    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:31.971696 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:31.971639    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:33.361225 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:33.361185    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:33.510853 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:33.510821    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:33.610882 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:33.610844    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:34.097799 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:34.097765    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:34.238853 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:34.238807    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:35.641023 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:35.640989    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:35.750114 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:35.750073    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:35.933530 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:35.933448    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:36.172084 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:36.172034    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:36.313197 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:36.313162    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:39.757577 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:39.757540    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c4cd778db-4k9k6"]
Sep 11 14:20:39.764056 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:39.764026    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c4cd778db-4k9k6"
Sep 11 14:20:39.771046 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:39.771005    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 11 14:20:39.771506 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:39.771485    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 11 14:20:39.771923 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:39.771900    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-cxdzr\""
Sep 11 14:20:39.772041 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:39.771951    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 11 14:20:39.772041 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:39.771951    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 11 14:20:39.772041 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:39.772012    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 11 14:20:39.776758 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:39.776737    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c4cd778db-4k9k6"]
Sep 11 14:20:39.906914 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:39.906877    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5e0cd52e-f9a2-4ed1-b209-2fe6a702dcfe-manager-config\") pod \"lws-controller-manager-7c4cd778db-4k9k6\" (UID: \"5e0cd52e-f9a2-4ed1-b209-2fe6a702dcfe\") " pod="openshift-lws-operator/lws-controller-manager-7c4cd778db-4k9k6"
Sep 11 14:20:39.906914 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:39.906927    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5d5f\" (UniqueName: \"kubernetes.io/projected/5e0cd52e-f9a2-4ed1-b209-2fe6a702dcfe-kube-api-access-v5d5f\") pod \"lws-controller-manager-7c4cd778db-4k9k6\" (UID: \"5e0cd52e-f9a2-4ed1-b209-2fe6a702dcfe\") " pod="openshift-lws-operator/lws-controller-manager-7c4cd778db-4k9k6"
Sep 11 14:20:39.907174 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:39.907018    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e0cd52e-f9a2-4ed1-b209-2fe6a702dcfe-cert\") pod \"lws-controller-manager-7c4cd778db-4k9k6\" (UID: \"5e0cd52e-f9a2-4ed1-b209-2fe6a702dcfe\") " pod="openshift-lws-operator/lws-controller-manager-7c4cd778db-4k9k6"
Sep 11 14:20:39.907174 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:39.907049    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e0cd52e-f9a2-4ed1-b209-2fe6a702dcfe-metrics-cert\") pod \"lws-controller-manager-7c4cd778db-4k9k6\" (UID: \"5e0cd52e-f9a2-4ed1-b209-2fe6a702dcfe\") " pod="openshift-lws-operator/lws-controller-manager-7c4cd778db-4k9k6"
Sep 11 14:20:40.007794 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:40.007692    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e0cd52e-f9a2-4ed1-b209-2fe6a702dcfe-cert\") pod \"lws-controller-manager-7c4cd778db-4k9k6\" (UID: \"5e0cd52e-f9a2-4ed1-b209-2fe6a702dcfe\") " pod="openshift-lws-operator/lws-controller-manager-7c4cd778db-4k9k6"
Sep 11 14:20:40.007794 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:40.007741    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e0cd52e-f9a2-4ed1-b209-2fe6a702dcfe-metrics-cert\") pod \"lws-controller-manager-7c4cd778db-4k9k6\" (UID: \"5e0cd52e-f9a2-4ed1-b209-2fe6a702dcfe\") " pod="openshift-lws-operator/lws-controller-manager-7c4cd778db-4k9k6"
Sep 11 14:20:40.008025 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:40.007870    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5e0cd52e-f9a2-4ed1-b209-2fe6a702dcfe-manager-config\") pod \"lws-controller-manager-7c4cd778db-4k9k6\" (UID: \"5e0cd52e-f9a2-4ed1-b209-2fe6a702dcfe\") " pod="openshift-lws-operator/lws-controller-manager-7c4cd778db-4k9k6"
Sep 11 14:20:40.008025 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:40.007910    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5d5f\" (UniqueName: \"kubernetes.io/projected/5e0cd52e-f9a2-4ed1-b209-2fe6a702dcfe-kube-api-access-v5d5f\") pod \"lws-controller-manager-7c4cd778db-4k9k6\" (UID: \"5e0cd52e-f9a2-4ed1-b209-2fe6a702dcfe\") " pod="openshift-lws-operator/lws-controller-manager-7c4cd778db-4k9k6"
Sep 11 14:20:40.008528 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:40.008504    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5e0cd52e-f9a2-4ed1-b209-2fe6a702dcfe-manager-config\") pod \"lws-controller-manager-7c4cd778db-4k9k6\" (UID: \"5e0cd52e-f9a2-4ed1-b209-2fe6a702dcfe\") " pod="openshift-lws-operator/lws-controller-manager-7c4cd778db-4k9k6"
Sep 11 14:20:40.010153 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:40.010125    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e0cd52e-f9a2-4ed1-b209-2fe6a702dcfe-cert\") pod \"lws-controller-manager-7c4cd778db-4k9k6\" (UID: \"5e0cd52e-f9a2-4ed1-b209-2fe6a702dcfe\") " pod="openshift-lws-operator/lws-controller-manager-7c4cd778db-4k9k6"
Sep 11 14:20:40.010248 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:40.010161    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e0cd52e-f9a2-4ed1-b209-2fe6a702dcfe-metrics-cert\") pod \"lws-controller-manager-7c4cd778db-4k9k6\" (UID: \"5e0cd52e-f9a2-4ed1-b209-2fe6a702dcfe\") " pod="openshift-lws-operator/lws-controller-manager-7c4cd778db-4k9k6"
Sep 11 14:20:40.017123 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:40.017104    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5d5f\" (UniqueName: \"kubernetes.io/projected/5e0cd52e-f9a2-4ed1-b209-2fe6a702dcfe-kube-api-access-v5d5f\") pod \"lws-controller-manager-7c4cd778db-4k9k6\" (UID: \"5e0cd52e-f9a2-4ed1-b209-2fe6a702dcfe\") " pod="openshift-lws-operator/lws-controller-manager-7c4cd778db-4k9k6"
Sep 11 14:20:40.074147 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:40.074102    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c4cd778db-4k9k6"
Sep 11 14:20:40.367442 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:40.367364    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c4cd778db-4k9k6"]
Sep 11 14:20:40.374991 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:40.374968    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 14:20:41.042125 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:41.042048    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c4cd778db-4k9k6" event={"ID":"5e0cd52e-f9a2-4ed1-b209-2fe6a702dcfe","Type":"ContainerStarted","Data":"027c6ee1c838e501358775c665b09616ec4f10d290ac47286c5c49aa63561fa6"}
Sep 11 14:20:43.052469 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:43.052435    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c4cd778db-4k9k6" event={"ID":"5e0cd52e-f9a2-4ed1-b209-2fe6a702dcfe","Type":"ContainerStarted","Data":"9c9ac8152f759f23191e69a3785a17f01e569ddc6d2dbf6ae4816e1a092e5ec2"}
Sep 11 14:20:43.052842 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:43.052549    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7c4cd778db-4k9k6"
Sep 11 14:20:43.202903 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:43.202844    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7c4cd778db-4k9k6" podStartSLOduration=1.9268484529999999 podStartE2EDuration="4.202827544s" totalImagesPullingTime="2.275979091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:20:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:20:43.193985978 +0000 UTC m=+335.992620760" watchObservedRunningTime="2026-09-11 14:20:43.202827544 +0000 UTC m=+336.001462387"
Sep 11 14:20:46.583552 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:46.583514    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:46.684021 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:46.683987    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6gwgr"]
Sep 11 14:20:46.687029 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:46.687013    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6gwgr"
Sep 11 14:20:46.695204 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:46.695181    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-cxgtx\""
Sep 11 14:20:46.695290 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:46.695265    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 11 14:20:46.704272 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:46.704248    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-f656b"]
Sep 11 14:20:46.707646 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:46.707628    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f656b"
Sep 11 14:20:46.713692 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:46.713658    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-sfzxv\""
Sep 11 14:20:46.713831 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:46.713813    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 11 14:20:46.726341 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:46.726317    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6gwgr"]
Sep 11 14:20:46.761068 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:46.761039    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-f656b"]
Sep 11 14:20:46.766464 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:46.766436    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2eca4de8-e58d-466e-a0d2-f2c615190b65-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-f656b\" (UID: \"2eca4de8-e58d-466e-a0d2-f2c615190b65\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f656b"
Sep 11 14:20:46.766597 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:46.766476    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8swz\" (UniqueName: \"kubernetes.io/projected/2eca4de8-e58d-466e-a0d2-f2c615190b65-kube-api-access-h8swz\") pod \"llmisvc-controller-manager-777c6bd7d5-f656b\" (UID: \"2eca4de8-e58d-466e-a0d2-f2c615190b65\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f656b"
Sep 11 14:20:46.766597 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:46.766507    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qpmf\" (UniqueName: \"kubernetes.io/projected/506192d2-fbe0-4023-8fd0-393328fb95d4-kube-api-access-8qpmf\") pod \"kserve-controller-manager-d6f4b65b8-6gwgr\" (UID: \"506192d2-fbe0-4023-8fd0-393328fb95d4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6gwgr"
Sep 11 14:20:46.766699 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:46.766616    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/506192d2-fbe0-4023-8fd0-393328fb95d4-cert\") pod \"kserve-controller-manager-d6f4b65b8-6gwgr\" (UID: \"506192d2-fbe0-4023-8fd0-393328fb95d4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6gwgr"
Sep 11 14:20:46.789283 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:46.789250    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:46.868162 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:46.868081    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/506192d2-fbe0-4023-8fd0-393328fb95d4-cert\") pod \"kserve-controller-manager-d6f4b65b8-6gwgr\" (UID: \"506192d2-fbe0-4023-8fd0-393328fb95d4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6gwgr"
Sep 11 14:20:46.868162 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:46.868148    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2eca4de8-e58d-466e-a0d2-f2c615190b65-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-f656b\" (UID: \"2eca4de8-e58d-466e-a0d2-f2c615190b65\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f656b"
Sep 11 14:20:46.868362 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:46.868169    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8swz\" (UniqueName: \"kubernetes.io/projected/2eca4de8-e58d-466e-a0d2-f2c615190b65-kube-api-access-h8swz\") pod \"llmisvc-controller-manager-777c6bd7d5-f656b\" (UID: \"2eca4de8-e58d-466e-a0d2-f2c615190b65\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f656b"
Sep 11 14:20:46.868362 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:46.868187    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qpmf\" (UniqueName: \"kubernetes.io/projected/506192d2-fbe0-4023-8fd0-393328fb95d4-kube-api-access-8qpmf\") pod \"kserve-controller-manager-d6f4b65b8-6gwgr\" (UID: \"506192d2-fbe0-4023-8fd0-393328fb95d4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6gwgr"
Sep 11 14:20:46.868362 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:20:46.868223    2584 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 11 14:20:46.868362 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:20:46.868290    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/506192d2-fbe0-4023-8fd0-393328fb95d4-cert podName:506192d2-fbe0-4023-8fd0-393328fb95d4 nodeName:}" failed. No retries permitted until 2026-09-11 14:20:47.368271792 +0000 UTC m=+340.166906552 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/506192d2-fbe0-4023-8fd0-393328fb95d4-cert") pod "kserve-controller-manager-d6f4b65b8-6gwgr" (UID: "506192d2-fbe0-4023-8fd0-393328fb95d4") : secret "kserve-webhook-server-cert" not found
Sep 11 14:20:46.868362 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:20:46.868290    2584 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 11 14:20:46.868362 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:20:46.868339    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eca4de8-e58d-466e-a0d2-f2c615190b65-cert podName:2eca4de8-e58d-466e-a0d2-f2c615190b65 nodeName:}" failed. No retries permitted until 2026-09-11 14:20:47.368326802 +0000 UTC m=+340.166961566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2eca4de8-e58d-466e-a0d2-f2c615190b65-cert") pod "llmisvc-controller-manager-777c6bd7d5-f656b" (UID: "2eca4de8-e58d-466e-a0d2-f2c615190b65") : secret "llmisvc-webhook-server-cert" not found
Sep 11 14:20:46.888298 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:46.888265    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qpmf\" (UniqueName: \"kubernetes.io/projected/506192d2-fbe0-4023-8fd0-393328fb95d4-kube-api-access-8qpmf\") pod \"kserve-controller-manager-d6f4b65b8-6gwgr\" (UID: \"506192d2-fbe0-4023-8fd0-393328fb95d4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6gwgr"
Sep 11 14:20:46.899252 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:46.899218    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8swz\" (UniqueName: \"kubernetes.io/projected/2eca4de8-e58d-466e-a0d2-f2c615190b65-kube-api-access-h8swz\") pod \"llmisvc-controller-manager-777c6bd7d5-f656b\" (UID: \"2eca4de8-e58d-466e-a0d2-f2c615190b65\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f656b"
Sep 11 14:20:47.028554 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:47.028523    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:47.186056 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:47.185971    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:47.373878 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:47.373832    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2eca4de8-e58d-466e-a0d2-f2c615190b65-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-f656b\" (UID: \"2eca4de8-e58d-466e-a0d2-f2c615190b65\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f656b"
Sep 11 14:20:47.374046 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:47.373914    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/506192d2-fbe0-4023-8fd0-393328fb95d4-cert\") pod \"kserve-controller-manager-d6f4b65b8-6gwgr\" (UID: \"506192d2-fbe0-4023-8fd0-393328fb95d4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6gwgr"
Sep 11 14:20:47.376359 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:47.376328    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/506192d2-fbe0-4023-8fd0-393328fb95d4-cert\") pod \"kserve-controller-manager-d6f4b65b8-6gwgr\" (UID: \"506192d2-fbe0-4023-8fd0-393328fb95d4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6gwgr"
Sep 11 14:20:47.376469 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:47.376328    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2eca4de8-e58d-466e-a0d2-f2c615190b65-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-f656b\" (UID: \"2eca4de8-e58d-466e-a0d2-f2c615190b65\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f656b"
Sep 11 14:20:47.597113 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:47.597070    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6gwgr"
Sep 11 14:20:47.616570 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:47.616539    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f656b"
Sep 11 14:20:47.891386 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:47.891306    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6gwgr"]
Sep 11 14:20:47.903252 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:20:47.903224    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod506192d2_fbe0_4023_8fd0_393328fb95d4.slice/crio-5209c42838eeb500ebd057b05ea5fd5553e12652e98cf5c883fe7b5ba658db2c WatchSource:0}: Error finding container 5209c42838eeb500ebd057b05ea5fd5553e12652e98cf5c883fe7b5ba658db2c: Status 404 returned error can't find the container with id 5209c42838eeb500ebd057b05ea5fd5553e12652e98cf5c883fe7b5ba658db2c
Sep 11 14:20:47.915668 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:47.915636    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-f656b"]
Sep 11 14:20:47.919384 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:20:47.919352    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2eca4de8_e58d_466e_a0d2_f2c615190b65.slice/crio-b26f4247b7fc5e1c5803639c3d78dbeb2ec0314e3be2c6947bb39d0dc479f43a WatchSource:0}: Error finding container b26f4247b7fc5e1c5803639c3d78dbeb2ec0314e3be2c6947bb39d0dc479f43a: Status 404 returned error can't find the container with id b26f4247b7fc5e1c5803639c3d78dbeb2ec0314e3be2c6947bb39d0dc479f43a
Sep 11 14:20:48.074178 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:48.074140    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f656b" event={"ID":"2eca4de8-e58d-466e-a0d2-f2c615190b65","Type":"ContainerStarted","Data":"b26f4247b7fc5e1c5803639c3d78dbeb2ec0314e3be2c6947bb39d0dc479f43a"}
Sep 11 14:20:48.075389 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:48.075362    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6gwgr" event={"ID":"506192d2-fbe0-4023-8fd0-393328fb95d4","Type":"ContainerStarted","Data":"5209c42838eeb500ebd057b05ea5fd5553e12652e98cf5c883fe7b5ba658db2c"}
Sep 11 14:20:50.163169 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:50.163129    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:50.308293 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:50.308245    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:50.417250 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:50.417166    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:20:52.097613 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:52.097568    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6gwgr" event={"ID":"506192d2-fbe0-4023-8fd0-393328fb95d4","Type":"ContainerStarted","Data":"9eaa22a95b1d05d7f9ad53128aa520132e0442eb03930c574ed4f4a8d56452b2"}
Sep 11 14:20:52.098094 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:52.097638    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6gwgr"
Sep 11 14:20:52.099126 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:52.099101    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f656b" event={"ID":"2eca4de8-e58d-466e-a0d2-f2c615190b65","Type":"ContainerStarted","Data":"fc280a57ac9f4478980adbd46a2e01f55b977f5fa60c1fb1202bca93987d7cb1"}
Sep 11 14:20:52.099238 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:52.099148    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f656b"
Sep 11 14:20:52.147165 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:52.147103    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6gwgr" podStartSLOduration=2.756403159 podStartE2EDuration="6.147080709s" totalImagesPullingTime="3.39067755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:20:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:20:52.145013912 +0000 UTC m=+344.943648704" watchObservedRunningTime="2026-09-11 14:20:52.147080709 +0000 UTC m=+344.945715494"
Sep 11 14:20:54.058817 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:54.058788    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7c4cd778db-4k9k6"
Sep 11 14:20:54.104841 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:20:54.104793    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f656b" podStartSLOduration=4.730118192 podStartE2EDuration="8.104775213s" totalImagesPullingTime="3.374657021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:20:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:20:52.220731445 +0000 UTC m=+345.019366228" watchObservedRunningTime="2026-09-11 14:20:54.104775213 +0000 UTC m=+346.903409994"
Sep 11 14:21:23.105751 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:21:23.105644    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f656b"
Sep 11 14:21:23.108621 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:21:23.108598    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6gwgr"
Sep 11 14:21:30.872856 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:21:30.872818    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:21:34.272627 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:21:34.272571    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:21:34.399340 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:21:34.399305    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:21:37.176602 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:21:37.176569    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:21:37.273359 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:21:37.273323    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:21:54.475850 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:21:54.475813    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:21:57.323497 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:21:57.323460    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:21:58.646583 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:21:58.646548    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxc6b"]
Sep 11 14:21:58.648907 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:21:58.648891    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxc6b"
Sep 11 14:21:58.654733 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:21:58.654707    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 11 14:21:58.655553 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:21:58.655530    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 14:21:58.655648 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:21:58.655533    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 14:21:58.655648 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:21:58.655570    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-zvdgr\""
Sep 11 14:21:58.672855 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:21:58.672826    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxc6b"]
Sep 11 14:21:58.738373 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:21:58.738338    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8kmb\" (UniqueName: \"kubernetes.io/projected/99eaa447-82dd-41b3-ac95-e2faf55d52a2-kube-api-access-r8kmb\") pod \"dns-operator-controller-manager-7b84cd7c9c-kxc6b\" (UID: \"99eaa447-82dd-41b3-ac95-e2faf55d52a2\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxc6b"
Sep 11 14:21:58.839365 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:21:58.839334    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8kmb\" (UniqueName: \"kubernetes.io/projected/99eaa447-82dd-41b3-ac95-e2faf55d52a2-kube-api-access-r8kmb\") pod \"dns-operator-controller-manager-7b84cd7c9c-kxc6b\" (UID: \"99eaa447-82dd-41b3-ac95-e2faf55d52a2\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxc6b"
Sep 11 14:21:58.854776 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:21:58.854744    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8kmb\" (UniqueName: \"kubernetes.io/projected/99eaa447-82dd-41b3-ac95-e2faf55d52a2-kube-api-access-r8kmb\") pod \"dns-operator-controller-manager-7b84cd7c9c-kxc6b\" (UID: \"99eaa447-82dd-41b3-ac95-e2faf55d52a2\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxc6b"
Sep 11 14:21:58.877149 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:21:58.877115    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:21:58.959135 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:21:58.959065    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxc6b"
Sep 11 14:21:59.241659 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:21:59.241632    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxc6b"]
Sep 11 14:21:59.243755 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:21:59.243722    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99eaa447_82dd_41b3_ac95_e2faf55d52a2.slice/crio-ec129e7fd9e533978dbd3bd87c165b79182fa3c74912ff43ed705c7b2f916f92 WatchSource:0}: Error finding container ec129e7fd9e533978dbd3bd87c165b79182fa3c74912ff43ed705c7b2f916f92: Status 404 returned error can't find the container with id ec129e7fd9e533978dbd3bd87c165b79182fa3c74912ff43ed705c7b2f916f92
Sep 11 14:21:59.299087 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:21:59.299047    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:21:59.384510 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:21:59.384472    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxc6b" event={"ID":"99eaa447-82dd-41b3-ac95-e2faf55d52a2","Type":"ContainerStarted","Data":"ec129e7fd9e533978dbd3bd87c165b79182fa3c74912ff43ed705c7b2f916f92"}
Sep 11 14:21:59.566523 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:21:59.566485    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:01.003470 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:01.003429    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:01.958504 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:01.958475    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:02.327034 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:02.326993    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:02.402620 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:02.402576    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxc6b" event={"ID":"99eaa447-82dd-41b3-ac95-e2faf55d52a2","Type":"ContainerStarted","Data":"ed26908114bcdd2eecccc2da1e9b752371e27e4c91ca0bbb0f2916838e0b3b85"}
Sep 11 14:22:02.402818 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:02.402735    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxc6b"
Sep 11 14:22:02.474824 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:02.474768    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxc6b" podStartSLOduration=1.804893564 podStartE2EDuration="4.474752898s" totalImagesPullingTime="2.669859334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:21:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:22:02.472642959 +0000 UTC m=+415.271277732" watchObservedRunningTime="2026-09-11 14:22:02.474752898 +0000 UTC m=+415.273387679"
Sep 11 14:22:02.845251 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:02.845217    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:03.039278 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:03.039237    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:03.192478 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:03.192378    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:04.463313 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:04.463263    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:04.600973 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:04.600938    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:06.044971 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:06.044927    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtk9g"]
Sep 11 14:22:06.048816 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:06.048789    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtk9g"
Sep 11 14:22:06.052649 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:06.052624    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-btkwl\""
Sep 11 14:22:06.063216 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:06.063191    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtk9g"]
Sep 11 14:22:06.201301 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:06.201273    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlvjx\" (UniqueName: \"kubernetes.io/projected/d23f7c66-3044-4e8c-a0ed-fb31e187fc31-kube-api-access-hlvjx\") pod \"kuadrant-operator-controller-manager-76f8f686bf-dtk9g\" (UID: \"d23f7c66-3044-4e8c-a0ed-fb31e187fc31\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtk9g"
Sep 11 14:22:06.201434 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:06.201323    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d23f7c66-3044-4e8c-a0ed-fb31e187fc31-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-dtk9g\" (UID: \"d23f7c66-3044-4e8c-a0ed-fb31e187fc31\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtk9g"
Sep 11 14:22:06.302598 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:06.302538    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlvjx\" (UniqueName: \"kubernetes.io/projected/d23f7c66-3044-4e8c-a0ed-fb31e187fc31-kube-api-access-hlvjx\") pod \"kuadrant-operator-controller-manager-76f8f686bf-dtk9g\" (UID: \"d23f7c66-3044-4e8c-a0ed-fb31e187fc31\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtk9g"
Sep 11 14:22:06.302598 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:06.302586    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d23f7c66-3044-4e8c-a0ed-fb31e187fc31-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-dtk9g\" (UID: \"d23f7c66-3044-4e8c-a0ed-fb31e187fc31\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtk9g"
Sep 11 14:22:06.302933 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:06.302914    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d23f7c66-3044-4e8c-a0ed-fb31e187fc31-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-dtk9g\" (UID: \"d23f7c66-3044-4e8c-a0ed-fb31e187fc31\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtk9g"
Sep 11 14:22:06.311772 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:06.311749    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlvjx\" (UniqueName: \"kubernetes.io/projected/d23f7c66-3044-4e8c-a0ed-fb31e187fc31-kube-api-access-hlvjx\") pod \"kuadrant-operator-controller-manager-76f8f686bf-dtk9g\" (UID: \"d23f7c66-3044-4e8c-a0ed-fb31e187fc31\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtk9g"
Sep 11 14:22:06.359311 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:06.359288    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtk9g"
Sep 11 14:22:06.640210 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:06.640128    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtk9g"]
Sep 11 14:22:06.643629 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:22:06.643603    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd23f7c66_3044_4e8c_a0ed_fb31e187fc31.slice/crio-5f32788fd2e0ea12cb17037895e9d7edf488bb353e9ba7f0a97052dc930531b3 WatchSource:0}: Error finding container 5f32788fd2e0ea12cb17037895e9d7edf488bb353e9ba7f0a97052dc930531b3: Status 404 returned error can't find the container with id 5f32788fd2e0ea12cb17037895e9d7edf488bb353e9ba7f0a97052dc930531b3
Sep 11 14:22:07.153237 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:07.153182    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:07.264470 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:07.264446    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:07.431936 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:07.431853    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtk9g" event={"ID":"d23f7c66-3044-4e8c-a0ed-fb31e187fc31","Type":"ContainerStarted","Data":"5f32788fd2e0ea12cb17037895e9d7edf488bb353e9ba7f0a97052dc930531b3"}
Sep 11 14:22:10.295921 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:10.295893    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:10.397668 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:10.397627    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:10.448977 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:10.448942    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtk9g" event={"ID":"d23f7c66-3044-4e8c-a0ed-fb31e187fc31","Type":"ContainerStarted","Data":"808ea298d39c24d78cb65f5e2873a5ee551133de2f0f0a90578aa891580ac2ba"}
Sep 11 14:22:10.449148 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:10.449026    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtk9g"
Sep 11 14:22:10.472856 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:10.472807    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtk9g" podStartSLOduration=0.83961072 podStartE2EDuration="4.472790031s" totalImagesPullingTime="3.633179311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:22:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:22:10.470483335 +0000 UTC m=+423.269118117" watchObservedRunningTime="2026-09-11 14:22:10.472790031 +0000 UTC m=+423.271424813"
Sep 11 14:22:12.191329 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:12.191294    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:12.297787 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:12.297741    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:13.353273 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:13.353240    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:13.374434 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:13.374406    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xn9q"]
Sep 11 14:22:13.377945 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:13.377927    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xn9q"
Sep 11 14:22:13.380690 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:13.380652    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 11 14:22:13.380857 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:13.380841    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 11 14:22:13.380922 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:13.380904    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7js6p\""
Sep 11 14:22:13.401712 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:13.401686    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xn9q"]
Sep 11 14:22:13.408803 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:13.408780    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxc6b"
Sep 11 14:22:13.465743 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:13.465711    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e9ad6e0-51c2-47f2-939f-b8e85f2a60e1-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6xn9q\" (UID: \"6e9ad6e0-51c2-47f2-939f-b8e85f2a60e1\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xn9q"
Sep 11 14:22:13.465891 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:13.465765    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkw4s\" (UniqueName: \"kubernetes.io/projected/6e9ad6e0-51c2-47f2-939f-b8e85f2a60e1-kube-api-access-wkw4s\") pod \"kuadrant-console-plugin-fbdd4f445-6xn9q\" (UID: \"6e9ad6e0-51c2-47f2-939f-b8e85f2a60e1\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xn9q"
Sep 11 14:22:13.465891 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:13.465862    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6e9ad6e0-51c2-47f2-939f-b8e85f2a60e1-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-6xn9q\" (UID: \"6e9ad6e0-51c2-47f2-939f-b8e85f2a60e1\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xn9q"
Sep 11 14:22:13.566570 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:13.566535    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e9ad6e0-51c2-47f2-939f-b8e85f2a60e1-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6xn9q\" (UID: \"6e9ad6e0-51c2-47f2-939f-b8e85f2a60e1\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xn9q"
Sep 11 14:22:13.566820 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:13.566604    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkw4s\" (UniqueName: \"kubernetes.io/projected/6e9ad6e0-51c2-47f2-939f-b8e85f2a60e1-kube-api-access-wkw4s\") pod \"kuadrant-console-plugin-fbdd4f445-6xn9q\" (UID: \"6e9ad6e0-51c2-47f2-939f-b8e85f2a60e1\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xn9q"
Sep 11 14:22:13.566820 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:13.566707    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6e9ad6e0-51c2-47f2-939f-b8e85f2a60e1-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-6xn9q\" (UID: \"6e9ad6e0-51c2-47f2-939f-b8e85f2a60e1\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xn9q"
Sep 11 14:22:13.567381 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:13.567361    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6e9ad6e0-51c2-47f2-939f-b8e85f2a60e1-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-6xn9q\" (UID: \"6e9ad6e0-51c2-47f2-939f-b8e85f2a60e1\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xn9q"
Sep 11 14:22:13.569146 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:13.569123    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e9ad6e0-51c2-47f2-939f-b8e85f2a60e1-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6xn9q\" (UID: \"6e9ad6e0-51c2-47f2-939f-b8e85f2a60e1\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xn9q"
Sep 11 14:22:13.584440 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:13.584409    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkw4s\" (UniqueName: \"kubernetes.io/projected/6e9ad6e0-51c2-47f2-939f-b8e85f2a60e1-kube-api-access-wkw4s\") pod \"kuadrant-console-plugin-fbdd4f445-6xn9q\" (UID: \"6e9ad6e0-51c2-47f2-939f-b8e85f2a60e1\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xn9q"
Sep 11 14:22:13.639861 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:13.639785    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:13.687100 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:13.687065    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xn9q"
Sep 11 14:22:13.972352 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:13.972325    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xn9q"]
Sep 11 14:22:13.974713 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:22:13.974672    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e9ad6e0_51c2_47f2_939f_b8e85f2a60e1.slice/crio-2beba8115fd3ed20e150a91f41fb2d445093e070a8453302b68b1bc073c9ab6c WatchSource:0}: Error finding container 2beba8115fd3ed20e150a91f41fb2d445093e070a8453302b68b1bc073c9ab6c: Status 404 returned error can't find the container with id 2beba8115fd3ed20e150a91f41fb2d445093e070a8453302b68b1bc073c9ab6c
Sep 11 14:22:14.467049 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:14.467013    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xn9q" event={"ID":"6e9ad6e0-51c2-47f2-939f-b8e85f2a60e1","Type":"ContainerStarted","Data":"2beba8115fd3ed20e150a91f41fb2d445093e070a8453302b68b1bc073c9ab6c"}
Sep 11 14:22:16.139626 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:16.139586    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:16.267019 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:16.266981    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:16.538520 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:16.538443    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:16.631706 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:16.631650    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:19.494517 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:19.494475    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xn9q" event={"ID":"6e9ad6e0-51c2-47f2-939f-b8e85f2a60e1","Type":"ContainerStarted","Data":"db371fd982a966257aa358926ccea89af0eff7c36777d6f28fae7ccf6386dfaa"}
Sep 11 14:22:19.644105 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:19.644050    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xn9q" podStartSLOduration=1.997627349 podStartE2EDuration="6.644035497s" totalImagesPullingTime="4.646408148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:22:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:22:19.641786152 +0000 UTC m=+432.440420934" watchObservedRunningTime="2026-09-11 14:22:19.644035497 +0000 UTC m=+432.442670306"
Sep 11 14:22:21.163316 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:21.163275    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:21.260237 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:21.260201    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:21.365285 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:21.365253    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:21.455645 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:21.455576    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtk9g"
Sep 11 14:22:21.463493 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:21.463462    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:23.119303 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:23.119268    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:23.224063 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:23.224019    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:23.329024 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:23.328985    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:23.969503 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:23.969471    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtk9g"]
Sep 11 14:22:23.969707 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:23.969687    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtk9g" podUID="d23f7c66-3044-4e8c-a0ed-fb31e187fc31" containerName="manager" containerID="cri-o://808ea298d39c24d78cb65f5e2873a5ee551133de2f0f0a90578aa891580ac2ba" gracePeriod=2
Sep 11 14:22:23.979520 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:23.979494    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtk9g"]
Sep 11 14:22:23.986513 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:22:23.986187    2584 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d23f7c66-3044-4e8c-a0ed-fb31e187fc31\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-dtk9g\": pods \"kuadrant-operator-controller-manager-76f8f686bf-dtk9g\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtk9g"
Sep 11 14:22:24.007203 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:24.007178    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-259wh"]
Sep 11 14:22:24.007522 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:24.007508    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d23f7c66-3044-4e8c-a0ed-fb31e187fc31" containerName="manager"
Sep 11 14:22:24.007565 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:24.007525    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d23f7c66-3044-4e8c-a0ed-fb31e187fc31" containerName="manager"
Sep 11 14:22:24.007602 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:24.007592    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d23f7c66-3044-4e8c-a0ed-fb31e187fc31" containerName="manager"
Sep 11 14:22:24.010581 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:24.010565    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-259wh"
Sep 11 14:22:24.024531 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:24.024506    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-259wh"]
Sep 11 14:22:24.056191 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:22:24.056148    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-dtk9g\" is forbidden: User \"system:node:ip-10-0-133-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-175.ec2.internal' and this object" podUID="d23f7c66-3044-4e8c-a0ed-fb31e187fc31" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtk9g"
Sep 11 14:22:24.157240 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:24.157200    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/761a3489-b759-401c-9379-7f6af49d7632-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-259wh\" (UID: \"761a3489-b759-401c-9379-7f6af49d7632\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-259wh"
Sep 11 14:22:24.157585 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:24.157253    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v27ll\" (UniqueName: \"kubernetes.io/projected/761a3489-b759-401c-9379-7f6af49d7632-kube-api-access-v27ll\") pod \"kuadrant-operator-controller-manager-76f8f686bf-259wh\" (UID: \"761a3489-b759-401c-9379-7f6af49d7632\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-259wh"
Sep 11 14:22:24.208360 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:24.208332    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtk9g"
Sep 11 14:22:24.210570 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:22:24.210544    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-dtk9g\" is forbidden: User \"system:node:ip-10-0-133-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-175.ec2.internal' and this object" podUID="d23f7c66-3044-4e8c-a0ed-fb31e187fc31" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtk9g"
Sep 11 14:22:24.258027 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:24.257953    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/761a3489-b759-401c-9379-7f6af49d7632-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-259wh\" (UID: \"761a3489-b759-401c-9379-7f6af49d7632\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-259wh"
Sep 11 14:22:24.258027 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:24.258004    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v27ll\" (UniqueName: \"kubernetes.io/projected/761a3489-b759-401c-9379-7f6af49d7632-kube-api-access-v27ll\") pod \"kuadrant-operator-controller-manager-76f8f686bf-259wh\" (UID: \"761a3489-b759-401c-9379-7f6af49d7632\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-259wh"
Sep 11 14:22:24.258372 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:24.258345    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/761a3489-b759-401c-9379-7f6af49d7632-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-259wh\" (UID: \"761a3489-b759-401c-9379-7f6af49d7632\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-259wh"
Sep 11 14:22:24.266487 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:24.266453    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v27ll\" (UniqueName: \"kubernetes.io/projected/761a3489-b759-401c-9379-7f6af49d7632-kube-api-access-v27ll\") pod \"kuadrant-operator-controller-manager-76f8f686bf-259wh\" (UID: \"761a3489-b759-401c-9379-7f6af49d7632\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-259wh"
Sep 11 14:22:24.351550 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:24.351519    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-259wh"
Sep 11 14:22:24.358592 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:24.358566    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlvjx\" (UniqueName: \"kubernetes.io/projected/d23f7c66-3044-4e8c-a0ed-fb31e187fc31-kube-api-access-hlvjx\") pod \"d23f7c66-3044-4e8c-a0ed-fb31e187fc31\" (UID: \"d23f7c66-3044-4e8c-a0ed-fb31e187fc31\") "
Sep 11 14:22:24.358706 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:24.358610    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d23f7c66-3044-4e8c-a0ed-fb31e187fc31-extensions-socket-volume\") pod \"d23f7c66-3044-4e8c-a0ed-fb31e187fc31\" (UID: \"d23f7c66-3044-4e8c-a0ed-fb31e187fc31\") "
Sep 11 14:22:24.359117 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:24.359094    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d23f7c66-3044-4e8c-a0ed-fb31e187fc31-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d23f7c66-3044-4e8c-a0ed-fb31e187fc31" (UID: "d23f7c66-3044-4e8c-a0ed-fb31e187fc31"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:22:24.360717 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:24.360657    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d23f7c66-3044-4e8c-a0ed-fb31e187fc31-kube-api-access-hlvjx" (OuterVolumeSpecName: "kube-api-access-hlvjx") pod "d23f7c66-3044-4e8c-a0ed-fb31e187fc31" (UID: "d23f7c66-3044-4e8c-a0ed-fb31e187fc31"). InnerVolumeSpecName "kube-api-access-hlvjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:22:24.459561 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:24.459524    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlvjx\" (UniqueName: \"kubernetes.io/projected/d23f7c66-3044-4e8c-a0ed-fb31e187fc31-kube-api-access-hlvjx\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:22:24.459561 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:24.459553    2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d23f7c66-3044-4e8c-a0ed-fb31e187fc31-extensions-socket-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:22:24.520187 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:24.520109    2584 generic.go:356] "Generic (PLEG): container finished" podID="d23f7c66-3044-4e8c-a0ed-fb31e187fc31" containerID="808ea298d39c24d78cb65f5e2873a5ee551133de2f0f0a90578aa891580ac2ba" exitCode=0
Sep 11 14:22:24.520187 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:24.520152    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtk9g"
Sep 11 14:22:24.520187 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:24.520161    2584 scope.go:117] "RemoveContainer" containerID="808ea298d39c24d78cb65f5e2873a5ee551133de2f0f0a90578aa891580ac2ba"
Sep 11 14:22:24.522958 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:22:24.522933    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-dtk9g\" is forbidden: User \"system:node:ip-10-0-133-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-175.ec2.internal' and this object" podUID="d23f7c66-3044-4e8c-a0ed-fb31e187fc31" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtk9g"
Sep 11 14:22:24.528972 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:24.528954    2584 scope.go:117] "RemoveContainer" containerID="808ea298d39c24d78cb65f5e2873a5ee551133de2f0f0a90578aa891580ac2ba"
Sep 11 14:22:24.529233 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:22:24.529218    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"808ea298d39c24d78cb65f5e2873a5ee551133de2f0f0a90578aa891580ac2ba\": container with ID starting with 808ea298d39c24d78cb65f5e2873a5ee551133de2f0f0a90578aa891580ac2ba not found: ID does not exist" containerID="808ea298d39c24d78cb65f5e2873a5ee551133de2f0f0a90578aa891580ac2ba"
Sep 11 14:22:24.529278 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:24.529241    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"808ea298d39c24d78cb65f5e2873a5ee551133de2f0f0a90578aa891580ac2ba"} err="failed to get container status \"808ea298d39c24d78cb65f5e2873a5ee551133de2f0f0a90578aa891580ac2ba\": rpc error: code = NotFound desc = could not find container \"808ea298d39c24d78cb65f5e2873a5ee551133de2f0f0a90578aa891580ac2ba\": container with ID starting with 808ea298d39c24d78cb65f5e2873a5ee551133de2f0f0a90578aa891580ac2ba not found: ID does not exist"
Sep 11 14:22:24.530609 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:22:24.530590    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-dtk9g\" is forbidden: User \"system:node:ip-10-0-133-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-175.ec2.internal' and this object" podUID="d23f7c66-3044-4e8c-a0ed-fb31e187fc31" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtk9g"
Sep 11 14:22:24.644901 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:24.644874    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-259wh"]
Sep 11 14:22:24.647730 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:22:24.647697    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod761a3489_b759_401c_9379_7f6af49d7632.slice/crio-0b4f34aa8d77d5fd94bab65c88112331b639d42ddb3c85f904465e646e1e1040 WatchSource:0}: Error finding container 0b4f34aa8d77d5fd94bab65c88112331b639d42ddb3c85f904465e646e1e1040: Status 404 returned error can't find the container with id 0b4f34aa8d77d5fd94bab65c88112331b639d42ddb3c85f904465e646e1e1040
Sep 11 14:22:25.527086 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:25.527054    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-259wh" event={"ID":"761a3489-b759-401c-9379-7f6af49d7632","Type":"ContainerStarted","Data":"a7233141e39f034b0539e819e77bc36b764bda1c0d0c88c23a3ef934dece9a72"}
Sep 11 14:22:25.527458 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:25.527104    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-259wh" event={"ID":"761a3489-b759-401c-9379-7f6af49d7632","Type":"ContainerStarted","Data":"0b4f34aa8d77d5fd94bab65c88112331b639d42ddb3c85f904465e646e1e1040"}
Sep 11 14:22:25.527458 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:25.527148    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-259wh"
Sep 11 14:22:25.533274 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:22:25.533245    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-dtk9g\" is forbidden: User \"system:node:ip-10-0-133-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-175.ec2.internal' and this object" podUID="d23f7c66-3044-4e8c-a0ed-fb31e187fc31" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtk9g"
Sep 11 14:22:25.593398 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:25.593346    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-259wh" podStartSLOduration=2.593332284 podStartE2EDuration="2.593332284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:22:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:22:25.591229762 +0000 UTC m=+438.389864543" watchObservedRunningTime="2026-09-11 14:22:25.593332284 +0000 UTC m=+438.391967060"
Sep 11 14:22:25.679429 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:25.679393    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d23f7c66-3044-4e8c-a0ed-fb31e187fc31" path="/var/lib/kubelet/pods/d23f7c66-3044-4e8c-a0ed-fb31e187fc31/volumes"
Sep 11 14:22:27.983213 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:27.983173    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:28.086855 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:28.086818    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:30.672937 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:30.672853    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:30.767779 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:30.767742    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:35.518014 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:35.517975    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:35.613383 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:35.613349    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:35.714257 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:35.714227    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:36.534722 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:36.534670    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-259wh"
Sep 11 14:22:40.692767 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:40.692731    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:40.789330 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:40.789293    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:40.886374 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:40.886339    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:43.818653 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:43.818604    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-259wh"]
Sep 11 14:22:43.819306 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:43.819274    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-259wh" podUID="761a3489-b759-401c-9379-7f6af49d7632" containerName="manager" containerID="cri-o://a7233141e39f034b0539e819e77bc36b764bda1c0d0c88c23a3ef934dece9a72" gracePeriod=10
Sep 11 14:22:44.070020 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:44.069955    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-259wh"
Sep 11 14:22:44.117404 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:44.117366    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/761a3489-b759-401c-9379-7f6af49d7632-extensions-socket-volume\") pod \"761a3489-b759-401c-9379-7f6af49d7632\" (UID: \"761a3489-b759-401c-9379-7f6af49d7632\") "
Sep 11 14:22:44.117593 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:44.117451    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v27ll\" (UniqueName: \"kubernetes.io/projected/761a3489-b759-401c-9379-7f6af49d7632-kube-api-access-v27ll\") pod \"761a3489-b759-401c-9379-7f6af49d7632\" (UID: \"761a3489-b759-401c-9379-7f6af49d7632\") "
Sep 11 14:22:44.117867 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:44.117841    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/761a3489-b759-401c-9379-7f6af49d7632-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "761a3489-b759-401c-9379-7f6af49d7632" (UID: "761a3489-b759-401c-9379-7f6af49d7632"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:22:44.119591 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:44.119571    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/761a3489-b759-401c-9379-7f6af49d7632-kube-api-access-v27ll" (OuterVolumeSpecName: "kube-api-access-v27ll") pod "761a3489-b759-401c-9379-7f6af49d7632" (UID: "761a3489-b759-401c-9379-7f6af49d7632"). InnerVolumeSpecName "kube-api-access-v27ll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:22:44.218310 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:44.218260    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v27ll\" (UniqueName: \"kubernetes.io/projected/761a3489-b759-401c-9379-7f6af49d7632-kube-api-access-v27ll\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:22:44.218310 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:44.218299    2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/761a3489-b759-401c-9379-7f6af49d7632-extensions-socket-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:22:44.617227 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:44.617189    2584 generic.go:356] "Generic (PLEG): container finished" podID="761a3489-b759-401c-9379-7f6af49d7632" containerID="a7233141e39f034b0539e819e77bc36b764bda1c0d0c88c23a3ef934dece9a72" exitCode=0
Sep 11 14:22:44.617227 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:44.617230    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-259wh"
Sep 11 14:22:44.617436 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:44.617272    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-259wh" event={"ID":"761a3489-b759-401c-9379-7f6af49d7632","Type":"ContainerDied","Data":"a7233141e39f034b0539e819e77bc36b764bda1c0d0c88c23a3ef934dece9a72"}
Sep 11 14:22:44.617436 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:44.617324    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-259wh" event={"ID":"761a3489-b759-401c-9379-7f6af49d7632","Type":"ContainerDied","Data":"0b4f34aa8d77d5fd94bab65c88112331b639d42ddb3c85f904465e646e1e1040"}
Sep 11 14:22:44.617436 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:44.617347    2584 scope.go:117] "RemoveContainer" containerID="a7233141e39f034b0539e819e77bc36b764bda1c0d0c88c23a3ef934dece9a72"
Sep 11 14:22:44.626527 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:44.626509    2584 scope.go:117] "RemoveContainer" containerID="a7233141e39f034b0539e819e77bc36b764bda1c0d0c88c23a3ef934dece9a72"
Sep 11 14:22:44.626842 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:22:44.626820    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7233141e39f034b0539e819e77bc36b764bda1c0d0c88c23a3ef934dece9a72\": container with ID starting with a7233141e39f034b0539e819e77bc36b764bda1c0d0c88c23a3ef934dece9a72 not found: ID does not exist" containerID="a7233141e39f034b0539e819e77bc36b764bda1c0d0c88c23a3ef934dece9a72"
Sep 11 14:22:44.626925 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:44.626852    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7233141e39f034b0539e819e77bc36b764bda1c0d0c88c23a3ef934dece9a72"} err="failed to get container status \"a7233141e39f034b0539e819e77bc36b764bda1c0d0c88c23a3ef934dece9a72\": rpc error: code = NotFound desc = could not find container \"a7233141e39f034b0539e819e77bc36b764bda1c0d0c88c23a3ef934dece9a72\": container with ID starting with a7233141e39f034b0539e819e77bc36b764bda1c0d0c88c23a3ef934dece9a72 not found: ID does not exist"
Sep 11 14:22:44.675958 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:44.675925    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-259wh"]
Sep 11 14:22:44.696597 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:44.696556    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-259wh"]
Sep 11 14:22:45.679151 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:45.679116    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="761a3489-b759-401c-9379-7f6af49d7632" path="/var/lib/kubelet/pods/761a3489-b759-401c-9379-7f6af49d7632/volumes"
Sep 11 14:22:48.143847 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:48.143811    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:22:48.232084 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:22:48.232049    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:23:00.464377 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:00.464309    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:23:00.653004 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:00.652970    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:23:02.716788 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:02.716734    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:23:02.745065 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:02.745028    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-ndjkn"]
Sep 11 14:23:02.745563 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:02.745546    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="761a3489-b759-401c-9379-7f6af49d7632" containerName="manager"
Sep 11 14:23:02.745608 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:02.745567    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="761a3489-b759-401c-9379-7f6af49d7632" containerName="manager"
Sep 11 14:23:02.745697 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:02.745670    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="761a3489-b759-401c-9379-7f6af49d7632" containerName="manager"
Sep 11 14:23:02.748099 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:02.748081    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-ndjkn"
Sep 11 14:23:02.753527 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:02.753506    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 11 14:23:02.771216 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:02.771193    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-ndjkn"]
Sep 11 14:23:02.831911 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:02.831878    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-ndjkn"]
Sep 11 14:23:02.839435 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:02.839403    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:23:02.882331 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:02.882300    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kzrm\" (UniqueName: \"kubernetes.io/projected/59f32b4f-3c5f-4ac2-ab05-36109fbea8e7-kube-api-access-7kzrm\") pod \"limitador-limitador-8588749977-ndjkn\" (UID: \"59f32b4f-3c5f-4ac2-ab05-36109fbea8e7\") " pod="kuadrant-system/limitador-limitador-8588749977-ndjkn"
Sep 11 14:23:02.882472 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:02.882382    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59f32b4f-3c5f-4ac2-ab05-36109fbea8e7-config-file\") pod \"limitador-limitador-8588749977-ndjkn\" (UID: \"59f32b4f-3c5f-4ac2-ab05-36109fbea8e7\") " pod="kuadrant-system/limitador-limitador-8588749977-ndjkn"
Sep 11 14:23:02.948759 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:02.948731    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:23:02.983010 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:02.982945    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59f32b4f-3c5f-4ac2-ab05-36109fbea8e7-config-file\") pod \"limitador-limitador-8588749977-ndjkn\" (UID: \"59f32b4f-3c5f-4ac2-ab05-36109fbea8e7\") " pod="kuadrant-system/limitador-limitador-8588749977-ndjkn"
Sep 11 14:23:02.983010 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:02.982991    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kzrm\" (UniqueName: \"kubernetes.io/projected/59f32b4f-3c5f-4ac2-ab05-36109fbea8e7-kube-api-access-7kzrm\") pod \"limitador-limitador-8588749977-ndjkn\" (UID: \"59f32b4f-3c5f-4ac2-ab05-36109fbea8e7\") " pod="kuadrant-system/limitador-limitador-8588749977-ndjkn"
Sep 11 14:23:02.983602 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:02.983580    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59f32b4f-3c5f-4ac2-ab05-36109fbea8e7-config-file\") pod \"limitador-limitador-8588749977-ndjkn\" (UID: \"59f32b4f-3c5f-4ac2-ab05-36109fbea8e7\") " pod="kuadrant-system/limitador-limitador-8588749977-ndjkn"
Sep 11 14:23:02.992943 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:02.992919    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kzrm\" (UniqueName: \"kubernetes.io/projected/59f32b4f-3c5f-4ac2-ab05-36109fbea8e7-kube-api-access-7kzrm\") pod \"limitador-limitador-8588749977-ndjkn\" (UID: \"59f32b4f-3c5f-4ac2-ab05-36109fbea8e7\") " pod="kuadrant-system/limitador-limitador-8588749977-ndjkn"
Sep 11 14:23:03.015644 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:03.015615    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:23:03.018351 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:03.018334    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-kv625"
Sep 11 14:23:03.031017 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:03.030992    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:23:03.057814 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:03.057783    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-ndjkn"
Sep 11 14:23:03.074136 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:03.074107    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:23:03.083778 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:03.083755    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6435339c-1193-4524-865e-8c1441868ff7-config-file\") pod \"limitador-limitador-84994f7ffc-kv625\" (UID: \"6435339c-1193-4524-865e-8c1441868ff7\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-kv625"
Sep 11 14:23:03.083877 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:03.083824    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf9b7\" (UniqueName: \"kubernetes.io/projected/6435339c-1193-4524-865e-8c1441868ff7-kube-api-access-kf9b7\") pod \"limitador-limitador-84994f7ffc-kv625\" (UID: \"6435339c-1193-4524-865e-8c1441868ff7\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-kv625"
Sep 11 14:23:03.184362 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:03.184322    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6435339c-1193-4524-865e-8c1441868ff7-config-file\") pod \"limitador-limitador-84994f7ffc-kv625\" (UID: \"6435339c-1193-4524-865e-8c1441868ff7\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-kv625"
Sep 11 14:23:03.184505 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:03.184379    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf9b7\" (UniqueName: \"kubernetes.io/projected/6435339c-1193-4524-865e-8c1441868ff7-kube-api-access-kf9b7\") pod \"limitador-limitador-84994f7ffc-kv625\" (UID: \"6435339c-1193-4524-865e-8c1441868ff7\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-kv625"
Sep 11 14:23:03.185005 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:03.184984    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6435339c-1193-4524-865e-8c1441868ff7-config-file\") pod \"limitador-limitador-84994f7ffc-kv625\" (UID: \"6435339c-1193-4524-865e-8c1441868ff7\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-kv625"
Sep 11 14:23:03.196561 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:03.196534    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf9b7\" (UniqueName: \"kubernetes.io/projected/6435339c-1193-4524-865e-8c1441868ff7-kube-api-access-kf9b7\") pod \"limitador-limitador-84994f7ffc-kv625\" (UID: \"6435339c-1193-4524-865e-8c1441868ff7\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-kv625"
Sep 11 14:23:03.328380 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:03.328350    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-kv625"
Sep 11 14:23:03.338437 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:03.338415    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-ndjkn"]
Sep 11 14:23:03.341552 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:23:03.341522    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59f32b4f_3c5f_4ac2_ab05_36109fbea8e7.slice/crio-fc94ed18b51a9005eaa630ebb3a58e43d4a0179dfc504cb18fa038ade92205aa WatchSource:0}: Error finding container fc94ed18b51a9005eaa630ebb3a58e43d4a0179dfc504cb18fa038ade92205aa: Status 404 returned error can't find the container with id fc94ed18b51a9005eaa630ebb3a58e43d4a0179dfc504cb18fa038ade92205aa
Sep 11 14:23:03.624288 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:03.624203    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:23:03.627230 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:23:03.627200    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6435339c_1193_4524_865e_8c1441868ff7.slice/crio-05b0f33b4a507f28a20b4bf8a7b45578b123bdc8c95448fe6a5ab8e1d8928085 WatchSource:0}: Error finding container 05b0f33b4a507f28a20b4bf8a7b45578b123bdc8c95448fe6a5ab8e1d8928085: Status 404 returned error can't find the container with id 05b0f33b4a507f28a20b4bf8a7b45578b123bdc8c95448fe6a5ab8e1d8928085
Sep 11 14:23:03.704280 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:03.704249    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-kv625" event={"ID":"6435339c-1193-4524-865e-8c1441868ff7","Type":"ContainerStarted","Data":"05b0f33b4a507f28a20b4bf8a7b45578b123bdc8c95448fe6a5ab8e1d8928085"}
Sep 11 14:23:03.705497 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:03.705474    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-ndjkn" event={"ID":"59f32b4f-3c5f-4ac2-ab05-36109fbea8e7","Type":"ContainerStarted","Data":"fc94ed18b51a9005eaa630ebb3a58e43d4a0179dfc504cb18fa038ade92205aa"}
Sep 11 14:23:03.795136 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:03.795110    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:23:03.947054 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:03.946968    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:23:05.717804 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:05.717762    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-kv625" event={"ID":"6435339c-1193-4524-865e-8c1441868ff7","Type":"ContainerStarted","Data":"82e9819f83beef8db56c7f36986d155800ee0ad650a2f4687b38d9460c28d048"}
Sep 11 14:23:05.718259 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:05.717882    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-kv625"
Sep 11 14:23:05.719236 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:05.719214    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-ndjkn" event={"ID":"59f32b4f-3c5f-4ac2-ab05-36109fbea8e7","Type":"ContainerStarted","Data":"a9ec1b7c7d292d6be99eb3b1d94589860a3e86467388645c26379366c0963a58"}
Sep 11 14:23:05.719353 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:05.719319    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-ndjkn"
Sep 11 14:23:05.739727 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:05.739669    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-kv625" podStartSLOduration=2.611827768 podStartE2EDuration="3.739655308s" totalImagesPullingTime="1.12782754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:23:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:23:05.738582608 +0000 UTC m=+478.537217391" watchObservedRunningTime="2026-09-11 14:23:05.739655308 +0000 UTC m=+478.538290090"
Sep 11 14:23:05.766589 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:05.766549    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-ndjkn" podStartSLOduration=2.3516966679999998 podStartE2EDuration="3.766537392s" totalImagesPullingTime="1.414840724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:23:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:23:05.765787733 +0000 UTC m=+478.564422516" watchObservedRunningTime="2026-09-11 14:23:05.766537392 +0000 UTC m=+478.565172206"
Sep 11 14:23:12.359158 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:12.359120    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:23:16.724801 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:16.724767    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-ndjkn"
Sep 11 14:23:16.725193 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:16.724838    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-kv625"
Sep 11 14:23:16.803284 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:16.803252    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-ndjkn"]
Sep 11 14:23:16.803479 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:16.803443    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-ndjkn" podUID="59f32b4f-3c5f-4ac2-ab05-36109fbea8e7" containerName="limitador" containerID="cri-o://a9ec1b7c7d292d6be99eb3b1d94589860a3e86467388645c26379366c0963a58" gracePeriod=30
Sep 11 14:23:17.747004 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:17.746972    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-ndjkn"
Sep 11 14:23:17.771003 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:17.770973    2584 generic.go:356] "Generic (PLEG): container finished" podID="59f32b4f-3c5f-4ac2-ab05-36109fbea8e7" containerID="a9ec1b7c7d292d6be99eb3b1d94589860a3e86467388645c26379366c0963a58" exitCode=0
Sep 11 14:23:17.771116 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:17.771010    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-ndjkn"
Sep 11 14:23:17.771116 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:17.771034    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-ndjkn" event={"ID":"59f32b4f-3c5f-4ac2-ab05-36109fbea8e7","Type":"ContainerDied","Data":"a9ec1b7c7d292d6be99eb3b1d94589860a3e86467388645c26379366c0963a58"}
Sep 11 14:23:17.771116 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:17.771084    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-ndjkn" event={"ID":"59f32b4f-3c5f-4ac2-ab05-36109fbea8e7","Type":"ContainerDied","Data":"fc94ed18b51a9005eaa630ebb3a58e43d4a0179dfc504cb18fa038ade92205aa"}
Sep 11 14:23:17.771116 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:17.771108    2584 scope.go:117] "RemoveContainer" containerID="a9ec1b7c7d292d6be99eb3b1d94589860a3e86467388645c26379366c0963a58"
Sep 11 14:23:17.778739 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:17.778720    2584 scope.go:117] "RemoveContainer" containerID="a9ec1b7c7d292d6be99eb3b1d94589860a3e86467388645c26379366c0963a58"
Sep 11 14:23:17.778987 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:23:17.778969    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9ec1b7c7d292d6be99eb3b1d94589860a3e86467388645c26379366c0963a58\": container with ID starting with a9ec1b7c7d292d6be99eb3b1d94589860a3e86467388645c26379366c0963a58 not found: ID does not exist" containerID="a9ec1b7c7d292d6be99eb3b1d94589860a3e86467388645c26379366c0963a58"
Sep 11 14:23:17.779047 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:17.779009    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9ec1b7c7d292d6be99eb3b1d94589860a3e86467388645c26379366c0963a58"} err="failed to get container status \"a9ec1b7c7d292d6be99eb3b1d94589860a3e86467388645c26379366c0963a58\": rpc error: code = NotFound desc = could not find container \"a9ec1b7c7d292d6be99eb3b1d94589860a3e86467388645c26379366c0963a58\": container with ID starting with a9ec1b7c7d292d6be99eb3b1d94589860a3e86467388645c26379366c0963a58 not found: ID does not exist"
Sep 11 14:23:17.914081 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:17.914009    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59f32b4f-3c5f-4ac2-ab05-36109fbea8e7-config-file\") pod \"59f32b4f-3c5f-4ac2-ab05-36109fbea8e7\" (UID: \"59f32b4f-3c5f-4ac2-ab05-36109fbea8e7\") "
Sep 11 14:23:17.914081 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:17.914061    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kzrm\" (UniqueName: \"kubernetes.io/projected/59f32b4f-3c5f-4ac2-ab05-36109fbea8e7-kube-api-access-7kzrm\") pod \"59f32b4f-3c5f-4ac2-ab05-36109fbea8e7\" (UID: \"59f32b4f-3c5f-4ac2-ab05-36109fbea8e7\") "
Sep 11 14:23:17.914349 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:17.914327    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59f32b4f-3c5f-4ac2-ab05-36109fbea8e7-config-file" (OuterVolumeSpecName: "config-file") pod "59f32b4f-3c5f-4ac2-ab05-36109fbea8e7" (UID: "59f32b4f-3c5f-4ac2-ab05-36109fbea8e7"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:23:17.915997 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:17.915974    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59f32b4f-3c5f-4ac2-ab05-36109fbea8e7-kube-api-access-7kzrm" (OuterVolumeSpecName: "kube-api-access-7kzrm") pod "59f32b4f-3c5f-4ac2-ab05-36109fbea8e7" (UID: "59f32b4f-3c5f-4ac2-ab05-36109fbea8e7"). InnerVolumeSpecName "kube-api-access-7kzrm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:23:18.014830 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:18.014789    2584 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59f32b4f-3c5f-4ac2-ab05-36109fbea8e7-config-file\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:23:18.014830 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:18.014826    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kzrm\" (UniqueName: \"kubernetes.io/projected/59f32b4f-3c5f-4ac2-ab05-36109fbea8e7-kube-api-access-7kzrm\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:23:18.105690 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:18.105653    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-ndjkn"]
Sep 11 14:23:18.107125 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:18.107106    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-ndjkn"]
Sep 11 14:23:19.081481 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:19.081442    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:23:19.263165 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:19.263130    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:23:19.678471 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:19.678438    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59f32b4f-3c5f-4ac2-ab05-36109fbea8e7" path="/var/lib/kubelet/pods/59f32b4f-3c5f-4ac2-ab05-36109fbea8e7/volumes"
Sep 11 14:23:19.749925 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:19.749895    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6kd2h"]
Sep 11 14:23:19.750311 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:19.750293    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59f32b4f-3c5f-4ac2-ab05-36109fbea8e7" containerName="limitador"
Sep 11 14:23:19.750389 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:19.750313    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="59f32b4f-3c5f-4ac2-ab05-36109fbea8e7" containerName="limitador"
Sep 11 14:23:19.750444 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:19.750403    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="59f32b4f-3c5f-4ac2-ab05-36109fbea8e7" containerName="limitador"
Sep 11 14:23:19.754612 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:19.754592    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6kd2h"
Sep 11 14:23:19.759713 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:19.759668    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-qq9b6\""
Sep 11 14:23:19.759903 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:19.759722    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 11 14:23:19.760284 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:19.760266    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 14:23:19.761384 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:19.761366    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 14:23:19.795146 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:19.795118    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6kd2h"]
Sep 11 14:23:19.833782 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:19.833726    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:23:19.929718 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:19.929608    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87k22\" (UniqueName: \"kubernetes.io/projected/9323c2fc-b7c3-449b-b8c7-1c833755b163-kube-api-access-87k22\") pod \"postgres-69fb4594cf-6kd2h\" (UID: \"9323c2fc-b7c3-449b-b8c7-1c833755b163\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6kd2h"
Sep 11 14:23:19.929718 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:19.929656    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9323c2fc-b7c3-449b-b8c7-1c833755b163-data\") pod \"postgres-69fb4594cf-6kd2h\" (UID: \"9323c2fc-b7c3-449b-b8c7-1c833755b163\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6kd2h"
Sep 11 14:23:20.030788 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:20.030752    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87k22\" (UniqueName: \"kubernetes.io/projected/9323c2fc-b7c3-449b-b8c7-1c833755b163-kube-api-access-87k22\") pod \"postgres-69fb4594cf-6kd2h\" (UID: \"9323c2fc-b7c3-449b-b8c7-1c833755b163\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6kd2h"
Sep 11 14:23:20.030934 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:20.030796    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9323c2fc-b7c3-449b-b8c7-1c833755b163-data\") pod \"postgres-69fb4594cf-6kd2h\" (UID: \"9323c2fc-b7c3-449b-b8c7-1c833755b163\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6kd2h"
Sep 11 14:23:20.031193 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:20.031176    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9323c2fc-b7c3-449b-b8c7-1c833755b163-data\") pod \"postgres-69fb4594cf-6kd2h\" (UID: \"9323c2fc-b7c3-449b-b8c7-1c833755b163\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6kd2h"
Sep 11 14:23:20.043959 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:20.043936    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87k22\" (UniqueName: \"kubernetes.io/projected/9323c2fc-b7c3-449b-b8c7-1c833755b163-kube-api-access-87k22\") pod \"postgres-69fb4594cf-6kd2h\" (UID: \"9323c2fc-b7c3-449b-b8c7-1c833755b163\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6kd2h"
Sep 11 14:23:20.064765 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:20.064746    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6kd2h"
Sep 11 14:23:20.344465 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:23:20.344424    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9323c2fc_b7c3_449b_b8c7_1c833755b163.slice/crio-0dd1b33ecdfc70f463dabd81452d953c0dc757ac19c995a6b965e93f904911f3 WatchSource:0}: Error finding container 0dd1b33ecdfc70f463dabd81452d953c0dc757ac19c995a6b965e93f904911f3: Status 404 returned error can't find the container with id 0dd1b33ecdfc70f463dabd81452d953c0dc757ac19c995a6b965e93f904911f3
Sep 11 14:23:20.354139 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:20.354118    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6kd2h"]
Sep 11 14:23:20.787392 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:20.787310    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6kd2h" event={"ID":"9323c2fc-b7c3-449b-b8c7-1c833755b163","Type":"ContainerStarted","Data":"0dd1b33ecdfc70f463dabd81452d953c0dc757ac19c995a6b965e93f904911f3"}
Sep 11 14:23:22.798356 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:22.798318    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6kd2h" event={"ID":"9323c2fc-b7c3-449b-b8c7-1c833755b163","Type":"ContainerStarted","Data":"30600e39d7ab3011e6e45c92cebfc8406d60b46dbe1dfac6c57fdb8838a8cf3d"}
Sep 11 14:23:22.798746 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:22.798405    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6kd2h"
Sep 11 14:23:22.822668 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:22.822624    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6kd2h" podStartSLOduration=1.8137089180000001 podStartE2EDuration="3.822611355s" totalImagesPullingTime="2.008902437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:23:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:23:22.821713422 +0000 UTC m=+495.620348204" watchObservedRunningTime="2026-09-11 14:23:22.822611355 +0000 UTC m=+495.621246136"
Sep 11 14:23:28.831105 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:28.831077    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6kd2h"
Sep 11 14:23:30.915848 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:30.915810    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:23:31.027794 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:31.027765    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:23:39.465409 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:39.465372    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:23:39.568315 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:39.568279    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:23:39.672761 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:39.672720    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:23:39.770892 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:39.770817    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-57d567598c-tmjd8"]
Sep 11 14:23:39.774161 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:39.774144    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57d567598c-tmjd8"
Sep 11 14:23:39.779864 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:39.779832    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 14:23:39.779864 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:39.779837    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 14:23:39.780096 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:39.779879    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pgmvd\""
Sep 11 14:23:39.780096 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:39.779845    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 14:23:39.781479 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:39.781451    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:23:39.792524 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:39.792502    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57d567598c-tmjd8"]
Sep 11 14:23:39.889324 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:39.889299    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6x9c\" (UniqueName: \"kubernetes.io/projected/c2bf1285-c840-4b0a-8f39-b157fedbd628-kube-api-access-l6x9c\") pod \"maas-controller-57d567598c-tmjd8\" (UID: \"c2bf1285-c840-4b0a-8f39-b157fedbd628\") " pod="opendatahub/maas-controller-57d567598c-tmjd8"
Sep 11 14:23:39.889495 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:39.889344    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2bf1285-c840-4b0a-8f39-b157fedbd628-metrics-certs\") pod \"maas-controller-57d567598c-tmjd8\" (UID: \"c2bf1285-c840-4b0a-8f39-b157fedbd628\") " pod="opendatahub/maas-controller-57d567598c-tmjd8"
Sep 11 14:23:39.889495 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:39.889375    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2bf1285-c840-4b0a-8f39-b157fedbd628-webhook-cert\") pod \"maas-controller-57d567598c-tmjd8\" (UID: \"c2bf1285-c840-4b0a-8f39-b157fedbd628\") " pod="opendatahub/maas-controller-57d567598c-tmjd8"
Sep 11 14:23:39.990668 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:39.990637    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6x9c\" (UniqueName: \"kubernetes.io/projected/c2bf1285-c840-4b0a-8f39-b157fedbd628-kube-api-access-l6x9c\") pod \"maas-controller-57d567598c-tmjd8\" (UID: \"c2bf1285-c840-4b0a-8f39-b157fedbd628\") " pod="opendatahub/maas-controller-57d567598c-tmjd8"
Sep 11 14:23:39.990834 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:39.990701    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2bf1285-c840-4b0a-8f39-b157fedbd628-metrics-certs\") pod \"maas-controller-57d567598c-tmjd8\" (UID: \"c2bf1285-c840-4b0a-8f39-b157fedbd628\") " pod="opendatahub/maas-controller-57d567598c-tmjd8"
Sep 11 14:23:39.990834 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:39.990727    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2bf1285-c840-4b0a-8f39-b157fedbd628-webhook-cert\") pod \"maas-controller-57d567598c-tmjd8\" (UID: \"c2bf1285-c840-4b0a-8f39-b157fedbd628\") " pod="opendatahub/maas-controller-57d567598c-tmjd8"
Sep 11 14:23:39.993169 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:39.993146    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2bf1285-c840-4b0a-8f39-b157fedbd628-metrics-certs\") pod \"maas-controller-57d567598c-tmjd8\" (UID: \"c2bf1285-c840-4b0a-8f39-b157fedbd628\") " pod="opendatahub/maas-controller-57d567598c-tmjd8"
Sep 11 14:23:39.993252 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:39.993174    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2bf1285-c840-4b0a-8f39-b157fedbd628-webhook-cert\") pod \"maas-controller-57d567598c-tmjd8\" (UID: \"c2bf1285-c840-4b0a-8f39-b157fedbd628\") " pod="opendatahub/maas-controller-57d567598c-tmjd8"
Sep 11 14:23:40.004109 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:40.004088    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6x9c\" (UniqueName: \"kubernetes.io/projected/c2bf1285-c840-4b0a-8f39-b157fedbd628-kube-api-access-l6x9c\") pod \"maas-controller-57d567598c-tmjd8\" (UID: \"c2bf1285-c840-4b0a-8f39-b157fedbd628\") " pod="opendatahub/maas-controller-57d567598c-tmjd8"
Sep 11 14:23:40.085167 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:40.085125    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57d567598c-tmjd8"
Sep 11 14:23:40.373906 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:40.373826    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57d567598c-tmjd8"]
Sep 11 14:23:40.379107 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:23:40.379078    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2bf1285_c840_4b0a_8f39_b157fedbd628.slice/crio-7876689e443b2ebe0a17f14d579ff90881aa774020bf922c170f51531094e0fa WatchSource:0}: Error finding container 7876689e443b2ebe0a17f14d579ff90881aa774020bf922c170f51531094e0fa: Status 404 returned error can't find the container with id 7876689e443b2ebe0a17f14d579ff90881aa774020bf922c170f51531094e0fa
Sep 11 14:23:40.885762 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:40.885722    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57d567598c-tmjd8" event={"ID":"c2bf1285-c840-4b0a-8f39-b157fedbd628","Type":"ContainerStarted","Data":"7876689e443b2ebe0a17f14d579ff90881aa774020bf922c170f51531094e0fa"}
Sep 11 14:23:40.953437 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:40.953399    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:23:41.038785 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:41.038739    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:23:42.745424 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:42.745393    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:23:42.882651 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:42.882570    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:23:42.902477 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:42.902446    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57d567598c-tmjd8" event={"ID":"c2bf1285-c840-4b0a-8f39-b157fedbd628","Type":"ContainerStarted","Data":"ae8a5d5e6b86222e9369fdebd72b420aa8178cce3ca7b0f757a6f82ea6d5de7b"}
Sep 11 14:23:42.902732 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:42.902546    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57d567598c-tmjd8"
Sep 11 14:23:53.909793 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:53.909759    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-57d567598c-tmjd8"
Sep 11 14:23:53.932817 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:23:53.932765    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-57d567598c-tmjd8" podStartSLOduration=12.754411358 podStartE2EDuration="14.932747748s" totalImagesPullingTime="2.17833639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:23:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:23:42.962410229 +0000 UTC m=+515.761045010" watchObservedRunningTime="2026-09-11 14:23:53.932747748 +0000 UTC m=+526.731382531"
Sep 11 14:24:11.069002 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:11.068958    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:24:12.139053 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:12.139012    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:24:12.216260 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:12.216229    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:24:16.055785 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:16.055743    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:24:16.159802 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:16.159767    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:24:17.705688 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:17.705650    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:24:17.880744 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:17.880706    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:24:18.037786 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:18.037672    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:24:18.132196 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:18.132161    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:24:18.604945 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:18.604900    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:24:18.723297 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:18.723259    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:24:18.878930 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:18.878854    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-twqsk"]
Sep 11 14:24:18.885348 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:18.885326    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-twqsk"
Sep 11 14:24:18.889466 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:18.889450    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 11 14:24:18.905763 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:18.905741    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-twqsk"]
Sep 11 14:24:18.972857 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:18.972813    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-7v489"]
Sep 11 14:24:18.976000 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:18.975976    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-7v489"
Sep 11 14:24:19.002818 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:19.002795    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-m4bvs\""
Sep 11 14:24:19.022785 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:19.022761    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-7v489"]
Sep 11 14:24:19.025151 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:19.025130    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1af58b6-5525-47e0-89fe-18582bb741ac-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-twqsk\" (UID: \"f1af58b6-5525-47e0-89fe-18582bb741ac\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-twqsk"
Sep 11 14:24:19.025258 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:19.025169    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7p6d\" (UniqueName: \"kubernetes.io/projected/f1af58b6-5525-47e0-89fe-18582bb741ac-kube-api-access-z7p6d\") pod \"payload-pre-processing-59fbc47bf8-twqsk\" (UID: \"f1af58b6-5525-47e0-89fe-18582bb741ac\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-twqsk"
Sep 11 14:24:19.125802 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:19.125775    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7p6d\" (UniqueName: \"kubernetes.io/projected/f1af58b6-5525-47e0-89fe-18582bb741ac-kube-api-access-z7p6d\") pod \"payload-pre-processing-59fbc47bf8-twqsk\" (UID: \"f1af58b6-5525-47e0-89fe-18582bb741ac\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-twqsk"
Sep 11 14:24:19.125964 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:19.125824    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwfsb\" (UniqueName: \"kubernetes.io/projected/6f7d76f2-d602-4dfa-a01c-67d6294ea8ac-kube-api-access-qwfsb\") pod \"payload-processing-5b54b7fbb7-7v489\" (UID: \"6f7d76f2-d602-4dfa-a01c-67d6294ea8ac\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-7v489"
Sep 11 14:24:19.125964 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:19.125881    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1af58b6-5525-47e0-89fe-18582bb741ac-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-twqsk\" (UID: \"f1af58b6-5525-47e0-89fe-18582bb741ac\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-twqsk"
Sep 11 14:24:19.125964 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:19.125898    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f7d76f2-d602-4dfa-a01c-67d6294ea8ac-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-7v489\" (UID: \"6f7d76f2-d602-4dfa-a01c-67d6294ea8ac\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-7v489"
Sep 11 14:24:19.126528 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:19.126510    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1af58b6-5525-47e0-89fe-18582bb741ac-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-twqsk\" (UID: \"f1af58b6-5525-47e0-89fe-18582bb741ac\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-twqsk"
Sep 11 14:24:19.144535 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:19.144470    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7p6d\" (UniqueName: \"kubernetes.io/projected/f1af58b6-5525-47e0-89fe-18582bb741ac-kube-api-access-z7p6d\") pod \"payload-pre-processing-59fbc47bf8-twqsk\" (UID: \"f1af58b6-5525-47e0-89fe-18582bb741ac\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-twqsk"
Sep 11 14:24:19.194472 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:19.194444    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-twqsk"
Sep 11 14:24:19.227088 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:19.227060    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f7d76f2-d602-4dfa-a01c-67d6294ea8ac-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-7v489\" (UID: \"6f7d76f2-d602-4dfa-a01c-67d6294ea8ac\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-7v489"
Sep 11 14:24:19.227220 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:19.227125    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwfsb\" (UniqueName: \"kubernetes.io/projected/6f7d76f2-d602-4dfa-a01c-67d6294ea8ac-kube-api-access-qwfsb\") pod \"payload-processing-5b54b7fbb7-7v489\" (UID: \"6f7d76f2-d602-4dfa-a01c-67d6294ea8ac\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-7v489"
Sep 11 14:24:19.227857 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:19.227837    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f7d76f2-d602-4dfa-a01c-67d6294ea8ac-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-7v489\" (UID: \"6f7d76f2-d602-4dfa-a01c-67d6294ea8ac\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-7v489"
Sep 11 14:24:19.248408 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:19.248332    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwfsb\" (UniqueName: \"kubernetes.io/projected/6f7d76f2-d602-4dfa-a01c-67d6294ea8ac-kube-api-access-qwfsb\") pod \"payload-processing-5b54b7fbb7-7v489\" (UID: \"6f7d76f2-d602-4dfa-a01c-67d6294ea8ac\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-7v489"
Sep 11 14:24:19.285646 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:19.285609    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-7v489"
Sep 11 14:24:19.340044 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:19.338762    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:24:19.502317 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:19.502293    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-twqsk"]
Sep 11 14:24:19.504708 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:24:19.504666    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1af58b6_5525_47e0_89fe_18582bb741ac.slice/crio-e25ab0e011c3145e7b3b2adb018057cfd6c879bfac337a1fe10e15ba6dbcf5b8 WatchSource:0}: Error finding container e25ab0e011c3145e7b3b2adb018057cfd6c879bfac337a1fe10e15ba6dbcf5b8: Status 404 returned error can't find the container with id e25ab0e011c3145e7b3b2adb018057cfd6c879bfac337a1fe10e15ba6dbcf5b8
Sep 11 14:24:19.571704 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:19.571662    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-7v489"]
Sep 11 14:24:19.574347 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:24:19.574321    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f7d76f2_d602_4dfa_a01c_67d6294ea8ac.slice/crio-50e4ff1480d694709f8f18aea7e8671dea37878de1739505c0f6dd045928e5e2 WatchSource:0}: Error finding container 50e4ff1480d694709f8f18aea7e8671dea37878de1739505c0f6dd045928e5e2: Status 404 returned error can't find the container with id 50e4ff1480d694709f8f18aea7e8671dea37878de1739505c0f6dd045928e5e2
Sep 11 14:24:20.071667 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:20.071632    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-7v489" event={"ID":"6f7d76f2-d602-4dfa-a01c-67d6294ea8ac","Type":"ContainerStarted","Data":"50e4ff1480d694709f8f18aea7e8671dea37878de1739505c0f6dd045928e5e2"}
Sep 11 14:24:20.072915 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:20.072891    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-twqsk" event={"ID":"f1af58b6-5525-47e0-89fe-18582bb741ac","Type":"ContainerStarted","Data":"e25ab0e011c3145e7b3b2adb018057cfd6c879bfac337a1fe10e15ba6dbcf5b8"}
Sep 11 14:24:23.091373 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:23.091331    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-7v489" event={"ID":"6f7d76f2-d602-4dfa-a01c-67d6294ea8ac","Type":"ContainerStarted","Data":"cd07310fb7a2775284f3c08ca4483639eb897b05d0ff2a1577d3f222b346da0b"}
Sep 11 14:24:23.091850 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:23.091455    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-7v489"
Sep 11 14:24:23.092972 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:23.092950    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-twqsk" event={"ID":"f1af58b6-5525-47e0-89fe-18582bb741ac","Type":"ContainerStarted","Data":"c28c8a501b13943399978dfae8e1f85490b0964249e84ea5e76aca346178815b"}
Sep 11 14:24:23.093090 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:23.093079    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-twqsk"
Sep 11 14:24:23.115069 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:23.115023    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-7v489" podStartSLOduration=2.522729585 podStartE2EDuration="5.115008287s" totalImagesPullingTime="2.592278702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:24:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:24:23.112446424 +0000 UTC m=+555.911081206" watchObservedRunningTime="2026-09-11 14:24:23.115008287 +0000 UTC m=+555.913643085"
Sep 11 14:24:23.134611 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:23.134565    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-twqsk" podStartSLOduration=2.466412268 podStartE2EDuration="5.13455131s" totalImagesPullingTime="2.668139042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:24:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:24:23.133770781 +0000 UTC m=+555.932405568" watchObservedRunningTime="2026-09-11 14:24:23.13455131 +0000 UTC m=+555.933186092"
Sep 11 14:24:28.303408 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:28.303366    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:24:28.388354 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:28.388318    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:24:34.099585 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:34.099556    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-twqsk"
Sep 11 14:24:34.099979 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:34.099619    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-7v489"
Sep 11 14:24:48.564969 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:48.564924    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:24:48.972704 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:48.972608    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:24:57.119633 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:57.119589    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:24:58.114232 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:24:58.114204    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:25:07.396850 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.396819    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm"]
Sep 11 14:25:07.399738 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.399719    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm"
Sep 11 14:25:07.402561 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.402541    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 14:25:07.402561 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.402550    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jg47g\""
Sep 11 14:25:07.402735 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.402541    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 11 14:25:07.403340 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.403325    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 14:25:07.412942 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.412919    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm"]
Sep 11 14:25:07.422970 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.422948    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:25:07.500207 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.500183    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88a84744-596b-4ac8-93c0-5586fb0c4b99-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm\" (UID: \"88a84744-596b-4ac8-93c0-5586fb0c4b99\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm"
Sep 11 14:25:07.500308 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.500217    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88a84744-596b-4ac8-93c0-5586fb0c4b99-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm\" (UID: \"88a84744-596b-4ac8-93c0-5586fb0c4b99\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm"
Sep 11 14:25:07.500308 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.500245    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb5sd\" (UniqueName: \"kubernetes.io/projected/88a84744-596b-4ac8-93c0-5586fb0c4b99-kube-api-access-gb5sd\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm\" (UID: \"88a84744-596b-4ac8-93c0-5586fb0c4b99\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm"
Sep 11 14:25:07.500382 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.500332    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88a84744-596b-4ac8-93c0-5586fb0c4b99-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm\" (UID: \"88a84744-596b-4ac8-93c0-5586fb0c4b99\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm"
Sep 11 14:25:07.500382 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.500356    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88a84744-596b-4ac8-93c0-5586fb0c4b99-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm\" (UID: \"88a84744-596b-4ac8-93c0-5586fb0c4b99\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm"
Sep 11 14:25:07.500382 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.500378    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88a84744-596b-4ac8-93c0-5586fb0c4b99-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm\" (UID: \"88a84744-596b-4ac8-93c0-5586fb0c4b99\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm"
Sep 11 14:25:07.600805 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.600781    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88a84744-596b-4ac8-93c0-5586fb0c4b99-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm\" (UID: \"88a84744-596b-4ac8-93c0-5586fb0c4b99\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm"
Sep 11 14:25:07.600996 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.600975    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88a84744-596b-4ac8-93c0-5586fb0c4b99-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm\" (UID: \"88a84744-596b-4ac8-93c0-5586fb0c4b99\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm"
Sep 11 14:25:07.601078 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.601061    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb5sd\" (UniqueName: \"kubernetes.io/projected/88a84744-596b-4ac8-93c0-5586fb0c4b99-kube-api-access-gb5sd\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm\" (UID: \"88a84744-596b-4ac8-93c0-5586fb0c4b99\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm"
Sep 11 14:25:07.601153 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.601135    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88a84744-596b-4ac8-93c0-5586fb0c4b99-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm\" (UID: \"88a84744-596b-4ac8-93c0-5586fb0c4b99\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm"
Sep 11 14:25:07.601216 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.601156    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88a84744-596b-4ac8-93c0-5586fb0c4b99-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm\" (UID: \"88a84744-596b-4ac8-93c0-5586fb0c4b99\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm"
Sep 11 14:25:07.601216 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.601167    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88a84744-596b-4ac8-93c0-5586fb0c4b99-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm\" (UID: \"88a84744-596b-4ac8-93c0-5586fb0c4b99\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm"
Sep 11 14:25:07.601216 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.601211    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88a84744-596b-4ac8-93c0-5586fb0c4b99-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm\" (UID: \"88a84744-596b-4ac8-93c0-5586fb0c4b99\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm"
Sep 11 14:25:07.601447 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.601422    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88a84744-596b-4ac8-93c0-5586fb0c4b99-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm\" (UID: \"88a84744-596b-4ac8-93c0-5586fb0c4b99\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm"
Sep 11 14:25:07.601610 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.601590    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88a84744-596b-4ac8-93c0-5586fb0c4b99-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm\" (UID: \"88a84744-596b-4ac8-93c0-5586fb0c4b99\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm"
Sep 11 14:25:07.603377 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.603354    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88a84744-596b-4ac8-93c0-5586fb0c4b99-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm\" (UID: \"88a84744-596b-4ac8-93c0-5586fb0c4b99\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm"
Sep 11 14:25:07.604250 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.604232    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 11 14:25:07.611212 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.611197    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 14:25:07.614212 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.614184    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88a84744-596b-4ac8-93c0-5586fb0c4b99-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm\" (UID: \"88a84744-596b-4ac8-93c0-5586fb0c4b99\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm"
Sep 11 14:25:07.621856 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.621834    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 14:25:07.632048 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.632029    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb5sd\" (UniqueName: \"kubernetes.io/projected/88a84744-596b-4ac8-93c0-5586fb0c4b99-kube-api-access-gb5sd\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm\" (UID: \"88a84744-596b-4ac8-93c0-5586fb0c4b99\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm"
Sep 11 14:25:07.711600 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.711547    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jg47g\""
Sep 11 14:25:07.719105 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:07.719083    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm"
Sep 11 14:25:08.006724 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:08.001608    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm"]
Sep 11 14:25:08.006724 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:25:08.003325    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88a84744_596b_4ac8_93c0_5586fb0c4b99.slice/crio-7383186ad0374174f2ed70df7aa7f5d8796d874c3545ef3d14ebe1cf68d47af6 WatchSource:0}: Error finding container 7383186ad0374174f2ed70df7aa7f5d8796d874c3545ef3d14ebe1cf68d47af6: Status 404 returned error can't find the container with id 7383186ad0374174f2ed70df7aa7f5d8796d874c3545ef3d14ebe1cf68d47af6
Sep 11 14:25:08.314596 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:08.314567    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm" event={"ID":"88a84744-596b-4ac8-93c0-5586fb0c4b99","Type":"ContainerStarted","Data":"7383186ad0374174f2ed70df7aa7f5d8796d874c3545ef3d14ebe1cf68d47af6"}
Sep 11 14:25:08.406015 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:08.405981    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:25:09.321725 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:09.321698    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm" event={"ID":"88a84744-596b-4ac8-93c0-5586fb0c4b99","Type":"ContainerStarted","Data":"c723513d36ab331af991eadc5ceb1d33fcb3f3c882a771a775823ed773ef2446"}
Sep 11 14:25:09.344195 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:09.344149    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm" podStartSLOduration=1.179391555 podStartE2EDuration="2.34413325s" totalImagesPullingTime="1.164741695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:25:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:25:09.342438231 +0000 UTC m=+602.141073012" watchObservedRunningTime="2026-09-11 14:25:09.34413325 +0000 UTC m=+602.142768032"
Sep 11 14:25:11.931200 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:11.931158    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:25:13.159125 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:13.159098    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:25:17.719788 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:17.719753    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm"
Sep 11 14:25:17.720281 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:17.719830    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm"
Sep 11 14:25:17.732804 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:17.732775    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm"
Sep 11 14:25:18.300514 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:18.300482    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:25:18.372710 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:18.372666    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm"
Sep 11 14:25:19.891229 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:19.891187    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx"]
Sep 11 14:25:19.895051 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:19.895028    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx"
Sep 11 14:25:19.898588 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:19.898568    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 11 14:25:19.924157 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:19.924130    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx"]
Sep 11 14:25:19.940528 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:19.940500    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:25:19.994733 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:19.994705    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f4fcffb-1812-4de9-805a-bcdad34d16fa-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx\" (UID: \"0f4fcffb-1812-4de9-805a-bcdad34d16fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx"
Sep 11 14:25:19.994822 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:19.994746    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f4fcffb-1812-4de9-805a-bcdad34d16fa-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx\" (UID: \"0f4fcffb-1812-4de9-805a-bcdad34d16fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx"
Sep 11 14:25:19.994875 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:19.994838    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f4fcffb-1812-4de9-805a-bcdad34d16fa-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx\" (UID: \"0f4fcffb-1812-4de9-805a-bcdad34d16fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx"
Sep 11 14:25:19.994875 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:19.994868    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f4fcffb-1812-4de9-805a-bcdad34d16fa-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx\" (UID: \"0f4fcffb-1812-4de9-805a-bcdad34d16fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx"
Sep 11 14:25:19.994947 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:19.994888    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f4fcffb-1812-4de9-805a-bcdad34d16fa-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx\" (UID: \"0f4fcffb-1812-4de9-805a-bcdad34d16fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx"
Sep 11 14:25:19.994947 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:19.994903    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6zpq\" (UniqueName: \"kubernetes.io/projected/0f4fcffb-1812-4de9-805a-bcdad34d16fa-kube-api-access-c6zpq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx\" (UID: \"0f4fcffb-1812-4de9-805a-bcdad34d16fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx"
Sep 11 14:25:20.095290 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:20.095261    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f4fcffb-1812-4de9-805a-bcdad34d16fa-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx\" (UID: \"0f4fcffb-1812-4de9-805a-bcdad34d16fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx"
Sep 11 14:25:20.095407 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:20.095296    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f4fcffb-1812-4de9-805a-bcdad34d16fa-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx\" (UID: \"0f4fcffb-1812-4de9-805a-bcdad34d16fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx"
Sep 11 14:25:20.095407 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:20.095315    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f4fcffb-1812-4de9-805a-bcdad34d16fa-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx\" (UID: \"0f4fcffb-1812-4de9-805a-bcdad34d16fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx"
Sep 11 14:25:20.095407 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:20.095338    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6zpq\" (UniqueName: \"kubernetes.io/projected/0f4fcffb-1812-4de9-805a-bcdad34d16fa-kube-api-access-c6zpq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx\" (UID: \"0f4fcffb-1812-4de9-805a-bcdad34d16fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx"
Sep 11 14:25:20.095534 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:20.095421    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f4fcffb-1812-4de9-805a-bcdad34d16fa-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx\" (UID: \"0f4fcffb-1812-4de9-805a-bcdad34d16fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx"
Sep 11 14:25:20.095534 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:20.095447    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f4fcffb-1812-4de9-805a-bcdad34d16fa-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx\" (UID: \"0f4fcffb-1812-4de9-805a-bcdad34d16fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx"
Sep 11 14:25:20.095747 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:20.095727    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f4fcffb-1812-4de9-805a-bcdad34d16fa-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx\" (UID: \"0f4fcffb-1812-4de9-805a-bcdad34d16fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx"
Sep 11 14:25:20.095805 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:20.095784    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f4fcffb-1812-4de9-805a-bcdad34d16fa-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx\" (UID: \"0f4fcffb-1812-4de9-805a-bcdad34d16fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx"
Sep 11 14:25:20.095848 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:20.095830    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f4fcffb-1812-4de9-805a-bcdad34d16fa-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx\" (UID: \"0f4fcffb-1812-4de9-805a-bcdad34d16fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx"
Sep 11 14:25:20.097658 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:20.097636    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f4fcffb-1812-4de9-805a-bcdad34d16fa-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx\" (UID: \"0f4fcffb-1812-4de9-805a-bcdad34d16fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx"
Sep 11 14:25:20.097943 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:20.097924    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f4fcffb-1812-4de9-805a-bcdad34d16fa-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx\" (UID: \"0f4fcffb-1812-4de9-805a-bcdad34d16fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx"
Sep 11 14:25:20.105822 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:20.105801    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6zpq\" (UniqueName: \"kubernetes.io/projected/0f4fcffb-1812-4de9-805a-bcdad34d16fa-kube-api-access-c6zpq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx\" (UID: \"0f4fcffb-1812-4de9-805a-bcdad34d16fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx"
Sep 11 14:25:20.204988 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:20.204934    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx"
Sep 11 14:25:20.486148 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:20.486068    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx"]
Sep 11 14:25:20.488336 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:25:20.488309    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f4fcffb_1812_4de9_805a_bcdad34d16fa.slice/crio-da5016f40c47f0478bd2fdd1e52bbfebdb75a99f1713976d90b11ffd1c898844 WatchSource:0}: Error finding container da5016f40c47f0478bd2fdd1e52bbfebdb75a99f1713976d90b11ffd1c898844: Status 404 returned error can't find the container with id da5016f40c47f0478bd2fdd1e52bbfebdb75a99f1713976d90b11ffd1c898844
Sep 11 14:25:21.377758 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:21.377721    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx" event={"ID":"0f4fcffb-1812-4de9-805a-bcdad34d16fa","Type":"ContainerStarted","Data":"af384ccf459b0c16390d3d952d5bc34d3cd4f6c83c03b66a3e5f3cc4f3d65e19"}
Sep 11 14:25:21.378200 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:21.377786    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx" event={"ID":"0f4fcffb-1812-4de9-805a-bcdad34d16fa","Type":"ContainerStarted","Data":"da5016f40c47f0478bd2fdd1e52bbfebdb75a99f1713976d90b11ffd1c898844"}
Sep 11 14:25:21.401554 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:21.401506    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx" podStartSLOduration=2.191436843 podStartE2EDuration="2.401491389s" totalImagesPullingTime="210.054546ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:25:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:25:21.400969911 +0000 UTC m=+614.199604697" watchObservedRunningTime="2026-09-11 14:25:21.401491389 +0000 UTC m=+614.200126171"
Sep 11 14:25:21.605515 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:21.605486    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:25:28.893407 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:28.893373    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:25:30.205481 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:30.205406    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx"
Sep 11 14:25:30.205481 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:30.205473    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx"
Sep 11 14:25:30.217749 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:30.217727    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx"
Sep 11 14:25:30.433278 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:30.433250    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx"
Sep 11 14:25:30.703945 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:30.703904    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:25:32.435388 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:32.435347    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:25:37.590395 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:25:37.590356    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:26:14.916181 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:14.916140    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:26:14.988459 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:14.988427    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:26:32.554108 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:32.554062    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:26:32.655109 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:32.655059    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:26:33.837275 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:33.837249    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:26:33.932166 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:33.932140    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:26:50.689811 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:50.689772    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:26:50.790053 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:50.790023    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:26:51.098572 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:51.098537    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:26:51.393845 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:51.393758    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:26:52.208499 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:52.208463    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:26:52.305150 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:52.305103    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:26:52.722414 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:52.722377    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:26:53.891603 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:53.891566    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:26:53.991857 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:53.991828    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:26:54.304005 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:54.303974    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:26:55.111543 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:55.111512    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:26:55.219662 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:55.219626    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:26:55.394324 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:55.394250    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:26:55.690089 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:55.689988    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:26:55.872646 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:55.872615    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a39864-55b5b965d6-jdfhp"]
Sep 11 14:26:55.876235 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:55.876213    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a39864-55b5b965d6-jdfhp"
Sep 11 14:26:55.878833 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:55.878810    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-a39864\""
Sep 11 14:26:55.878996 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:55.878978    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-a39864-dockercfg-xcndl\""
Sep 11 14:26:55.892954 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:55.892933    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a39864-55b5b965d6-jdfhp"]
Sep 11 14:26:55.939470 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:55.939438    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05b406c9-95a0-46fb-9751-0693fb9d0f0c-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-a39864-55b5b965d6-jdfhp\" (UID: \"05b406c9-95a0-46fb-9751-0693fb9d0f0c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a39864-55b5b965d6-jdfhp"
Sep 11 14:26:55.939630 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:55.939504    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpxpk\" (UniqueName: \"kubernetes.io/projected/05b406c9-95a0-46fb-9751-0693fb9d0f0c-kube-api-access-wpxpk\") pod \"payload-pre-processing-e2e-inf-a-a39864-55b5b965d6-jdfhp\" (UID: \"05b406c9-95a0-46fb-9751-0693fb9d0f0c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a39864-55b5b965d6-jdfhp"
Sep 11 14:26:55.957202 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:55.957137    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a39864-566d6bc64c-z9tvv"]
Sep 11 14:26:55.960471 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:55.960455    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-a39864-566d6bc64c-z9tvv"
Sep 11 14:26:55.971181 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:55.971155    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a39864-566d6bc64c-z9tvv"]
Sep 11 14:26:56.040171 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:56.040132    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjx6j\" (UniqueName: \"kubernetes.io/projected/b18ba9a4-6f28-4368-bfcb-827fe0b03a00-kube-api-access-rjx6j\") pod \"payload-processing-e2e-inf-a-a39864-566d6bc64c-z9tvv\" (UID: \"b18ba9a4-6f28-4368-bfcb-827fe0b03a00\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a39864-566d6bc64c-z9tvv"
Sep 11 14:26:56.040171 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:56.040172    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b18ba9a4-6f28-4368-bfcb-827fe0b03a00-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-a39864-566d6bc64c-z9tvv\" (UID: \"b18ba9a4-6f28-4368-bfcb-827fe0b03a00\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a39864-566d6bc64c-z9tvv"
Sep 11 14:26:56.040390 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:56.040263    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05b406c9-95a0-46fb-9751-0693fb9d0f0c-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-a39864-55b5b965d6-jdfhp\" (UID: \"05b406c9-95a0-46fb-9751-0693fb9d0f0c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a39864-55b5b965d6-jdfhp"
Sep 11 14:26:56.040450 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:56.040415    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpxpk\" (UniqueName: \"kubernetes.io/projected/05b406c9-95a0-46fb-9751-0693fb9d0f0c-kube-api-access-wpxpk\") pod \"payload-pre-processing-e2e-inf-a-a39864-55b5b965d6-jdfhp\" (UID: \"05b406c9-95a0-46fb-9751-0693fb9d0f0c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a39864-55b5b965d6-jdfhp"
Sep 11 14:26:56.041249 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:56.041217    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05b406c9-95a0-46fb-9751-0693fb9d0f0c-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-a39864-55b5b965d6-jdfhp\" (UID: \"05b406c9-95a0-46fb-9751-0693fb9d0f0c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a39864-55b5b965d6-jdfhp"
Sep 11 14:26:56.048244 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:56.048221    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpxpk\" (UniqueName: \"kubernetes.io/projected/05b406c9-95a0-46fb-9751-0693fb9d0f0c-kube-api-access-wpxpk\") pod \"payload-pre-processing-e2e-inf-a-a39864-55b5b965d6-jdfhp\" (UID: \"05b406c9-95a0-46fb-9751-0693fb9d0f0c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a39864-55b5b965d6-jdfhp"
Sep 11 14:26:56.141722 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:56.141692    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjx6j\" (UniqueName: \"kubernetes.io/projected/b18ba9a4-6f28-4368-bfcb-827fe0b03a00-kube-api-access-rjx6j\") pod \"payload-processing-e2e-inf-a-a39864-566d6bc64c-z9tvv\" (UID: \"b18ba9a4-6f28-4368-bfcb-827fe0b03a00\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a39864-566d6bc64c-z9tvv"
Sep 11 14:26:56.141722 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:56.141727    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b18ba9a4-6f28-4368-bfcb-827fe0b03a00-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-a39864-566d6bc64c-z9tvv\" (UID: \"b18ba9a4-6f28-4368-bfcb-827fe0b03a00\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a39864-566d6bc64c-z9tvv"
Sep 11 14:26:56.142374 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:56.142356    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b18ba9a4-6f28-4368-bfcb-827fe0b03a00-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-a39864-566d6bc64c-z9tvv\" (UID: \"b18ba9a4-6f28-4368-bfcb-827fe0b03a00\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a39864-566d6bc64c-z9tvv"
Sep 11 14:26:56.152184 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:56.152134    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjx6j\" (UniqueName: \"kubernetes.io/projected/b18ba9a4-6f28-4368-bfcb-827fe0b03a00-kube-api-access-rjx6j\") pod \"payload-processing-e2e-inf-a-a39864-566d6bc64c-z9tvv\" (UID: \"b18ba9a4-6f28-4368-bfcb-827fe0b03a00\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a39864-566d6bc64c-z9tvv"
Sep 11 14:26:56.152433 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:56.152403    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:26:56.186152 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:56.186125    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a39864-55b5b965d6-jdfhp"
Sep 11 14:26:56.272509 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:56.272473    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-a39864-566d6bc64c-z9tvv"
Sep 11 14:26:56.459591 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:56.459570    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a39864-55b5b965d6-jdfhp"]
Sep 11 14:26:56.461755 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:26:56.461727    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05b406c9_95a0_46fb_9751_0693fb9d0f0c.slice/crio-389aee6e3f28895aa6ee7e4227e5a1a51c458221642fc5716898fa2c8b816403 WatchSource:0}: Error finding container 389aee6e3f28895aa6ee7e4227e5a1a51c458221642fc5716898fa2c8b816403: Status 404 returned error can't find the container with id 389aee6e3f28895aa6ee7e4227e5a1a51c458221642fc5716898fa2c8b816403
Sep 11 14:26:56.550811 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:56.550784    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a39864-566d6bc64c-z9tvv"]
Sep 11 14:26:56.552591 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:26:56.552569    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb18ba9a4_6f28_4368_bfcb_827fe0b03a00.slice/crio-98c57b232deeadf43503bdbe97bd54cbbdc6ba1e87862d23a37a4e960ad49fd3 WatchSource:0}: Error finding container 98c57b232deeadf43503bdbe97bd54cbbdc6ba1e87862d23a37a4e960ad49fd3: Status 404 returned error can't find the container with id 98c57b232deeadf43503bdbe97bd54cbbdc6ba1e87862d23a37a4e960ad49fd3
Sep 11 14:26:56.816964 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:56.816927    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-a39864-566d6bc64c-z9tvv" event={"ID":"b18ba9a4-6f28-4368-bfcb-827fe0b03a00","Type":"ContainerStarted","Data":"a43d11a527a53ad136601e41637634b7834f47600643ebbd0da1e22ff5b20fab"}
Sep 11 14:26:56.817156 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:56.816996    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-a39864-566d6bc64c-z9tvv" event={"ID":"b18ba9a4-6f28-4368-bfcb-827fe0b03a00","Type":"ContainerStarted","Data":"98c57b232deeadf43503bdbe97bd54cbbdc6ba1e87862d23a37a4e960ad49fd3"}
Sep 11 14:26:56.817156 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:56.817033    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-a39864-566d6bc64c-z9tvv"
Sep 11 14:26:56.818791 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:56.818759    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a39864-55b5b965d6-jdfhp" event={"ID":"05b406c9-95a0-46fb-9751-0693fb9d0f0c","Type":"ContainerStarted","Data":"2c114c98b82f7cc4112027bcf28bf1c049936b368f415f493c7df55d10115313"}
Sep 11 14:26:56.818910 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:56.818817    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a39864-55b5b965d6-jdfhp" event={"ID":"05b406c9-95a0-46fb-9751-0693fb9d0f0c","Type":"ContainerStarted","Data":"389aee6e3f28895aa6ee7e4227e5a1a51c458221642fc5716898fa2c8b816403"}
Sep 11 14:26:56.818910 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:56.818846    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a39864-55b5b965d6-jdfhp"
Sep 11 14:26:56.836016 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:56.835958    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-a39864-566d6bc64c-z9tvv" podStartSLOduration=1.835938724 podStartE2EDuration="1.835938724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:26:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:26:56.833999713 +0000 UTC m=+709.632634520" watchObservedRunningTime="2026-09-11 14:26:56.835938724 +0000 UTC m=+709.634573509"
Sep 11 14:26:56.851275 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:56.851210    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a39864-55b5b965d6-jdfhp" podStartSLOduration=1.851190704 podStartE2EDuration="1.851190704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:26:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:26:56.850538964 +0000 UTC m=+709.649173747" watchObservedRunningTime="2026-09-11 14:26:56.851190704 +0000 UTC m=+709.649825484"
Sep 11 14:26:59.199001 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:59.198965    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:26:59.254565 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:59.254530    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:26:59.442020 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:59.441987    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:26:59.513775 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:59.513692    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:26:59.707378 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:59.707342    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:26:59.891151 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:59.891117    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:26:59.984443 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:26:59.984411    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:01.599657 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:01.599620    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:02.374943 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:02.374906    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:02.544024 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:02.543965    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:02.648128 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:02.648044    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:02.961343 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:02.961260    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:03.127998 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:03.127960    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:03.247101 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:03.247005    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:04.231611 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:04.231578    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:27:04.459592 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:04.459555    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:04.562069 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:04.562034    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:04.782100 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:04.782045    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:05.087885 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:05.087845    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:05.192365 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:05.192319    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:05.271104 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:05.271072    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-b4a233-58c977bb86-fjmm8"]
Sep 11 14:27:05.273542 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:05.273524    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-b4a233-58c977bb86-fjmm8"
Sep 11 14:27:05.276171 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:05.276147    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-b4a233\""
Sep 11 14:27:05.276262 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:05.276232    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-b4a233-dockercfg-7574g\""
Sep 11 14:27:05.289282 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:05.289257    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-b4a233-58c977bb86-fjmm8"]
Sep 11 14:27:05.324212 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:05.324173    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60a8da00-e5db-45ff-a57a-0c8c9639be33-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-b4a233-58c977bb86-fjmm8\" (UID: \"60a8da00-e5db-45ff-a57a-0c8c9639be33\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-b4a233-58c977bb86-fjmm8"
Sep 11 14:27:05.324370 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:05.324221    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v995\" (UniqueName: \"kubernetes.io/projected/60a8da00-e5db-45ff-a57a-0c8c9639be33-kube-api-access-6v995\") pod \"payload-pre-processing-e2e-autores-b4a233-58c977bb86-fjmm8\" (UID: \"60a8da00-e5db-45ff-a57a-0c8c9639be33\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-b4a233-58c977bb86-fjmm8"
Sep 11 14:27:05.386030 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:05.385947    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-b4a233-c57c5c7f9-f8h7s"]
Sep 11 14:27:05.388460 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:05.388441    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-b4a233-c57c5c7f9-f8h7s"
Sep 11 14:27:05.405517 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:05.405494    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-b4a233-c57c5c7f9-f8h7s"]
Sep 11 14:27:05.425749 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:05.425717    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v995\" (UniqueName: \"kubernetes.io/projected/60a8da00-e5db-45ff-a57a-0c8c9639be33-kube-api-access-6v995\") pod \"payload-pre-processing-e2e-autores-b4a233-58c977bb86-fjmm8\" (UID: \"60a8da00-e5db-45ff-a57a-0c8c9639be33\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-b4a233-58c977bb86-fjmm8"
Sep 11 14:27:05.425900 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:05.425809    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q6rw\" (UniqueName: \"kubernetes.io/projected/5584d036-8a73-48c2-9cb3-870654179634-kube-api-access-9q6rw\") pod \"payload-processing-e2e-autores-b4a233-c57c5c7f9-f8h7s\" (UID: \"5584d036-8a73-48c2-9cb3-870654179634\") " pod="openshift-ingress/payload-processing-e2e-autores-b4a233-c57c5c7f9-f8h7s"
Sep 11 14:27:05.425900 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:05.425877    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5584d036-8a73-48c2-9cb3-870654179634-plugins-config-volume\") pod \"payload-processing-e2e-autores-b4a233-c57c5c7f9-f8h7s\" (UID: \"5584d036-8a73-48c2-9cb3-870654179634\") " pod="openshift-ingress/payload-processing-e2e-autores-b4a233-c57c5c7f9-f8h7s"
Sep 11 14:27:05.426021 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:05.425916    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60a8da00-e5db-45ff-a57a-0c8c9639be33-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-b4a233-58c977bb86-fjmm8\" (UID: \"60a8da00-e5db-45ff-a57a-0c8c9639be33\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-b4a233-58c977bb86-fjmm8"
Sep 11 14:27:05.426593 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:05.426568    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60a8da00-e5db-45ff-a57a-0c8c9639be33-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-b4a233-58c977bb86-fjmm8\" (UID: \"60a8da00-e5db-45ff-a57a-0c8c9639be33\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-b4a233-58c977bb86-fjmm8"
Sep 11 14:27:05.440152 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:05.440130    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v995\" (UniqueName: \"kubernetes.io/projected/60a8da00-e5db-45ff-a57a-0c8c9639be33-kube-api-access-6v995\") pod \"payload-pre-processing-e2e-autores-b4a233-58c977bb86-fjmm8\" (UID: \"60a8da00-e5db-45ff-a57a-0c8c9639be33\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-b4a233-58c977bb86-fjmm8"
Sep 11 14:27:05.527397 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:05.527357    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q6rw\" (UniqueName: \"kubernetes.io/projected/5584d036-8a73-48c2-9cb3-870654179634-kube-api-access-9q6rw\") pod \"payload-processing-e2e-autores-b4a233-c57c5c7f9-f8h7s\" (UID: \"5584d036-8a73-48c2-9cb3-870654179634\") " pod="openshift-ingress/payload-processing-e2e-autores-b4a233-c57c5c7f9-f8h7s"
Sep 11 14:27:05.527594 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:05.527430    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5584d036-8a73-48c2-9cb3-870654179634-plugins-config-volume\") pod \"payload-processing-e2e-autores-b4a233-c57c5c7f9-f8h7s\" (UID: \"5584d036-8a73-48c2-9cb3-870654179634\") " pod="openshift-ingress/payload-processing-e2e-autores-b4a233-c57c5c7f9-f8h7s"
Sep 11 14:27:05.528225 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:05.528203    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5584d036-8a73-48c2-9cb3-870654179634-plugins-config-volume\") pod \"payload-processing-e2e-autores-b4a233-c57c5c7f9-f8h7s\" (UID: \"5584d036-8a73-48c2-9cb3-870654179634\") " pod="openshift-ingress/payload-processing-e2e-autores-b4a233-c57c5c7f9-f8h7s"
Sep 11 14:27:05.547542 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:05.547515    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q6rw\" (UniqueName: \"kubernetes.io/projected/5584d036-8a73-48c2-9cb3-870654179634-kube-api-access-9q6rw\") pod \"payload-processing-e2e-autores-b4a233-c57c5c7f9-f8h7s\" (UID: \"5584d036-8a73-48c2-9cb3-870654179634\") " pod="openshift-ingress/payload-processing-e2e-autores-b4a233-c57c5c7f9-f8h7s"
Sep 11 14:27:05.584033 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:05.583991    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-b4a233-58c977bb86-fjmm8"
Sep 11 14:27:05.698191 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:05.698161    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-b4a233-c57c5c7f9-f8h7s"
Sep 11 14:27:05.802518 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:05.802476    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:05.882530 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:05.882499    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-b4a233-58c977bb86-fjmm8"]
Sep 11 14:27:05.888119 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:27:05.888085    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60a8da00_e5db_45ff_a57a_0c8c9639be33.slice/crio-3a9d43d1e63e4acc5dd34dd5fc86280dac31e4d89a0de4e953d4cec472d9c557 WatchSource:0}: Error finding container 3a9d43d1e63e4acc5dd34dd5fc86280dac31e4d89a0de4e953d4cec472d9c557: Status 404 returned error can't find the container with id 3a9d43d1e63e4acc5dd34dd5fc86280dac31e4d89a0de4e953d4cec472d9c557
Sep 11 14:27:05.912838 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:05.912786    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:05.988463 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:05.988359    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-b4a233-c57c5c7f9-f8h7s"]
Sep 11 14:27:05.991347 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:27:05.991317    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5584d036_8a73_48c2_9cb3_870654179634.slice/crio-0243daac491cb1fec7ceae212cc90cfb47563dfe5743a261983f71e54ad37101 WatchSource:0}: Error finding container 0243daac491cb1fec7ceae212cc90cfb47563dfe5743a261983f71e54ad37101: Status 404 returned error can't find the container with id 0243daac491cb1fec7ceae212cc90cfb47563dfe5743a261983f71e54ad37101
Sep 11 14:27:06.020612 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:06.020572    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:06.736593 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:06.736560    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:06.827334 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:06.827295    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:06.850436 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:06.850401    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-43ca2273-5b55486c69-q7bfl"]
Sep 11 14:27:06.852968 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:06.852946    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-43ca2273-5b55486c69-q7bfl"
Sep 11 14:27:06.855497 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:06.855475    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-43ca2273\""
Sep 11 14:27:06.871473 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:06.871439    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-b4a233-58c977bb86-fjmm8" event={"ID":"60a8da00-e5db-45ff-a57a-0c8c9639be33","Type":"ContainerStarted","Data":"e83e6fe3f01732e18cc7b6f59bf43d9b2b5918249c8269d441d74eb59e73d013"}
Sep 11 14:27:06.871644 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:06.871501    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-b4a233-58c977bb86-fjmm8" event={"ID":"60a8da00-e5db-45ff-a57a-0c8c9639be33","Type":"ContainerStarted","Data":"3a9d43d1e63e4acc5dd34dd5fc86280dac31e4d89a0de4e953d4cec472d9c557"}
Sep 11 14:27:06.871644 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:06.871564    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-b4a233-58c977bb86-fjmm8"
Sep 11 14:27:06.874067 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:06.874034    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-b4a233-c57c5c7f9-f8h7s" event={"ID":"5584d036-8a73-48c2-9cb3-870654179634","Type":"ContainerStarted","Data":"3e92887d44ae4188e1bb7ee0a8eb7f08dc8ec3a8805a1435d792e27cb1538e16"}
Sep 11 14:27:06.874177 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:06.874099    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-b4a233-c57c5c7f9-f8h7s"
Sep 11 14:27:06.874177 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:06.874122    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-b4a233-c57c5c7f9-f8h7s" event={"ID":"5584d036-8a73-48c2-9cb3-870654179634","Type":"ContainerStarted","Data":"0243daac491cb1fec7ceae212cc90cfb47563dfe5743a261983f71e54ad37101"}
Sep 11 14:27:06.875639 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:06.875617    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-43ca2273-5b55486c69-q7bfl"]
Sep 11 14:27:06.915833 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:06.915799    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-43ca2273-595f6db5f8-b2p7m"]
Sep 11 14:27:06.918487 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:06.918453    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-43ca2273-595f6db5f8-b2p7m"
Sep 11 14:27:06.919868 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:06.919819    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-b4a233-58c977bb86-fjmm8" podStartSLOduration=1.9198011369999999 podStartE2EDuration="1.919801137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:27:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:27:06.917608092 +0000 UTC m=+719.716242874" watchObservedRunningTime="2026-09-11 14:27:06.919801137 +0000 UTC m=+719.718435922"
Sep 11 14:27:06.922382 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:06.922357    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-43ca2273-dockercfg-5w6wf\""
Sep 11 14:27:06.937026 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:06.936999    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-43ca2273-595f6db5f8-b2p7m"]
Sep 11 14:27:06.941494 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:06.941470    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8cb24168-dfea-4ed3-8573-fad2ff415d1e-plugins-config-volume\") pod \"payload-processing-e2e-ait-43ca2273-5b55486c69-q7bfl\" (UID: \"8cb24168-dfea-4ed3-8573-fad2ff415d1e\") " pod="openshift-ingress/payload-processing-e2e-ait-43ca2273-5b55486c69-q7bfl"
Sep 11 14:27:06.941620 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:06.941523    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndllj\" (UniqueName: \"kubernetes.io/projected/8cb24168-dfea-4ed3-8573-fad2ff415d1e-kube-api-access-ndllj\") pod \"payload-processing-e2e-ait-43ca2273-5b55486c69-q7bfl\" (UID: \"8cb24168-dfea-4ed3-8573-fad2ff415d1e\") " pod="openshift-ingress/payload-processing-e2e-ait-43ca2273-5b55486c69-q7bfl"
Sep 11 14:27:06.954606 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:06.954555    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-b4a233-c57c5c7f9-f8h7s" podStartSLOduration=1.954535704 podStartE2EDuration="1.954535704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:27:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:27:06.952072566 +0000 UTC m=+719.750707353" watchObservedRunningTime="2026-09-11 14:27:06.954535704 +0000 UTC m=+719.753170489"
Sep 11 14:27:07.043118 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:07.043081    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50ad49be-f1b9-4c26-aa7f-db3d05cc1401-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-43ca2273-595f6db5f8-b2p7m\" (UID: \"50ad49be-f1b9-4c26-aa7f-db3d05cc1401\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-43ca2273-595f6db5f8-b2p7m"
Sep 11 14:27:07.043296 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:07.043215    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgt64\" (UniqueName: \"kubernetes.io/projected/50ad49be-f1b9-4c26-aa7f-db3d05cc1401-kube-api-access-xgt64\") pod \"payload-pre-processing-e2e-ait-43ca2273-595f6db5f8-b2p7m\" (UID: \"50ad49be-f1b9-4c26-aa7f-db3d05cc1401\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-43ca2273-595f6db5f8-b2p7m"
Sep 11 14:27:07.043296 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:07.043262    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8cb24168-dfea-4ed3-8573-fad2ff415d1e-plugins-config-volume\") pod \"payload-processing-e2e-ait-43ca2273-5b55486c69-q7bfl\" (UID: \"8cb24168-dfea-4ed3-8573-fad2ff415d1e\") " pod="openshift-ingress/payload-processing-e2e-ait-43ca2273-5b55486c69-q7bfl"
Sep 11 14:27:07.043404 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:07.043313    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndllj\" (UniqueName: \"kubernetes.io/projected/8cb24168-dfea-4ed3-8573-fad2ff415d1e-kube-api-access-ndllj\") pod \"payload-processing-e2e-ait-43ca2273-5b55486c69-q7bfl\" (UID: \"8cb24168-dfea-4ed3-8573-fad2ff415d1e\") " pod="openshift-ingress/payload-processing-e2e-ait-43ca2273-5b55486c69-q7bfl"
Sep 11 14:27:07.044109 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:07.044077    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8cb24168-dfea-4ed3-8573-fad2ff415d1e-plugins-config-volume\") pod \"payload-processing-e2e-ait-43ca2273-5b55486c69-q7bfl\" (UID: \"8cb24168-dfea-4ed3-8573-fad2ff415d1e\") " pod="openshift-ingress/payload-processing-e2e-ait-43ca2273-5b55486c69-q7bfl"
Sep 11 14:27:07.051835 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:07.051815    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndllj\" (UniqueName: \"kubernetes.io/projected/8cb24168-dfea-4ed3-8573-fad2ff415d1e-kube-api-access-ndllj\") pod \"payload-processing-e2e-ait-43ca2273-5b55486c69-q7bfl\" (UID: \"8cb24168-dfea-4ed3-8573-fad2ff415d1e\") " pod="openshift-ingress/payload-processing-e2e-ait-43ca2273-5b55486c69-q7bfl"
Sep 11 14:27:07.143891 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:07.143849    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50ad49be-f1b9-4c26-aa7f-db3d05cc1401-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-43ca2273-595f6db5f8-b2p7m\" (UID: \"50ad49be-f1b9-4c26-aa7f-db3d05cc1401\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-43ca2273-595f6db5f8-b2p7m"
Sep 11 14:27:07.144055 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:07.143979    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgt64\" (UniqueName: \"kubernetes.io/projected/50ad49be-f1b9-4c26-aa7f-db3d05cc1401-kube-api-access-xgt64\") pod \"payload-pre-processing-e2e-ait-43ca2273-595f6db5f8-b2p7m\" (UID: \"50ad49be-f1b9-4c26-aa7f-db3d05cc1401\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-43ca2273-595f6db5f8-b2p7m"
Sep 11 14:27:07.144603 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:07.144584    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50ad49be-f1b9-4c26-aa7f-db3d05cc1401-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-43ca2273-595f6db5f8-b2p7m\" (UID: \"50ad49be-f1b9-4c26-aa7f-db3d05cc1401\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-43ca2273-595f6db5f8-b2p7m"
Sep 11 14:27:07.154852 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:07.154828    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgt64\" (UniqueName: \"kubernetes.io/projected/50ad49be-f1b9-4c26-aa7f-db3d05cc1401-kube-api-access-xgt64\") pod \"payload-pre-processing-e2e-ait-43ca2273-595f6db5f8-b2p7m\" (UID: \"50ad49be-f1b9-4c26-aa7f-db3d05cc1401\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-43ca2273-595f6db5f8-b2p7m"
Sep 11 14:27:07.163586 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:07.163565    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-43ca2273-5b55486c69-q7bfl"
Sep 11 14:27:07.230021 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:07.229993    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-43ca2273-595f6db5f8-b2p7m"
Sep 11 14:27:07.449110 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:07.449077    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-43ca2273-5b55486c69-q7bfl"]
Sep 11 14:27:07.449528 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:07.449128    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:07.451745 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:27:07.451721    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cb24168_dfea_4ed3_8573_fad2ff415d1e.slice/crio-408cb9a1896edf009632da4902775d49d84a7c8db453aea554bb84bb4547ed3d WatchSource:0}: Error finding container 408cb9a1896edf009632da4902775d49d84a7c8db453aea554bb84bb4547ed3d: Status 404 returned error can't find the container with id 408cb9a1896edf009632da4902775d49d84a7c8db453aea554bb84bb4547ed3d
Sep 11 14:27:07.512843 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:27:07.512814    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50ad49be_f1b9_4c26_aa7f_db3d05cc1401.slice/crio-4c9f6dcb6f17fcea2e7af9cb9f78e5f510ec9f3884fd81b268f09ee792fdd978 WatchSource:0}: Error finding container 4c9f6dcb6f17fcea2e7af9cb9f78e5f510ec9f3884fd81b268f09ee792fdd978: Status 404 returned error can't find the container with id 4c9f6dcb6f17fcea2e7af9cb9f78e5f510ec9f3884fd81b268f09ee792fdd978
Sep 11 14:27:07.513141 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:07.513120    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-43ca2273-595f6db5f8-b2p7m"]
Sep 11 14:27:07.826076 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:07.826046    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a39864-55b5b965d6-jdfhp"
Sep 11 14:27:07.826427 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:07.826223    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-a39864-566d6bc64c-z9tvv"
Sep 11 14:27:07.881176 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:07.881137    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-43ca2273-595f6db5f8-b2p7m" event={"ID":"50ad49be-f1b9-4c26-aa7f-db3d05cc1401","Type":"ContainerStarted","Data":"823e6ca5b4437c371510ab3dbdb3f4b45ebc1be22135d5630fbe8be5e4932afe"}
Sep 11 14:27:07.881360 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:07.881218    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-43ca2273-595f6db5f8-b2p7m" event={"ID":"50ad49be-f1b9-4c26-aa7f-db3d05cc1401","Type":"ContainerStarted","Data":"4c9f6dcb6f17fcea2e7af9cb9f78e5f510ec9f3884fd81b268f09ee792fdd978"}
Sep 11 14:27:07.881575 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:07.881556    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-43ca2273-595f6db5f8-b2p7m"
Sep 11 14:27:07.883200 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:07.883175    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-43ca2273-5b55486c69-q7bfl" event={"ID":"8cb24168-dfea-4ed3-8573-fad2ff415d1e","Type":"ContainerStarted","Data":"a276c68d2ebffeac4a46027ccc3c13daefc787513fe5e4be9d7d5b4d5b6eaf9d"}
Sep 11 14:27:07.883335 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:07.883220    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-43ca2273-5b55486c69-q7bfl" event={"ID":"8cb24168-dfea-4ed3-8573-fad2ff415d1e","Type":"ContainerStarted","Data":"408cb9a1896edf009632da4902775d49d84a7c8db453aea554bb84bb4547ed3d"}
Sep 11 14:27:07.883335 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:07.883294    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-43ca2273-5b55486c69-q7bfl"
Sep 11 14:27:07.916643 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:07.916588    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-43ca2273-595f6db5f8-b2p7m" podStartSLOduration=1.916573172 podStartE2EDuration="1.916573172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:27:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:27:07.915289477 +0000 UTC m=+720.713924260" watchObservedRunningTime="2026-09-11 14:27:07.916573172 +0000 UTC m=+720.715207977"
Sep 11 14:27:07.940945 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:07.940581    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-43ca2273-5b55486c69-q7bfl" podStartSLOduration=1.940562195 podStartE2EDuration="1.940562195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:27:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:27:07.939929982 +0000 UTC m=+720.738564776" watchObservedRunningTime="2026-09-11 14:27:07.940562195 +0000 UTC m=+720.739196977"
Sep 11 14:27:08.330126 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:08.330083    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:08.708180 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:08.708106    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:09.091080 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:09.091040    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:09.191619 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:09.191579    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:09.467217 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:09.467121    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:09.563247 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:09.563212    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:09.822868 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:09.822835    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:09.916554 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:09.916522    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:10.017809 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:10.017766    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:10.178609 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:10.178526    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:10.278394 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:10.278361    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:10.387960 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:10.387925    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:10.646725 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:10.646673    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:12.573106 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:12.573068    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:12.847562 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:12.847487    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:13.127062 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:13.126973    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:13.212403 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:13.212371    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:14.384777 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:14.384735    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:14.978541 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:14.978505    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:15.095728 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:15.095668    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:16.097751 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:16.097720    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:17.132969 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:17.132940    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:17.254833 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:17.254804    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:17.371232 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:17.371188    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:17.705462 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:17.705428    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:17.763714 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:17.763672    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43ca2273-kpw4s"]
Sep 11 14:27:17.767255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:17.767237    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43ca2273-kpw4s"
Sep 11 14:27:17.770311 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:17.770292    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dp8gp\""
Sep 11 14:27:17.781999 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:17.781976    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43ca2273-kpw4s"]
Sep 11 14:27:17.839617 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:17.839584    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24860560-43fc-42bf-b459-3ac374e24056-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-43ca2273-kpw4s\" (UID: \"24860560-43fc-42bf-b459-3ac374e24056\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43ca2273-kpw4s"
Sep 11 14:27:17.873219 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:17.873187    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:17.885883 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:17.885857    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-b4a233-c57c5c7f9-f8h7s"
Sep 11 14:27:17.886024 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:17.885924    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-b4a233-58c977bb86-fjmm8"
Sep 11 14:27:17.941074 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:17.941044    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24860560-43fc-42bf-b459-3ac374e24056-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-43ca2273-kpw4s\" (UID: \"24860560-43fc-42bf-b459-3ac374e24056\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43ca2273-kpw4s"
Sep 11 14:27:17.941643 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:17.941613    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24860560-43fc-42bf-b459-3ac374e24056-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-43ca2273-kpw4s\" (UID: \"24860560-43fc-42bf-b459-3ac374e24056\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43ca2273-kpw4s"
Sep 11 14:27:17.976144 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:17.976065    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:18.014035 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:18.014005    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-b6b864-85f4d6986c-kgzbs"]
Sep 11 14:27:18.017453 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:18.017432    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-b6b864-85f4d6986c-kgzbs"
Sep 11 14:27:18.020403 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:18.020351    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-b6b864\""
Sep 11 14:27:18.020670 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:18.020651    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-b6b864-dockercfg-vrchg\""
Sep 11 14:27:18.033364 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:18.033342    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-b6b864-85f4d6986c-kgzbs"]
Sep 11 14:27:18.081108 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:18.081078    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43ca2273-kpw4s"
Sep 11 14:27:18.144053 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:18.143783    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqnfv\" (UniqueName: \"kubernetes.io/projected/d659b308-feb5-44d5-a1eb-40a509a07068-kube-api-access-zqnfv\") pod \"payload-processing-e2e-inf-b-b6b864-85f4d6986c-kgzbs\" (UID: \"d659b308-feb5-44d5-a1eb-40a509a07068\") " pod="openshift-ingress/payload-processing-e2e-inf-b-b6b864-85f4d6986c-kgzbs"
Sep 11 14:27:18.144053 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:18.143952    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d659b308-feb5-44d5-a1eb-40a509a07068-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-b6b864-85f4d6986c-kgzbs\" (UID: \"d659b308-feb5-44d5-a1eb-40a509a07068\") " pod="openshift-ingress/payload-processing-e2e-inf-b-b6b864-85f4d6986c-kgzbs"
Sep 11 14:27:18.244885 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:18.244804    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d659b308-feb5-44d5-a1eb-40a509a07068-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-b6b864-85f4d6986c-kgzbs\" (UID: \"d659b308-feb5-44d5-a1eb-40a509a07068\") " pod="openshift-ingress/payload-processing-e2e-inf-b-b6b864-85f4d6986c-kgzbs"
Sep 11 14:27:18.244885 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:18.244873    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqnfv\" (UniqueName: \"kubernetes.io/projected/d659b308-feb5-44d5-a1eb-40a509a07068-kube-api-access-zqnfv\") pod \"payload-processing-e2e-inf-b-b6b864-85f4d6986c-kgzbs\" (UID: \"d659b308-feb5-44d5-a1eb-40a509a07068\") " pod="openshift-ingress/payload-processing-e2e-inf-b-b6b864-85f4d6986c-kgzbs"
Sep 11 14:27:18.245591 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:18.245569    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d659b308-feb5-44d5-a1eb-40a509a07068-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-b6b864-85f4d6986c-kgzbs\" (UID: \"d659b308-feb5-44d5-a1eb-40a509a07068\") " pod="openshift-ingress/payload-processing-e2e-inf-b-b6b864-85f4d6986c-kgzbs"
Sep 11 14:27:18.262848 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:18.262815    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqnfv\" (UniqueName: \"kubernetes.io/projected/d659b308-feb5-44d5-a1eb-40a509a07068-kube-api-access-zqnfv\") pod \"payload-processing-e2e-inf-b-b6b864-85f4d6986c-kgzbs\" (UID: \"d659b308-feb5-44d5-a1eb-40a509a07068\") " pod="openshift-ingress/payload-processing-e2e-inf-b-b6b864-85f4d6986c-kgzbs"
Sep 11 14:27:18.328956 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:18.328919    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-b6b864-85f4d6986c-kgzbs"
Sep 11 14:27:18.362028 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:18.362000    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43ca2273-kpw4s"]
Sep 11 14:27:18.364429 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:27:18.364403    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24860560_43fc_42bf_b459_3ac374e24056.slice/crio-b62e53b156dbce101515ab976177d9c67f5a8323be4fe07d0587b51332fd8cd8 WatchSource:0}: Error finding container b62e53b156dbce101515ab976177d9c67f5a8323be4fe07d0587b51332fd8cd8: Status 404 returned error can't find the container with id b62e53b156dbce101515ab976177d9c67f5a8323be4fe07d0587b51332fd8cd8
Sep 11 14:27:18.366422 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:18.366402    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 14:27:18.562365 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:18.562330    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:18.619324 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:18.619282    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-b6b864-85f4d6986c-kgzbs"]
Sep 11 14:27:18.620548 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:27:18.620524    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd659b308_feb5_44d5_a1eb_40a509a07068.slice/crio-91459f87696d49b837fa339055fc4adfaa46448eefcb06a4f9d4a760c0c878ae WatchSource:0}: Error finding container 91459f87696d49b837fa339055fc4adfaa46448eefcb06a4f9d4a760c0c878ae: Status 404 returned error can't find the container with id 91459f87696d49b837fa339055fc4adfaa46448eefcb06a4f9d4a760c0c878ae
Sep 11 14:27:18.649826 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:18.649804    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:27:18.889638 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:18.889557    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-43ca2273-5b55486c69-q7bfl"
Sep 11 14:27:18.943085 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:18.943052    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-b6b864-85f4d6986c-kgzbs" event={"ID":"d659b308-feb5-44d5-a1eb-40a509a07068","Type":"ContainerStarted","Data":"c6f64dca7371b1adbbe37612f0c22bc0ec036843db2cc0dc7dac1de4e65f9fd2"}
Sep 11 14:27:18.943240 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:18.943214    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-b6b864-85f4d6986c-kgzbs"
Sep 11 14:27:18.943290 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:18.943258    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-b6b864-85f4d6986c-kgzbs" event={"ID":"d659b308-feb5-44d5-a1eb-40a509a07068","Type":"ContainerStarted","Data":"91459f87696d49b837fa339055fc4adfaa46448eefcb06a4f9d4a760c0c878ae"}
Sep 11 14:27:18.944304 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:18.944278    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43ca2273-kpw4s" event={"ID":"24860560-43fc-42bf-b459-3ac374e24056","Type":"ContainerStarted","Data":"b62e53b156dbce101515ab976177d9c67f5a8323be4fe07d0587b51332fd8cd8"}
Sep 11 14:27:19.014989 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:19.014941    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-b6b864-85f4d6986c-kgzbs" podStartSLOduration=2.014925957 podStartE2EDuration="2.014925957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:27:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:27:19.013484868 +0000 UTC m=+731.812119650" watchObservedRunningTime="2026-09-11 14:27:19.014925957 +0000 UTC m=+731.813560738"
Sep 11 14:27:19.767317 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:19.767279    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:19.866990 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:19.866952    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:19.895366 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:19.895341    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-43ca2273-595f6db5f8-b2p7m"
Sep 11 14:27:20.009241 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:20.009201    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:20.172469 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:20.172434    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:20.935609 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:20.935580    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:21.404650 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:21.404617    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:21.848633 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:21.848601    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:21.963239 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:21.963210    2584 generic.go:356] "Generic (PLEG): container finished" podID="24860560-43fc-42bf-b459-3ac374e24056" containerID="f5a494065779cbfb1328feb1de666fa03b6aa02e7c802a2cb5ce723b23b93c36" exitCode=0
Sep 11 14:27:21.963565 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:21.963258    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43ca2273-kpw4s" event={"ID":"24860560-43fc-42bf-b459-3ac374e24056","Type":"ContainerDied","Data":"f5a494065779cbfb1328feb1de666fa03b6aa02e7c802a2cb5ce723b23b93c36"}
Sep 11 14:27:22.777490 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:22.777454    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:23.106196 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:23.106175    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43ca2273-kpw4s"
Sep 11 14:27:23.192027 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:23.192000    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24860560-43fc-42bf-b459-3ac374e24056-maas-api-service-ca\") pod \"24860560-43fc-42bf-b459-3ac374e24056\" (UID: \"24860560-43fc-42bf-b459-3ac374e24056\") "
Sep 11 14:27:23.192315 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:23.192291    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24860560-43fc-42bf-b459-3ac374e24056-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "24860560-43fc-42bf-b459-3ac374e24056" (UID: "24860560-43fc-42bf-b459-3ac374e24056"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:27:23.293342 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:23.293317    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24860560-43fc-42bf-b459-3ac374e24056-maas-api-service-ca\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:27:23.975369 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:23.975309    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43ca2273-kpw4s"
Sep 11 14:27:23.975369 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:23.975352    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43ca2273-kpw4s" event={"ID":"24860560-43fc-42bf-b459-3ac374e24056","Type":"ContainerDied","Data":"b62e53b156dbce101515ab976177d9c67f5a8323be4fe07d0587b51332fd8cd8"}
Sep 11 14:27:23.975533 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:23.975397    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b62e53b156dbce101515ab976177d9c67f5a8323be4fe07d0587b51332fd8cd8"
Sep 11 14:27:25.597759 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:25.597727    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:27.513848 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:27.513809    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:27.614177 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:27.614145    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:27.714532 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:27.714501    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:28.184136 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:28.184101    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:28.215050 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:28.215019    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-43ca2273-5b55486c69-q7bfl"]
Sep 11 14:27:28.215284 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:28.215252    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-43ca2273-5b55486c69-q7bfl" podUID="8cb24168-dfea-4ed3-8573-fad2ff415d1e" containerName="payload-processing" containerID="cri-o://a276c68d2ebffeac4a46027ccc3c13daefc787513fe5e4be9d7d5b4d5b6eaf9d" gracePeriod=30
Sep 11 14:27:28.226407 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:28.226383    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-43ca2273-595f6db5f8-b2p7m"]
Sep 11 14:27:28.226582 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:28.226561    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-43ca2273-595f6db5f8-b2p7m" podUID="50ad49be-f1b9-4c26-aa7f-db3d05cc1401" containerName="payload-pre-processing" containerID="cri-o://823e6ca5b4437c371510ab3dbdb3f4b45ebc1be22135d5630fbe8be5e4932afe" gracePeriod=30
Sep 11 14:27:28.283433 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:28.283403    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:28.384486 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:28.384448    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:28.421091 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:28.421063    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43ca2273-kpw4s"]
Sep 11 14:27:28.426083 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:28.426058    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43ca2273-kpw4s"]
Sep 11 14:27:28.495469 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:28.495256    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:28.522787 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:28.522762    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-43ca2273-5b55486c69-q7bfl"
Sep 11 14:27:28.552828 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:28.552808    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-43ca2273-595f6db5f8-b2p7m"
Sep 11 14:27:28.636077 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:28.636043    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8cb24168-dfea-4ed3-8573-fad2ff415d1e-plugins-config-volume\") pod \"8cb24168-dfea-4ed3-8573-fad2ff415d1e\" (UID: \"8cb24168-dfea-4ed3-8573-fad2ff415d1e\") "
Sep 11 14:27:28.636250 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:28.636123    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndllj\" (UniqueName: \"kubernetes.io/projected/8cb24168-dfea-4ed3-8573-fad2ff415d1e-kube-api-access-ndllj\") pod \"8cb24168-dfea-4ed3-8573-fad2ff415d1e\" (UID: \"8cb24168-dfea-4ed3-8573-fad2ff415d1e\") "
Sep 11 14:27:28.636501 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:28.636469    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cb24168-dfea-4ed3-8573-fad2ff415d1e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8cb24168-dfea-4ed3-8573-fad2ff415d1e" (UID: "8cb24168-dfea-4ed3-8573-fad2ff415d1e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:27:28.638564 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:28.638531    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cb24168-dfea-4ed3-8573-fad2ff415d1e-kube-api-access-ndllj" (OuterVolumeSpecName: "kube-api-access-ndllj") pod "8cb24168-dfea-4ed3-8573-fad2ff415d1e" (UID: "8cb24168-dfea-4ed3-8573-fad2ff415d1e"). InnerVolumeSpecName "kube-api-access-ndllj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:27:28.683063 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:28.683021    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:28.737045 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:28.736956    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgt64\" (UniqueName: \"kubernetes.io/projected/50ad49be-f1b9-4c26-aa7f-db3d05cc1401-kube-api-access-xgt64\") pod \"50ad49be-f1b9-4c26-aa7f-db3d05cc1401\" (UID: \"50ad49be-f1b9-4c26-aa7f-db3d05cc1401\") "
Sep 11 14:27:28.737200 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:28.737052    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50ad49be-f1b9-4c26-aa7f-db3d05cc1401-plugins-config-volume\") pod \"50ad49be-f1b9-4c26-aa7f-db3d05cc1401\" (UID: \"50ad49be-f1b9-4c26-aa7f-db3d05cc1401\") "
Sep 11 14:27:28.737354 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:28.737337    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8cb24168-dfea-4ed3-8573-fad2ff415d1e-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:27:28.737414 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:28.737357    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndllj\" (UniqueName: \"kubernetes.io/projected/8cb24168-dfea-4ed3-8573-fad2ff415d1e-kube-api-access-ndllj\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:27:28.737414 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:28.737376    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50ad49be-f1b9-4c26-aa7f-db3d05cc1401-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "50ad49be-f1b9-4c26-aa7f-db3d05cc1401" (UID: "50ad49be-f1b9-4c26-aa7f-db3d05cc1401"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:27:28.739079 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:28.739052    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50ad49be-f1b9-4c26-aa7f-db3d05cc1401-kube-api-access-xgt64" (OuterVolumeSpecName: "kube-api-access-xgt64") pod "50ad49be-f1b9-4c26-aa7f-db3d05cc1401" (UID: "50ad49be-f1b9-4c26-aa7f-db3d05cc1401"). InnerVolumeSpecName "kube-api-access-xgt64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:27:28.838524 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:28.838498    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgt64\" (UniqueName: \"kubernetes.io/projected/50ad49be-f1b9-4c26-aa7f-db3d05cc1401-kube-api-access-xgt64\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:27:28.838524 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:28.838523    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50ad49be-f1b9-4c26-aa7f-db3d05cc1401-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:27:28.936093 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:28.936062    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:29.000643 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:29.000584    2584 generic.go:356] "Generic (PLEG): container finished" podID="8cb24168-dfea-4ed3-8573-fad2ff415d1e" containerID="a276c68d2ebffeac4a46027ccc3c13daefc787513fe5e4be9d7d5b4d5b6eaf9d" exitCode=0
Sep 11 14:27:29.000643 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:29.000627    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-43ca2273-5b55486c69-q7bfl"
Sep 11 14:27:29.000835 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:29.000667    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-43ca2273-5b55486c69-q7bfl" event={"ID":"8cb24168-dfea-4ed3-8573-fad2ff415d1e","Type":"ContainerDied","Data":"a276c68d2ebffeac4a46027ccc3c13daefc787513fe5e4be9d7d5b4d5b6eaf9d"}
Sep 11 14:27:29.000835 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:29.000739    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-43ca2273-5b55486c69-q7bfl" event={"ID":"8cb24168-dfea-4ed3-8573-fad2ff415d1e","Type":"ContainerDied","Data":"408cb9a1896edf009632da4902775d49d84a7c8db453aea554bb84bb4547ed3d"}
Sep 11 14:27:29.000835 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:29.000766    2584 scope.go:117] "RemoveContainer" containerID="a276c68d2ebffeac4a46027ccc3c13daefc787513fe5e4be9d7d5b4d5b6eaf9d"
Sep 11 14:27:29.002102 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:29.002071    2584 generic.go:356] "Generic (PLEG): container finished" podID="50ad49be-f1b9-4c26-aa7f-db3d05cc1401" containerID="823e6ca5b4437c371510ab3dbdb3f4b45ebc1be22135d5630fbe8be5e4932afe" exitCode=0
Sep 11 14:27:29.002184 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:29.002126    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-43ca2273-595f6db5f8-b2p7m"
Sep 11 14:27:29.002242 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:29.002102    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-43ca2273-595f6db5f8-b2p7m" event={"ID":"50ad49be-f1b9-4c26-aa7f-db3d05cc1401","Type":"ContainerDied","Data":"823e6ca5b4437c371510ab3dbdb3f4b45ebc1be22135d5630fbe8be5e4932afe"}
Sep 11 14:27:29.002300 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:29.002238    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-43ca2273-595f6db5f8-b2p7m" event={"ID":"50ad49be-f1b9-4c26-aa7f-db3d05cc1401","Type":"ContainerDied","Data":"4c9f6dcb6f17fcea2e7af9cb9f78e5f510ec9f3884fd81b268f09ee792fdd978"}
Sep 11 14:27:29.009371 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:29.009356    2584 scope.go:117] "RemoveContainer" containerID="a276c68d2ebffeac4a46027ccc3c13daefc787513fe5e4be9d7d5b4d5b6eaf9d"
Sep 11 14:27:29.009673 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:27:29.009647    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a276c68d2ebffeac4a46027ccc3c13daefc787513fe5e4be9d7d5b4d5b6eaf9d\": container with ID starting with a276c68d2ebffeac4a46027ccc3c13daefc787513fe5e4be9d7d5b4d5b6eaf9d not found: ID does not exist" containerID="a276c68d2ebffeac4a46027ccc3c13daefc787513fe5e4be9d7d5b4d5b6eaf9d"
Sep 11 14:27:29.009794 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:29.009730    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a276c68d2ebffeac4a46027ccc3c13daefc787513fe5e4be9d7d5b4d5b6eaf9d"} err="failed to get container status \"a276c68d2ebffeac4a46027ccc3c13daefc787513fe5e4be9d7d5b4d5b6eaf9d\": rpc error: code = NotFound desc = could not find container \"a276c68d2ebffeac4a46027ccc3c13daefc787513fe5e4be9d7d5b4d5b6eaf9d\": container with ID starting with a276c68d2ebffeac4a46027ccc3c13daefc787513fe5e4be9d7d5b4d5b6eaf9d not found: ID does not exist"
Sep 11 14:27:29.009794 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:29.009757    2584 scope.go:117] "RemoveContainer" containerID="823e6ca5b4437c371510ab3dbdb3f4b45ebc1be22135d5630fbe8be5e4932afe"
Sep 11 14:27:29.019968 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:29.019950    2584 scope.go:117] "RemoveContainer" containerID="823e6ca5b4437c371510ab3dbdb3f4b45ebc1be22135d5630fbe8be5e4932afe"
Sep 11 14:27:29.020270 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:27:29.020245    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"823e6ca5b4437c371510ab3dbdb3f4b45ebc1be22135d5630fbe8be5e4932afe\": container with ID starting with 823e6ca5b4437c371510ab3dbdb3f4b45ebc1be22135d5630fbe8be5e4932afe not found: ID does not exist" containerID="823e6ca5b4437c371510ab3dbdb3f4b45ebc1be22135d5630fbe8be5e4932afe"
Sep 11 14:27:29.020361 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:29.020280    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"823e6ca5b4437c371510ab3dbdb3f4b45ebc1be22135d5630fbe8be5e4932afe"} err="failed to get container status \"823e6ca5b4437c371510ab3dbdb3f4b45ebc1be22135d5630fbe8be5e4932afe\": rpc error: code = NotFound desc = could not find container \"823e6ca5b4437c371510ab3dbdb3f4b45ebc1be22135d5630fbe8be5e4932afe\": container with ID starting with 823e6ca5b4437c371510ab3dbdb3f4b45ebc1be22135d5630fbe8be5e4932afe not found: ID does not exist"
Sep 11 14:27:29.032207 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:29.032186    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-43ca2273-5b55486c69-q7bfl"]
Sep 11 14:27:29.038203 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:29.038184    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-43ca2273-5b55486c69-q7bfl"]
Sep 11 14:27:29.070901 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:29.070880    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-43ca2273-595f6db5f8-b2p7m"]
Sep 11 14:27:29.082403 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:29.082379    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-43ca2273-595f6db5f8-b2p7m"]
Sep 11 14:27:29.115122 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:29.115100    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:29.202706 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:29.202670    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:29.310844 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:29.310823    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:29.679928 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:29.679858    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24860560-43fc-42bf-b459-3ac374e24056" path="/var/lib/kubelet/pods/24860560-43fc-42bf-b459-3ac374e24056/volumes"
Sep 11 14:27:29.680327 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:29.680312    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50ad49be-f1b9-4c26-aa7f-db3d05cc1401" path="/var/lib/kubelet/pods/50ad49be-f1b9-4c26-aa7f-db3d05cc1401/volumes"
Sep 11 14:27:29.680821 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:29.680801    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cb24168-dfea-4ed3-8573-fad2ff415d1e" path="/var/lib/kubelet/pods/8cb24168-dfea-4ed3-8573-fad2ff415d1e/volumes"
Sep 11 14:27:29.750875 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:29.750843    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:29.899470 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:29.899444    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:29.953424 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:29.953359    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-b6b864-85f4d6986c-kgzbs"
Sep 11 14:27:29.987174 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:29.987141    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:31.029060 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:31.029029    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:32.159841 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:32.159807    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:32.703250 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:32.703216    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:32.803893 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:32.803861    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:32.985296 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:32.985228    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:33.269661 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:33.269566    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:33.343589 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:33.343551    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:33.444085 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:33.444042    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:33.838162 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:33.838116    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:33.936365 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:33.936331    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:33.954748 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:33.954718    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-2db3d4c3-7f8479db58-gb44m"]
Sep 11 14:27:33.955134 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:33.955121    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50ad49be-f1b9-4c26-aa7f-db3d05cc1401" containerName="payload-pre-processing"
Sep 11 14:27:33.955187 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:33.955136    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="50ad49be-f1b9-4c26-aa7f-db3d05cc1401" containerName="payload-pre-processing"
Sep 11 14:27:33.955187 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:33.955148    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cb24168-dfea-4ed3-8573-fad2ff415d1e" containerName="payload-processing"
Sep 11 14:27:33.955187 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:33.955154    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cb24168-dfea-4ed3-8573-fad2ff415d1e" containerName="payload-processing"
Sep 11 14:27:33.955187 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:33.955161    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24860560-43fc-42bf-b459-3ac374e24056" containerName="revoke-keys"
Sep 11 14:27:33.955187 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:33.955166    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="24860560-43fc-42bf-b459-3ac374e24056" containerName="revoke-keys"
Sep 11 14:27:33.955365 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:33.955230    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="50ad49be-f1b9-4c26-aa7f-db3d05cc1401" containerName="payload-pre-processing"
Sep 11 14:27:33.955365 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:33.955239    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cb24168-dfea-4ed3-8573-fad2ff415d1e" containerName="payload-processing"
Sep 11 14:27:33.955365 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:33.955247    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="24860560-43fc-42bf-b459-3ac374e24056" containerName="revoke-keys"
Sep 11 14:27:33.958380 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:33.958363    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-2db3d4c3-7f8479db58-gb44m"
Sep 11 14:27:33.961554 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:33.961536    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-2db3d4c3-dockercfg-7dzjb\""
Sep 11 14:27:33.961922 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:33.961908    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-2db3d4c3\""
Sep 11 14:27:33.976442 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:33.976423    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-2db3d4c3-7f8479db58-gb44m"]
Sep 11 14:27:33.982580 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:33.982560    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b1d0ed3-11f1-4505-9db8-5522857cb90a-plugins-config-volume\") pod \"payload-processing-e2e-migrate-2db3d4c3-7f8479db58-gb44m\" (UID: \"5b1d0ed3-11f1-4505-9db8-5522857cb90a\") " pod="openshift-ingress/payload-processing-e2e-migrate-2db3d4c3-7f8479db58-gb44m"
Sep 11 14:27:33.982722 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:33.982601    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld8bv\" (UniqueName: \"kubernetes.io/projected/5b1d0ed3-11f1-4505-9db8-5522857cb90a-kube-api-access-ld8bv\") pod \"payload-processing-e2e-migrate-2db3d4c3-7f8479db58-gb44m\" (UID: \"5b1d0ed3-11f1-4505-9db8-5522857cb90a\") " pod="openshift-ingress/payload-processing-e2e-migrate-2db3d4c3-7f8479db58-gb44m"
Sep 11 14:27:34.015359 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:34.015333    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-2db3d4c3-587b9456c4-ppwjm"]
Sep 11 14:27:34.018650 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:34.018633    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2db3d4c3-587b9456c4-ppwjm"
Sep 11 14:27:34.036765 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:34.036744    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-2db3d4c3-587b9456c4-ppwjm"]
Sep 11 14:27:34.083042 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:34.083021    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b1d0ed3-11f1-4505-9db8-5522857cb90a-plugins-config-volume\") pod \"payload-processing-e2e-migrate-2db3d4c3-7f8479db58-gb44m\" (UID: \"5b1d0ed3-11f1-4505-9db8-5522857cb90a\") " pod="openshift-ingress/payload-processing-e2e-migrate-2db3d4c3-7f8479db58-gb44m"
Sep 11 14:27:34.083147 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:34.083055    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aaf9243a-b6d5-4966-b99b-d576a97b5cf3-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-2db3d4c3-587b9456c4-ppwjm\" (UID: \"aaf9243a-b6d5-4966-b99b-d576a97b5cf3\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-2db3d4c3-587b9456c4-ppwjm"
Sep 11 14:27:34.083147 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:34.083089    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld8bv\" (UniqueName: \"kubernetes.io/projected/5b1d0ed3-11f1-4505-9db8-5522857cb90a-kube-api-access-ld8bv\") pod \"payload-processing-e2e-migrate-2db3d4c3-7f8479db58-gb44m\" (UID: \"5b1d0ed3-11f1-4505-9db8-5522857cb90a\") " pod="openshift-ingress/payload-processing-e2e-migrate-2db3d4c3-7f8479db58-gb44m"
Sep 11 14:27:34.083224 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:34.083184    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqf6c\" (UniqueName: \"kubernetes.io/projected/aaf9243a-b6d5-4966-b99b-d576a97b5cf3-kube-api-access-sqf6c\") pod \"payload-pre-processing-e2e-migrate-2db3d4c3-587b9456c4-ppwjm\" (UID: \"aaf9243a-b6d5-4966-b99b-d576a97b5cf3\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-2db3d4c3-587b9456c4-ppwjm"
Sep 11 14:27:34.083668 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:34.083651    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b1d0ed3-11f1-4505-9db8-5522857cb90a-plugins-config-volume\") pod \"payload-processing-e2e-migrate-2db3d4c3-7f8479db58-gb44m\" (UID: \"5b1d0ed3-11f1-4505-9db8-5522857cb90a\") " pod="openshift-ingress/payload-processing-e2e-migrate-2db3d4c3-7f8479db58-gb44m"
Sep 11 14:27:34.091946 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:34.091900    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld8bv\" (UniqueName: \"kubernetes.io/projected/5b1d0ed3-11f1-4505-9db8-5522857cb90a-kube-api-access-ld8bv\") pod \"payload-processing-e2e-migrate-2db3d4c3-7f8479db58-gb44m\" (UID: \"5b1d0ed3-11f1-4505-9db8-5522857cb90a\") " pod="openshift-ingress/payload-processing-e2e-migrate-2db3d4c3-7f8479db58-gb44m"
Sep 11 14:27:34.184134 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:34.184099    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqf6c\" (UniqueName: \"kubernetes.io/projected/aaf9243a-b6d5-4966-b99b-d576a97b5cf3-kube-api-access-sqf6c\") pod \"payload-pre-processing-e2e-migrate-2db3d4c3-587b9456c4-ppwjm\" (UID: \"aaf9243a-b6d5-4966-b99b-d576a97b5cf3\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-2db3d4c3-587b9456c4-ppwjm"
Sep 11 14:27:34.184267 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:34.184162    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aaf9243a-b6d5-4966-b99b-d576a97b5cf3-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-2db3d4c3-587b9456c4-ppwjm\" (UID: \"aaf9243a-b6d5-4966-b99b-d576a97b5cf3\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-2db3d4c3-587b9456c4-ppwjm"
Sep 11 14:27:34.184836 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:34.184816    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aaf9243a-b6d5-4966-b99b-d576a97b5cf3-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-2db3d4c3-587b9456c4-ppwjm\" (UID: \"aaf9243a-b6d5-4966-b99b-d576a97b5cf3\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-2db3d4c3-587b9456c4-ppwjm"
Sep 11 14:27:34.196598 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:34.196572    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqf6c\" (UniqueName: \"kubernetes.io/projected/aaf9243a-b6d5-4966-b99b-d576a97b5cf3-kube-api-access-sqf6c\") pod \"payload-pre-processing-e2e-migrate-2db3d4c3-587b9456c4-ppwjm\" (UID: \"aaf9243a-b6d5-4966-b99b-d576a97b5cf3\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-2db3d4c3-587b9456c4-ppwjm"
Sep 11 14:27:34.268483 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:34.268456    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-2db3d4c3-7f8479db58-gb44m"
Sep 11 14:27:34.333705 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:34.328785    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2db3d4c3-587b9456c4-ppwjm"
Sep 11 14:27:34.449846 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:34.449797    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:34.552767 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:34.552743    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-2db3d4c3-7f8479db58-gb44m"]
Sep 11 14:27:34.554341 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:27:34.554319    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b1d0ed3_11f1_4505_9db8_5522857cb90a.slice/crio-d2ff777d978674b58f9717c1b546599b0f87874bcee45832aa71b9d204ee9efd WatchSource:0}: Error finding container d2ff777d978674b58f9717c1b546599b0f87874bcee45832aa71b9d204ee9efd: Status 404 returned error can't find the container with id d2ff777d978674b58f9717c1b546599b0f87874bcee45832aa71b9d204ee9efd
Sep 11 14:27:34.618651 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:34.618570    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-2db3d4c3-587b9456c4-ppwjm"]
Sep 11 14:27:34.619412 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:27:34.619381    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaf9243a_b6d5_4966_b99b_d576a97b5cf3.slice/crio-7d4d9ff68f3a56e84c6c30da15412d7e7a63d6c54aae7a7e7ef95f7682a6a7f7 WatchSource:0}: Error finding container 7d4d9ff68f3a56e84c6c30da15412d7e7a63d6c54aae7a7e7ef95f7682a6a7f7: Status 404 returned error can't find the container with id 7d4d9ff68f3a56e84c6c30da15412d7e7a63d6c54aae7a7e7ef95f7682a6a7f7
Sep 11 14:27:35.038930 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:35.038902    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2db3d4c3-587b9456c4-ppwjm" event={"ID":"aaf9243a-b6d5-4966-b99b-d576a97b5cf3","Type":"ContainerStarted","Data":"4ce898d19e3d4f215d8f51cb8df03f21203f335cb826ca5853dc3682dc2024fc"}
Sep 11 14:27:35.039093 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:35.038956    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2db3d4c3-587b9456c4-ppwjm" event={"ID":"aaf9243a-b6d5-4966-b99b-d576a97b5cf3","Type":"ContainerStarted","Data":"7d4d9ff68f3a56e84c6c30da15412d7e7a63d6c54aae7a7e7ef95f7682a6a7f7"}
Sep 11 14:27:35.039093 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:35.038994    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2db3d4c3-587b9456c4-ppwjm"
Sep 11 14:27:35.040552 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:35.040525    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-2db3d4c3-7f8479db58-gb44m" event={"ID":"5b1d0ed3-11f1-4505-9db8-5522857cb90a","Type":"ContainerStarted","Data":"9e371ac2699b27e313572c6ca3c25e8158df0f1175827cd829105c374509a2a2"}
Sep 11 14:27:35.040673 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:35.040572    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-2db3d4c3-7f8479db58-gb44m" event={"ID":"5b1d0ed3-11f1-4505-9db8-5522857cb90a","Type":"ContainerStarted","Data":"d2ff777d978674b58f9717c1b546599b0f87874bcee45832aa71b9d204ee9efd"}
Sep 11 14:27:35.040673 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:35.040614    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-2db3d4c3-7f8479db58-gb44m"
Sep 11 14:27:35.059670 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:35.059629    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2db3d4c3-587b9456c4-ppwjm" podStartSLOduration=2.059615037 podStartE2EDuration="2.059615037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:27:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:27:35.058199545 +0000 UTC m=+747.856834330" watchObservedRunningTime="2026-09-11 14:27:35.059615037 +0000 UTC m=+747.858249819"
Sep 11 14:27:35.079430 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:35.079385    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-2db3d4c3-7f8479db58-gb44m" podStartSLOduration=2.079373524 podStartE2EDuration="2.079373524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:27:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:27:35.077979419 +0000 UTC m=+747.876614201" watchObservedRunningTime="2026-09-11 14:27:35.079373524 +0000 UTC m=+747.878008307"
Sep 11 14:27:35.208413 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:35.208376    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:27:35.248215 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:35.248168    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:36.222390 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:36.222350    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:37.012949 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:37.012910    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:37.919701 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:37.919658    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:38.870887 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:38.870847    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:46.047571 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:46.047534    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2db3d4c3-587b9456c4-ppwjm"
Sep 11 14:27:46.047984 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:46.047625    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-2db3d4c3-7f8479db58-gb44m"
Sep 11 14:27:51.602608 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:51.602574    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:27:54.288126 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:54.288087    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:55.738050 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:55.738011    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:56.581067 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:56.581035    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:57.338582 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:57.338542    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:57.740923 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:57.740844    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2db3d4c3-lgj7g"]
Sep 11 14:27:57.749554 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:57.749511    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2db3d4c3-lgj7g"
Sep 11 14:27:57.750588 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:57.750561    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2db3d4c3-lgj7g"]
Sep 11 14:27:57.752939 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:57.752919    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dp8gp\""
Sep 11 14:27:57.874839 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:57.874809    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9488709-7eea-4c7b-88ae-565fcda13d9d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-2db3d4c3-lgj7g\" (UID: \"a9488709-7eea-4c7b-88ae-565fcda13d9d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2db3d4c3-lgj7g"
Sep 11 14:27:57.975431 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:57.975404    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9488709-7eea-4c7b-88ae-565fcda13d9d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-2db3d4c3-lgj7g\" (UID: \"a9488709-7eea-4c7b-88ae-565fcda13d9d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2db3d4c3-lgj7g"
Sep 11 14:27:57.975986 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:57.975965    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9488709-7eea-4c7b-88ae-565fcda13d9d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-2db3d4c3-lgj7g\" (UID: \"a9488709-7eea-4c7b-88ae-565fcda13d9d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2db3d4c3-lgj7g"
Sep 11 14:27:58.061321 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:58.061300    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2db3d4c3-lgj7g"
Sep 11 14:27:58.310172 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:58.310134    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:58.350523 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:58.350451    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2db3d4c3-lgj7g"]
Sep 11 14:27:58.354020 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:27:58.353989    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9488709_7eea_4c7b_88ae_565fcda13d9d.slice/crio-972740ff9a3e825d810c75802b543482ac95ef070a09f9e9f5b320f62d6db404 WatchSource:0}: Error finding container 972740ff9a3e825d810c75802b543482ac95ef070a09f9e9f5b320f62d6db404: Status 404 returned error can't find the container with id 972740ff9a3e825d810c75802b543482ac95ef070a09f9e9f5b320f62d6db404
Sep 11 14:27:59.135608 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:59.135565    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:27:59.169332 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:59.169303    2584 generic.go:356] "Generic (PLEG): container finished" podID="a9488709-7eea-4c7b-88ae-565fcda13d9d" containerID="3d5cf89be103cf7cb4dd90bacfeb179b388fc1d8dfa3ea09228c894deaa69d4d" exitCode=0
Sep 11 14:27:59.169469 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:59.169384    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2db3d4c3-lgj7g" event={"ID":"a9488709-7eea-4c7b-88ae-565fcda13d9d","Type":"ContainerDied","Data":"3d5cf89be103cf7cb4dd90bacfeb179b388fc1d8dfa3ea09228c894deaa69d4d"}
Sep 11 14:27:59.169469 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:59.169441    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2db3d4c3-lgj7g" event={"ID":"a9488709-7eea-4c7b-88ae-565fcda13d9d","Type":"ContainerStarted","Data":"972740ff9a3e825d810c75802b543482ac95ef070a09f9e9f5b320f62d6db404"}
Sep 11 14:27:59.905111 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:27:59.905074    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:00.326796 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:00.326767    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2db3d4c3-lgj7g"
Sep 11 14:28:00.395729 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:00.395698    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9488709-7eea-4c7b-88ae-565fcda13d9d-maas-api-service-ca\") pod \"a9488709-7eea-4c7b-88ae-565fcda13d9d\" (UID: \"a9488709-7eea-4c7b-88ae-565fcda13d9d\") "
Sep 11 14:28:00.395955 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:00.395933    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9488709-7eea-4c7b-88ae-565fcda13d9d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a9488709-7eea-4c7b-88ae-565fcda13d9d" (UID: "a9488709-7eea-4c7b-88ae-565fcda13d9d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:28:00.496708 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:00.496622    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9488709-7eea-4c7b-88ae-565fcda13d9d-maas-api-service-ca\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:28:00.912714 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:00.912663    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:01.181448 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:01.181380    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2db3d4c3-lgj7g"
Sep 11 14:28:01.181448 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:01.181388    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2db3d4c3-lgj7g" event={"ID":"a9488709-7eea-4c7b-88ae-565fcda13d9d","Type":"ContainerDied","Data":"972740ff9a3e825d810c75802b543482ac95ef070a09f9e9f5b320f62d6db404"}
Sep 11 14:28:01.181448 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:01.181441    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="972740ff9a3e825d810c75802b543482ac95ef070a09f9e9f5b320f62d6db404"
Sep 11 14:28:01.687856 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:01.687811    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:03.388137 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.388107    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"]
Sep 11 14:28:03.388614 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.388600    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9488709-7eea-4c7b-88ae-565fcda13d9d" containerName="revoke-keys"
Sep 11 14:28:03.388656 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.388616    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9488709-7eea-4c7b-88ae-565fcda13d9d" containerName="revoke-keys"
Sep 11 14:28:03.388720 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.388709    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9488709-7eea-4c7b-88ae-565fcda13d9d" containerName="revoke-keys"
Sep 11 14:28:03.391893 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.391877    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"
Sep 11 14:28:03.398000 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.397962    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-b4a233\"/\"openshift-service-ca.crt\""
Sep 11 14:28:03.398146 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.398016    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-b4a233\"/\"kube-root-ca.crt\""
Sep 11 14:28:03.398146 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.398060    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-b4a233\"/\"autores-model-b4a233-kserve-self-signed-certs\""
Sep 11 14:28:03.398146 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.398129    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-b4a233\"/\"default-dockercfg-d4tng\""
Sep 11 14:28:03.412637 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.412607    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"]
Sep 11 14:28:03.417547 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.417520    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:03.521028 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.521001    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44922383-b3eb-443b-9b95-6c0e1c861579-model-cache\") pod \"autores-model-b4a233-kserve-78cb5bdf67-68kd4\" (UID: \"44922383-b3eb-443b-9b95-6c0e1c861579\") " pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"
Sep 11 14:28:03.521145 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.521045    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5hfr\" (UniqueName: \"kubernetes.io/projected/44922383-b3eb-443b-9b95-6c0e1c861579-kube-api-access-b5hfr\") pod \"autores-model-b4a233-kserve-78cb5bdf67-68kd4\" (UID: \"44922383-b3eb-443b-9b95-6c0e1c861579\") " pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"
Sep 11 14:28:03.521145 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.521073    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44922383-b3eb-443b-9b95-6c0e1c861579-tmp-dir\") pod \"autores-model-b4a233-kserve-78cb5bdf67-68kd4\" (UID: \"44922383-b3eb-443b-9b95-6c0e1c861579\") " pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"
Sep 11 14:28:03.521231 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.521152    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44922383-b3eb-443b-9b95-6c0e1c861579-dshm\") pod \"autores-model-b4a233-kserve-78cb5bdf67-68kd4\" (UID: \"44922383-b3eb-443b-9b95-6c0e1c861579\") " pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"
Sep 11 14:28:03.521231 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.521196    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44922383-b3eb-443b-9b95-6c0e1c861579-tls-certs\") pod \"autores-model-b4a233-kserve-78cb5bdf67-68kd4\" (UID: \"44922383-b3eb-443b-9b95-6c0e1c861579\") " pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"
Sep 11 14:28:03.521300 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.521260    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44922383-b3eb-443b-9b95-6c0e1c861579-home\") pod \"autores-model-b4a233-kserve-78cb5bdf67-68kd4\" (UID: \"44922383-b3eb-443b-9b95-6c0e1c861579\") " pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"
Sep 11 14:28:03.622652 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.622626    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44922383-b3eb-443b-9b95-6c0e1c861579-home\") pod \"autores-model-b4a233-kserve-78cb5bdf67-68kd4\" (UID: \"44922383-b3eb-443b-9b95-6c0e1c861579\") " pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"
Sep 11 14:28:03.622777 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.622667    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44922383-b3eb-443b-9b95-6c0e1c861579-model-cache\") pod \"autores-model-b4a233-kserve-78cb5bdf67-68kd4\" (UID: \"44922383-b3eb-443b-9b95-6c0e1c861579\") " pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"
Sep 11 14:28:03.622777 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.622725    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5hfr\" (UniqueName: \"kubernetes.io/projected/44922383-b3eb-443b-9b95-6c0e1c861579-kube-api-access-b5hfr\") pod \"autores-model-b4a233-kserve-78cb5bdf67-68kd4\" (UID: \"44922383-b3eb-443b-9b95-6c0e1c861579\") " pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"
Sep 11 14:28:03.622777 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.622750    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44922383-b3eb-443b-9b95-6c0e1c861579-tmp-dir\") pod \"autores-model-b4a233-kserve-78cb5bdf67-68kd4\" (UID: \"44922383-b3eb-443b-9b95-6c0e1c861579\") " pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"
Sep 11 14:28:03.622777 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.622771    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44922383-b3eb-443b-9b95-6c0e1c861579-dshm\") pod \"autores-model-b4a233-kserve-78cb5bdf67-68kd4\" (UID: \"44922383-b3eb-443b-9b95-6c0e1c861579\") " pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"
Sep 11 14:28:03.622995 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.622786    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44922383-b3eb-443b-9b95-6c0e1c861579-tls-certs\") pod \"autores-model-b4a233-kserve-78cb5bdf67-68kd4\" (UID: \"44922383-b3eb-443b-9b95-6c0e1c861579\") " pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"
Sep 11 14:28:03.623100 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.623069    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44922383-b3eb-443b-9b95-6c0e1c861579-home\") pod \"autores-model-b4a233-kserve-78cb5bdf67-68kd4\" (UID: \"44922383-b3eb-443b-9b95-6c0e1c861579\") " pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"
Sep 11 14:28:03.623155 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.623095    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44922383-b3eb-443b-9b95-6c0e1c861579-model-cache\") pod \"autores-model-b4a233-kserve-78cb5bdf67-68kd4\" (UID: \"44922383-b3eb-443b-9b95-6c0e1c861579\") " pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"
Sep 11 14:28:03.623155 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.623130    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44922383-b3eb-443b-9b95-6c0e1c861579-tmp-dir\") pod \"autores-model-b4a233-kserve-78cb5bdf67-68kd4\" (UID: \"44922383-b3eb-443b-9b95-6c0e1c861579\") " pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"
Sep 11 14:28:03.625128 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.625104    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44922383-b3eb-443b-9b95-6c0e1c861579-dshm\") pod \"autores-model-b4a233-kserve-78cb5bdf67-68kd4\" (UID: \"44922383-b3eb-443b-9b95-6c0e1c861579\") " pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"
Sep 11 14:28:03.625288 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.625271    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44922383-b3eb-443b-9b95-6c0e1c861579-tls-certs\") pod \"autores-model-b4a233-kserve-78cb5bdf67-68kd4\" (UID: \"44922383-b3eb-443b-9b95-6c0e1c861579\") " pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"
Sep 11 14:28:03.630899 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.630880    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5hfr\" (UniqueName: \"kubernetes.io/projected/44922383-b3eb-443b-9b95-6c0e1c861579-kube-api-access-b5hfr\") pod \"autores-model-b4a233-kserve-78cb5bdf67-68kd4\" (UID: \"44922383-b3eb-443b-9b95-6c0e1c861579\") " pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"
Sep 11 14:28:03.701115 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.701038    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"
Sep 11 14:28:03.923915 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.923882    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:03.985342 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:03.985317    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"]
Sep 11 14:28:03.986642 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:28:03.986618    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44922383_b3eb_443b_9b95_6c0e1c861579.slice/crio-f5aec8842ce584c893db4ed1e2cd0ccee16300252cdb98be6c738194c5573d7e WatchSource:0}: Error finding container f5aec8842ce584c893db4ed1e2cd0ccee16300252cdb98be6c738194c5573d7e: Status 404 returned error can't find the container with id f5aec8842ce584c893db4ed1e2cd0ccee16300252cdb98be6c738194c5573d7e
Sep 11 14:28:04.199367 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:04.199331    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4" event={"ID":"44922383-b3eb-443b-9b95-6c0e1c861579","Type":"ContainerStarted","Data":"61956dff39f9dc4e390d180b093f053114ba715f258420677901b77265da1b19"}
Sep 11 14:28:04.199492 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:04.199379    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4" event={"ID":"44922383-b3eb-443b-9b95-6c0e1c861579","Type":"ContainerStarted","Data":"f5aec8842ce584c893db4ed1e2cd0ccee16300252cdb98be6c738194c5573d7e"}
Sep 11 14:28:04.221033 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:04.220990    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4" podStartSLOduration=1.220975301 podStartE2EDuration="1.220975301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:28:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:28:04.218245666 +0000 UTC m=+777.016880449" watchObservedRunningTime="2026-09-11 14:28:04.220975301 +0000 UTC m=+777.019610082"
Sep 11 14:28:04.662282 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:04.662241    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:04.742691 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:04.742627    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-2db3d4c3-7f8479db58-gb44m"]
Sep 11 14:28:04.743069 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:04.743038    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-2db3d4c3-7f8479db58-gb44m" podUID="5b1d0ed3-11f1-4505-9db8-5522857cb90a" containerName="payload-processing" containerID="cri-o://9e371ac2699b27e313572c6ca3c25e8158df0f1175827cd829105c374509a2a2" gracePeriod=30
Sep 11 14:28:04.746655 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:04.746630    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-2db3d4c3-587b9456c4-ppwjm"]
Sep 11 14:28:04.746923 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:04.746895    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2db3d4c3-587b9456c4-ppwjm" podUID="aaf9243a-b6d5-4966-b99b-d576a97b5cf3" containerName="payload-pre-processing" containerID="cri-o://4ce898d19e3d4f215d8f51cb8df03f21203f335cb826ca5853dc3682dc2024fc" gracePeriod=30
Sep 11 14:28:04.787152 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:04.787126    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:04.881856 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:04.881816    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:04.981840 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:04.981563    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:04.982272 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:04.982250    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2db3d4c3-lgj7g"]
Sep 11 14:28:04.985473 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:04.985448    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2db3d4c3-lgj7g"]
Sep 11 14:28:05.035978 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.035957    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-2db3d4c3-7f8479db58-gb44m"
Sep 11 14:28:05.039133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.039116    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2db3d4c3-587b9456c4-ppwjm"
Sep 11 14:28:05.057910 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.057885    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:05.138137 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.138096    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aaf9243a-b6d5-4966-b99b-d576a97b5cf3-plugins-config-volume\") pod \"aaf9243a-b6d5-4966-b99b-d576a97b5cf3\" (UID: \"aaf9243a-b6d5-4966-b99b-d576a97b5cf3\") "
Sep 11 14:28:05.138326 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.138173    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b1d0ed3-11f1-4505-9db8-5522857cb90a-plugins-config-volume\") pod \"5b1d0ed3-11f1-4505-9db8-5522857cb90a\" (UID: \"5b1d0ed3-11f1-4505-9db8-5522857cb90a\") "
Sep 11 14:28:05.138326 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.138213    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ld8bv\" (UniqueName: \"kubernetes.io/projected/5b1d0ed3-11f1-4505-9db8-5522857cb90a-kube-api-access-ld8bv\") pod \"5b1d0ed3-11f1-4505-9db8-5522857cb90a\" (UID: \"5b1d0ed3-11f1-4505-9db8-5522857cb90a\") "
Sep 11 14:28:05.138326 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.138283    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqf6c\" (UniqueName: \"kubernetes.io/projected/aaf9243a-b6d5-4966-b99b-d576a97b5cf3-kube-api-access-sqf6c\") pod \"aaf9243a-b6d5-4966-b99b-d576a97b5cf3\" (UID: \"aaf9243a-b6d5-4966-b99b-d576a97b5cf3\") "
Sep 11 14:28:05.138511 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.138474    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaf9243a-b6d5-4966-b99b-d576a97b5cf3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "aaf9243a-b6d5-4966-b99b-d576a97b5cf3" (UID: "aaf9243a-b6d5-4966-b99b-d576a97b5cf3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:28:05.138600 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.138570    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b1d0ed3-11f1-4505-9db8-5522857cb90a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5b1d0ed3-11f1-4505-9db8-5522857cb90a" (UID: "5b1d0ed3-11f1-4505-9db8-5522857cb90a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:28:05.138747 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.138724    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b1d0ed3-11f1-4505-9db8-5522857cb90a-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:28:05.138747 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.138748    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aaf9243a-b6d5-4966-b99b-d576a97b5cf3-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:28:05.140358 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.140332    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaf9243a-b6d5-4966-b99b-d576a97b5cf3-kube-api-access-sqf6c" (OuterVolumeSpecName: "kube-api-access-sqf6c") pod "aaf9243a-b6d5-4966-b99b-d576a97b5cf3" (UID: "aaf9243a-b6d5-4966-b99b-d576a97b5cf3"). InnerVolumeSpecName "kube-api-access-sqf6c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:28:05.140444 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.140412    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b1d0ed3-11f1-4505-9db8-5522857cb90a-kube-api-access-ld8bv" (OuterVolumeSpecName: "kube-api-access-ld8bv") pod "5b1d0ed3-11f1-4505-9db8-5522857cb90a" (UID: "5b1d0ed3-11f1-4505-9db8-5522857cb90a"). InnerVolumeSpecName "kube-api-access-ld8bv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:28:05.144108 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.144080    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:05.205861 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.205787    2584 generic.go:356] "Generic (PLEG): container finished" podID="5b1d0ed3-11f1-4505-9db8-5522857cb90a" containerID="9e371ac2699b27e313572c6ca3c25e8158df0f1175827cd829105c374509a2a2" exitCode=0
Sep 11 14:28:05.205861 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.205843    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-2db3d4c3-7f8479db58-gb44m"
Sep 11 14:28:05.206023 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.205873    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-2db3d4c3-7f8479db58-gb44m" event={"ID":"5b1d0ed3-11f1-4505-9db8-5522857cb90a","Type":"ContainerDied","Data":"9e371ac2699b27e313572c6ca3c25e8158df0f1175827cd829105c374509a2a2"}
Sep 11 14:28:05.206023 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.205937    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-2db3d4c3-7f8479db58-gb44m" event={"ID":"5b1d0ed3-11f1-4505-9db8-5522857cb90a","Type":"ContainerDied","Data":"d2ff777d978674b58f9717c1b546599b0f87874bcee45832aa71b9d204ee9efd"}
Sep 11 14:28:05.206023 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.205971    2584 scope.go:117] "RemoveContainer" containerID="9e371ac2699b27e313572c6ca3c25e8158df0f1175827cd829105c374509a2a2"
Sep 11 14:28:05.207373 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.207350    2584 generic.go:356] "Generic (PLEG): container finished" podID="aaf9243a-b6d5-4966-b99b-d576a97b5cf3" containerID="4ce898d19e3d4f215d8f51cb8df03f21203f335cb826ca5853dc3682dc2024fc" exitCode=0
Sep 11 14:28:05.207480 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.207386    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2db3d4c3-587b9456c4-ppwjm"
Sep 11 14:28:05.207480 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.207428    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2db3d4c3-587b9456c4-ppwjm" event={"ID":"aaf9243a-b6d5-4966-b99b-d576a97b5cf3","Type":"ContainerDied","Data":"4ce898d19e3d4f215d8f51cb8df03f21203f335cb826ca5853dc3682dc2024fc"}
Sep 11 14:28:05.207480 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.207463    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2db3d4c3-587b9456c4-ppwjm" event={"ID":"aaf9243a-b6d5-4966-b99b-d576a97b5cf3","Type":"ContainerDied","Data":"7d4d9ff68f3a56e84c6c30da15412d7e7a63d6c54aae7a7e7ef95f7682a6a7f7"}
Sep 11 14:28:05.220606 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.220581    2584 scope.go:117] "RemoveContainer" containerID="9e371ac2699b27e313572c6ca3c25e8158df0f1175827cd829105c374509a2a2"
Sep 11 14:28:05.221063 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:28:05.221038    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e371ac2699b27e313572c6ca3c25e8158df0f1175827cd829105c374509a2a2\": container with ID starting with 9e371ac2699b27e313572c6ca3c25e8158df0f1175827cd829105c374509a2a2 not found: ID does not exist" containerID="9e371ac2699b27e313572c6ca3c25e8158df0f1175827cd829105c374509a2a2"
Sep 11 14:28:05.221152 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.221074    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e371ac2699b27e313572c6ca3c25e8158df0f1175827cd829105c374509a2a2"} err="failed to get container status \"9e371ac2699b27e313572c6ca3c25e8158df0f1175827cd829105c374509a2a2\": rpc error: code = NotFound desc = could not find container \"9e371ac2699b27e313572c6ca3c25e8158df0f1175827cd829105c374509a2a2\": container with ID starting with 9e371ac2699b27e313572c6ca3c25e8158df0f1175827cd829105c374509a2a2 not found: ID does not exist"
Sep 11 14:28:05.221152 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.221097    2584 scope.go:117] "RemoveContainer" containerID="4ce898d19e3d4f215d8f51cb8df03f21203f335cb826ca5853dc3682dc2024fc"
Sep 11 14:28:05.229132 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.229117    2584 scope.go:117] "RemoveContainer" containerID="4ce898d19e3d4f215d8f51cb8df03f21203f335cb826ca5853dc3682dc2024fc"
Sep 11 14:28:05.229410 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:28:05.229392    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ce898d19e3d4f215d8f51cb8df03f21203f335cb826ca5853dc3682dc2024fc\": container with ID starting with 4ce898d19e3d4f215d8f51cb8df03f21203f335cb826ca5853dc3682dc2024fc not found: ID does not exist" containerID="4ce898d19e3d4f215d8f51cb8df03f21203f335cb826ca5853dc3682dc2024fc"
Sep 11 14:28:05.229464 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.229416    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ce898d19e3d4f215d8f51cb8df03f21203f335cb826ca5853dc3682dc2024fc"} err="failed to get container status \"4ce898d19e3d4f215d8f51cb8df03f21203f335cb826ca5853dc3682dc2024fc\": rpc error: code = NotFound desc = could not find container \"4ce898d19e3d4f215d8f51cb8df03f21203f335cb826ca5853dc3682dc2024fc\": container with ID starting with 4ce898d19e3d4f215d8f51cb8df03f21203f335cb826ca5853dc3682dc2024fc not found: ID does not exist"
Sep 11 14:28:05.234942 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.234923    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-2db3d4c3-7f8479db58-gb44m"]
Sep 11 14:28:05.239977 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.239959    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ld8bv\" (UniqueName: \"kubernetes.io/projected/5b1d0ed3-11f1-4505-9db8-5522857cb90a-kube-api-access-ld8bv\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:28:05.240048 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.239979    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqf6c\" (UniqueName: \"kubernetes.io/projected/aaf9243a-b6d5-4966-b99b-d576a97b5cf3-kube-api-access-sqf6c\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:28:05.246451 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.246429    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-2db3d4c3-7f8479db58-gb44m"]
Sep 11 14:28:05.257556 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.257536    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-2db3d4c3-587b9456c4-ppwjm"]
Sep 11 14:28:05.264421 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.264403    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-2db3d4c3-587b9456c4-ppwjm"]
Sep 11 14:28:05.454632 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.454602    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:05.657744 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.657712    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:05.680094 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.680068    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b1d0ed3-11f1-4505-9db8-5522857cb90a" path="/var/lib/kubelet/pods/5b1d0ed3-11f1-4505-9db8-5522857cb90a/volumes"
Sep 11 14:28:05.680502 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.680485    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9488709-7eea-4c7b-88ae-565fcda13d9d" path="/var/lib/kubelet/pods/a9488709-7eea-4c7b-88ae-565fcda13d9d/volumes"
Sep 11 14:28:05.680884 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:05.680869    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aaf9243a-b6d5-4966-b99b-d576a97b5cf3" path="/var/lib/kubelet/pods/aaf9243a-b6d5-4966-b99b-d576a97b5cf3/volumes"
Sep 11 14:28:06.039119 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:06.039085    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:06.399118 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:06.399038    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:06.602768 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:06.602734    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:07.409774 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:07.409740    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:08.324805 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:08.324771    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:08.940434 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:08.940395    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:09.046104 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:09.046074    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:09.143955 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:09.143923    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:09.514626 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:09.514592    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:28:10.151138 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:10.151098    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:10.915286 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:10.915242    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:11.705899 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:11.705860    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:11.806829 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:11.806796    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:12.232346 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.232315    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:12.331765 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.331734    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f44a68eb-5c6db68fcd-h9gx7"]
Sep 11 14:28:12.332161 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.332149    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b1d0ed3-11f1-4505-9db8-5522857cb90a" containerName="payload-processing"
Sep 11 14:28:12.332209 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.332162    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b1d0ed3-11f1-4505-9db8-5522857cb90a" containerName="payload-processing"
Sep 11 14:28:12.332209 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.332176    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaf9243a-b6d5-4966-b99b-d576a97b5cf3" containerName="payload-pre-processing"
Sep 11 14:28:12.332209 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.332182    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaf9243a-b6d5-4966-b99b-d576a97b5cf3" containerName="payload-pre-processing"
Sep 11 14:28:12.332296 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.332238    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b1d0ed3-11f1-4505-9db8-5522857cb90a" containerName="payload-processing"
Sep 11 14:28:12.332296 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.332247    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaf9243a-b6d5-4966-b99b-d576a97b5cf3" containerName="payload-pre-processing"
Sep 11 14:28:12.336845 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.336827    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f44a68eb-5c6db68fcd-h9gx7"
Sep 11 14:28:12.339815 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.339796    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-f44a68eb\""
Sep 11 14:28:12.347390 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.347319    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:12.348923 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.348901    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f44a68eb-5c6db68fcd-h9gx7"]
Sep 11 14:28:12.356328 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.356301    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f44a68eb-7dcf8b74d7-k6fnx"]
Sep 11 14:28:12.360307 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.360288    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f44a68eb-7dcf8b74d7-k6fnx"
Sep 11 14:28:12.362778 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.362751    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-f44a68eb-dockercfg-k9q2r\""
Sep 11 14:28:12.369931 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.369906    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f44a68eb-7dcf8b74d7-k6fnx"]
Sep 11 14:28:12.502029 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.501953    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkgkn\" (UniqueName: \"kubernetes.io/projected/dda3da22-a0b2-4a79-8e80-e11d4f1198bd-kube-api-access-lkgkn\") pod \"payload-pre-processing-e2e-ait-f44a68eb-5c6db68fcd-h9gx7\" (UID: \"dda3da22-a0b2-4a79-8e80-e11d4f1198bd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f44a68eb-5c6db68fcd-h9gx7"
Sep 11 14:28:12.502029 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.501994    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dda3da22-a0b2-4a79-8e80-e11d4f1198bd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f44a68eb-5c6db68fcd-h9gx7\" (UID: \"dda3da22-a0b2-4a79-8e80-e11d4f1198bd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f44a68eb-5c6db68fcd-h9gx7"
Sep 11 14:28:12.502029 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.502019    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72b0d010-5a7d-4471-9b17-2e57e6881a63-plugins-config-volume\") pod \"payload-processing-e2e-ait-f44a68eb-7dcf8b74d7-k6fnx\" (UID: \"72b0d010-5a7d-4471-9b17-2e57e6881a63\") " pod="openshift-ingress/payload-processing-e2e-ait-f44a68eb-7dcf8b74d7-k6fnx"
Sep 11 14:28:12.502272 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.502084    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc27h\" (UniqueName: \"kubernetes.io/projected/72b0d010-5a7d-4471-9b17-2e57e6881a63-kube-api-access-hc27h\") pod \"payload-processing-e2e-ait-f44a68eb-7dcf8b74d7-k6fnx\" (UID: \"72b0d010-5a7d-4471-9b17-2e57e6881a63\") " pod="openshift-ingress/payload-processing-e2e-ait-f44a68eb-7dcf8b74d7-k6fnx"
Sep 11 14:28:12.602438 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.602402    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkgkn\" (UniqueName: \"kubernetes.io/projected/dda3da22-a0b2-4a79-8e80-e11d4f1198bd-kube-api-access-lkgkn\") pod \"payload-pre-processing-e2e-ait-f44a68eb-5c6db68fcd-h9gx7\" (UID: \"dda3da22-a0b2-4a79-8e80-e11d4f1198bd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f44a68eb-5c6db68fcd-h9gx7"
Sep 11 14:28:12.602564 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.602445    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dda3da22-a0b2-4a79-8e80-e11d4f1198bd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f44a68eb-5c6db68fcd-h9gx7\" (UID: \"dda3da22-a0b2-4a79-8e80-e11d4f1198bd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f44a68eb-5c6db68fcd-h9gx7"
Sep 11 14:28:12.602564 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.602469    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72b0d010-5a7d-4471-9b17-2e57e6881a63-plugins-config-volume\") pod \"payload-processing-e2e-ait-f44a68eb-7dcf8b74d7-k6fnx\" (UID: \"72b0d010-5a7d-4471-9b17-2e57e6881a63\") " pod="openshift-ingress/payload-processing-e2e-ait-f44a68eb-7dcf8b74d7-k6fnx"
Sep 11 14:28:12.602564 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.602510    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc27h\" (UniqueName: \"kubernetes.io/projected/72b0d010-5a7d-4471-9b17-2e57e6881a63-kube-api-access-hc27h\") pod \"payload-processing-e2e-ait-f44a68eb-7dcf8b74d7-k6fnx\" (UID: \"72b0d010-5a7d-4471-9b17-2e57e6881a63\") " pod="openshift-ingress/payload-processing-e2e-ait-f44a68eb-7dcf8b74d7-k6fnx"
Sep 11 14:28:12.603148 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.603129    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dda3da22-a0b2-4a79-8e80-e11d4f1198bd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f44a68eb-5c6db68fcd-h9gx7\" (UID: \"dda3da22-a0b2-4a79-8e80-e11d4f1198bd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f44a68eb-5c6db68fcd-h9gx7"
Sep 11 14:28:12.603212 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.603195    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72b0d010-5a7d-4471-9b17-2e57e6881a63-plugins-config-volume\") pod \"payload-processing-e2e-ait-f44a68eb-7dcf8b74d7-k6fnx\" (UID: \"72b0d010-5a7d-4471-9b17-2e57e6881a63\") " pod="openshift-ingress/payload-processing-e2e-ait-f44a68eb-7dcf8b74d7-k6fnx"
Sep 11 14:28:12.610856 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.610830    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc27h\" (UniqueName: \"kubernetes.io/projected/72b0d010-5a7d-4471-9b17-2e57e6881a63-kube-api-access-hc27h\") pod \"payload-processing-e2e-ait-f44a68eb-7dcf8b74d7-k6fnx\" (UID: \"72b0d010-5a7d-4471-9b17-2e57e6881a63\") " pod="openshift-ingress/payload-processing-e2e-ait-f44a68eb-7dcf8b74d7-k6fnx"
Sep 11 14:28:12.610984 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.610963    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkgkn\" (UniqueName: \"kubernetes.io/projected/dda3da22-a0b2-4a79-8e80-e11d4f1198bd-kube-api-access-lkgkn\") pod \"payload-pre-processing-e2e-ait-f44a68eb-5c6db68fcd-h9gx7\" (UID: \"dda3da22-a0b2-4a79-8e80-e11d4f1198bd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f44a68eb-5c6db68fcd-h9gx7"
Sep 11 14:28:12.650770 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.650743    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f44a68eb-5c6db68fcd-h9gx7"
Sep 11 14:28:12.671813 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.671788    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f44a68eb-7dcf8b74d7-k6fnx"
Sep 11 14:28:12.924016 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.923986    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f44a68eb-5c6db68fcd-h9gx7"]
Sep 11 14:28:12.925063 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:28:12.925040    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddda3da22_a0b2_4a79_8e80_e11d4f1198bd.slice/crio-f1c372be4c79500de59b0a4f1a4bbf64617a689f9276fd4fff6dd3a6a8f51d39 WatchSource:0}: Error finding container f1c372be4c79500de59b0a4f1a4bbf64617a689f9276fd4fff6dd3a6a8f51d39: Status 404 returned error can't find the container with id f1c372be4c79500de59b0a4f1a4bbf64617a689f9276fd4fff6dd3a6a8f51d39
Sep 11 14:28:12.954740 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.954722    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f44a68eb-7dcf8b74d7-k6fnx"]
Sep 11 14:28:12.958703 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:28:12.958653    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72b0d010_5a7d_4471_9b17_2e57e6881a63.slice/crio-22724d0fc1b552b098827db2cd3851b38d4c2817c4ac50b807c915a4fe975b08 WatchSource:0}: Error finding container 22724d0fc1b552b098827db2cd3851b38d4c2817c4ac50b807c915a4fe975b08: Status 404 returned error can't find the container with id 22724d0fc1b552b098827db2cd3851b38d4c2817c4ac50b807c915a4fe975b08
Sep 11 14:28:12.993593 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:12.993561    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:13.092730 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:13.092694    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:13.258865 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:13.258782    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f44a68eb-7dcf8b74d7-k6fnx" event={"ID":"72b0d010-5a7d-4471-9b17-2e57e6881a63","Type":"ContainerStarted","Data":"3d0dc480361650ebb25260c57b7a9f1cb6316e2579ab5b37c6bfa1de6c94fb2c"}
Sep 11 14:28:13.258865 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:13.258837    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f44a68eb-7dcf8b74d7-k6fnx" event={"ID":"72b0d010-5a7d-4471-9b17-2e57e6881a63","Type":"ContainerStarted","Data":"22724d0fc1b552b098827db2cd3851b38d4c2817c4ac50b807c915a4fe975b08"}
Sep 11 14:28:13.259171 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:13.258990    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-f44a68eb-7dcf8b74d7-k6fnx"
Sep 11 14:28:13.260746 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:13.260712    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f44a68eb-5c6db68fcd-h9gx7" event={"ID":"dda3da22-a0b2-4a79-8e80-e11d4f1198bd","Type":"ContainerStarted","Data":"dc3d5f9e4171edc23707984aeae9a74742ff413db7ef4cedcaa73efa58b01ed0"}
Sep 11 14:28:13.260848 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:13.260756    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f44a68eb-5c6db68fcd-h9gx7" event={"ID":"dda3da22-a0b2-4a79-8e80-e11d4f1198bd","Type":"ContainerStarted","Data":"f1c372be4c79500de59b0a4f1a4bbf64617a689f9276fd4fff6dd3a6a8f51d39"}
Sep 11 14:28:13.260848 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:13.260800    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-f44a68eb-5c6db68fcd-h9gx7"
Sep 11 14:28:13.279634 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:13.279582    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-f44a68eb-7dcf8b74d7-k6fnx" podStartSLOduration=1.279566523 podStartE2EDuration="1.279566523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:28:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:28:13.278817421 +0000 UTC m=+786.077452232" watchObservedRunningTime="2026-09-11 14:28:13.279566523 +0000 UTC m=+786.078201306"
Sep 11 14:28:13.299819 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:13.299778    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-f44a68eb-5c6db68fcd-h9gx7" podStartSLOduration=1.2997651239999999 podStartE2EDuration="1.299765124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:28:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:28:13.297633569 +0000 UTC m=+786.096268350" watchObservedRunningTime="2026-09-11 14:28:13.299765124 +0000 UTC m=+786.098399906"
Sep 11 14:28:13.701588 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:13.701560    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"
Sep 11 14:28:13.701759 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:13.701624    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"
Sep 11 14:28:13.714510 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:13.714488    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"
Sep 11 14:28:14.279617 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:14.279591    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"
Sep 11 14:28:24.270790 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:24.270761    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-f44a68eb-7dcf8b74d7-k6fnx"
Sep 11 14:28:24.271189 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:24.270922    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-f44a68eb-5c6db68fcd-h9gx7"
Sep 11 14:28:30.229468 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:30.229386    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:28:48.886851 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:48.886811    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:48.987345 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:48.987310    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:49.092267 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:49.092232    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:49.933453 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:49.933414    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:51.108460 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:51.108428    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:52.004918 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:52.004885    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:53.045666 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:53.045635    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:54.194741 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:54.194705    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:54.989056 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:54.989022    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:56.006132 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:56.006097    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:56.814361 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:56.814323    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:57.631861 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:57.631828    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:58.655633 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:58.655588    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:58.745811 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:58.745774    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:59.794240 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:59.794200    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:28:59.890954 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:59.890923    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-b4a233-58c977bb86-fjmm8"]
Sep 11 14:28:59.891516 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:59.891233    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-b4a233-58c977bb86-fjmm8" podUID="60a8da00-e5db-45ff-a57a-0c8c9639be33" containerName="payload-pre-processing" containerID="cri-o://e83e6fe3f01732e18cc7b6f59bf43d9b2b5918249c8269d441d74eb59e73d013" gracePeriod=30
Sep 11 14:28:59.893661 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:59.893634    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-b4a233-c57c5c7f9-f8h7s"]
Sep 11 14:28:59.894183 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:59.893884    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-b4a233-c57c5c7f9-f8h7s" podUID="5584d036-8a73-48c2-9cb3-870654179634" containerName="payload-processing" containerID="cri-o://3e92887d44ae4188e1bb7ee0a8eb7f08dc8ec3a8805a1435d792e27cb1538e16" gracePeriod=30
Sep 11 14:28:59.911881 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:28:59.911854    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:00.004927 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.004888    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:00.104662 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.104576    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:00.185896 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.185870    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-b4a233-c57c5c7f9-f8h7s"
Sep 11 14:29:00.188656 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.188636    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-b4a233-58c977bb86-fjmm8"
Sep 11 14:29:00.290506 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.290467    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:00.298466 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.298443    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9q6rw\" (UniqueName: \"kubernetes.io/projected/5584d036-8a73-48c2-9cb3-870654179634-kube-api-access-9q6rw\") pod \"5584d036-8a73-48c2-9cb3-870654179634\" (UID: \"5584d036-8a73-48c2-9cb3-870654179634\") "
Sep 11 14:29:00.298585 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.298536    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5584d036-8a73-48c2-9cb3-870654179634-plugins-config-volume\") pod \"5584d036-8a73-48c2-9cb3-870654179634\" (UID: \"5584d036-8a73-48c2-9cb3-870654179634\") "
Sep 11 14:29:00.298585 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.298554    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6v995\" (UniqueName: \"kubernetes.io/projected/60a8da00-e5db-45ff-a57a-0c8c9639be33-kube-api-access-6v995\") pod \"60a8da00-e5db-45ff-a57a-0c8c9639be33\" (UID: \"60a8da00-e5db-45ff-a57a-0c8c9639be33\") "
Sep 11 14:29:00.298585 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.298572    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60a8da00-e5db-45ff-a57a-0c8c9639be33-plugins-config-volume\") pod \"60a8da00-e5db-45ff-a57a-0c8c9639be33\" (UID: \"60a8da00-e5db-45ff-a57a-0c8c9639be33\") "
Sep 11 14:29:00.298950 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.298926    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5584d036-8a73-48c2-9cb3-870654179634-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5584d036-8a73-48c2-9cb3-870654179634" (UID: "5584d036-8a73-48c2-9cb3-870654179634"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:29:00.299010 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.298940    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60a8da00-e5db-45ff-a57a-0c8c9639be33-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "60a8da00-e5db-45ff-a57a-0c8c9639be33" (UID: "60a8da00-e5db-45ff-a57a-0c8c9639be33"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:29:00.300541 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.300511    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5584d036-8a73-48c2-9cb3-870654179634-kube-api-access-9q6rw" (OuterVolumeSpecName: "kube-api-access-9q6rw") pod "5584d036-8a73-48c2-9cb3-870654179634" (UID: "5584d036-8a73-48c2-9cb3-870654179634"). InnerVolumeSpecName "kube-api-access-9q6rw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:29:00.300650 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.300554    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60a8da00-e5db-45ff-a57a-0c8c9639be33-kube-api-access-6v995" (OuterVolumeSpecName: "kube-api-access-6v995") pod "60a8da00-e5db-45ff-a57a-0c8c9639be33" (UID: "60a8da00-e5db-45ff-a57a-0c8c9639be33"). InnerVolumeSpecName "kube-api-access-6v995". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:29:00.388373 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.388310    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:00.399485 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.399460    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5584d036-8a73-48c2-9cb3-870654179634-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:29:00.399485 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.399482    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6v995\" (UniqueName: \"kubernetes.io/projected/60a8da00-e5db-45ff-a57a-0c8c9639be33-kube-api-access-6v995\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:29:00.399612 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.399492    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60a8da00-e5db-45ff-a57a-0c8c9639be33-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:29:00.399612 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.399500    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9q6rw\" (UniqueName: \"kubernetes.io/projected/5584d036-8a73-48c2-9cb3-870654179634-kube-api-access-9q6rw\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:29:00.502202 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.502169    2584 generic.go:356] "Generic (PLEG): container finished" podID="60a8da00-e5db-45ff-a57a-0c8c9639be33" containerID="e83e6fe3f01732e18cc7b6f59bf43d9b2b5918249c8269d441d74eb59e73d013" exitCode=0
Sep 11 14:29:00.502302 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.502214    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-b4a233-58c977bb86-fjmm8"
Sep 11 14:29:00.502302 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.502252    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-b4a233-58c977bb86-fjmm8" event={"ID":"60a8da00-e5db-45ff-a57a-0c8c9639be33","Type":"ContainerDied","Data":"e83e6fe3f01732e18cc7b6f59bf43d9b2b5918249c8269d441d74eb59e73d013"}
Sep 11 14:29:00.502302 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.502298    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-b4a233-58c977bb86-fjmm8" event={"ID":"60a8da00-e5db-45ff-a57a-0c8c9639be33","Type":"ContainerDied","Data":"3a9d43d1e63e4acc5dd34dd5fc86280dac31e4d89a0de4e953d4cec472d9c557"}
Sep 11 14:29:00.502462 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.502326    2584 scope.go:117] "RemoveContainer" containerID="e83e6fe3f01732e18cc7b6f59bf43d9b2b5918249c8269d441d74eb59e73d013"
Sep 11 14:29:00.503819 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.503794    2584 generic.go:356] "Generic (PLEG): container finished" podID="5584d036-8a73-48c2-9cb3-870654179634" containerID="3e92887d44ae4188e1bb7ee0a8eb7f08dc8ec3a8805a1435d792e27cb1538e16" exitCode=0
Sep 11 14:29:00.503936 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.503833    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-b4a233-c57c5c7f9-f8h7s"
Sep 11 14:29:00.503936 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.503830    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-b4a233-c57c5c7f9-f8h7s" event={"ID":"5584d036-8a73-48c2-9cb3-870654179634","Type":"ContainerDied","Data":"3e92887d44ae4188e1bb7ee0a8eb7f08dc8ec3a8805a1435d792e27cb1538e16"}
Sep 11 14:29:00.504053 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.503932    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-b4a233-c57c5c7f9-f8h7s" event={"ID":"5584d036-8a73-48c2-9cb3-870654179634","Type":"ContainerDied","Data":"0243daac491cb1fec7ceae212cc90cfb47563dfe5743a261983f71e54ad37101"}
Sep 11 14:29:00.511998 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.511982    2584 scope.go:117] "RemoveContainer" containerID="e83e6fe3f01732e18cc7b6f59bf43d9b2b5918249c8269d441d74eb59e73d013"
Sep 11 14:29:00.512288 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:29:00.512271    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e83e6fe3f01732e18cc7b6f59bf43d9b2b5918249c8269d441d74eb59e73d013\": container with ID starting with e83e6fe3f01732e18cc7b6f59bf43d9b2b5918249c8269d441d74eb59e73d013 not found: ID does not exist" containerID="e83e6fe3f01732e18cc7b6f59bf43d9b2b5918249c8269d441d74eb59e73d013"
Sep 11 14:29:00.512365 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.512297    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e83e6fe3f01732e18cc7b6f59bf43d9b2b5918249c8269d441d74eb59e73d013"} err="failed to get container status \"e83e6fe3f01732e18cc7b6f59bf43d9b2b5918249c8269d441d74eb59e73d013\": rpc error: code = NotFound desc = could not find container \"e83e6fe3f01732e18cc7b6f59bf43d9b2b5918249c8269d441d74eb59e73d013\": container with ID starting with e83e6fe3f01732e18cc7b6f59bf43d9b2b5918249c8269d441d74eb59e73d013 not found: ID does not exist"
Sep 11 14:29:00.512365 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.512317    2584 scope.go:117] "RemoveContainer" containerID="3e92887d44ae4188e1bb7ee0a8eb7f08dc8ec3a8805a1435d792e27cb1538e16"
Sep 11 14:29:00.520891 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.520869    2584 scope.go:117] "RemoveContainer" containerID="3e92887d44ae4188e1bb7ee0a8eb7f08dc8ec3a8805a1435d792e27cb1538e16"
Sep 11 14:29:00.521179 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:29:00.521155    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e92887d44ae4188e1bb7ee0a8eb7f08dc8ec3a8805a1435d792e27cb1538e16\": container with ID starting with 3e92887d44ae4188e1bb7ee0a8eb7f08dc8ec3a8805a1435d792e27cb1538e16 not found: ID does not exist" containerID="3e92887d44ae4188e1bb7ee0a8eb7f08dc8ec3a8805a1435d792e27cb1538e16"
Sep 11 14:29:00.521248 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.521186    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e92887d44ae4188e1bb7ee0a8eb7f08dc8ec3a8805a1435d792e27cb1538e16"} err="failed to get container status \"3e92887d44ae4188e1bb7ee0a8eb7f08dc8ec3a8805a1435d792e27cb1538e16\": rpc error: code = NotFound desc = could not find container \"3e92887d44ae4188e1bb7ee0a8eb7f08dc8ec3a8805a1435d792e27cb1538e16\": container with ID starting with 3e92887d44ae4188e1bb7ee0a8eb7f08dc8ec3a8805a1435d792e27cb1538e16 not found: ID does not exist"
Sep 11 14:29:00.533779 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.533758    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-b4a233-c57c5c7f9-f8h7s"]
Sep 11 14:29:00.536381 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.536357    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-b4a233-c57c5c7f9-f8h7s"]
Sep 11 14:29:00.549834 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.549808    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-b4a233-58c977bb86-fjmm8"]
Sep 11 14:29:00.555706 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.555670    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-b4a233-58c977bb86-fjmm8"]
Sep 11 14:29:00.690129 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:00.690066    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:01.335528 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:01.335489    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:01.679183 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:01.679113    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5584d036-8a73-48c2-9cb3-870654179634" path="/var/lib/kubelet/pods/5584d036-8a73-48c2-9cb3-870654179634/volumes"
Sep 11 14:29:01.679458 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:01.679444    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60a8da00-e5db-45ff-a57a-0c8c9639be33" path="/var/lib/kubelet/pods/60a8da00-e5db-45ff-a57a-0c8c9639be33/volumes"
Sep 11 14:29:02.251846 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:02.251796    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:03.455388 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:03.455349    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:04.225798 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:04.225757    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:04.779360 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:04.779330    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"]
Sep 11 14:29:04.800629 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:04.800596    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:05.763377 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:05.763341    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:05.924872 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:05.924830    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:05.955476 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:05.953934    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f44a68eb-7dcf8b74d7-k6fnx"]
Sep 11 14:29:05.955476 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:05.955252    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-f44a68eb-7dcf8b74d7-k6fnx" podUID="72b0d010-5a7d-4471-9b17-2e57e6881a63" containerName="payload-processing" containerID="cri-o://3d0dc480361650ebb25260c57b7a9f1cb6316e2579ab5b37c6bfa1de6c94fb2c" gracePeriod=30
Sep 11 14:29:05.957571 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:05.957548    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f44a68eb-5c6db68fcd-h9gx7"]
Sep 11 14:29:05.957771 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:05.957750    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-f44a68eb-5c6db68fcd-h9gx7" podUID="dda3da22-a0b2-4a79-8e80-e11d4f1198bd" containerName="payload-pre-processing" containerID="cri-o://dc3d5f9e4171edc23707984aeae9a74742ff413db7ef4cedcaa73efa58b01ed0" gracePeriod=30
Sep 11 14:29:06.025920 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.025780    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:06.119896 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.119751    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:06.196411 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.196375    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:06.251657 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.251633    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f44a68eb-7dcf8b74d7-k6fnx"
Sep 11 14:29:06.253653 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.253637    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f44a68eb-5c6db68fcd-h9gx7"
Sep 11 14:29:06.351353 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.351326    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hc27h\" (UniqueName: \"kubernetes.io/projected/72b0d010-5a7d-4471-9b17-2e57e6881a63-kube-api-access-hc27h\") pod \"72b0d010-5a7d-4471-9b17-2e57e6881a63\" (UID: \"72b0d010-5a7d-4471-9b17-2e57e6881a63\") "
Sep 11 14:29:06.351526 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.351369    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkgkn\" (UniqueName: \"kubernetes.io/projected/dda3da22-a0b2-4a79-8e80-e11d4f1198bd-kube-api-access-lkgkn\") pod \"dda3da22-a0b2-4a79-8e80-e11d4f1198bd\" (UID: \"dda3da22-a0b2-4a79-8e80-e11d4f1198bd\") "
Sep 11 14:29:06.351526 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.351430    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dda3da22-a0b2-4a79-8e80-e11d4f1198bd-plugins-config-volume\") pod \"dda3da22-a0b2-4a79-8e80-e11d4f1198bd\" (UID: \"dda3da22-a0b2-4a79-8e80-e11d4f1198bd\") "
Sep 11 14:29:06.351526 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.351493    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72b0d010-5a7d-4471-9b17-2e57e6881a63-plugins-config-volume\") pod \"72b0d010-5a7d-4471-9b17-2e57e6881a63\" (UID: \"72b0d010-5a7d-4471-9b17-2e57e6881a63\") "
Sep 11 14:29:06.351918 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.351886    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dda3da22-a0b2-4a79-8e80-e11d4f1198bd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dda3da22-a0b2-4a79-8e80-e11d4f1198bd" (UID: "dda3da22-a0b2-4a79-8e80-e11d4f1198bd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:29:06.352041 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.351902    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72b0d010-5a7d-4471-9b17-2e57e6881a63-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "72b0d010-5a7d-4471-9b17-2e57e6881a63" (UID: "72b0d010-5a7d-4471-9b17-2e57e6881a63"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:29:06.353496 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.353472    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dda3da22-a0b2-4a79-8e80-e11d4f1198bd-kube-api-access-lkgkn" (OuterVolumeSpecName: "kube-api-access-lkgkn") pod "dda3da22-a0b2-4a79-8e80-e11d4f1198bd" (UID: "dda3da22-a0b2-4a79-8e80-e11d4f1198bd"). InnerVolumeSpecName "kube-api-access-lkgkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:29:06.353583 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.353535    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72b0d010-5a7d-4471-9b17-2e57e6881a63-kube-api-access-hc27h" (OuterVolumeSpecName: "kube-api-access-hc27h") pod "72b0d010-5a7d-4471-9b17-2e57e6881a63" (UID: "72b0d010-5a7d-4471-9b17-2e57e6881a63"). InnerVolumeSpecName "kube-api-access-hc27h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:29:06.452907 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.452877    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hc27h\" (UniqueName: \"kubernetes.io/projected/72b0d010-5a7d-4471-9b17-2e57e6881a63-kube-api-access-hc27h\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:29:06.452907 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.452903    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkgkn\" (UniqueName: \"kubernetes.io/projected/dda3da22-a0b2-4a79-8e80-e11d4f1198bd-kube-api-access-lkgkn\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:29:06.453060 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.452914    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dda3da22-a0b2-4a79-8e80-e11d4f1198bd-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:29:06.453060 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.452924    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72b0d010-5a7d-4471-9b17-2e57e6881a63-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:29:06.539948 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.539914    2584 generic.go:356] "Generic (PLEG): container finished" podID="72b0d010-5a7d-4471-9b17-2e57e6881a63" containerID="3d0dc480361650ebb25260c57b7a9f1cb6316e2579ab5b37c6bfa1de6c94fb2c" exitCode=0
Sep 11 14:29:06.540069 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.539962    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f44a68eb-7dcf8b74d7-k6fnx"
Sep 11 14:29:06.540069 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.540000    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f44a68eb-7dcf8b74d7-k6fnx" event={"ID":"72b0d010-5a7d-4471-9b17-2e57e6881a63","Type":"ContainerDied","Data":"3d0dc480361650ebb25260c57b7a9f1cb6316e2579ab5b37c6bfa1de6c94fb2c"}
Sep 11 14:29:06.540187 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.540070    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f44a68eb-7dcf8b74d7-k6fnx" event={"ID":"72b0d010-5a7d-4471-9b17-2e57e6881a63","Type":"ContainerDied","Data":"22724d0fc1b552b098827db2cd3851b38d4c2817c4ac50b807c915a4fe975b08"}
Sep 11 14:29:06.540187 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.540109    2584 scope.go:117] "RemoveContainer" containerID="3d0dc480361650ebb25260c57b7a9f1cb6316e2579ab5b37c6bfa1de6c94fb2c"
Sep 11 14:29:06.541501 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.541480    2584 generic.go:356] "Generic (PLEG): container finished" podID="dda3da22-a0b2-4a79-8e80-e11d4f1198bd" containerID="dc3d5f9e4171edc23707984aeae9a74742ff413db7ef4cedcaa73efa58b01ed0" exitCode=0
Sep 11 14:29:06.541584 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.541523    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f44a68eb-5c6db68fcd-h9gx7"
Sep 11 14:29:06.541644 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.541524    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f44a68eb-5c6db68fcd-h9gx7" event={"ID":"dda3da22-a0b2-4a79-8e80-e11d4f1198bd","Type":"ContainerDied","Data":"dc3d5f9e4171edc23707984aeae9a74742ff413db7ef4cedcaa73efa58b01ed0"}
Sep 11 14:29:06.541644 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.541629    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f44a68eb-5c6db68fcd-h9gx7" event={"ID":"dda3da22-a0b2-4a79-8e80-e11d4f1198bd","Type":"ContainerDied","Data":"f1c372be4c79500de59b0a4f1a4bbf64617a689f9276fd4fff6dd3a6a8f51d39"}
Sep 11 14:29:06.549568 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.549550    2584 scope.go:117] "RemoveContainer" containerID="3d0dc480361650ebb25260c57b7a9f1cb6316e2579ab5b37c6bfa1de6c94fb2c"
Sep 11 14:29:06.549876 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:29:06.549853    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d0dc480361650ebb25260c57b7a9f1cb6316e2579ab5b37c6bfa1de6c94fb2c\": container with ID starting with 3d0dc480361650ebb25260c57b7a9f1cb6316e2579ab5b37c6bfa1de6c94fb2c not found: ID does not exist" containerID="3d0dc480361650ebb25260c57b7a9f1cb6316e2579ab5b37c6bfa1de6c94fb2c"
Sep 11 14:29:06.549950 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.549882    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d0dc480361650ebb25260c57b7a9f1cb6316e2579ab5b37c6bfa1de6c94fb2c"} err="failed to get container status \"3d0dc480361650ebb25260c57b7a9f1cb6316e2579ab5b37c6bfa1de6c94fb2c\": rpc error: code = NotFound desc = could not find container \"3d0dc480361650ebb25260c57b7a9f1cb6316e2579ab5b37c6bfa1de6c94fb2c\": container with ID starting with 3d0dc480361650ebb25260c57b7a9f1cb6316e2579ab5b37c6bfa1de6c94fb2c not found: ID does not exist"
Sep 11 14:29:06.549950 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.549904    2584 scope.go:117] "RemoveContainer" containerID="dc3d5f9e4171edc23707984aeae9a74742ff413db7ef4cedcaa73efa58b01ed0"
Sep 11 14:29:06.558013 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.557999    2584 scope.go:117] "RemoveContainer" containerID="dc3d5f9e4171edc23707984aeae9a74742ff413db7ef4cedcaa73efa58b01ed0"
Sep 11 14:29:06.558276 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:29:06.558259    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc3d5f9e4171edc23707984aeae9a74742ff413db7ef4cedcaa73efa58b01ed0\": container with ID starting with dc3d5f9e4171edc23707984aeae9a74742ff413db7ef4cedcaa73efa58b01ed0 not found: ID does not exist" containerID="dc3d5f9e4171edc23707984aeae9a74742ff413db7ef4cedcaa73efa58b01ed0"
Sep 11 14:29:06.558342 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.558288    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc3d5f9e4171edc23707984aeae9a74742ff413db7ef4cedcaa73efa58b01ed0"} err="failed to get container status \"dc3d5f9e4171edc23707984aeae9a74742ff413db7ef4cedcaa73efa58b01ed0\": rpc error: code = NotFound desc = could not find container \"dc3d5f9e4171edc23707984aeae9a74742ff413db7ef4cedcaa73efa58b01ed0\": container with ID starting with dc3d5f9e4171edc23707984aeae9a74742ff413db7ef4cedcaa73efa58b01ed0 not found: ID does not exist"
Sep 11 14:29:06.580754 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.580729    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f44a68eb-5c6db68fcd-h9gx7"]
Sep 11 14:29:06.609180 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.609130    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f44a68eb-5c6db68fcd-h9gx7"]
Sep 11 14:29:06.658587 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.658564    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f44a68eb-7dcf8b74d7-k6fnx"]
Sep 11 14:29:06.662033 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.662014    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f44a68eb-7dcf8b74d7-k6fnx"]
Sep 11 14:29:06.674290 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:06.674270    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:07.388492 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:07.388459    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:07.497912 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:07.497878    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:07.681740 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:07.681712    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72b0d010-5a7d-4471-9b17-2e57e6881a63" path="/var/lib/kubelet/pods/72b0d010-5a7d-4471-9b17-2e57e6881a63/volumes"
Sep 11 14:29:07.682154 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:07.682134    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dda3da22-a0b2-4a79-8e80-e11d4f1198bd" path="/var/lib/kubelet/pods/dda3da22-a0b2-4a79-8e80-e11d4f1198bd/volumes"
Sep 11 14:29:07.834351 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:07.834322    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:08.251484 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:08.251454    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:08.488885 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:08.488850    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:08.617469 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:08.617440    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:09.705920 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:09.705888    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:29:10.532755 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:10.532718    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:11.289167 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:11.289131    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:11.395256 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:11.395208    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:11.510158 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:11.510131    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:12.747415 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:12.747383    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:14.100336 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:14.100301    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:14.198080 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:14.198032    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:14.301915 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:14.301882    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:14.736619 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:14.736567    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:14.828546 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:14.828517    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:14.929298 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:14.929272    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b0010444-5bcc87b78b-xm9rw"]
Sep 11 14:29:14.929654 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:14.929641    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5584d036-8a73-48c2-9cb3-870654179634" containerName="payload-processing"
Sep 11 14:29:14.929727 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:14.929656    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="5584d036-8a73-48c2-9cb3-870654179634" containerName="payload-processing"
Sep 11 14:29:14.929727 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:14.929665    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dda3da22-a0b2-4a79-8e80-e11d4f1198bd" containerName="payload-pre-processing"
Sep 11 14:29:14.929727 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:14.929671    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="dda3da22-a0b2-4a79-8e80-e11d4f1198bd" containerName="payload-pre-processing"
Sep 11 14:29:14.929727 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:14.929696    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60a8da00-e5db-45ff-a57a-0c8c9639be33" containerName="payload-pre-processing"
Sep 11 14:29:14.929727 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:14.929702    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="60a8da00-e5db-45ff-a57a-0c8c9639be33" containerName="payload-pre-processing"
Sep 11 14:29:14.929727 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:14.929709    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72b0d010-5a7d-4471-9b17-2e57e6881a63" containerName="payload-processing"
Sep 11 14:29:14.929727 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:14.929715    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="72b0d010-5a7d-4471-9b17-2e57e6881a63" containerName="payload-processing"
Sep 11 14:29:14.929961 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:14.929772    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="5584d036-8a73-48c2-9cb3-870654179634" containerName="payload-processing"
Sep 11 14:29:14.929961 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:14.929782    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="60a8da00-e5db-45ff-a57a-0c8c9639be33" containerName="payload-pre-processing"
Sep 11 14:29:14.929961 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:14.929788    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="72b0d010-5a7d-4471-9b17-2e57e6881a63" containerName="payload-processing"
Sep 11 14:29:14.929961 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:14.929795    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="dda3da22-a0b2-4a79-8e80-e11d4f1198bd" containerName="payload-pre-processing"
Sep 11 14:29:14.934573 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:14.934556    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-b0010444-5bcc87b78b-xm9rw"
Sep 11 14:29:14.937244 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:14.937223    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-b0010444\""
Sep 11 14:29:14.937358 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:14.937270    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-b0010444-dockercfg-wfmbw\""
Sep 11 14:29:14.945070 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:14.945045    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b0010444-5bcc87b78b-xm9rw"]
Sep 11 14:29:15.009882 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:15.009828    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b0010444-5d6f9bdccc-8wcbs"]
Sep 11 14:29:15.013228 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:15.013211    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b0010444-5d6f9bdccc-8wcbs"
Sep 11 14:29:15.022966 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:15.022942    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64f24460-438a-42bf-a19f-8261805b1119-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-b0010444-5bcc87b78b-xm9rw\" (UID: \"64f24460-438a-42bf-a19f-8261805b1119\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b0010444-5bcc87b78b-xm9rw"
Sep 11 14:29:15.023070 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:15.022982    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j44sv\" (UniqueName: \"kubernetes.io/projected/64f24460-438a-42bf-a19f-8261805b1119-kube-api-access-j44sv\") pod \"payload-pre-processing-e2e-derive-b0010444-5bcc87b78b-xm9rw\" (UID: \"64f24460-438a-42bf-a19f-8261805b1119\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b0010444-5bcc87b78b-xm9rw"
Sep 11 14:29:15.024216 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:15.024191    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b0010444-5d6f9bdccc-8wcbs"]
Sep 11 14:29:15.123918 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:15.123888    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bwxx\" (UniqueName: \"kubernetes.io/projected/cb542bb4-2863-4ad4-bacd-96ab43ea1007-kube-api-access-6bwxx\") pod \"payload-processing-e2e-derive-b0010444-5d6f9bdccc-8wcbs\" (UID: \"cb542bb4-2863-4ad4-bacd-96ab43ea1007\") " pod="openshift-ingress/payload-processing-e2e-derive-b0010444-5d6f9bdccc-8wcbs"
Sep 11 14:29:15.124328 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:15.124022    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64f24460-438a-42bf-a19f-8261805b1119-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-b0010444-5bcc87b78b-xm9rw\" (UID: \"64f24460-438a-42bf-a19f-8261805b1119\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b0010444-5bcc87b78b-xm9rw"
Sep 11 14:29:15.124328 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:15.124065    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb542bb4-2863-4ad4-bacd-96ab43ea1007-plugins-config-volume\") pod \"payload-processing-e2e-derive-b0010444-5d6f9bdccc-8wcbs\" (UID: \"cb542bb4-2863-4ad4-bacd-96ab43ea1007\") " pod="openshift-ingress/payload-processing-e2e-derive-b0010444-5d6f9bdccc-8wcbs"
Sep 11 14:29:15.124328 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:15.124096    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j44sv\" (UniqueName: \"kubernetes.io/projected/64f24460-438a-42bf-a19f-8261805b1119-kube-api-access-j44sv\") pod \"payload-pre-processing-e2e-derive-b0010444-5bcc87b78b-xm9rw\" (UID: \"64f24460-438a-42bf-a19f-8261805b1119\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b0010444-5bcc87b78b-xm9rw"
Sep 11 14:29:15.124622 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:15.124602    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64f24460-438a-42bf-a19f-8261805b1119-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-b0010444-5bcc87b78b-xm9rw\" (UID: \"64f24460-438a-42bf-a19f-8261805b1119\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b0010444-5bcc87b78b-xm9rw"
Sep 11 14:29:15.158197 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:15.158170    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j44sv\" (UniqueName: \"kubernetes.io/projected/64f24460-438a-42bf-a19f-8261805b1119-kube-api-access-j44sv\") pod \"payload-pre-processing-e2e-derive-b0010444-5bcc87b78b-xm9rw\" (UID: \"64f24460-438a-42bf-a19f-8261805b1119\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b0010444-5bcc87b78b-xm9rw"
Sep 11 14:29:15.224671 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:15.224644    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb542bb4-2863-4ad4-bacd-96ab43ea1007-plugins-config-volume\") pod \"payload-processing-e2e-derive-b0010444-5d6f9bdccc-8wcbs\" (UID: \"cb542bb4-2863-4ad4-bacd-96ab43ea1007\") " pod="openshift-ingress/payload-processing-e2e-derive-b0010444-5d6f9bdccc-8wcbs"
Sep 11 14:29:15.224781 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:15.224725    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bwxx\" (UniqueName: \"kubernetes.io/projected/cb542bb4-2863-4ad4-bacd-96ab43ea1007-kube-api-access-6bwxx\") pod \"payload-processing-e2e-derive-b0010444-5d6f9bdccc-8wcbs\" (UID: \"cb542bb4-2863-4ad4-bacd-96ab43ea1007\") " pod="openshift-ingress/payload-processing-e2e-derive-b0010444-5d6f9bdccc-8wcbs"
Sep 11 14:29:15.225297 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:15.225274    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb542bb4-2863-4ad4-bacd-96ab43ea1007-plugins-config-volume\") pod \"payload-processing-e2e-derive-b0010444-5d6f9bdccc-8wcbs\" (UID: \"cb542bb4-2863-4ad4-bacd-96ab43ea1007\") " pod="openshift-ingress/payload-processing-e2e-derive-b0010444-5d6f9bdccc-8wcbs"
Sep 11 14:29:15.246094 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:15.246066    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-b0010444-5bcc87b78b-xm9rw"
Sep 11 14:29:15.248001 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:15.247982    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bwxx\" (UniqueName: \"kubernetes.io/projected/cb542bb4-2863-4ad4-bacd-96ab43ea1007-kube-api-access-6bwxx\") pod \"payload-processing-e2e-derive-b0010444-5d6f9bdccc-8wcbs\" (UID: \"cb542bb4-2863-4ad4-bacd-96ab43ea1007\") " pod="openshift-ingress/payload-processing-e2e-derive-b0010444-5d6f9bdccc-8wcbs"
Sep 11 14:29:15.323281 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:15.323130    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b0010444-5d6f9bdccc-8wcbs"
Sep 11 14:29:15.520548 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:15.520313    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b0010444-5bcc87b78b-xm9rw"]
Sep 11 14:29:15.522745 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:29:15.522711    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64f24460_438a_42bf_a19f_8261805b1119.slice/crio-22e87546ba18c1ac62bc4ef104fb15e4b6fba9ee2437e43e2a8adf76253db8f6 WatchSource:0}: Error finding container 22e87546ba18c1ac62bc4ef104fb15e4b6fba9ee2437e43e2a8adf76253db8f6: Status 404 returned error can't find the container with id 22e87546ba18c1ac62bc4ef104fb15e4b6fba9ee2437e43e2a8adf76253db8f6
Sep 11 14:29:15.589544 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:15.589522    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-b0010444-5bcc87b78b-xm9rw" event={"ID":"64f24460-438a-42bf-a19f-8261805b1119","Type":"ContainerStarted","Data":"f86ad37f6617a182b763388515d1f7f3afe246d85983e487e367263fcb868664"}
Sep 11 14:29:15.589642 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:15.589567    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-b0010444-5bcc87b78b-xm9rw" event={"ID":"64f24460-438a-42bf-a19f-8261805b1119","Type":"ContainerStarted","Data":"22e87546ba18c1ac62bc4ef104fb15e4b6fba9ee2437e43e2a8adf76253db8f6"}
Sep 11 14:29:15.589725 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:15.589651    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-b0010444-5bcc87b78b-xm9rw"
Sep 11 14:29:15.603699 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:15.603656    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b0010444-5d6f9bdccc-8wcbs"]
Sep 11 14:29:15.605342 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:29:15.605296    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb542bb4_2863_4ad4_bacd_96ab43ea1007.slice/crio-325cea776b6860a58f84b93cde4becb38e19308eea56b9a5026a1568a32d3b51 WatchSource:0}: Error finding container 325cea776b6860a58f84b93cde4becb38e19308eea56b9a5026a1568a32d3b51: Status 404 returned error can't find the container with id 325cea776b6860a58f84b93cde4becb38e19308eea56b9a5026a1568a32d3b51
Sep 11 14:29:15.611257 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:15.611205    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-b0010444-5bcc87b78b-xm9rw" podStartSLOduration=1.611188543 podStartE2EDuration="1.611188543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:29:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:29:15.610986669 +0000 UTC m=+848.409621450" watchObservedRunningTime="2026-09-11 14:29:15.611188543 +0000 UTC m=+848.409823325"
Sep 11 14:29:16.602537 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:16.602496    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b0010444-5d6f9bdccc-8wcbs" event={"ID":"cb542bb4-2863-4ad4-bacd-96ab43ea1007","Type":"ContainerStarted","Data":"89db1606405b996595ec4551d37d2a22b22e29404317fac6a7c0c3f5abd4a4df"}
Sep 11 14:29:16.602986 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:16.602799    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-b0010444-5d6f9bdccc-8wcbs"
Sep 11 14:29:16.602986 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:16.602841    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b0010444-5d6f9bdccc-8wcbs" event={"ID":"cb542bb4-2863-4ad4-bacd-96ab43ea1007","Type":"ContainerStarted","Data":"325cea776b6860a58f84b93cde4becb38e19308eea56b9a5026a1568a32d3b51"}
Sep 11 14:29:16.624354 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:16.624311    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-b0010444-5d6f9bdccc-8wcbs" podStartSLOduration=2.6242986139999998 podStartE2EDuration="2.624298614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:29:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:29:16.622520128 +0000 UTC m=+849.421154909" watchObservedRunningTime="2026-09-11 14:29:16.624298614 +0000 UTC m=+849.422933396"
Sep 11 14:29:19.798498 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:19.798457    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4" podUID="44922383-b3eb-443b-9b95-6c0e1c861579" containerName="main" containerID="cri-o://61956dff39f9dc4e390d180b093f053114ba715f258420677901b77265da1b19" gracePeriod=45
Sep 11 14:29:20.052231 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:20.052175    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"
Sep 11 14:29:20.166542 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:20.166517    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44922383-b3eb-443b-9b95-6c0e1c861579-tmp-dir\") pod \"44922383-b3eb-443b-9b95-6c0e1c861579\" (UID: \"44922383-b3eb-443b-9b95-6c0e1c861579\") "
Sep 11 14:29:20.166707 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:20.166553    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5hfr\" (UniqueName: \"kubernetes.io/projected/44922383-b3eb-443b-9b95-6c0e1c861579-kube-api-access-b5hfr\") pod \"44922383-b3eb-443b-9b95-6c0e1c861579\" (UID: \"44922383-b3eb-443b-9b95-6c0e1c861579\") "
Sep 11 14:29:20.166707 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:20.166588    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44922383-b3eb-443b-9b95-6c0e1c861579-tls-certs\") pod \"44922383-b3eb-443b-9b95-6c0e1c861579\" (UID: \"44922383-b3eb-443b-9b95-6c0e1c861579\") "
Sep 11 14:29:20.166707 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:20.166624    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44922383-b3eb-443b-9b95-6c0e1c861579-model-cache\") pod \"44922383-b3eb-443b-9b95-6c0e1c861579\" (UID: \"44922383-b3eb-443b-9b95-6c0e1c861579\") "
Sep 11 14:29:20.166880 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:20.166710    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44922383-b3eb-443b-9b95-6c0e1c861579-home\") pod \"44922383-b3eb-443b-9b95-6c0e1c861579\" (UID: \"44922383-b3eb-443b-9b95-6c0e1c861579\") "
Sep 11 14:29:20.166880 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:20.166771    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44922383-b3eb-443b-9b95-6c0e1c861579-dshm\") pod \"44922383-b3eb-443b-9b95-6c0e1c861579\" (UID: \"44922383-b3eb-443b-9b95-6c0e1c861579\") "
Sep 11 14:29:20.166880 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:20.166825    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44922383-b3eb-443b-9b95-6c0e1c861579-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "44922383-b3eb-443b-9b95-6c0e1c861579" (UID: "44922383-b3eb-443b-9b95-6c0e1c861579"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:29:20.167030 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:20.166913    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44922383-b3eb-443b-9b95-6c0e1c861579-model-cache" (OuterVolumeSpecName: "model-cache") pod "44922383-b3eb-443b-9b95-6c0e1c861579" (UID: "44922383-b3eb-443b-9b95-6c0e1c861579"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:29:20.167030 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:20.166978    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44922383-b3eb-443b-9b95-6c0e1c861579-home" (OuterVolumeSpecName: "home") pod "44922383-b3eb-443b-9b95-6c0e1c861579" (UID: "44922383-b3eb-443b-9b95-6c0e1c861579"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:29:20.167148 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:20.167091    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44922383-b3eb-443b-9b95-6c0e1c861579-model-cache\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:29:20.167148 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:20.167110    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44922383-b3eb-443b-9b95-6c0e1c861579-home\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:29:20.167148 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:20.167124    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44922383-b3eb-443b-9b95-6c0e1c861579-tmp-dir\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:29:20.168717 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:20.168698    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44922383-b3eb-443b-9b95-6c0e1c861579-dshm" (OuterVolumeSpecName: "dshm") pod "44922383-b3eb-443b-9b95-6c0e1c861579" (UID: "44922383-b3eb-443b-9b95-6c0e1c861579"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:29:20.168800 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:20.168782    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44922383-b3eb-443b-9b95-6c0e1c861579-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "44922383-b3eb-443b-9b95-6c0e1c861579" (UID: "44922383-b3eb-443b-9b95-6c0e1c861579"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:29:20.168899 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:20.168879    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44922383-b3eb-443b-9b95-6c0e1c861579-kube-api-access-b5hfr" (OuterVolumeSpecName: "kube-api-access-b5hfr") pod "44922383-b3eb-443b-9b95-6c0e1c861579" (UID: "44922383-b3eb-443b-9b95-6c0e1c861579"). InnerVolumeSpecName "kube-api-access-b5hfr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:29:20.267545 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:20.267520    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44922383-b3eb-443b-9b95-6c0e1c861579-dshm\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:29:20.267664 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:20.267561    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5hfr\" (UniqueName: \"kubernetes.io/projected/44922383-b3eb-443b-9b95-6c0e1c861579-kube-api-access-b5hfr\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:29:20.267664 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:20.267572    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44922383-b3eb-443b-9b95-6c0e1c861579-tls-certs\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:29:20.624557 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:20.624527    2584 generic.go:356] "Generic (PLEG): container finished" podID="44922383-b3eb-443b-9b95-6c0e1c861579" containerID="61956dff39f9dc4e390d180b093f053114ba715f258420677901b77265da1b19" exitCode=0
Sep 11 14:29:20.624705 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:20.624573    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"
Sep 11 14:29:20.624705 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:20.624596    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4" event={"ID":"44922383-b3eb-443b-9b95-6c0e1c861579","Type":"ContainerDied","Data":"61956dff39f9dc4e390d180b093f053114ba715f258420677901b77265da1b19"}
Sep 11 14:29:20.624705 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:20.624630    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4" event={"ID":"44922383-b3eb-443b-9b95-6c0e1c861579","Type":"ContainerDied","Data":"f5aec8842ce584c893db4ed1e2cd0ccee16300252cdb98be6c738194c5573d7e"}
Sep 11 14:29:20.624705 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:20.624649    2584 scope.go:117] "RemoveContainer" containerID="61956dff39f9dc4e390d180b093f053114ba715f258420677901b77265da1b19"
Sep 11 14:29:20.633492 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:20.633474    2584 scope.go:117] "RemoveContainer" containerID="61956dff39f9dc4e390d180b093f053114ba715f258420677901b77265da1b19"
Sep 11 14:29:20.633766 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:29:20.633749    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61956dff39f9dc4e390d180b093f053114ba715f258420677901b77265da1b19\": container with ID starting with 61956dff39f9dc4e390d180b093f053114ba715f258420677901b77265da1b19 not found: ID does not exist" containerID="61956dff39f9dc4e390d180b093f053114ba715f258420677901b77265da1b19"
Sep 11 14:29:20.633824 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:20.633773    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61956dff39f9dc4e390d180b093f053114ba715f258420677901b77265da1b19"} err="failed to get container status \"61956dff39f9dc4e390d180b093f053114ba715f258420677901b77265da1b19\": rpc error: code = NotFound desc = could not find container \"61956dff39f9dc4e390d180b093f053114ba715f258420677901b77265da1b19\": container with ID starting with 61956dff39f9dc4e390d180b093f053114ba715f258420677901b77265da1b19 not found: ID does not exist"
Sep 11 14:29:20.675080 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:20.675057    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"]
Sep 11 14:29:20.684099 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:20.684074    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-b4a233/autores-model-b4a233-kserve-78cb5bdf67-68kd4"]
Sep 11 14:29:21.678858 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:21.678822    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44922383-b3eb-443b-9b95-6c0e1c861579" path="/var/lib/kubelet/pods/44922383-b3eb-443b-9b95-6c0e1c861579/volumes"
Sep 11 14:29:26.604588 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:26.604556    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-b0010444-5bcc87b78b-xm9rw"
Sep 11 14:29:27.536342 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:27.536307    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:29:27.610086 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:27.610062    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-b0010444-5d6f9bdccc-8wcbs"
Sep 11 14:29:34.981007 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:34.980971    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:36.916191 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:36.916159    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:38.394155 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:38.394116    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:39.302187 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:39.302139    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:40.186277 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:40.186239    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:41.337064 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:41.337031    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b0010444-hh9qn"]
Sep 11 14:29:41.337552 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:41.337531    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44922383-b3eb-443b-9b95-6c0e1c861579" containerName="main"
Sep 11 14:29:41.337596 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:41.337555    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="44922383-b3eb-443b-9b95-6c0e1c861579" containerName="main"
Sep 11 14:29:41.337667 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:41.337658    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="44922383-b3eb-443b-9b95-6c0e1c861579" containerName="main"
Sep 11 14:29:41.340755 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:41.340735    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b0010444-hh9qn"
Sep 11 14:29:41.343265 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:41.343243    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dp8gp\""
Sep 11 14:29:41.349776 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:41.349747    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b0010444-hh9qn"]
Sep 11 14:29:41.441333 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:41.441306    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4526274a-5642-44e8-bc54-6251905ecd1b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-b0010444-hh9qn\" (UID: \"4526274a-5642-44e8-bc54-6251905ecd1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b0010444-hh9qn"
Sep 11 14:29:41.541658 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:41.541631    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4526274a-5642-44e8-bc54-6251905ecd1b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-b0010444-hh9qn\" (UID: \"4526274a-5642-44e8-bc54-6251905ecd1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b0010444-hh9qn"
Sep 11 14:29:41.542264 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:41.542245    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4526274a-5642-44e8-bc54-6251905ecd1b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-b0010444-hh9qn\" (UID: \"4526274a-5642-44e8-bc54-6251905ecd1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b0010444-hh9qn"
Sep 11 14:29:41.652205 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:41.652139    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b0010444-hh9qn"
Sep 11 14:29:41.928634 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:41.928564    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b0010444-hh9qn"]
Sep 11 14:29:41.931973 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:29:41.931945    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4526274a_5642_44e8_bc54_6251905ecd1b.slice/crio-74bbbf7b9eebedfac7ad52dbbde166a064de55a88bf0fc04cbd9200e6d961d8f WatchSource:0}: Error finding container 74bbbf7b9eebedfac7ad52dbbde166a064de55a88bf0fc04cbd9200e6d961d8f: Status 404 returned error can't find the container with id 74bbbf7b9eebedfac7ad52dbbde166a064de55a88bf0fc04cbd9200e6d961d8f
Sep 11 14:29:42.235254 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:42.235222    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:42.746593 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:42.746565    2584 generic.go:356] "Generic (PLEG): container finished" podID="4526274a-5642-44e8-bc54-6251905ecd1b" containerID="3e070aefa8bbb81e8e2ede6316da3e4b23227d1421fe49ec9d6914a5e6cc20e9" exitCode=0
Sep 11 14:29:42.746884 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:42.746636    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b0010444-hh9qn" event={"ID":"4526274a-5642-44e8-bc54-6251905ecd1b","Type":"ContainerDied","Data":"3e070aefa8bbb81e8e2ede6316da3e4b23227d1421fe49ec9d6914a5e6cc20e9"}
Sep 11 14:29:42.746884 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:42.746668    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b0010444-hh9qn" event={"ID":"4526274a-5642-44e8-bc54-6251905ecd1b","Type":"ContainerStarted","Data":"74bbbf7b9eebedfac7ad52dbbde166a064de55a88bf0fc04cbd9200e6d961d8f"}
Sep 11 14:29:43.076983 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:43.076952    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:43.408887 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:43.408824    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:29:43.891274 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:43.891247    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b0010444-hh9qn"
Sep 11 14:29:43.936691 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:43.936637    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:43.962670 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:43.962640    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4526274a-5642-44e8-bc54-6251905ecd1b-maas-api-service-ca\") pod \"4526274a-5642-44e8-bc54-6251905ecd1b\" (UID: \"4526274a-5642-44e8-bc54-6251905ecd1b\") "
Sep 11 14:29:43.962957 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:43.962937    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4526274a-5642-44e8-bc54-6251905ecd1b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4526274a-5642-44e8-bc54-6251905ecd1b" (UID: "4526274a-5642-44e8-bc54-6251905ecd1b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:29:44.033329 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:44.033243    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:44.063855 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:44.063829    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4526274a-5642-44e8-bc54-6251905ecd1b-maas-api-service-ca\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:29:44.234098 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:44.234070    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:44.748892 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:44.748857    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:44.758111 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:44.758091    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b0010444-hh9qn"
Sep 11 14:29:44.758241 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:44.758138    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b0010444-hh9qn" event={"ID":"4526274a-5642-44e8-bc54-6251905ecd1b","Type":"ContainerDied","Data":"74bbbf7b9eebedfac7ad52dbbde166a064de55a88bf0fc04cbd9200e6d961d8f"}
Sep 11 14:29:44.758241 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:44.758178    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74bbbf7b9eebedfac7ad52dbbde166a064de55a88bf0fc04cbd9200e6d961d8f"
Sep 11 14:29:44.875433 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:44.875408    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:45.142244 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:45.142184    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:45.244087 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:45.244063    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:45.386556 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:45.386514    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:46.328852 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:46.328816    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:48.359941 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:48.359907    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:48.451007 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:48.450970    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:48.744478 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:48.744402    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:49.701353 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:49.701320    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:50.713943 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:50.713915    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:51.606761 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:51.606722    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:51.664971 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:51.664935    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:52.008265 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:52.008184    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:52.144627 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:52.144596    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:52.241058 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:52.241024    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:52.263412 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:52.263347    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-696fee-66cff78f7d-bbnh4"]
Sep 11 14:29:52.263762 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:52.263750    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4526274a-5642-44e8-bc54-6251905ecd1b" containerName="revoke-keys"
Sep 11 14:29:52.263810 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:52.263763    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="4526274a-5642-44e8-bc54-6251905ecd1b" containerName="revoke-keys"
Sep 11 14:29:52.263846 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:52.263840    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="4526274a-5642-44e8-bc54-6251905ecd1b" containerName="revoke-keys"
Sep 11 14:29:52.268106 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:52.268089    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-696fee-66cff78f7d-bbnh4"
Sep 11 14:29:52.270433 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:52.270416    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-696fee-dockercfg-mdh7n\""
Sep 11 14:29:52.270515 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:52.270468    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-696fee\""
Sep 11 14:29:52.279917 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:52.279896    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-696fee-66cff78f7d-bbnh4"]
Sep 11 14:29:52.287007 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:52.286984    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-696fee-7b5886d8bf-7czgc"]
Sep 11 14:29:52.290517 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:52.290492    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-696fee-7b5886d8bf-7czgc"
Sep 11 14:29:52.302072 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:52.302051    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-696fee-7b5886d8bf-7czgc"]
Sep 11 14:29:52.333406 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:52.333381    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp97x\" (UniqueName: \"kubernetes.io/projected/69827068-bc47-4827-9224-5ec931867e15-kube-api-access-qp97x\") pod \"payload-pre-processing-e2e-explicit-696fee-66cff78f7d-bbnh4\" (UID: \"69827068-bc47-4827-9224-5ec931867e15\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-696fee-66cff78f7d-bbnh4"
Sep 11 14:29:52.333513 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:52.333495    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69827068-bc47-4827-9224-5ec931867e15-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-696fee-66cff78f7d-bbnh4\" (UID: \"69827068-bc47-4827-9224-5ec931867e15\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-696fee-66cff78f7d-bbnh4"
Sep 11 14:29:52.434159 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:52.434130    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99a95f64-7f55-43ad-a05f-69c05e74fdb2-plugins-config-volume\") pod \"payload-processing-e2e-explicit-696fee-7b5886d8bf-7czgc\" (UID: \"99a95f64-7f55-43ad-a05f-69c05e74fdb2\") " pod="openshift-ingress/payload-processing-e2e-explicit-696fee-7b5886d8bf-7czgc"
Sep 11 14:29:52.434254 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:52.434182    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x5kx\" (UniqueName: \"kubernetes.io/projected/99a95f64-7f55-43ad-a05f-69c05e74fdb2-kube-api-access-7x5kx\") pod \"payload-processing-e2e-explicit-696fee-7b5886d8bf-7czgc\" (UID: \"99a95f64-7f55-43ad-a05f-69c05e74fdb2\") " pod="openshift-ingress/payload-processing-e2e-explicit-696fee-7b5886d8bf-7czgc"
Sep 11 14:29:52.434254 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:52.434232    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69827068-bc47-4827-9224-5ec931867e15-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-696fee-66cff78f7d-bbnh4\" (UID: \"69827068-bc47-4827-9224-5ec931867e15\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-696fee-66cff78f7d-bbnh4"
Sep 11 14:29:52.434326 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:52.434305    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp97x\" (UniqueName: \"kubernetes.io/projected/69827068-bc47-4827-9224-5ec931867e15-kube-api-access-qp97x\") pod \"payload-pre-processing-e2e-explicit-696fee-66cff78f7d-bbnh4\" (UID: \"69827068-bc47-4827-9224-5ec931867e15\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-696fee-66cff78f7d-bbnh4"
Sep 11 14:29:52.434885 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:52.434864    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69827068-bc47-4827-9224-5ec931867e15-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-696fee-66cff78f7d-bbnh4\" (UID: \"69827068-bc47-4827-9224-5ec931867e15\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-696fee-66cff78f7d-bbnh4"
Sep 11 14:29:52.443073 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:52.443054    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp97x\" (UniqueName: \"kubernetes.io/projected/69827068-bc47-4827-9224-5ec931867e15-kube-api-access-qp97x\") pod \"payload-pre-processing-e2e-explicit-696fee-66cff78f7d-bbnh4\" (UID: \"69827068-bc47-4827-9224-5ec931867e15\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-696fee-66cff78f7d-bbnh4"
Sep 11 14:29:52.535622 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:52.535550    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99a95f64-7f55-43ad-a05f-69c05e74fdb2-plugins-config-volume\") pod \"payload-processing-e2e-explicit-696fee-7b5886d8bf-7czgc\" (UID: \"99a95f64-7f55-43ad-a05f-69c05e74fdb2\") " pod="openshift-ingress/payload-processing-e2e-explicit-696fee-7b5886d8bf-7czgc"
Sep 11 14:29:52.535742 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:52.535663    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x5kx\" (UniqueName: \"kubernetes.io/projected/99a95f64-7f55-43ad-a05f-69c05e74fdb2-kube-api-access-7x5kx\") pod \"payload-processing-e2e-explicit-696fee-7b5886d8bf-7czgc\" (UID: \"99a95f64-7f55-43ad-a05f-69c05e74fdb2\") " pod="openshift-ingress/payload-processing-e2e-explicit-696fee-7b5886d8bf-7czgc"
Sep 11 14:29:52.536232 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:52.536214    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99a95f64-7f55-43ad-a05f-69c05e74fdb2-plugins-config-volume\") pod \"payload-processing-e2e-explicit-696fee-7b5886d8bf-7czgc\" (UID: \"99a95f64-7f55-43ad-a05f-69c05e74fdb2\") " pod="openshift-ingress/payload-processing-e2e-explicit-696fee-7b5886d8bf-7czgc"
Sep 11 14:29:52.548088 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:52.548068    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x5kx\" (UniqueName: \"kubernetes.io/projected/99a95f64-7f55-43ad-a05f-69c05e74fdb2-kube-api-access-7x5kx\") pod \"payload-processing-e2e-explicit-696fee-7b5886d8bf-7czgc\" (UID: \"99a95f64-7f55-43ad-a05f-69c05e74fdb2\") " pod="openshift-ingress/payload-processing-e2e-explicit-696fee-7b5886d8bf-7czgc"
Sep 11 14:29:52.579448 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:52.579430    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-696fee-66cff78f7d-bbnh4"
Sep 11 14:29:52.601793 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:52.601774    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-696fee-7b5886d8bf-7czgc"
Sep 11 14:29:52.856731 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:52.856708    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-696fee-66cff78f7d-bbnh4"]
Sep 11 14:29:52.858510 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:29:52.858477    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69827068_bc47_4827_9224_5ec931867e15.slice/crio-f29694510017b977f9c08cdba45ffa89d03e493303ad4601157db9c4a8745adc WatchSource:0}: Error finding container f29694510017b977f9c08cdba45ffa89d03e493303ad4601157db9c4a8745adc: Status 404 returned error can't find the container with id f29694510017b977f9c08cdba45ffa89d03e493303ad4601157db9c4a8745adc
Sep 11 14:29:52.884751 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:52.884729    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-696fee-7b5886d8bf-7czgc"]
Sep 11 14:29:52.892664 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:29:52.892630    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99a95f64_7f55_43ad_a05f_69c05e74fdb2.slice/crio-2718481e33edad7514a18197f66a0fc1fff0f92fda6872855faf4b71d55ddd19 WatchSource:0}: Error finding container 2718481e33edad7514a18197f66a0fc1fff0f92fda6872855faf4b71d55ddd19: Status 404 returned error can't find the container with id 2718481e33edad7514a18197f66a0fc1fff0f92fda6872855faf4b71d55ddd19
Sep 11 14:29:53.096890 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.096850    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:53.131787 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.131467    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b0010444-5d6f9bdccc-8wcbs"]
Sep 11 14:29:53.132777 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.132744    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-b0010444-5d6f9bdccc-8wcbs" podUID="cb542bb4-2863-4ad4-bacd-96ab43ea1007" containerName="payload-processing" containerID="cri-o://89db1606405b996595ec4551d37d2a22b22e29404317fac6a7c0c3f5abd4a4df" gracePeriod=30
Sep 11 14:29:53.138592 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.137839    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b0010444-5bcc87b78b-xm9rw"]
Sep 11 14:29:53.138592 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.138049    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-b0010444-5bcc87b78b-xm9rw" podUID="64f24460-438a-42bf-a19f-8261805b1119" containerName="payload-pre-processing" containerID="cri-o://f86ad37f6617a182b763388515d1f7f3afe246d85983e487e367263fcb868664" gracePeriod=30
Sep 11 14:29:53.173226 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.173180    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:53.241467 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.241435    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:53.342671 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.342603    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:53.418395 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.418370    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b0010444-5d6f9bdccc-8wcbs"
Sep 11 14:29:53.434935 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.434910    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-b0010444-5bcc87b78b-xm9rw"
Sep 11 14:29:53.505903 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.505859    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:53.547012 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.546987    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bwxx\" (UniqueName: \"kubernetes.io/projected/cb542bb4-2863-4ad4-bacd-96ab43ea1007-kube-api-access-6bwxx\") pod \"cb542bb4-2863-4ad4-bacd-96ab43ea1007\" (UID: \"cb542bb4-2863-4ad4-bacd-96ab43ea1007\") "
Sep 11 14:29:53.547151 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.547089    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb542bb4-2863-4ad4-bacd-96ab43ea1007-plugins-config-volume\") pod \"cb542bb4-2863-4ad4-bacd-96ab43ea1007\" (UID: \"cb542bb4-2863-4ad4-bacd-96ab43ea1007\") "
Sep 11 14:29:53.547217 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.547156    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64f24460-438a-42bf-a19f-8261805b1119-plugins-config-volume\") pod \"64f24460-438a-42bf-a19f-8261805b1119\" (UID: \"64f24460-438a-42bf-a19f-8261805b1119\") "
Sep 11 14:29:53.547217 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.547194    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j44sv\" (UniqueName: \"kubernetes.io/projected/64f24460-438a-42bf-a19f-8261805b1119-kube-api-access-j44sv\") pod \"64f24460-438a-42bf-a19f-8261805b1119\" (UID: \"64f24460-438a-42bf-a19f-8261805b1119\") "
Sep 11 14:29:53.547501 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.547474    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb542bb4-2863-4ad4-bacd-96ab43ea1007-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cb542bb4-2863-4ad4-bacd-96ab43ea1007" (UID: "cb542bb4-2863-4ad4-bacd-96ab43ea1007"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:29:53.547592 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.547557    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64f24460-438a-42bf-a19f-8261805b1119-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "64f24460-438a-42bf-a19f-8261805b1119" (UID: "64f24460-438a-42bf-a19f-8261805b1119"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:29:53.549613 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.549587    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb542bb4-2863-4ad4-bacd-96ab43ea1007-kube-api-access-6bwxx" (OuterVolumeSpecName: "kube-api-access-6bwxx") pod "cb542bb4-2863-4ad4-bacd-96ab43ea1007" (UID: "cb542bb4-2863-4ad4-bacd-96ab43ea1007"). InnerVolumeSpecName "kube-api-access-6bwxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:29:53.549944 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.549912    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64f24460-438a-42bf-a19f-8261805b1119-kube-api-access-j44sv" (OuterVolumeSpecName: "kube-api-access-j44sv") pod "64f24460-438a-42bf-a19f-8261805b1119" (UID: "64f24460-438a-42bf-a19f-8261805b1119"). InnerVolumeSpecName "kube-api-access-j44sv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:29:53.555226 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.555172    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b0010444-hh9qn"]
Sep 11 14:29:53.558227 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.558204    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b0010444-hh9qn"]
Sep 11 14:29:53.648251 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.648229    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb542bb4-2863-4ad4-bacd-96ab43ea1007-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:29:53.648331 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.648254    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64f24460-438a-42bf-a19f-8261805b1119-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:29:53.648331 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.648270    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j44sv\" (UniqueName: \"kubernetes.io/projected/64f24460-438a-42bf-a19f-8261805b1119-kube-api-access-j44sv\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:29:53.648331 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.648282    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bwxx\" (UniqueName: \"kubernetes.io/projected/cb542bb4-2863-4ad4-bacd-96ab43ea1007-kube-api-access-6bwxx\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:29:53.683703 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.683622    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4526274a-5642-44e8-bc54-6251905ecd1b" path="/var/lib/kubelet/pods/4526274a-5642-44e8-bc54-6251905ecd1b/volumes"
Sep 11 14:29:53.721319 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.721290    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:53.803783 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.803756    2584 generic.go:356] "Generic (PLEG): container finished" podID="cb542bb4-2863-4ad4-bacd-96ab43ea1007" containerID="89db1606405b996595ec4551d37d2a22b22e29404317fac6a7c0c3f5abd4a4df" exitCode=0
Sep 11 14:29:53.803907 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.803808    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b0010444-5d6f9bdccc-8wcbs"
Sep 11 14:29:53.803907 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.803845    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b0010444-5d6f9bdccc-8wcbs" event={"ID":"cb542bb4-2863-4ad4-bacd-96ab43ea1007","Type":"ContainerDied","Data":"89db1606405b996595ec4551d37d2a22b22e29404317fac6a7c0c3f5abd4a4df"}
Sep 11 14:29:53.803907 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.803899    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b0010444-5d6f9bdccc-8wcbs" event={"ID":"cb542bb4-2863-4ad4-bacd-96ab43ea1007","Type":"ContainerDied","Data":"325cea776b6860a58f84b93cde4becb38e19308eea56b9a5026a1568a32d3b51"}
Sep 11 14:29:53.804067 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.803932    2584 scope.go:117] "RemoveContainer" containerID="89db1606405b996595ec4551d37d2a22b22e29404317fac6a7c0c3f5abd4a4df"
Sep 11 14:29:53.806225 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.805785    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-696fee-7b5886d8bf-7czgc" event={"ID":"99a95f64-7f55-43ad-a05f-69c05e74fdb2","Type":"ContainerStarted","Data":"c2f222cdfd44775be86afd264324d0fdb8991468e42819c75e125dd45068c89f"}
Sep 11 14:29:53.806225 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.805832    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-696fee-7b5886d8bf-7czgc" event={"ID":"99a95f64-7f55-43ad-a05f-69c05e74fdb2","Type":"ContainerStarted","Data":"2718481e33edad7514a18197f66a0fc1fff0f92fda6872855faf4b71d55ddd19"}
Sep 11 14:29:53.806225 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.805864    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-696fee-7b5886d8bf-7czgc"
Sep 11 14:29:53.807569 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.807424    2584 generic.go:356] "Generic (PLEG): container finished" podID="64f24460-438a-42bf-a19f-8261805b1119" containerID="f86ad37f6617a182b763388515d1f7f3afe246d85983e487e367263fcb868664" exitCode=0
Sep 11 14:29:53.807569 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.807507    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-b0010444-5bcc87b78b-xm9rw"
Sep 11 14:29:53.807770 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.807507    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-b0010444-5bcc87b78b-xm9rw" event={"ID":"64f24460-438a-42bf-a19f-8261805b1119","Type":"ContainerDied","Data":"f86ad37f6617a182b763388515d1f7f3afe246d85983e487e367263fcb868664"}
Sep 11 14:29:53.807851 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.807804    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-b0010444-5bcc87b78b-xm9rw" event={"ID":"64f24460-438a-42bf-a19f-8261805b1119","Type":"ContainerDied","Data":"22e87546ba18c1ac62bc4ef104fb15e4b6fba9ee2437e43e2a8adf76253db8f6"}
Sep 11 14:29:53.809556 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.809531    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-696fee-66cff78f7d-bbnh4" event={"ID":"69827068-bc47-4827-9224-5ec931867e15","Type":"ContainerStarted","Data":"9ee4261c3427271f473c0366b68086c963bbc0d8c802fc999fc0c3f6f6919ad9"}
Sep 11 14:29:53.809654 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.809580    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-696fee-66cff78f7d-bbnh4" event={"ID":"69827068-bc47-4827-9224-5ec931867e15","Type":"ContainerStarted","Data":"f29694510017b977f9c08cdba45ffa89d03e493303ad4601157db9c4a8745adc"}
Sep 11 14:29:53.809728 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.809651    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-696fee-66cff78f7d-bbnh4"
Sep 11 14:29:53.814315 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.814297    2584 scope.go:117] "RemoveContainer" containerID="89db1606405b996595ec4551d37d2a22b22e29404317fac6a7c0c3f5abd4a4df"
Sep 11 14:29:53.814645 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:29:53.814619    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89db1606405b996595ec4551d37d2a22b22e29404317fac6a7c0c3f5abd4a4df\": container with ID starting with 89db1606405b996595ec4551d37d2a22b22e29404317fac6a7c0c3f5abd4a4df not found: ID does not exist" containerID="89db1606405b996595ec4551d37d2a22b22e29404317fac6a7c0c3f5abd4a4df"
Sep 11 14:29:53.814738 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.814657    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89db1606405b996595ec4551d37d2a22b22e29404317fac6a7c0c3f5abd4a4df"} err="failed to get container status \"89db1606405b996595ec4551d37d2a22b22e29404317fac6a7c0c3f5abd4a4df\": rpc error: code = NotFound desc = could not find container \"89db1606405b996595ec4551d37d2a22b22e29404317fac6a7c0c3f5abd4a4df\": container with ID starting with 89db1606405b996595ec4551d37d2a22b22e29404317fac6a7c0c3f5abd4a4df not found: ID does not exist"
Sep 11 14:29:53.814738 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.814699    2584 scope.go:117] "RemoveContainer" containerID="f86ad37f6617a182b763388515d1f7f3afe246d85983e487e367263fcb868664"
Sep 11 14:29:53.827438 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.826802    2584 scope.go:117] "RemoveContainer" containerID="f86ad37f6617a182b763388515d1f7f3afe246d85983e487e367263fcb868664"
Sep 11 14:29:53.827438 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:29:53.827426    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f86ad37f6617a182b763388515d1f7f3afe246d85983e487e367263fcb868664\": container with ID starting with f86ad37f6617a182b763388515d1f7f3afe246d85983e487e367263fcb868664 not found: ID does not exist" containerID="f86ad37f6617a182b763388515d1f7f3afe246d85983e487e367263fcb868664"
Sep 11 14:29:53.827601 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.827461    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f86ad37f6617a182b763388515d1f7f3afe246d85983e487e367263fcb868664"} err="failed to get container status \"f86ad37f6617a182b763388515d1f7f3afe246d85983e487e367263fcb868664\": rpc error: code = NotFound desc = could not find container \"f86ad37f6617a182b763388515d1f7f3afe246d85983e487e367263fcb868664\": container with ID starting with f86ad37f6617a182b763388515d1f7f3afe246d85983e487e367263fcb868664 not found: ID does not exist"
Sep 11 14:29:53.830032 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.829983    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-696fee-7b5886d8bf-7czgc" podStartSLOduration=1.8299661280000001 podStartE2EDuration="1.829966128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:29:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:29:53.827155814 +0000 UTC m=+886.625790596" watchObservedRunningTime="2026-09-11 14:29:53.829966128 +0000 UTC m=+886.628600912"
Sep 11 14:29:53.846722 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.846671    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b0010444-5d6f9bdccc-8wcbs"]
Sep 11 14:29:53.849483 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.849461    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b0010444-5d6f9bdccc-8wcbs"]
Sep 11 14:29:53.866532 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.866485    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-696fee-66cff78f7d-bbnh4" podStartSLOduration=1.866474091 podStartE2EDuration="1.866474091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:29:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:29:53.864516113 +0000 UTC m=+886.663150896" watchObservedRunningTime="2026-09-11 14:29:53.866474091 +0000 UTC m=+886.665108900"
Sep 11 14:29:53.886829 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.886803    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b0010444-5bcc87b78b-xm9rw"]
Sep 11 14:29:53.891085 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:53.891064    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b0010444-5bcc87b78b-xm9rw"]
Sep 11 14:29:54.330495 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:54.330462    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:54.520218 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:54.520186    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:54.638273 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:54.638204    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:54.719505 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:54.719472    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:55.679745 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:55.679710    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64f24460-438a-42bf-a19f-8261805b1119" path="/var/lib/kubelet/pods/64f24460-438a-42bf-a19f-8261805b1119/volumes"
Sep 11 14:29:55.680182 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:55.680049    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb542bb4-2863-4ad4-bacd-96ab43ea1007" path="/var/lib/kubelet/pods/cb542bb4-2863-4ad4-bacd-96ab43ea1007/volumes"
Sep 11 14:29:55.683399 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:55.683372    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:56.354465 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:56.354422    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:56.501588 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:56.501552    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:57.284181 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:57.284137    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:29:58.115008 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:29:58.114976    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:30:00.153599 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:00.153520    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-696fee-29818950-vb4pf"]
Sep 11 14:30:00.154113 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:00.154092    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb542bb4-2863-4ad4-bacd-96ab43ea1007" containerName="payload-processing"
Sep 11 14:30:00.154188 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:00.154115    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb542bb4-2863-4ad4-bacd-96ab43ea1007" containerName="payload-processing"
Sep 11 14:30:00.154188 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:00.154156    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64f24460-438a-42bf-a19f-8261805b1119" containerName="payload-pre-processing"
Sep 11 14:30:00.154188 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:00.154165    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="64f24460-438a-42bf-a19f-8261805b1119" containerName="payload-pre-processing"
Sep 11 14:30:00.154346 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:00.154287    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="64f24460-438a-42bf-a19f-8261805b1119" containerName="payload-pre-processing"
Sep 11 14:30:00.154346 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:00.154300    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb542bb4-2863-4ad4-bacd-96ab43ea1007" containerName="payload-processing"
Sep 11 14:30:00.159139 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:00.159113    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-696fee-29818950-vb4pf"
Sep 11 14:30:00.161037 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:00.161013    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b6b864-29818950-mb2fp"]
Sep 11 14:30:00.163715 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:00.163694    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dp8gp\""
Sep 11 14:30:00.164297 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:00.164278    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b6b864-29818950-mb2fp"
Sep 11 14:30:00.171496 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:00.171474    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-696fee-29818950-vb4pf"]
Sep 11 14:30:00.172250 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:00.172231    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-696fee-29818950-vb4pf"
Sep 11 14:30:00.178747 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:00.178730    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b6b864-29818950-mb2fp"
Sep 11 14:30:00.187896 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:00.187698    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b6b864-29818950-mb2fp"]
Sep 11 14:30:00.454913 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:00.454840    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-696fee-29818950-vb4pf"]
Sep 11 14:30:00.459039 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:30:00.459006    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34587748_1066_4341_9a08_c829328403bf.slice/crio-b2824ccef76549565ab835c4abf15604c014f393fd25759962431da4feade930 WatchSource:0}: Error finding container b2824ccef76549565ab835c4abf15604c014f393fd25759962431da4feade930: Status 404 returned error can't find the container with id b2824ccef76549565ab835c4abf15604c014f393fd25759962431da4feade930
Sep 11 14:30:00.460520 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:00.460483    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b6b864-29818950-mb2fp"]
Sep 11 14:30:00.462420 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:30:00.462382    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode569c43d_84be_46f4_8da4_61f2fc1351fa.slice/crio-6b98b8ec2ee1f4a81b5c1e7a601406affa319a8550bcb4e67cb245487011c0f5 WatchSource:0}: Error finding container 6b98b8ec2ee1f4a81b5c1e7a601406affa319a8550bcb4e67cb245487011c0f5: Status 404 returned error can't find the container with id 6b98b8ec2ee1f4a81b5c1e7a601406affa319a8550bcb4e67cb245487011c0f5
Sep 11 14:30:00.846225 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:00.846197    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b6b864-29818950-mb2fp" event={"ID":"e569c43d-84be-46f4-8da4-61f2fc1351fa","Type":"ContainerStarted","Data":"48f2fb6e32b2662588cee3275d74ef3d45e70316b9a65ae87d86e2ecf47befa5"}
Sep 11 14:30:00.846328 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:00.846254    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b6b864-29818950-mb2fp" event={"ID":"e569c43d-84be-46f4-8da4-61f2fc1351fa","Type":"ContainerStarted","Data":"6b98b8ec2ee1f4a81b5c1e7a601406affa319a8550bcb4e67cb245487011c0f5"}
Sep 11 14:30:00.847833 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:00.847809    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-696fee-29818950-vb4pf" event={"ID":"34587748-1066-4341-9a08-c829328403bf","Type":"ContainerStarted","Data":"94200f2f6a38b41215d8c33a458125b6cb94abfed56c11356ef4e884933d731b"}
Sep 11 14:30:00.847925 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:00.847857    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-696fee-29818950-vb4pf" event={"ID":"34587748-1066-4341-9a08-c829328403bf","Type":"ContainerStarted","Data":"b2824ccef76549565ab835c4abf15604c014f393fd25759962431da4feade930"}
Sep 11 14:30:00.864549 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:00.864508    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b6b864-29818950-mb2fp" podStartSLOduration=0.864492983 podStartE2EDuration="864.492983ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:30:00.863329547 +0000 UTC m=+893.661964331" watchObservedRunningTime="2026-09-11 14:30:00.864492983 +0000 UTC m=+893.663127762"
Sep 11 14:30:00.881064 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:00.881027    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-696fee-29818950-vb4pf" podStartSLOduration=0.881013321 podStartE2EDuration="881.013321ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:30:00.880170541 +0000 UTC m=+893.678805325" watchObservedRunningTime="2026-09-11 14:30:00.881013321 +0000 UTC m=+893.679648102"
Sep 11 14:30:01.854180 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:01.854151    2584 generic.go:356] "Generic (PLEG): container finished" podID="e569c43d-84be-46f4-8da4-61f2fc1351fa" containerID="48f2fb6e32b2662588cee3275d74ef3d45e70316b9a65ae87d86e2ecf47befa5" exitCode=0
Sep 11 14:30:01.854531 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:01.854238    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b6b864-29818950-mb2fp" event={"ID":"e569c43d-84be-46f4-8da4-61f2fc1351fa","Type":"ContainerDied","Data":"48f2fb6e32b2662588cee3275d74ef3d45e70316b9a65ae87d86e2ecf47befa5"}
Sep 11 14:30:01.855808 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:01.855787    2584 generic.go:356] "Generic (PLEG): container finished" podID="34587748-1066-4341-9a08-c829328403bf" containerID="94200f2f6a38b41215d8c33a458125b6cb94abfed56c11356ef4e884933d731b" exitCode=0
Sep 11 14:30:01.855908 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:01.855812    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-696fee-29818950-vb4pf" event={"ID":"34587748-1066-4341-9a08-c829328403bf","Type":"ContainerDied","Data":"94200f2f6a38b41215d8c33a458125b6cb94abfed56c11356ef4e884933d731b"}
Sep 11 14:30:03.007182 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:03.007158    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b6b864-29818950-mb2fp"
Sep 11 14:30:03.010069 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:03.010045    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-696fee-29818950-vb4pf"
Sep 11 14:30:03.275916 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:03.275839    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:03.374339 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:03.374310    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:03.539229 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:03.539199    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:03.866904 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:03.866843    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b6b864-29818950-mb2fp"
Sep 11 14:30:03.866904 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:03.866877    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b6b864-29818950-mb2fp" event={"ID":"e569c43d-84be-46f4-8da4-61f2fc1351fa","Type":"ContainerDied","Data":"6b98b8ec2ee1f4a81b5c1e7a601406affa319a8550bcb4e67cb245487011c0f5"}
Sep 11 14:30:03.867070 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:03.866921    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b98b8ec2ee1f4a81b5c1e7a601406affa319a8550bcb4e67cb245487011c0f5"
Sep 11 14:30:03.868226 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:03.868208    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-696fee-29818950-vb4pf"
Sep 11 14:30:03.868318 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:03.868247    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-696fee-29818950-vb4pf" event={"ID":"34587748-1066-4341-9a08-c829328403bf","Type":"ContainerDied","Data":"b2824ccef76549565ab835c4abf15604c014f393fd25759962431da4feade930"}
Sep 11 14:30:03.868318 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:03.868291    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2824ccef76549565ab835c4abf15604c014f393fd25759962431da4feade930"
Sep 11 14:30:04.040893 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:04.040866    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:04.820139 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:04.820109    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-696fee-7b5886d8bf-7czgc"
Sep 11 14:30:04.820291 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:04.820181    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-696fee-66cff78f7d-bbnh4"
Sep 11 14:30:15.453116 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:15.453072    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:15.792935 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:15.792902    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:30:16.144933 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:16.144844    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:17.219834 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:17.219799    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:18.116213 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:18.116181    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:18.499857 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:18.499781    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:25.481157 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.481124    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"]
Sep 11 14:30:25.481516 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.481504    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34587748-1066-4341-9a08-c829328403bf" containerName="cleanup"
Sep 11 14:30:25.481516 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.481517    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="34587748-1066-4341-9a08-c829328403bf" containerName="cleanup"
Sep 11 14:30:25.481593 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.481534    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e569c43d-84be-46f4-8da4-61f2fc1351fa" containerName="cleanup"
Sep 11 14:30:25.481593 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.481540    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="e569c43d-84be-46f4-8da4-61f2fc1351fa" containerName="cleanup"
Sep 11 14:30:25.481659 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.481607    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="e569c43d-84be-46f4-8da4-61f2fc1351fa" containerName="cleanup"
Sep 11 14:30:25.481659 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.481618    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="34587748-1066-4341-9a08-c829328403bf" containerName="cleanup"
Sep 11 14:30:25.485003 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.484988    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"
Sep 11 14:30:25.488169 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.488143    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-696fee\"/\"openshift-service-ca.crt\""
Sep 11 14:30:25.489512 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.489359    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-696fee\"/\"default-dockercfg-xxddk\""
Sep 11 14:30:25.489512 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.489398    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-696fee\"/\"kube-root-ca.crt\""
Sep 11 14:30:25.489512 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.489414    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-696fee\"/\"explicit-model-696fee-kserve-self-signed-certs\""
Sep 11 14:30:25.494219 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.494192    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"]
Sep 11 14:30:25.505162 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.505135    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8c32f54-58de-4080-8442-0dc0f6ebba8d-model-cache\") pod \"explicit-model-696fee-kserve-585fbcd995-9tlct\" (UID: \"f8c32f54-58de-4080-8442-0dc0f6ebba8d\") " pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"
Sep 11 14:30:25.505258 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.505173    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8c32f54-58de-4080-8442-0dc0f6ebba8d-tls-certs\") pod \"explicit-model-696fee-kserve-585fbcd995-9tlct\" (UID: \"f8c32f54-58de-4080-8442-0dc0f6ebba8d\") " pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"
Sep 11 14:30:25.505258 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.505206    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9h2n\" (UniqueName: \"kubernetes.io/projected/f8c32f54-58de-4080-8442-0dc0f6ebba8d-kube-api-access-x9h2n\") pod \"explicit-model-696fee-kserve-585fbcd995-9tlct\" (UID: \"f8c32f54-58de-4080-8442-0dc0f6ebba8d\") " pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"
Sep 11 14:30:25.505258 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.505238    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8c32f54-58de-4080-8442-0dc0f6ebba8d-tmp-dir\") pod \"explicit-model-696fee-kserve-585fbcd995-9tlct\" (UID: \"f8c32f54-58de-4080-8442-0dc0f6ebba8d\") " pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"
Sep 11 14:30:25.505562 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.505270    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8c32f54-58de-4080-8442-0dc0f6ebba8d-home\") pod \"explicit-model-696fee-kserve-585fbcd995-9tlct\" (UID: \"f8c32f54-58de-4080-8442-0dc0f6ebba8d\") " pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"
Sep 11 14:30:25.505562 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.505306    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8c32f54-58de-4080-8442-0dc0f6ebba8d-dshm\") pod \"explicit-model-696fee-kserve-585fbcd995-9tlct\" (UID: \"f8c32f54-58de-4080-8442-0dc0f6ebba8d\") " pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"
Sep 11 14:30:25.512972 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.512949    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:25.606493 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.606465    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9h2n\" (UniqueName: \"kubernetes.io/projected/f8c32f54-58de-4080-8442-0dc0f6ebba8d-kube-api-access-x9h2n\") pod \"explicit-model-696fee-kserve-585fbcd995-9tlct\" (UID: \"f8c32f54-58de-4080-8442-0dc0f6ebba8d\") " pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"
Sep 11 14:30:25.606596 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.606498    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8c32f54-58de-4080-8442-0dc0f6ebba8d-tmp-dir\") pod \"explicit-model-696fee-kserve-585fbcd995-9tlct\" (UID: \"f8c32f54-58de-4080-8442-0dc0f6ebba8d\") " pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"
Sep 11 14:30:25.606596 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.606524    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8c32f54-58de-4080-8442-0dc0f6ebba8d-home\") pod \"explicit-model-696fee-kserve-585fbcd995-9tlct\" (UID: \"f8c32f54-58de-4080-8442-0dc0f6ebba8d\") " pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"
Sep 11 14:30:25.606742 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.606709    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8c32f54-58de-4080-8442-0dc0f6ebba8d-dshm\") pod \"explicit-model-696fee-kserve-585fbcd995-9tlct\" (UID: \"f8c32f54-58de-4080-8442-0dc0f6ebba8d\") " pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"
Sep 11 14:30:25.606815 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.606795    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8c32f54-58de-4080-8442-0dc0f6ebba8d-model-cache\") pod \"explicit-model-696fee-kserve-585fbcd995-9tlct\" (UID: \"f8c32f54-58de-4080-8442-0dc0f6ebba8d\") " pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"
Sep 11 14:30:25.606815 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.606810    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8c32f54-58de-4080-8442-0dc0f6ebba8d-tls-certs\") pod \"explicit-model-696fee-kserve-585fbcd995-9tlct\" (UID: \"f8c32f54-58de-4080-8442-0dc0f6ebba8d\") " pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"
Sep 11 14:30:25.606926 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.606855    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8c32f54-58de-4080-8442-0dc0f6ebba8d-tmp-dir\") pod \"explicit-model-696fee-kserve-585fbcd995-9tlct\" (UID: \"f8c32f54-58de-4080-8442-0dc0f6ebba8d\") " pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"
Sep 11 14:30:25.606982 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.606947    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8c32f54-58de-4080-8442-0dc0f6ebba8d-home\") pod \"explicit-model-696fee-kserve-585fbcd995-9tlct\" (UID: \"f8c32f54-58de-4080-8442-0dc0f6ebba8d\") " pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"
Sep 11 14:30:25.607125 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.607107    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8c32f54-58de-4080-8442-0dc0f6ebba8d-model-cache\") pod \"explicit-model-696fee-kserve-585fbcd995-9tlct\" (UID: \"f8c32f54-58de-4080-8442-0dc0f6ebba8d\") " pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"
Sep 11 14:30:25.608917 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.608894    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8c32f54-58de-4080-8442-0dc0f6ebba8d-dshm\") pod \"explicit-model-696fee-kserve-585fbcd995-9tlct\" (UID: \"f8c32f54-58de-4080-8442-0dc0f6ebba8d\") " pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"
Sep 11 14:30:25.609034 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.609018    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8c32f54-58de-4080-8442-0dc0f6ebba8d-tls-certs\") pod \"explicit-model-696fee-kserve-585fbcd995-9tlct\" (UID: \"f8c32f54-58de-4080-8442-0dc0f6ebba8d\") " pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"
Sep 11 14:30:25.615009 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.614987    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9h2n\" (UniqueName: \"kubernetes.io/projected/f8c32f54-58de-4080-8442-0dc0f6ebba8d-kube-api-access-x9h2n\") pod \"explicit-model-696fee-kserve-585fbcd995-9tlct\" (UID: \"f8c32f54-58de-4080-8442-0dc0f6ebba8d\") " pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"
Sep 11 14:30:25.795670 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:25.795647    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"
Sep 11 14:30:26.094804 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:26.094780    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"]
Sep 11 14:30:26.097300 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:30:26.097272    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8c32f54_58de_4080_8442_0dc0f6ebba8d.slice/crio-c98d2312aea109b3c486138600bd329ea48b9959e83c4f1147eced930c355864 WatchSource:0}: Error finding container c98d2312aea109b3c486138600bd329ea48b9959e83c4f1147eced930c355864: Status 404 returned error can't find the container with id c98d2312aea109b3c486138600bd329ea48b9959e83c4f1147eced930c355864
Sep 11 14:30:26.987585 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:26.987549    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct" event={"ID":"f8c32f54-58de-4080-8442-0dc0f6ebba8d","Type":"ContainerStarted","Data":"8482d93844e2707f87dfbda8e62bdf0e2a7da9cab62f26e882811c433013fb91"}
Sep 11 14:30:26.987585 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:26.987590    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct" event={"ID":"f8c32f54-58de-4080-8442-0dc0f6ebba8d","Type":"ContainerStarted","Data":"c98d2312aea109b3c486138600bd329ea48b9959e83c4f1147eced930c355864"}
Sep 11 14:30:27.010625 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:27.010551    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct" podStartSLOduration=2.010532985 podStartE2EDuration="2.010532985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:30:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:30:27.008815099 +0000 UTC m=+919.807449894" watchObservedRunningTime="2026-09-11 14:30:27.010532985 +0000 UTC m=+919.809167768"
Sep 11 14:30:30.027386 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:30.027350    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:31.799335 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:31.799302    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:30:35.795985 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:35.795941    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"
Sep 11 14:30:35.796353 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:35.796015    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"
Sep 11 14:30:35.809258 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:35.809236    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"
Sep 11 14:30:36.047512 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:36.047437    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"
Sep 11 14:30:36.869133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:36.869096    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:38.064090 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:38.064054    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:39.694075 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:39.694046    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"]
Sep 11 14:30:39.703056 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:39.703011    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:39.819665 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:39.819632    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-696fee-stxxl"]
Sep 11 14:30:39.823319 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:39.823298    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-696fee-stxxl"
Sep 11 14:30:39.825813 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:39.825794    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dp8gp\""
Sep 11 14:30:39.831108 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:39.831085    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-696fee-stxxl"]
Sep 11 14:30:39.932640 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:39.932603    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74deb42c-b03e-40f7-8dc0-443560633257-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-696fee-stxxl\" (UID: \"74deb42c-b03e-40f7-8dc0-443560633257\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-696fee-stxxl"
Sep 11 14:30:40.033374 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:40.033292    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74deb42c-b03e-40f7-8dc0-443560633257-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-696fee-stxxl\" (UID: \"74deb42c-b03e-40f7-8dc0-443560633257\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-696fee-stxxl"
Sep 11 14:30:40.033940 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:40.033919    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74deb42c-b03e-40f7-8dc0-443560633257-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-696fee-stxxl\" (UID: \"74deb42c-b03e-40f7-8dc0-443560633257\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-696fee-stxxl"
Sep 11 14:30:40.135870 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:40.135842    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-696fee-stxxl"
Sep 11 14:30:40.425600 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:40.425573    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-696fee-stxxl"]
Sep 11 14:30:40.427226 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:30:40.427198    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74deb42c_b03e_40f7_8dc0_443560633257.slice/crio-08e4de876c73aece8504460d81a6f2a8d9cf23aa29336f54333d1efb1e032daa WatchSource:0}: Error finding container 08e4de876c73aece8504460d81a6f2a8d9cf23aa29336f54333d1efb1e032daa: Status 404 returned error can't find the container with id 08e4de876c73aece8504460d81a6f2a8d9cf23aa29336f54333d1efb1e032daa
Sep 11 14:30:40.907448 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:40.907417    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:41.064987 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:41.064962    2584 generic.go:356] "Generic (PLEG): container finished" podID="74deb42c-b03e-40f7-8dc0-443560633257" containerID="8ffd0e9e9b24285d068315bef39b75218b99683b5a507beefe8fa5b870a4ee8c" exitCode=0
Sep 11 14:30:41.065109 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:41.065046    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-696fee-stxxl" event={"ID":"74deb42c-b03e-40f7-8dc0-443560633257","Type":"ContainerDied","Data":"8ffd0e9e9b24285d068315bef39b75218b99683b5a507beefe8fa5b870a4ee8c"}
Sep 11 14:30:41.065109 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:41.065104    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-696fee-stxxl" event={"ID":"74deb42c-b03e-40f7-8dc0-443560633257","Type":"ContainerStarted","Data":"08e4de876c73aece8504460d81a6f2a8d9cf23aa29336f54333d1efb1e032daa"}
Sep 11 14:30:41.859001 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:41.858969    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:42.212136 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:42.212116    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-696fee-stxxl"
Sep 11 14:30:42.252114 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:42.252084    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74deb42c-b03e-40f7-8dc0-443560633257-maas-api-service-ca\") pod \"74deb42c-b03e-40f7-8dc0-443560633257\" (UID: \"74deb42c-b03e-40f7-8dc0-443560633257\") "
Sep 11 14:30:42.252483 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:42.252458    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74deb42c-b03e-40f7-8dc0-443560633257-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "74deb42c-b03e-40f7-8dc0-443560633257" (UID: "74deb42c-b03e-40f7-8dc0-443560633257"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:30:42.353066 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:42.353036    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74deb42c-b03e-40f7-8dc0-443560633257-maas-api-service-ca\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:30:42.752025 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:42.751994    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:43.076796 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:43.076773    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-696fee-stxxl"
Sep 11 14:30:43.076935 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:43.076818    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-696fee-stxxl" event={"ID":"74deb42c-b03e-40f7-8dc0-443560633257","Type":"ContainerDied","Data":"08e4de876c73aece8504460d81a6f2a8d9cf23aa29336f54333d1efb1e032daa"}
Sep 11 14:30:43.076935 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:43.076889    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="08e4de876c73aece8504460d81a6f2a8d9cf23aa29336f54333d1efb1e032daa"
Sep 11 14:30:44.127090 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:44.127050    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:48.104023 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:48.103986    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:30:50.370966 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:50.370905    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:50.375608 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:50.375581    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-696fee-29818950-vb4pf"]
Sep 11 14:30:50.379096 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:50.379070    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-696fee-29818950-vb4pf"]
Sep 11 14:30:50.401848 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:50.401823    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-696fee-7b5886d8bf-7czgc"]
Sep 11 14:30:50.402049 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:50.402023    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-696fee-7b5886d8bf-7czgc" podUID="99a95f64-7f55-43ad-a05f-69c05e74fdb2" containerName="payload-processing" containerID="cri-o://c2f222cdfd44775be86afd264324d0fdb8991468e42819c75e125dd45068c89f" gracePeriod=30
Sep 11 14:30:50.414814 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:50.414790    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-696fee-66cff78f7d-bbnh4"]
Sep 11 14:30:50.415063 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:50.415032    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-696fee-66cff78f7d-bbnh4" podUID="69827068-bc47-4827-9224-5ec931867e15" containerName="payload-pre-processing" containerID="cri-o://9ee4261c3427271f473c0366b68086c963bbc0d8c802fc999fc0c3f6f6919ad9" gracePeriod=30
Sep 11 14:30:50.440939 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:50.440905    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:50.542699 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:50.542651    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:50.580245 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:50.580185    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-696fee-stxxl"]
Sep 11 14:30:50.583161 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:50.583128    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-696fee-stxxl"]
Sep 11 14:30:50.609699 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:50.609654    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:50.702412 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:50.702382    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-696fee-7b5886d8bf-7czgc"
Sep 11 14:30:50.704962 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:50.704943    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-696fee-66cff78f7d-bbnh4"
Sep 11 14:30:50.830188 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:50.830162    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7x5kx\" (UniqueName: \"kubernetes.io/projected/99a95f64-7f55-43ad-a05f-69c05e74fdb2-kube-api-access-7x5kx\") pod \"99a95f64-7f55-43ad-a05f-69c05e74fdb2\" (UID: \"99a95f64-7f55-43ad-a05f-69c05e74fdb2\") "
Sep 11 14:30:50.830343 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:50.830211    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qp97x\" (UniqueName: \"kubernetes.io/projected/69827068-bc47-4827-9224-5ec931867e15-kube-api-access-qp97x\") pod \"69827068-bc47-4827-9224-5ec931867e15\" (UID: \"69827068-bc47-4827-9224-5ec931867e15\") "
Sep 11 14:30:50.830343 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:50.830240    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99a95f64-7f55-43ad-a05f-69c05e74fdb2-plugins-config-volume\") pod \"99a95f64-7f55-43ad-a05f-69c05e74fdb2\" (UID: \"99a95f64-7f55-43ad-a05f-69c05e74fdb2\") "
Sep 11 14:30:50.830429 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:50.830374    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69827068-bc47-4827-9224-5ec931867e15-plugins-config-volume\") pod \"69827068-bc47-4827-9224-5ec931867e15\" (UID: \"69827068-bc47-4827-9224-5ec931867e15\") "
Sep 11 14:30:50.830770 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:50.830725    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99a95f64-7f55-43ad-a05f-69c05e74fdb2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "99a95f64-7f55-43ad-a05f-69c05e74fdb2" (UID: "99a95f64-7f55-43ad-a05f-69c05e74fdb2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:30:50.830897 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:50.830788    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69827068-bc47-4827-9224-5ec931867e15-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "69827068-bc47-4827-9224-5ec931867e15" (UID: "69827068-bc47-4827-9224-5ec931867e15"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:30:50.832335 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:50.832309    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99a95f64-7f55-43ad-a05f-69c05e74fdb2-kube-api-access-7x5kx" (OuterVolumeSpecName: "kube-api-access-7x5kx") pod "99a95f64-7f55-43ad-a05f-69c05e74fdb2" (UID: "99a95f64-7f55-43ad-a05f-69c05e74fdb2"). InnerVolumeSpecName "kube-api-access-7x5kx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:30:50.832428 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:50.832345    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69827068-bc47-4827-9224-5ec931867e15-kube-api-access-qp97x" (OuterVolumeSpecName: "kube-api-access-qp97x") pod "69827068-bc47-4827-9224-5ec931867e15" (UID: "69827068-bc47-4827-9224-5ec931867e15"). InnerVolumeSpecName "kube-api-access-qp97x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:30:50.932080 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:50.932015    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69827068-bc47-4827-9224-5ec931867e15-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:30:50.932080 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:50.932041    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7x5kx\" (UniqueName: \"kubernetes.io/projected/99a95f64-7f55-43ad-a05f-69c05e74fdb2-kube-api-access-7x5kx\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:30:50.932080 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:50.932056    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qp97x\" (UniqueName: \"kubernetes.io/projected/69827068-bc47-4827-9224-5ec931867e15-kube-api-access-qp97x\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:30:50.932080 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:50.932068    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99a95f64-7f55-43ad-a05f-69c05e74fdb2-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:30:50.960714 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:50.960670    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:51.061027 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:51.061002    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:51.121376 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:51.121347    2584 generic.go:356] "Generic (PLEG): container finished" podID="99a95f64-7f55-43ad-a05f-69c05e74fdb2" containerID="c2f222cdfd44775be86afd264324d0fdb8991468e42819c75e125dd45068c89f" exitCode=0
Sep 11 14:30:51.121517 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:51.121378    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-696fee-7b5886d8bf-7czgc" event={"ID":"99a95f64-7f55-43ad-a05f-69c05e74fdb2","Type":"ContainerDied","Data":"c2f222cdfd44775be86afd264324d0fdb8991468e42819c75e125dd45068c89f"}
Sep 11 14:30:51.121517 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:51.121417    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-696fee-7b5886d8bf-7czgc"
Sep 11 14:30:51.121517 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:51.121443    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-696fee-7b5886d8bf-7czgc" event={"ID":"99a95f64-7f55-43ad-a05f-69c05e74fdb2","Type":"ContainerDied","Data":"2718481e33edad7514a18197f66a0fc1fff0f92fda6872855faf4b71d55ddd19"}
Sep 11 14:30:51.121517 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:51.121474    2584 scope.go:117] "RemoveContainer" containerID="c2f222cdfd44775be86afd264324d0fdb8991468e42819c75e125dd45068c89f"
Sep 11 14:30:51.122974 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:51.122947    2584 generic.go:356] "Generic (PLEG): container finished" podID="69827068-bc47-4827-9224-5ec931867e15" containerID="9ee4261c3427271f473c0366b68086c963bbc0d8c802fc999fc0c3f6f6919ad9" exitCode=0
Sep 11 14:30:51.123072 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:51.122983    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-696fee-66cff78f7d-bbnh4" event={"ID":"69827068-bc47-4827-9224-5ec931867e15","Type":"ContainerDied","Data":"9ee4261c3427271f473c0366b68086c963bbc0d8c802fc999fc0c3f6f6919ad9"}
Sep 11 14:30:51.123072 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:51.123041    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-696fee-66cff78f7d-bbnh4" event={"ID":"69827068-bc47-4827-9224-5ec931867e15","Type":"ContainerDied","Data":"f29694510017b977f9c08cdba45ffa89d03e493303ad4601157db9c4a8745adc"}
Sep 11 14:30:51.123072 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:51.122992    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-696fee-66cff78f7d-bbnh4"
Sep 11 14:30:51.132152 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:51.132127    2584 scope.go:117] "RemoveContainer" containerID="c2f222cdfd44775be86afd264324d0fdb8991468e42819c75e125dd45068c89f"
Sep 11 14:30:51.132436 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:30:51.132416    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2f222cdfd44775be86afd264324d0fdb8991468e42819c75e125dd45068c89f\": container with ID starting with c2f222cdfd44775be86afd264324d0fdb8991468e42819c75e125dd45068c89f not found: ID does not exist" containerID="c2f222cdfd44775be86afd264324d0fdb8991468e42819c75e125dd45068c89f"
Sep 11 14:30:51.132494 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:51.132446    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2f222cdfd44775be86afd264324d0fdb8991468e42819c75e125dd45068c89f"} err="failed to get container status \"c2f222cdfd44775be86afd264324d0fdb8991468e42819c75e125dd45068c89f\": rpc error: code = NotFound desc = could not find container \"c2f222cdfd44775be86afd264324d0fdb8991468e42819c75e125dd45068c89f\": container with ID starting with c2f222cdfd44775be86afd264324d0fdb8991468e42819c75e125dd45068c89f not found: ID does not exist"
Sep 11 14:30:51.132494 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:51.132471    2584 scope.go:117] "RemoveContainer" containerID="9ee4261c3427271f473c0366b68086c963bbc0d8c802fc999fc0c3f6f6919ad9"
Sep 11 14:30:51.140275 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:51.140258    2584 scope.go:117] "RemoveContainer" containerID="9ee4261c3427271f473c0366b68086c963bbc0d8c802fc999fc0c3f6f6919ad9"
Sep 11 14:30:51.140530 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:30:51.140515    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ee4261c3427271f473c0366b68086c963bbc0d8c802fc999fc0c3f6f6919ad9\": container with ID starting with 9ee4261c3427271f473c0366b68086c963bbc0d8c802fc999fc0c3f6f6919ad9 not found: ID does not exist" containerID="9ee4261c3427271f473c0366b68086c963bbc0d8c802fc999fc0c3f6f6919ad9"
Sep 11 14:30:51.140571 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:51.140537    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ee4261c3427271f473c0366b68086c963bbc0d8c802fc999fc0c3f6f6919ad9"} err="failed to get container status \"9ee4261c3427271f473c0366b68086c963bbc0d8c802fc999fc0c3f6f6919ad9\": rpc error: code = NotFound desc = could not find container \"9ee4261c3427271f473c0366b68086c963bbc0d8c802fc999fc0c3f6f6919ad9\": container with ID starting with 9ee4261c3427271f473c0366b68086c963bbc0d8c802fc999fc0c3f6f6919ad9 not found: ID does not exist"
Sep 11 14:30:51.153614 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:51.153596    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-696fee-7b5886d8bf-7czgc"]
Sep 11 14:30:51.162756 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:51.162735    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-696fee-7b5886d8bf-7czgc"]
Sep 11 14:30:51.184458 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:51.184410    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-696fee-66cff78f7d-bbnh4"]
Sep 11 14:30:51.191927 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:51.191904    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-696fee-66cff78f7d-bbnh4"]
Sep 11 14:30:51.679852 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:51.679825    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34587748-1066-4341-9a08-c829328403bf" path="/var/lib/kubelet/pods/34587748-1066-4341-9a08-c829328403bf/volumes"
Sep 11 14:30:51.680187 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:51.680137    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69827068-bc47-4827-9224-5ec931867e15" path="/var/lib/kubelet/pods/69827068-bc47-4827-9224-5ec931867e15/volumes"
Sep 11 14:30:51.680422 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:51.680408    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74deb42c-b03e-40f7-8dc0-443560633257" path="/var/lib/kubelet/pods/74deb42c-b03e-40f7-8dc0-443560633257/volumes"
Sep 11 14:30:51.680735 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:51.680722    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99a95f64-7f55-43ad-a05f-69c05e74fdb2" path="/var/lib/kubelet/pods/99a95f64-7f55-43ad-a05f-69c05e74fdb2/volumes"
Sep 11 14:30:51.916649 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:51.916622    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:53.159213 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:53.159186    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:53.256176 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:53.256149    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:54.713061 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:54.713015    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct" podUID="f8c32f54-58de-4080-8442-0dc0f6ebba8d" containerName="main" containerID="cri-o://8482d93844e2707f87dfbda8e62bdf0e2a7da9cab62f26e882811c433013fb91" gracePeriod=45
Sep 11 14:30:54.964123 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:54.964061    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"
Sep 11 14:30:55.068222 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:55.068194    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8c32f54-58de-4080-8442-0dc0f6ebba8d-tmp-dir\") pod \"f8c32f54-58de-4080-8442-0dc0f6ebba8d\" (UID: \"f8c32f54-58de-4080-8442-0dc0f6ebba8d\") "
Sep 11 14:30:55.068377 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:55.068231    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8c32f54-58de-4080-8442-0dc0f6ebba8d-model-cache\") pod \"f8c32f54-58de-4080-8442-0dc0f6ebba8d\" (UID: \"f8c32f54-58de-4080-8442-0dc0f6ebba8d\") "
Sep 11 14:30:55.068377 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:55.068338    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8c32f54-58de-4080-8442-0dc0f6ebba8d-tls-certs\") pod \"f8c32f54-58de-4080-8442-0dc0f6ebba8d\" (UID: \"f8c32f54-58de-4080-8442-0dc0f6ebba8d\") "
Sep 11 14:30:55.068377 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:55.068371    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8c32f54-58de-4080-8442-0dc0f6ebba8d-dshm\") pod \"f8c32f54-58de-4080-8442-0dc0f6ebba8d\" (UID: \"f8c32f54-58de-4080-8442-0dc0f6ebba8d\") "
Sep 11 14:30:55.068551 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:55.068394    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8c32f54-58de-4080-8442-0dc0f6ebba8d-home\") pod \"f8c32f54-58de-4080-8442-0dc0f6ebba8d\" (UID: \"f8c32f54-58de-4080-8442-0dc0f6ebba8d\") "
Sep 11 14:30:55.068551 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:55.068453    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8c32f54-58de-4080-8442-0dc0f6ebba8d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f8c32f54-58de-4080-8442-0dc0f6ebba8d" (UID: "f8c32f54-58de-4080-8442-0dc0f6ebba8d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:30:55.068551 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:55.068464    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8c32f54-58de-4080-8442-0dc0f6ebba8d-model-cache" (OuterVolumeSpecName: "model-cache") pod "f8c32f54-58de-4080-8442-0dc0f6ebba8d" (UID: "f8c32f54-58de-4080-8442-0dc0f6ebba8d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:30:55.068551 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:55.068460    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9h2n\" (UniqueName: \"kubernetes.io/projected/f8c32f54-58de-4080-8442-0dc0f6ebba8d-kube-api-access-x9h2n\") pod \"f8c32f54-58de-4080-8442-0dc0f6ebba8d\" (UID: \"f8c32f54-58de-4080-8442-0dc0f6ebba8d\") "
Sep 11 14:30:55.068790 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:55.068636    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8c32f54-58de-4080-8442-0dc0f6ebba8d-home" (OuterVolumeSpecName: "home") pod "f8c32f54-58de-4080-8442-0dc0f6ebba8d" (UID: "f8c32f54-58de-4080-8442-0dc0f6ebba8d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:30:55.068833 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:55.068800    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8c32f54-58de-4080-8442-0dc0f6ebba8d-model-cache\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:30:55.068874 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:55.068829    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8c32f54-58de-4080-8442-0dc0f6ebba8d-home\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:30:55.068874 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:55.068867    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8c32f54-58de-4080-8442-0dc0f6ebba8d-tmp-dir\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:30:55.070497 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:55.070470    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8c32f54-58de-4080-8442-0dc0f6ebba8d-dshm" (OuterVolumeSpecName: "dshm") pod "f8c32f54-58de-4080-8442-0dc0f6ebba8d" (UID: "f8c32f54-58de-4080-8442-0dc0f6ebba8d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:30:55.070497 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:55.070489    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8c32f54-58de-4080-8442-0dc0f6ebba8d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f8c32f54-58de-4080-8442-0dc0f6ebba8d" (UID: "f8c32f54-58de-4080-8442-0dc0f6ebba8d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:30:55.070631 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:55.070539    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8c32f54-58de-4080-8442-0dc0f6ebba8d-kube-api-access-x9h2n" (OuterVolumeSpecName: "kube-api-access-x9h2n") pod "f8c32f54-58de-4080-8442-0dc0f6ebba8d" (UID: "f8c32f54-58de-4080-8442-0dc0f6ebba8d"). InnerVolumeSpecName "kube-api-access-x9h2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:30:55.145944 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:55.145904    2584 generic.go:356] "Generic (PLEG): container finished" podID="f8c32f54-58de-4080-8442-0dc0f6ebba8d" containerID="8482d93844e2707f87dfbda8e62bdf0e2a7da9cab62f26e882811c433013fb91" exitCode=0
Sep 11 14:30:55.146097 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:55.145955    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"
Sep 11 14:30:55.146097 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:55.145997    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct" event={"ID":"f8c32f54-58de-4080-8442-0dc0f6ebba8d","Type":"ContainerDied","Data":"8482d93844e2707f87dfbda8e62bdf0e2a7da9cab62f26e882811c433013fb91"}
Sep 11 14:30:55.146097 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:55.146040    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct" event={"ID":"f8c32f54-58de-4080-8442-0dc0f6ebba8d","Type":"ContainerDied","Data":"c98d2312aea109b3c486138600bd329ea48b9959e83c4f1147eced930c355864"}
Sep 11 14:30:55.146097 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:55.146061    2584 scope.go:117] "RemoveContainer" containerID="8482d93844e2707f87dfbda8e62bdf0e2a7da9cab62f26e882811c433013fb91"
Sep 11 14:30:55.154972 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:55.154956    2584 scope.go:117] "RemoveContainer" containerID="8482d93844e2707f87dfbda8e62bdf0e2a7da9cab62f26e882811c433013fb91"
Sep 11 14:30:55.155235 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:30:55.155219    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8482d93844e2707f87dfbda8e62bdf0e2a7da9cab62f26e882811c433013fb91\": container with ID starting with 8482d93844e2707f87dfbda8e62bdf0e2a7da9cab62f26e882811c433013fb91 not found: ID does not exist" containerID="8482d93844e2707f87dfbda8e62bdf0e2a7da9cab62f26e882811c433013fb91"
Sep 11 14:30:55.155302 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:55.155243    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8482d93844e2707f87dfbda8e62bdf0e2a7da9cab62f26e882811c433013fb91"} err="failed to get container status \"8482d93844e2707f87dfbda8e62bdf0e2a7da9cab62f26e882811c433013fb91\": rpc error: code = NotFound desc = could not find container \"8482d93844e2707f87dfbda8e62bdf0e2a7da9cab62f26e882811c433013fb91\": container with ID starting with 8482d93844e2707f87dfbda8e62bdf0e2a7da9cab62f26e882811c433013fb91 not found: ID does not exist"
Sep 11 14:30:55.167618 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:55.167597    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"]
Sep 11 14:30:55.170051 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:55.170030    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8c32f54-58de-4080-8442-0dc0f6ebba8d-tls-certs\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:30:55.170051 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:55.170049    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8c32f54-58de-4080-8442-0dc0f6ebba8d-dshm\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:30:55.170208 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:55.170058    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9h2n\" (UniqueName: \"kubernetes.io/projected/f8c32f54-58de-4080-8442-0dc0f6ebba8d-kube-api-access-x9h2n\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:30:55.170792 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:55.170772    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-696fee/explicit-model-696fee-kserve-585fbcd995-9tlct"]
Sep 11 14:30:55.679276 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:55.679242    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8c32f54-58de-4080-8442-0dc0f6ebba8d" path="/var/lib/kubelet/pods/f8c32f54-58de-4080-8442-0dc0f6ebba8d/volumes"
Sep 11 14:30:57.747734 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:57.747697    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:57.813982 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:57.813939    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:58.067308 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:58.067275    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:58.526192 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:58.526095    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:58.953661 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:58.953623    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:59.127850 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:59.127816    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:30:59.943897 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:30:59.943862    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:00.010733 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:00.010671    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:00.091610 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:00.091569    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:00.194108 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:00.193990    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:00.874773 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:00.874737    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:00.975041 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:00.975006    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:01.122546 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:01.122509    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:02.516359 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:02.516323    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:31:09.393795 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.393757    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"]
Sep 11 14:31:09.394205 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.394190    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69827068-bc47-4827-9224-5ec931867e15" containerName="payload-pre-processing"
Sep 11 14:31:09.394249 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.394207    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="69827068-bc47-4827-9224-5ec931867e15" containerName="payload-pre-processing"
Sep 11 14:31:09.394249 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.394233    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8c32f54-58de-4080-8442-0dc0f6ebba8d" containerName="main"
Sep 11 14:31:09.394249 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.394238    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8c32f54-58de-4080-8442-0dc0f6ebba8d" containerName="main"
Sep 11 14:31:09.394249 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.394244    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74deb42c-b03e-40f7-8dc0-443560633257" containerName="revoke-keys"
Sep 11 14:31:09.394373 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.394250    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="74deb42c-b03e-40f7-8dc0-443560633257" containerName="revoke-keys"
Sep 11 14:31:09.394373 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.394259    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99a95f64-7f55-43ad-a05f-69c05e74fdb2" containerName="payload-processing"
Sep 11 14:31:09.394373 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.394268    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="99a95f64-7f55-43ad-a05f-69c05e74fdb2" containerName="payload-processing"
Sep 11 14:31:09.394373 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.394327    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="99a95f64-7f55-43ad-a05f-69c05e74fdb2" containerName="payload-processing"
Sep 11 14:31:09.394373 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.394336    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8c32f54-58de-4080-8442-0dc0f6ebba8d" containerName="main"
Sep 11 14:31:09.394373 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.394349    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="74deb42c-b03e-40f7-8dc0-443560633257" containerName="revoke-keys"
Sep 11 14:31:09.394373 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.394359    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="69827068-bc47-4827-9224-5ec931867e15" containerName="payload-pre-processing"
Sep 11 14:31:09.399193 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.399175    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"
Sep 11 14:31:09.402032 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.402003    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-e1e477\"/\"kube-root-ca.crt\""
Sep 11 14:31:09.402125 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.402034    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-e1e477\"/\"openshift-service-ca.crt\""
Sep 11 14:31:09.402125 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.402034    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-e1e477\"/\"noten-model-e1e477-kserve-self-signed-certs\""
Sep 11 14:31:09.402340 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.402325    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-e1e477\"/\"default-dockercfg-dzcdx\""
Sep 11 14:31:09.410815 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.410793    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"]
Sep 11 14:31:09.487749 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.487718    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:09.499424 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.499393    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4aad55f1-3029-4895-8079-7e76d9d47b90-tmp-dir\") pod \"noten-model-e1e477-kserve-76fb778ff5-8bphx\" (UID: \"4aad55f1-3029-4895-8079-7e76d9d47b90\") " pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"
Sep 11 14:31:09.499424 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.499424    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4aad55f1-3029-4895-8079-7e76d9d47b90-model-cache\") pod \"noten-model-e1e477-kserve-76fb778ff5-8bphx\" (UID: \"4aad55f1-3029-4895-8079-7e76d9d47b90\") " pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"
Sep 11 14:31:09.499592 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.499460    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4aad55f1-3029-4895-8079-7e76d9d47b90-tls-certs\") pod \"noten-model-e1e477-kserve-76fb778ff5-8bphx\" (UID: \"4aad55f1-3029-4895-8079-7e76d9d47b90\") " pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"
Sep 11 14:31:09.499592 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.499501    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4aad55f1-3029-4895-8079-7e76d9d47b90-home\") pod \"noten-model-e1e477-kserve-76fb778ff5-8bphx\" (UID: \"4aad55f1-3029-4895-8079-7e76d9d47b90\") " pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"
Sep 11 14:31:09.499592 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.499550    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgjsb\" (UniqueName: \"kubernetes.io/projected/4aad55f1-3029-4895-8079-7e76d9d47b90-kube-api-access-sgjsb\") pod \"noten-model-e1e477-kserve-76fb778ff5-8bphx\" (UID: \"4aad55f1-3029-4895-8079-7e76d9d47b90\") " pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"
Sep 11 14:31:09.499719 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.499593    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4aad55f1-3029-4895-8079-7e76d9d47b90-dshm\") pod \"noten-model-e1e477-kserve-76fb778ff5-8bphx\" (UID: \"4aad55f1-3029-4895-8079-7e76d9d47b90\") " pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"
Sep 11 14:31:09.600044 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.600000    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgjsb\" (UniqueName: \"kubernetes.io/projected/4aad55f1-3029-4895-8079-7e76d9d47b90-kube-api-access-sgjsb\") pod \"noten-model-e1e477-kserve-76fb778ff5-8bphx\" (UID: \"4aad55f1-3029-4895-8079-7e76d9d47b90\") " pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"
Sep 11 14:31:09.600044 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.600043    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4aad55f1-3029-4895-8079-7e76d9d47b90-dshm\") pod \"noten-model-e1e477-kserve-76fb778ff5-8bphx\" (UID: \"4aad55f1-3029-4895-8079-7e76d9d47b90\") " pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"
Sep 11 14:31:09.600310 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.600076    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4aad55f1-3029-4895-8079-7e76d9d47b90-tmp-dir\") pod \"noten-model-e1e477-kserve-76fb778ff5-8bphx\" (UID: \"4aad55f1-3029-4895-8079-7e76d9d47b90\") " pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"
Sep 11 14:31:09.600310 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.600099    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4aad55f1-3029-4895-8079-7e76d9d47b90-model-cache\") pod \"noten-model-e1e477-kserve-76fb778ff5-8bphx\" (UID: \"4aad55f1-3029-4895-8079-7e76d9d47b90\") " pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"
Sep 11 14:31:09.600310 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.600140    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4aad55f1-3029-4895-8079-7e76d9d47b90-tls-certs\") pod \"noten-model-e1e477-kserve-76fb778ff5-8bphx\" (UID: \"4aad55f1-3029-4895-8079-7e76d9d47b90\") " pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"
Sep 11 14:31:09.600310 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.600158    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4aad55f1-3029-4895-8079-7e76d9d47b90-home\") pod \"noten-model-e1e477-kserve-76fb778ff5-8bphx\" (UID: \"4aad55f1-3029-4895-8079-7e76d9d47b90\") " pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"
Sep 11 14:31:09.600533 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.600507    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4aad55f1-3029-4895-8079-7e76d9d47b90-tmp-dir\") pod \"noten-model-e1e477-kserve-76fb778ff5-8bphx\" (UID: \"4aad55f1-3029-4895-8079-7e76d9d47b90\") " pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"
Sep 11 14:31:09.600590 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.600551    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4aad55f1-3029-4895-8079-7e76d9d47b90-model-cache\") pod \"noten-model-e1e477-kserve-76fb778ff5-8bphx\" (UID: \"4aad55f1-3029-4895-8079-7e76d9d47b90\") " pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"
Sep 11 14:31:09.600637 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.600565    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4aad55f1-3029-4895-8079-7e76d9d47b90-home\") pod \"noten-model-e1e477-kserve-76fb778ff5-8bphx\" (UID: \"4aad55f1-3029-4895-8079-7e76d9d47b90\") " pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"
Sep 11 14:31:09.602437 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.602410    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4aad55f1-3029-4895-8079-7e76d9d47b90-dshm\") pod \"noten-model-e1e477-kserve-76fb778ff5-8bphx\" (UID: \"4aad55f1-3029-4895-8079-7e76d9d47b90\") " pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"
Sep 11 14:31:09.602576 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.602558    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4aad55f1-3029-4895-8079-7e76d9d47b90-tls-certs\") pod \"noten-model-e1e477-kserve-76fb778ff5-8bphx\" (UID: \"4aad55f1-3029-4895-8079-7e76d9d47b90\") " pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"
Sep 11 14:31:09.613167 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.613140    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgjsb\" (UniqueName: \"kubernetes.io/projected/4aad55f1-3029-4895-8079-7e76d9d47b90-kube-api-access-sgjsb\") pod \"noten-model-e1e477-kserve-76fb778ff5-8bphx\" (UID: \"4aad55f1-3029-4895-8079-7e76d9d47b90\") " pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"
Sep 11 14:31:09.708485 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.708406    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"
Sep 11 14:31:09.980766 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:09.980745    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"]
Sep 11 14:31:09.983352 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:31:09.983323    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4aad55f1_3029_4895_8079_7e76d9d47b90.slice/crio-b1346be2c1e77e40c575959cda42ad34eb8e81c15166caa41623ec998907d195 WatchSource:0}: Error finding container b1346be2c1e77e40c575959cda42ad34eb8e81c15166caa41623ec998907d195: Status 404 returned error can't find the container with id b1346be2c1e77e40c575959cda42ad34eb8e81c15166caa41623ec998907d195
Sep 11 14:31:10.226807 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:10.226770    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx" event={"ID":"4aad55f1-3029-4895-8079-7e76d9d47b90","Type":"ContainerStarted","Data":"35c66d08c023af4030e2cdad31eb4e8edd400fd6714e703289eff2266b7a6897"}
Sep 11 14:31:10.226973 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:10.226817    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx" event={"ID":"4aad55f1-3029-4895-8079-7e76d9d47b90","Type":"ContainerStarted","Data":"b1346be2c1e77e40c575959cda42ad34eb8e81c15166caa41623ec998907d195"}
Sep 11 14:31:10.246112 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:10.246021    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx" podStartSLOduration=1.246005529 podStartE2EDuration="1.246005529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:31:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:31:10.244543642 +0000 UTC m=+963.043178424" watchObservedRunningTime="2026-09-11 14:31:10.246005529 +0000 UTC m=+963.044640310"
Sep 11 14:31:10.696208 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:10.696174    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:11.633882 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:11.633842    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:11.785815 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:11.785771    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:15.301491 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:15.301455    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:31:17.754400 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:17.754352    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:17.821148 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:17.821108    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:17.931672 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:17.931633    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:18.029642 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:18.029556    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:18.129747 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:18.129713    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:18.828979 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:18.828943    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:18.928302 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:18.928264    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:19.025826 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:19.025788    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:19.709308 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:19.709269    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"
Sep 11 14:31:19.709506 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:19.709337    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"
Sep 11 14:31:19.724111 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:19.724088    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"
Sep 11 14:31:20.289028 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:20.289000    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"
Sep 11 14:31:20.726087 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:20.726000    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:22.137467 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:22.137433    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:26.264118 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:26.264086    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:26.390560 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:26.390524    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a39864-nckcc"]
Sep 11 14:31:26.394450 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:26.394427    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a39864-nckcc"
Sep 11 14:31:26.397325 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:26.397306    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dp8gp\""
Sep 11 14:31:26.405598 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:26.405574    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a39864-nckcc"]
Sep 11 14:31:26.448390 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:26.448357    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e143e92-830f-4b92-a14d-0f8f555c7a8c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a39864-nckcc\" (UID: \"6e143e92-830f-4b92-a14d-0f8f555c7a8c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a39864-nckcc"
Sep 11 14:31:26.549398 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:26.549364    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e143e92-830f-4b92-a14d-0f8f555c7a8c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a39864-nckcc\" (UID: \"6e143e92-830f-4b92-a14d-0f8f555c7a8c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a39864-nckcc"
Sep 11 14:31:26.550006 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:26.549985    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e143e92-830f-4b92-a14d-0f8f555c7a8c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a39864-nckcc\" (UID: \"6e143e92-830f-4b92-a14d-0f8f555c7a8c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a39864-nckcc"
Sep 11 14:31:26.694039 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:26.694000    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:26.705849 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:26.705821    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a39864-nckcc"
Sep 11 14:31:27.013607 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:27.013534    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a39864-nckcc"]
Sep 11 14:31:27.021563 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:31:27.021528    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e143e92_830f_4b92_a14d_0f8f555c7a8c.slice/crio-94f8b944b7849ef44f23891b53b4723900b40620ff95affd4a32a6751518c2f4 WatchSource:0}: Error finding container 94f8b944b7849ef44f23891b53b4723900b40620ff95affd4a32a6751518c2f4: Status 404 returned error can't find the container with id 94f8b944b7849ef44f23891b53b4723900b40620ff95affd4a32a6751518c2f4
Sep 11 14:31:27.252963 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:27.252939    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"]
Sep 11 14:31:27.286250 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:27.286192    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:27.315217 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:27.315187    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a39864-nckcc" event={"ID":"6e143e92-830f-4b92-a14d-0f8f555c7a8c","Type":"ContainerStarted","Data":"94f8b944b7849ef44f23891b53b4723900b40620ff95affd4a32a6751518c2f4"}
Sep 11 14:31:27.375732 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:27.375702    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:27.622491 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:27.622465    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:27.727150 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:27.727119    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:27.957840 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:27.957765    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:28.321269 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:28.321241    2584 generic.go:356] "Generic (PLEG): container finished" podID="6e143e92-830f-4b92-a14d-0f8f555c7a8c" containerID="0570834577ffd7404fbb99cb0ad8bc5e4a33d13a3a412ee2a03adcad0765095e" exitCode=0
Sep 11 14:31:28.321585 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:28.321284    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a39864-nckcc" event={"ID":"6e143e92-830f-4b92-a14d-0f8f555c7a8c","Type":"ContainerDied","Data":"0570834577ffd7404fbb99cb0ad8bc5e4a33d13a3a412ee2a03adcad0765095e"}
Sep 11 14:31:28.451584 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:28.451556    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:28.670619 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:28.670549    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:29.463803 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:29.463778    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a39864-nckcc"
Sep 11 14:31:29.574413 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:29.574386    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e143e92-830f-4b92-a14d-0f8f555c7a8c-maas-api-service-ca\") pod \"6e143e92-830f-4b92-a14d-0f8f555c7a8c\" (UID: \"6e143e92-830f-4b92-a14d-0f8f555c7a8c\") "
Sep 11 14:31:29.574759 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:29.574740    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e143e92-830f-4b92-a14d-0f8f555c7a8c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6e143e92-830f-4b92-a14d-0f8f555c7a8c" (UID: "6e143e92-830f-4b92-a14d-0f8f555c7a8c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:31:29.675502 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:29.675434    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e143e92-830f-4b92-a14d-0f8f555c7a8c-maas-api-service-ca\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:31:29.825443 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:29.825412    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:30.332530 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:30.332502    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a39864-nckcc"
Sep 11 14:31:30.332730 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:30.332495    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a39864-nckcc" event={"ID":"6e143e92-830f-4b92-a14d-0f8f555c7a8c","Type":"ContainerDied","Data":"94f8b944b7849ef44f23891b53b4723900b40620ff95affd4a32a6751518c2f4"}
Sep 11 14:31:30.332730 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:30.332633    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94f8b944b7849ef44f23891b53b4723900b40620ff95affd4a32a6751518c2f4"
Sep 11 14:31:31.008542 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:31.008504    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:31:32.790295 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:32.790259    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:34.649810 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:34.649776    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:34.721067 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:34.721032    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:34.940763 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:34.940665    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:35.377027 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:35.376913    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:35.752778 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:35.752699    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:37.064716 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:37.064663    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:37.164553 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:37.164522    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a39864-566d6bc64c-z9tvv"]
Sep 11 14:31:37.164802 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:37.164770    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-a39864-566d6bc64c-z9tvv" podUID="b18ba9a4-6f28-4368-bfcb-827fe0b03a00" containerName="payload-processing" containerID="cri-o://a43d11a527a53ad136601e41637634b7834f47600643ebbd0da1e22ff5b20fab" gracePeriod=30
Sep 11 14:31:37.183548 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:37.183520    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a39864-55b5b965d6-jdfhp"]
Sep 11 14:31:37.183778 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:37.183751    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a39864-55b5b965d6-jdfhp" podUID="05b406c9-95a0-46fb-9751-0693fb9d0f0c" containerName="payload-pre-processing" containerID="cri-o://2c114c98b82f7cc4112027bcf28bf1c049936b368f415f493c7df55d10115313" gracePeriod=30
Sep 11 14:31:37.208427 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:37.208393    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:37.305572 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:37.305534    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:37.383640 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:37.383506    2584 generic.go:356] "Generic (PLEG): container finished" podID="05b406c9-95a0-46fb-9751-0693fb9d0f0c" containerID="2c114c98b82f7cc4112027bcf28bf1c049936b368f415f493c7df55d10115313" exitCode=0
Sep 11 14:31:37.383640 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:37.383561    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a39864-55b5b965d6-jdfhp" event={"ID":"05b406c9-95a0-46fb-9751-0693fb9d0f0c","Type":"ContainerDied","Data":"2c114c98b82f7cc4112027bcf28bf1c049936b368f415f493c7df55d10115313"}
Sep 11 14:31:37.385670 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:37.385645    2584 generic.go:356] "Generic (PLEG): container finished" podID="b18ba9a4-6f28-4368-bfcb-827fe0b03a00" containerID="a43d11a527a53ad136601e41637634b7834f47600643ebbd0da1e22ff5b20fab" exitCode=0
Sep 11 14:31:37.385812 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:37.385698    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-a39864-566d6bc64c-z9tvv" event={"ID":"b18ba9a4-6f28-4368-bfcb-827fe0b03a00","Type":"ContainerDied","Data":"a43d11a527a53ad136601e41637634b7834f47600643ebbd0da1e22ff5b20fab"}
Sep 11 14:31:37.417755 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:37.417725    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:37.461368 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:37.461347    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-a39864-566d6bc64c-z9tvv"
Sep 11 14:31:37.464416 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:37.464394    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a39864-55b5b965d6-jdfhp"
Sep 11 14:31:37.471026 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:37.471006    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a39864-nckcc"]
Sep 11 14:31:37.479289 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:37.479256    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a39864-nckcc"]
Sep 11 14:31:37.523462 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:37.523430    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:37.536219 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:37.536190    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjx6j\" (UniqueName: \"kubernetes.io/projected/b18ba9a4-6f28-4368-bfcb-827fe0b03a00-kube-api-access-rjx6j\") pod \"b18ba9a4-6f28-4368-bfcb-827fe0b03a00\" (UID: \"b18ba9a4-6f28-4368-bfcb-827fe0b03a00\") "
Sep 11 14:31:37.536402 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:37.536264    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b18ba9a4-6f28-4368-bfcb-827fe0b03a00-plugins-config-volume\") pod \"b18ba9a4-6f28-4368-bfcb-827fe0b03a00\" (UID: \"b18ba9a4-6f28-4368-bfcb-827fe0b03a00\") "
Sep 11 14:31:37.536402 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:37.536307    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05b406c9-95a0-46fb-9751-0693fb9d0f0c-plugins-config-volume\") pod \"05b406c9-95a0-46fb-9751-0693fb9d0f0c\" (UID: \"05b406c9-95a0-46fb-9751-0693fb9d0f0c\") "
Sep 11 14:31:37.536542 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:37.536408    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpxpk\" (UniqueName: \"kubernetes.io/projected/05b406c9-95a0-46fb-9751-0693fb9d0f0c-kube-api-access-wpxpk\") pod \"05b406c9-95a0-46fb-9751-0693fb9d0f0c\" (UID: \"05b406c9-95a0-46fb-9751-0693fb9d0f0c\") "
Sep 11 14:31:37.536712 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:37.536661    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b18ba9a4-6f28-4368-bfcb-827fe0b03a00-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b18ba9a4-6f28-4368-bfcb-827fe0b03a00" (UID: "b18ba9a4-6f28-4368-bfcb-827fe0b03a00"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:31:37.537045 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:37.536989    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05b406c9-95a0-46fb-9751-0693fb9d0f0c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "05b406c9-95a0-46fb-9751-0693fb9d0f0c" (UID: "05b406c9-95a0-46fb-9751-0693fb9d0f0c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:31:37.540646 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:37.540594    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05b406c9-95a0-46fb-9751-0693fb9d0f0c-kube-api-access-wpxpk" (OuterVolumeSpecName: "kube-api-access-wpxpk") pod "05b406c9-95a0-46fb-9751-0693fb9d0f0c" (UID: "05b406c9-95a0-46fb-9751-0693fb9d0f0c"). InnerVolumeSpecName "kube-api-access-wpxpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:31:37.540646 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:37.540603    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b18ba9a4-6f28-4368-bfcb-827fe0b03a00-kube-api-access-rjx6j" (OuterVolumeSpecName: "kube-api-access-rjx6j") pod "b18ba9a4-6f28-4368-bfcb-827fe0b03a00" (UID: "b18ba9a4-6f28-4368-bfcb-827fe0b03a00"). InnerVolumeSpecName "kube-api-access-rjx6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:31:37.637732 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:37.637651    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpxpk\" (UniqueName: \"kubernetes.io/projected/05b406c9-95a0-46fb-9751-0693fb9d0f0c-kube-api-access-wpxpk\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:31:37.637732 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:37.637707    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjx6j\" (UniqueName: \"kubernetes.io/projected/b18ba9a4-6f28-4368-bfcb-827fe0b03a00-kube-api-access-rjx6j\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:31:37.637732 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:37.637718    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b18ba9a4-6f28-4368-bfcb-827fe0b03a00-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:31:37.637732 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:37.637727    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05b406c9-95a0-46fb-9751-0693fb9d0f0c-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:31:37.679710 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:37.679662    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e143e92-830f-4b92-a14d-0f8f555c7a8c" path="/var/lib/kubelet/pods/6e143e92-830f-4b92-a14d-0f8f555c7a8c/volumes"
Sep 11 14:31:38.026822 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:38.026715    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:38.205673 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:38.205638    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:38.391843 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:38.391814    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-a39864-566d6bc64c-z9tvv"
Sep 11 14:31:38.392045 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:38.391858    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-a39864-566d6bc64c-z9tvv" event={"ID":"b18ba9a4-6f28-4368-bfcb-827fe0b03a00","Type":"ContainerDied","Data":"98c57b232deeadf43503bdbe97bd54cbbdc6ba1e87862d23a37a4e960ad49fd3"}
Sep 11 14:31:38.392045 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:38.391931    2584 scope.go:117] "RemoveContainer" containerID="a43d11a527a53ad136601e41637634b7834f47600643ebbd0da1e22ff5b20fab"
Sep 11 14:31:38.393308 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:38.393184    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a39864-55b5b965d6-jdfhp" event={"ID":"05b406c9-95a0-46fb-9751-0693fb9d0f0c","Type":"ContainerDied","Data":"389aee6e3f28895aa6ee7e4227e5a1a51c458221642fc5716898fa2c8b816403"}
Sep 11 14:31:38.393308 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:38.393216    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a39864-55b5b965d6-jdfhp"
Sep 11 14:31:38.400440 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:38.400423    2584 scope.go:117] "RemoveContainer" containerID="2c114c98b82f7cc4112027bcf28bf1c049936b368f415f493c7df55d10115313"
Sep 11 14:31:38.435801 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:38.435769    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a39864-566d6bc64c-z9tvv"]
Sep 11 14:31:38.457776 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:38.457736    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a39864-566d6bc64c-z9tvv"]
Sep 11 14:31:38.484640 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:38.484608    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a39864-55b5b965d6-jdfhp"]
Sep 11 14:31:38.492223 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:38.492194    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a39864-55b5b965d6-jdfhp"]
Sep 11 14:31:39.033061 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:39.032994    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:39.121842 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:39.121803    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:39.414877 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:39.414844    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:39.681885 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:39.681797    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05b406c9-95a0-46fb-9751-0693fb9d0f0c" path="/var/lib/kubelet/pods/05b406c9-95a0-46fb-9751-0693fb9d0f0c/volumes"
Sep 11 14:31:39.682415 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:39.682388    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b18ba9a4-6f28-4368-bfcb-827fe0b03a00" path="/var/lib/kubelet/pods/b18ba9a4-6f28-4368-bfcb-827fe0b03a00/volumes"
Sep 11 14:31:40.535065 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:40.535014    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:40.595856 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:40.595823    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:40.712603 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:40.712567    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:41.064826 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.064767    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:41.160206 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.160169    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:41.190165 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.190130    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-02723795-5d8c4f88c8-kwlj9"]
Sep 11 14:31:41.190543 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.190530    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05b406c9-95a0-46fb-9751-0693fb9d0f0c" containerName="payload-pre-processing"
Sep 11 14:31:41.190596 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.190546    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="05b406c9-95a0-46fb-9751-0693fb9d0f0c" containerName="payload-pre-processing"
Sep 11 14:31:41.190596 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.190555    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e143e92-830f-4b92-a14d-0f8f555c7a8c" containerName="revoke-keys"
Sep 11 14:31:41.190596 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.190561    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e143e92-830f-4b92-a14d-0f8f555c7a8c" containerName="revoke-keys"
Sep 11 14:31:41.190596 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.190571    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b18ba9a4-6f28-4368-bfcb-827fe0b03a00" containerName="payload-processing"
Sep 11 14:31:41.190596 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.190577    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b18ba9a4-6f28-4368-bfcb-827fe0b03a00" containerName="payload-processing"
Sep 11 14:31:41.190770 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.190643    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b18ba9a4-6f28-4368-bfcb-827fe0b03a00" containerName="payload-processing"
Sep 11 14:31:41.190770 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.190653    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e143e92-830f-4b92-a14d-0f8f555c7a8c" containerName="revoke-keys"
Sep 11 14:31:41.190770 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.190662    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="05b406c9-95a0-46fb-9751-0693fb9d0f0c" containerName="payload-pre-processing"
Sep 11 14:31:41.195294 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.195271    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-02723795-5d8c4f88c8-kwlj9"
Sep 11 14:31:41.195485 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.195463    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-02723795-566867c4f7-fkxx5"]
Sep 11 14:31:41.198282 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.198262    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-02723795\""
Sep 11 14:31:41.198821 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.198792    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-02723795-566867c4f7-fkxx5"
Sep 11 14:31:41.201307 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.201285    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-02723795-dockercfg-fwzvf\""
Sep 11 14:31:41.211648 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.211628    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-02723795-5d8c4f88c8-kwlj9"]
Sep 11 14:31:41.215877 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.215857    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-02723795-566867c4f7-fkxx5"]
Sep 11 14:31:41.266833 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.266808    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw7l5\" (UniqueName: \"kubernetes.io/projected/c9adc541-3155-4436-8e4d-4916b0b6c196-kube-api-access-jw7l5\") pod \"payload-pre-processing-e2e-mt-02723795-5d8c4f88c8-kwlj9\" (UID: \"c9adc541-3155-4436-8e4d-4916b0b6c196\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-02723795-5d8c4f88c8-kwlj9"
Sep 11 14:31:41.266938 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.266851    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3ff5a86-4172-45b4-bc73-50147004384b-plugins-config-volume\") pod \"payload-processing-e2e-mt-02723795-566867c4f7-fkxx5\" (UID: \"c3ff5a86-4172-45b4-bc73-50147004384b\") " pod="openshift-ingress/payload-processing-e2e-mt-02723795-566867c4f7-fkxx5"
Sep 11 14:31:41.266938 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.266915    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq4qc\" (UniqueName: \"kubernetes.io/projected/c3ff5a86-4172-45b4-bc73-50147004384b-kube-api-access-pq4qc\") pod \"payload-processing-e2e-mt-02723795-566867c4f7-fkxx5\" (UID: \"c3ff5a86-4172-45b4-bc73-50147004384b\") " pod="openshift-ingress/payload-processing-e2e-mt-02723795-566867c4f7-fkxx5"
Sep 11 14:31:41.267012 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.266958    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9adc541-3155-4436-8e4d-4916b0b6c196-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-02723795-5d8c4f88c8-kwlj9\" (UID: \"c9adc541-3155-4436-8e4d-4916b0b6c196\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-02723795-5d8c4f88c8-kwlj9"
Sep 11 14:31:41.368077 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.367994    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw7l5\" (UniqueName: \"kubernetes.io/projected/c9adc541-3155-4436-8e4d-4916b0b6c196-kube-api-access-jw7l5\") pod \"payload-pre-processing-e2e-mt-02723795-5d8c4f88c8-kwlj9\" (UID: \"c9adc541-3155-4436-8e4d-4916b0b6c196\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-02723795-5d8c4f88c8-kwlj9"
Sep 11 14:31:41.368077 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.368066    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3ff5a86-4172-45b4-bc73-50147004384b-plugins-config-volume\") pod \"payload-processing-e2e-mt-02723795-566867c4f7-fkxx5\" (UID: \"c3ff5a86-4172-45b4-bc73-50147004384b\") " pod="openshift-ingress/payload-processing-e2e-mt-02723795-566867c4f7-fkxx5"
Sep 11 14:31:41.368281 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.368102    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq4qc\" (UniqueName: \"kubernetes.io/projected/c3ff5a86-4172-45b4-bc73-50147004384b-kube-api-access-pq4qc\") pod \"payload-processing-e2e-mt-02723795-566867c4f7-fkxx5\" (UID: \"c3ff5a86-4172-45b4-bc73-50147004384b\") " pod="openshift-ingress/payload-processing-e2e-mt-02723795-566867c4f7-fkxx5"
Sep 11 14:31:41.368281 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.368123    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9adc541-3155-4436-8e4d-4916b0b6c196-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-02723795-5d8c4f88c8-kwlj9\" (UID: \"c9adc541-3155-4436-8e4d-4916b0b6c196\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-02723795-5d8c4f88c8-kwlj9"
Sep 11 14:31:41.368779 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.368759    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9adc541-3155-4436-8e4d-4916b0b6c196-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-02723795-5d8c4f88c8-kwlj9\" (UID: \"c9adc541-3155-4436-8e4d-4916b0b6c196\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-02723795-5d8c4f88c8-kwlj9"
Sep 11 14:31:41.368826 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.368801    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3ff5a86-4172-45b4-bc73-50147004384b-plugins-config-volume\") pod \"payload-processing-e2e-mt-02723795-566867c4f7-fkxx5\" (UID: \"c3ff5a86-4172-45b4-bc73-50147004384b\") " pod="openshift-ingress/payload-processing-e2e-mt-02723795-566867c4f7-fkxx5"
Sep 11 14:31:41.377463 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.377440    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq4qc\" (UniqueName: \"kubernetes.io/projected/c3ff5a86-4172-45b4-bc73-50147004384b-kube-api-access-pq4qc\") pod \"payload-processing-e2e-mt-02723795-566867c4f7-fkxx5\" (UID: \"c3ff5a86-4172-45b4-bc73-50147004384b\") " pod="openshift-ingress/payload-processing-e2e-mt-02723795-566867c4f7-fkxx5"
Sep 11 14:31:41.377614 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.377594    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw7l5\" (UniqueName: \"kubernetes.io/projected/c9adc541-3155-4436-8e4d-4916b0b6c196-kube-api-access-jw7l5\") pod \"payload-pre-processing-e2e-mt-02723795-5d8c4f88c8-kwlj9\" (UID: \"c9adc541-3155-4436-8e4d-4916b0b6c196\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-02723795-5d8c4f88c8-kwlj9"
Sep 11 14:31:41.507177 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.507138    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-02723795-5d8c4f88c8-kwlj9"
Sep 11 14:31:41.514220 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.514190    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-02723795-566867c4f7-fkxx5"
Sep 11 14:31:41.531588 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.531556    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:41.807476 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.807454    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-02723795-5d8c4f88c8-kwlj9"]
Sep 11 14:31:41.809571 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:31:41.809544    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9adc541_3155_4436_8e4d_4916b0b6c196.slice/crio-07f8779dccb8de3a4dac516b27568b3e1c89dd88f23f3598bc0a8f63902b9897 WatchSource:0}: Error finding container 07f8779dccb8de3a4dac516b27568b3e1c89dd88f23f3598bc0a8f63902b9897: Status 404 returned error can't find the container with id 07f8779dccb8de3a4dac516b27568b3e1c89dd88f23f3598bc0a8f63902b9897
Sep 11 14:31:41.830063 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:41.830041    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-02723795-566867c4f7-fkxx5"]
Sep 11 14:31:41.831600 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:31:41.831578    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3ff5a86_4172_45b4_bc73_50147004384b.slice/crio-63a70839483343551031690a557889f8d5f93558e60f8dcd0cb147a4eb869934 WatchSource:0}: Error finding container 63a70839483343551031690a557889f8d5f93558e60f8dcd0cb147a4eb869934: Status 404 returned error can't find the container with id 63a70839483343551031690a557889f8d5f93558e60f8dcd0cb147a4eb869934
Sep 11 14:31:42.271658 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.271572    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx" podUID="4aad55f1-3029-4895-8079-7e76d9d47b90" containerName="main" containerID="cri-o://35c66d08c023af4030e2cdad31eb4e8edd400fd6714e703289eff2266b7a6897" gracePeriod=45
Sep 11 14:31:42.365545 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.365510    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:42.417300 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.417250    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-02723795-566867c4f7-fkxx5" event={"ID":"c3ff5a86-4172-45b4-bc73-50147004384b","Type":"ContainerStarted","Data":"97c6e304267bc1101149498979082d2f6e272cfb97762ad2ec3adcbcedf6299a"}
Sep 11 14:31:42.417460 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.417445    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-02723795-566867c4f7-fkxx5"
Sep 11 14:31:42.417530 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.417488    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-02723795-566867c4f7-fkxx5" event={"ID":"c3ff5a86-4172-45b4-bc73-50147004384b","Type":"ContainerStarted","Data":"63a70839483343551031690a557889f8d5f93558e60f8dcd0cb147a4eb869934"}
Sep 11 14:31:42.420435 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.420407    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-02723795-5d8c4f88c8-kwlj9" event={"ID":"c9adc541-3155-4436-8e4d-4916b0b6c196","Type":"ContainerStarted","Data":"08d59bfee07640df8507fb6fc2e7acc35aebfb18cf154357d617a680af67383c"}
Sep 11 14:31:42.420556 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.420455    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-02723795-5d8c4f88c8-kwlj9" event={"ID":"c9adc541-3155-4436-8e4d-4916b0b6c196","Type":"ContainerStarted","Data":"07f8779dccb8de3a4dac516b27568b3e1c89dd88f23f3598bc0a8f63902b9897"}
Sep 11 14:31:42.420817 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.420671    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-02723795-5d8c4f88c8-kwlj9"
Sep 11 14:31:42.422606 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.422578    2584 generic.go:356] "Generic (PLEG): container finished" podID="4aad55f1-3029-4895-8079-7e76d9d47b90" containerID="35c66d08c023af4030e2cdad31eb4e8edd400fd6714e703289eff2266b7a6897" exitCode=0
Sep 11 14:31:42.422723 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.422709    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx" event={"ID":"4aad55f1-3029-4895-8079-7e76d9d47b90","Type":"ContainerDied","Data":"35c66d08c023af4030e2cdad31eb4e8edd400fd6714e703289eff2266b7a6897"}
Sep 11 14:31:42.471300 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.471253    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-02723795-566867c4f7-fkxx5" podStartSLOduration=1.471238483 podStartE2EDuration="1.471238483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:31:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:31:42.467807338 +0000 UTC m=+995.266442123" watchObservedRunningTime="2026-09-11 14:31:42.471238483 +0000 UTC m=+995.269873265"
Sep 11 14:31:42.520516 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.520460    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-02723795-5d8c4f88c8-kwlj9" podStartSLOduration=1.520439605 podStartE2EDuration="1.520439605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:31:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:31:42.516816728 +0000 UTC m=+995.315451510" watchObservedRunningTime="2026-09-11 14:31:42.520439605 +0000 UTC m=+995.319074388"
Sep 11 14:31:42.538652 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.538629    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"
Sep 11 14:31:42.678922 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.678892    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgjsb\" (UniqueName: \"kubernetes.io/projected/4aad55f1-3029-4895-8079-7e76d9d47b90-kube-api-access-sgjsb\") pod \"4aad55f1-3029-4895-8079-7e76d9d47b90\" (UID: \"4aad55f1-3029-4895-8079-7e76d9d47b90\") "
Sep 11 14:31:42.679114 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.678937    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4aad55f1-3029-4895-8079-7e76d9d47b90-model-cache\") pod \"4aad55f1-3029-4895-8079-7e76d9d47b90\" (UID: \"4aad55f1-3029-4895-8079-7e76d9d47b90\") "
Sep 11 14:31:42.679114 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.678958    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4aad55f1-3029-4895-8079-7e76d9d47b90-home\") pod \"4aad55f1-3029-4895-8079-7e76d9d47b90\" (UID: \"4aad55f1-3029-4895-8079-7e76d9d47b90\") "
Sep 11 14:31:42.679114 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.678980    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4aad55f1-3029-4895-8079-7e76d9d47b90-dshm\") pod \"4aad55f1-3029-4895-8079-7e76d9d47b90\" (UID: \"4aad55f1-3029-4895-8079-7e76d9d47b90\") "
Sep 11 14:31:42.679114 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.679006    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4aad55f1-3029-4895-8079-7e76d9d47b90-tmp-dir\") pod \"4aad55f1-3029-4895-8079-7e76d9d47b90\" (UID: \"4aad55f1-3029-4895-8079-7e76d9d47b90\") "
Sep 11 14:31:42.679114 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.679069    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4aad55f1-3029-4895-8079-7e76d9d47b90-tls-certs\") pod \"4aad55f1-3029-4895-8079-7e76d9d47b90\" (UID: \"4aad55f1-3029-4895-8079-7e76d9d47b90\") "
Sep 11 14:31:42.679385 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.679183    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4aad55f1-3029-4895-8079-7e76d9d47b90-home" (OuterVolumeSpecName: "home") pod "4aad55f1-3029-4895-8079-7e76d9d47b90" (UID: "4aad55f1-3029-4895-8079-7e76d9d47b90"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:31:42.679385 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.679198    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4aad55f1-3029-4895-8079-7e76d9d47b90-model-cache" (OuterVolumeSpecName: "model-cache") pod "4aad55f1-3029-4895-8079-7e76d9d47b90" (UID: "4aad55f1-3029-4895-8079-7e76d9d47b90"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:31:42.679385 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.679296    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4aad55f1-3029-4895-8079-7e76d9d47b90-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4aad55f1-3029-4895-8079-7e76d9d47b90" (UID: "4aad55f1-3029-4895-8079-7e76d9d47b90"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:31:42.679385 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.679364    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4aad55f1-3029-4895-8079-7e76d9d47b90-model-cache\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:31:42.679385 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.679383    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4aad55f1-3029-4895-8079-7e76d9d47b90-home\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:31:42.679552 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.679397    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4aad55f1-3029-4895-8079-7e76d9d47b90-tmp-dir\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:31:42.681232 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.681208    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4aad55f1-3029-4895-8079-7e76d9d47b90-kube-api-access-sgjsb" (OuterVolumeSpecName: "kube-api-access-sgjsb") pod "4aad55f1-3029-4895-8079-7e76d9d47b90" (UID: "4aad55f1-3029-4895-8079-7e76d9d47b90"). InnerVolumeSpecName "kube-api-access-sgjsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:31:42.681334 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.681209    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4aad55f1-3029-4895-8079-7e76d9d47b90-dshm" (OuterVolumeSpecName: "dshm") pod "4aad55f1-3029-4895-8079-7e76d9d47b90" (UID: "4aad55f1-3029-4895-8079-7e76d9d47b90"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:31:42.681334 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.681240    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aad55f1-3029-4895-8079-7e76d9d47b90-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4aad55f1-3029-4895-8079-7e76d9d47b90" (UID: "4aad55f1-3029-4895-8079-7e76d9d47b90"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:31:42.780010 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.779985    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgjsb\" (UniqueName: \"kubernetes.io/projected/4aad55f1-3029-4895-8079-7e76d9d47b90-kube-api-access-sgjsb\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:31:42.780010 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.780005    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4aad55f1-3029-4895-8079-7e76d9d47b90-dshm\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:31:42.780149 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:42.780017    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4aad55f1-3029-4895-8079-7e76d9d47b90-tls-certs\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:31:43.429791 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:43.429758    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"
Sep 11 14:31:43.430254 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:43.429801    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx" event={"ID":"4aad55f1-3029-4895-8079-7e76d9d47b90","Type":"ContainerDied","Data":"b1346be2c1e77e40c575959cda42ad34eb8e81c15166caa41623ec998907d195"}
Sep 11 14:31:43.430254 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:43.429849    2584 scope.go:117] "RemoveContainer" containerID="35c66d08c023af4030e2cdad31eb4e8edd400fd6714e703289eff2266b7a6897"
Sep 11 14:31:43.451888 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:43.451865    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"]
Sep 11 14:31:43.457381 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:43.457360    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-e1e477/noten-model-e1e477-kserve-76fb778ff5-8bphx"]
Sep 11 14:31:43.679843 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:43.679761    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4aad55f1-3029-4895-8079-7e76d9d47b90" path="/var/lib/kubelet/pods/4aad55f1-3029-4895-8079-7e76d9d47b90/volumes"
Sep 11 14:31:44.121637 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:44.121605    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:31:44.267399 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:44.267366    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:44.367483 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:44.367460    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:44.625251 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:44.625216    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:45.119512 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:45.119467    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b6b864-28jmf"]
Sep 11 14:31:45.119984 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:45.119964    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4aad55f1-3029-4895-8079-7e76d9d47b90" containerName="main"
Sep 11 14:31:45.119984 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:45.119986    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="4aad55f1-3029-4895-8079-7e76d9d47b90" containerName="main"
Sep 11 14:31:45.120155 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:45.120101    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="4aad55f1-3029-4895-8079-7e76d9d47b90" containerName="main"
Sep 11 14:31:45.124517 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:45.124487    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b6b864-28jmf"
Sep 11 14:31:45.126948 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:45.126925    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dp8gp\""
Sep 11 14:31:45.132136 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:45.132113    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b6b864-28jmf"]
Sep 11 14:31:45.198994 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:45.198963    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed212f0c-e472-4d0f-9a5d-431ac14a8f29-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-b6b864-28jmf\" (UID: \"ed212f0c-e472-4d0f-9a5d-431ac14a8f29\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b6b864-28jmf"
Sep 11 14:31:45.242759 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:45.242720    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:45.299687 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:45.299651    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed212f0c-e472-4d0f-9a5d-431ac14a8f29-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-b6b864-28jmf\" (UID: \"ed212f0c-e472-4d0f-9a5d-431ac14a8f29\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b6b864-28jmf"
Sep 11 14:31:45.300223 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:45.300205    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed212f0c-e472-4d0f-9a5d-431ac14a8f29-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-b6b864-28jmf\" (UID: \"ed212f0c-e472-4d0f-9a5d-431ac14a8f29\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b6b864-28jmf"
Sep 11 14:31:45.437062 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:45.436993    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b6b864-28jmf"
Sep 11 14:31:45.719464 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:45.719429    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b6b864-28jmf"]
Sep 11 14:31:45.722966 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:31:45.722933    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded212f0c_e472_4d0f_9a5d_431ac14a8f29.slice/crio-6031b909c6e1dee7f258807929bc1b808f63c4252a9521a994eac98cf4baf2c6 WatchSource:0}: Error finding container 6031b909c6e1dee7f258807929bc1b808f63c4252a9521a994eac98cf4baf2c6: Status 404 returned error can't find the container with id 6031b909c6e1dee7f258807929bc1b808f63c4252a9521a994eac98cf4baf2c6
Sep 11 14:31:46.220928 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:46.220894    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:46.449391 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:46.449366    2584 generic.go:356] "Generic (PLEG): container finished" podID="ed212f0c-e472-4d0f-9a5d-431ac14a8f29" containerID="dd45e8fc3b13281113c49ccf06f88f524936c07554b8d97c759c321559bdb3cf" exitCode=0
Sep 11 14:31:46.449494 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:46.449445    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b6b864-28jmf" event={"ID":"ed212f0c-e472-4d0f-9a5d-431ac14a8f29","Type":"ContainerDied","Data":"dd45e8fc3b13281113c49ccf06f88f524936c07554b8d97c759c321559bdb3cf"}
Sep 11 14:31:46.449539 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:46.449493    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b6b864-28jmf" event={"ID":"ed212f0c-e472-4d0f-9a5d-431ac14a8f29","Type":"ContainerStarted","Data":"6031b909c6e1dee7f258807929bc1b808f63c4252a9521a994eac98cf4baf2c6"}
Sep 11 14:31:47.072620 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:47.072583    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:47.595760 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:47.595734    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b6b864-28jmf"
Sep 11 14:31:47.722999 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:47.722925    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed212f0c-e472-4d0f-9a5d-431ac14a8f29-maas-api-service-ca\") pod \"ed212f0c-e472-4d0f-9a5d-431ac14a8f29\" (UID: \"ed212f0c-e472-4d0f-9a5d-431ac14a8f29\") "
Sep 11 14:31:47.723289 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:47.723265    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed212f0c-e472-4d0f-9a5d-431ac14a8f29-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ed212f0c-e472-4d0f-9a5d-431ac14a8f29" (UID: "ed212f0c-e472-4d0f-9a5d-431ac14a8f29"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:31:47.824307 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:47.824277    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed212f0c-e472-4d0f-9a5d-431ac14a8f29-maas-api-service-ca\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:31:48.316613 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:48.316578    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:48.461589 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:48.461557    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b6b864-28jmf" event={"ID":"ed212f0c-e472-4d0f-9a5d-431ac14a8f29","Type":"ContainerDied","Data":"6031b909c6e1dee7f258807929bc1b808f63c4252a9521a994eac98cf4baf2c6"}
Sep 11 14:31:48.461589 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:48.461574    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b6b864-28jmf"
Sep 11 14:31:48.461816 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:48.461633    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6031b909c6e1dee7f258807929bc1b808f63c4252a9521a994eac98cf4baf2c6"
Sep 11 14:31:53.432437 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:53.432409    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-02723795-5d8c4f88c8-kwlj9"
Sep 11 14:31:53.432877 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:53.432483    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-02723795-566867c4f7-fkxx5"
Sep 11 14:31:55.752738 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:55.752704    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:55.763186 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:55.763157    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b6b864-29818950-mb2fp"]
Sep 11 14:31:55.765314 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:55.765291    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b6b864-29818950-mb2fp"]
Sep 11 14:31:55.801814 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:55.801787    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-b6b864-85f4d6986c-kgzbs"]
Sep 11 14:31:55.802082 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:55.802048    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-b6b864-85f4d6986c-kgzbs" podUID="d659b308-feb5-44d5-a1eb-40a509a07068" containerName="payload-processing" containerID="cri-o://c6f64dca7371b1adbbe37612f0c22bc0ec036843db2cc0dc7dac1de4e65f9fd2" gracePeriod=30
Sep 11 14:31:55.846896 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:55.846864    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:55.909069 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:55.909045    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:55.989212 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:55.989165    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:55.997329 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:55.997286    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b6b864-28jmf"]
Sep 11 14:31:56.000090 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:56.000065    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b6b864-28jmf"]
Sep 11 14:31:56.046249 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:56.046221    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:56.057628 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:56.057608    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-b6b864-85f4d6986c-kgzbs"
Sep 11 14:31:56.199824 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:56.199795    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d659b308-feb5-44d5-a1eb-40a509a07068-plugins-config-volume\") pod \"d659b308-feb5-44d5-a1eb-40a509a07068\" (UID: \"d659b308-feb5-44d5-a1eb-40a509a07068\") "
Sep 11 14:31:56.199982 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:56.199916    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqnfv\" (UniqueName: \"kubernetes.io/projected/d659b308-feb5-44d5-a1eb-40a509a07068-kube-api-access-zqnfv\") pod \"d659b308-feb5-44d5-a1eb-40a509a07068\" (UID: \"d659b308-feb5-44d5-a1eb-40a509a07068\") "
Sep 11 14:31:56.200137 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:56.200114    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d659b308-feb5-44d5-a1eb-40a509a07068-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d659b308-feb5-44d5-a1eb-40a509a07068" (UID: "d659b308-feb5-44d5-a1eb-40a509a07068"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:31:56.200202 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:56.200183    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d659b308-feb5-44d5-a1eb-40a509a07068-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:31:56.201999 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:56.201973    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d659b308-feb5-44d5-a1eb-40a509a07068-kube-api-access-zqnfv" (OuterVolumeSpecName: "kube-api-access-zqnfv") pod "d659b308-feb5-44d5-a1eb-40a509a07068" (UID: "d659b308-feb5-44d5-a1eb-40a509a07068"). InnerVolumeSpecName "kube-api-access-zqnfv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:31:56.300731 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:56.300701    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqnfv\" (UniqueName: \"kubernetes.io/projected/d659b308-feb5-44d5-a1eb-40a509a07068-kube-api-access-zqnfv\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:31:56.415670 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:56.415639    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:56.507585 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:56.507558    2584 generic.go:356] "Generic (PLEG): container finished" podID="d659b308-feb5-44d5-a1eb-40a509a07068" containerID="c6f64dca7371b1adbbe37612f0c22bc0ec036843db2cc0dc7dac1de4e65f9fd2" exitCode=0
Sep 11 14:31:56.507734 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:56.507599    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-b6b864-85f4d6986c-kgzbs" event={"ID":"d659b308-feb5-44d5-a1eb-40a509a07068","Type":"ContainerDied","Data":"c6f64dca7371b1adbbe37612f0c22bc0ec036843db2cc0dc7dac1de4e65f9fd2"}
Sep 11 14:31:56.507734 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:56.507612    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-b6b864-85f4d6986c-kgzbs"
Sep 11 14:31:56.507734 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:56.507655    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-b6b864-85f4d6986c-kgzbs" event={"ID":"d659b308-feb5-44d5-a1eb-40a509a07068","Type":"ContainerDied","Data":"91459f87696d49b837fa339055fc4adfaa46448eefcb06a4f9d4a760c0c878ae"}
Sep 11 14:31:56.507734 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:56.507671    2584 scope.go:117] "RemoveContainer" containerID="c6f64dca7371b1adbbe37612f0c22bc0ec036843db2cc0dc7dac1de4e65f9fd2"
Sep 11 14:31:56.516265 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:56.516249    2584 scope.go:117] "RemoveContainer" containerID="c6f64dca7371b1adbbe37612f0c22bc0ec036843db2cc0dc7dac1de4e65f9fd2"
Sep 11 14:31:56.516581 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:31:56.516555    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6f64dca7371b1adbbe37612f0c22bc0ec036843db2cc0dc7dac1de4e65f9fd2\": container with ID starting with c6f64dca7371b1adbbe37612f0c22bc0ec036843db2cc0dc7dac1de4e65f9fd2 not found: ID does not exist" containerID="c6f64dca7371b1adbbe37612f0c22bc0ec036843db2cc0dc7dac1de4e65f9fd2"
Sep 11 14:31:56.516662 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:56.516594    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6f64dca7371b1adbbe37612f0c22bc0ec036843db2cc0dc7dac1de4e65f9fd2"} err="failed to get container status \"c6f64dca7371b1adbbe37612f0c22bc0ec036843db2cc0dc7dac1de4e65f9fd2\": rpc error: code = NotFound desc = could not find container \"c6f64dca7371b1adbbe37612f0c22bc0ec036843db2cc0dc7dac1de4e65f9fd2\": container with ID starting with c6f64dca7371b1adbbe37612f0c22bc0ec036843db2cc0dc7dac1de4e65f9fd2 not found: ID does not exist"
Sep 11 14:31:56.516662 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:56.516565    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:56.531493 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:56.531473    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-b6b864-85f4d6986c-kgzbs"]
Sep 11 14:31:56.534274 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:56.534250    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-b6b864-85f4d6986c-kgzbs"]
Sep 11 14:31:57.259727 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:57.259664    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:57.679205 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:57.679171    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d659b308-feb5-44d5-a1eb-40a509a07068" path="/var/lib/kubelet/pods/d659b308-feb5-44d5-a1eb-40a509a07068/volumes"
Sep 11 14:31:57.679451 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:57.679437    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e569c43d-84be-46f4-8da4-61f2fc1351fa" path="/var/lib/kubelet/pods/e569c43d-84be-46f4-8da4-61f2fc1351fa/volumes"
Sep 11 14:31:57.679710 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:57.679694    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed212f0c-e472-4d0f-9a5d-431ac14a8f29" path="/var/lib/kubelet/pods/ed212f0c-e472-4d0f-9a5d-431ac14a8f29/volumes"
Sep 11 14:31:58.515081 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:58.515045    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:31:58.995731 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:58.995697    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:59.137999 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:59.137970    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:59.809779 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:59.809743    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:31:59.897414 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:31:59.897387    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:00.045383 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:00.045352    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:00.368499 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:00.368466    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:03.069669 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:03.069634    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:03.151563 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:03.151531    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:03.400069 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:03.399977    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:04.009425 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:04.009383    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:04.398392 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:04.398344    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:04.495030 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:04.494999    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:05.395130 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:05.395094    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:05.463424 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:05.463391    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:06.619020 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:06.618984    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:06.716846 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:06.716813    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:07.043497 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:07.043470    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-02723795-kjwhm"]
Sep 11 14:32:07.043898 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:07.043883    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d659b308-feb5-44d5-a1eb-40a509a07068" containerName="payload-processing"
Sep 11 14:32:07.043948 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:07.043899    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d659b308-feb5-44d5-a1eb-40a509a07068" containerName="payload-processing"
Sep 11 14:32:07.043948 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:07.043911    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed212f0c-e472-4d0f-9a5d-431ac14a8f29" containerName="revoke-keys"
Sep 11 14:32:07.043948 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:07.043917    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed212f0c-e472-4d0f-9a5d-431ac14a8f29" containerName="revoke-keys"
Sep 11 14:32:07.044041 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:07.043986    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed212f0c-e472-4d0f-9a5d-431ac14a8f29" containerName="revoke-keys"
Sep 11 14:32:07.044041 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:07.043999    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d659b308-feb5-44d5-a1eb-40a509a07068" containerName="payload-processing"
Sep 11 14:32:07.047130 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:07.047113    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-02723795-kjwhm"
Sep 11 14:32:07.049486 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:07.049463    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dp8gp\""
Sep 11 14:32:07.055366 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:07.055341    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-02723795-kjwhm"]
Sep 11 14:32:07.183404 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:07.183376    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d1943ff-c1ac-49c4-bd72-76c80a4834a3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-02723795-kjwhm\" (UID: \"5d1943ff-c1ac-49c4-bd72-76c80a4834a3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-02723795-kjwhm"
Sep 11 14:32:07.284797 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:07.284770    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d1943ff-c1ac-49c4-bd72-76c80a4834a3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-02723795-kjwhm\" (UID: \"5d1943ff-c1ac-49c4-bd72-76c80a4834a3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-02723795-kjwhm"
Sep 11 14:32:07.285343 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:07.285321    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d1943ff-c1ac-49c4-bd72-76c80a4834a3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-02723795-kjwhm\" (UID: \"5d1943ff-c1ac-49c4-bd72-76c80a4834a3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-02723795-kjwhm"
Sep 11 14:32:07.358955 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:07.358895    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-02723795-kjwhm"
Sep 11 14:32:07.630527 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:07.630500    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-02723795-kjwhm"]
Sep 11 14:32:07.632106 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:32:07.632081    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d1943ff_c1ac_49c4_bd72_76c80a4834a3.slice/crio-30ea7833108a20182e9b074bafb647013db74c0f2039e3da225723ffa8738d1f WatchSource:0}: Error finding container 30ea7833108a20182e9b074bafb647013db74c0f2039e3da225723ffa8738d1f: Status 404 returned error can't find the container with id 30ea7833108a20182e9b074bafb647013db74c0f2039e3da225723ffa8738d1f
Sep 11 14:32:07.818932 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:07.818899    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:08.126187 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:08.126156    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:08.227305 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:08.227232    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:08.571587 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:08.571557    2584 generic.go:356] "Generic (PLEG): container finished" podID="5d1943ff-c1ac-49c4-bd72-76c80a4834a3" containerID="b29e2d5efc79249f207665d0b0853fdb4729c09280b0de257e1c3ed87cf01bf9" exitCode=0
Sep 11 14:32:08.571726 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:08.571608    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-02723795-kjwhm" event={"ID":"5d1943ff-c1ac-49c4-bd72-76c80a4834a3","Type":"ContainerDied","Data":"b29e2d5efc79249f207665d0b0853fdb4729c09280b0de257e1c3ed87cf01bf9"}
Sep 11 14:32:08.571726 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:08.571658    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-02723795-kjwhm" event={"ID":"5d1943ff-c1ac-49c4-bd72-76c80a4834a3","Type":"ContainerStarted","Data":"30ea7833108a20182e9b074bafb647013db74c0f2039e3da225723ffa8738d1f"}
Sep 11 14:32:08.842443 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:08.842360    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:09.630597 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:09.630565    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:09.715821 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:09.715792    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:09.723383 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:09.723347    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-02723795-kjwhm"
Sep 11 14:32:09.906214 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:09.906138    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d1943ff-c1ac-49c4-bd72-76c80a4834a3-maas-api-service-ca\") pod \"5d1943ff-c1ac-49c4-bd72-76c80a4834a3\" (UID: \"5d1943ff-c1ac-49c4-bd72-76c80a4834a3\") "
Sep 11 14:32:09.906530 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:09.906442    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d1943ff-c1ac-49c4-bd72-76c80a4834a3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5d1943ff-c1ac-49c4-bd72-76c80a4834a3" (UID: "5d1943ff-c1ac-49c4-bd72-76c80a4834a3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:32:09.931842 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:09.931816    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:10.007381 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:10.007360    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d1943ff-c1ac-49c4-bd72-76c80a4834a3-maas-api-service-ca\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:32:10.171124 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:10.171050    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:10.269071 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:10.269044    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:10.363478 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:10.363446    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72e046-669d4b786b-h7brn"]
Sep 11 14:32:10.363896 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:10.363878    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d1943ff-c1ac-49c4-bd72-76c80a4834a3" containerName="revoke-keys"
Sep 11 14:32:10.363974 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:10.363897    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d1943ff-c1ac-49c4-bd72-76c80a4834a3" containerName="revoke-keys"
Sep 11 14:32:10.364042 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:10.364027    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d1943ff-c1ac-49c4-bd72-76c80a4834a3" containerName="revoke-keys"
Sep 11 14:32:10.367106 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:10.367087    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72e046-669d4b786b-h7brn"
Sep 11 14:32:10.369652 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:10.369628    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-72e046-dockercfg-8l8xd\""
Sep 11 14:32:10.369845 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:10.369827    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-72e046\""
Sep 11 14:32:10.381216 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:10.381193    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72e046-669d4b786b-h7brn"]
Sep 11 14:32:10.512058 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:10.511989    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49d9d520-2902-4cf1-8415-6ff82d607531-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-72e046-669d4b786b-h7brn\" (UID: \"49d9d520-2902-4cf1-8415-6ff82d607531\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72e046-669d4b786b-h7brn"
Sep 11 14:32:10.512180 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:10.512057    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9j97\" (UniqueName: \"kubernetes.io/projected/49d9d520-2902-4cf1-8415-6ff82d607531-kube-api-access-g9j97\") pod \"payload-pre-processing-e2e-shared-a-w3-72e046-669d4b786b-h7brn\" (UID: \"49d9d520-2902-4cf1-8415-6ff82d607531\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72e046-669d4b786b-h7brn"
Sep 11 14:32:10.585575 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:10.585555    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-02723795-kjwhm"
Sep 11 14:32:10.585575 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:10.585565    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-02723795-kjwhm" event={"ID":"5d1943ff-c1ac-49c4-bd72-76c80a4834a3","Type":"ContainerDied","Data":"30ea7833108a20182e9b074bafb647013db74c0f2039e3da225723ffa8738d1f"}
Sep 11 14:32:10.585741 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:10.585606    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30ea7833108a20182e9b074bafb647013db74c0f2039e3da225723ffa8738d1f"
Sep 11 14:32:10.613226 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:10.613204    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9j97\" (UniqueName: \"kubernetes.io/projected/49d9d520-2902-4cf1-8415-6ff82d607531-kube-api-access-g9j97\") pod \"payload-pre-processing-e2e-shared-a-w3-72e046-669d4b786b-h7brn\" (UID: \"49d9d520-2902-4cf1-8415-6ff82d607531\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72e046-669d4b786b-h7brn"
Sep 11 14:32:10.613318 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:10.613268    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49d9d520-2902-4cf1-8415-6ff82d607531-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-72e046-669d4b786b-h7brn\" (UID: \"49d9d520-2902-4cf1-8415-6ff82d607531\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72e046-669d4b786b-h7brn"
Sep 11 14:32:10.613951 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:10.613925    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49d9d520-2902-4cf1-8415-6ff82d607531-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-72e046-669d4b786b-h7brn\" (UID: \"49d9d520-2902-4cf1-8415-6ff82d607531\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72e046-669d4b786b-h7brn"
Sep 11 14:32:10.622355 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:10.622331    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9j97\" (UniqueName: \"kubernetes.io/projected/49d9d520-2902-4cf1-8415-6ff82d607531-kube-api-access-g9j97\") pod \"payload-pre-processing-e2e-shared-a-w3-72e046-669d4b786b-h7brn\" (UID: \"49d9d520-2902-4cf1-8415-6ff82d607531\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72e046-669d4b786b-h7brn"
Sep 11 14:32:10.677437 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:10.677410    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72e046-669d4b786b-h7brn"
Sep 11 14:32:10.959661 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:10.959632    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72e046-669d4b786b-h7brn"]
Sep 11 14:32:10.961819 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:32:10.961791    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49d9d520_2902_4cf1_8415_6ff82d607531.slice/crio-5861f31889c431eef5fb6085540d847138c8938eb305f96b8edbd5d257586cb7 WatchSource:0}: Error finding container 5861f31889c431eef5fb6085540d847138c8938eb305f96b8edbd5d257586cb7: Status 404 returned error can't find the container with id 5861f31889c431eef5fb6085540d847138c8938eb305f96b8edbd5d257586cb7
Sep 11 14:32:11.592148 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:11.592113    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72e046-669d4b786b-h7brn" event={"ID":"49d9d520-2902-4cf1-8415-6ff82d607531","Type":"ContainerStarted","Data":"308e9e94f7acdcc3850e5ea7e56617b51e05789c87bd324ff85a30bdef26c726"}
Sep 11 14:32:11.592310 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:11.592164    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72e046-669d4b786b-h7brn" event={"ID":"49d9d520-2902-4cf1-8415-6ff82d607531","Type":"ContainerStarted","Data":"5861f31889c431eef5fb6085540d847138c8938eb305f96b8edbd5d257586cb7"}
Sep 11 14:32:11.592310 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:11.592199    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72e046-669d4b786b-h7brn"
Sep 11 14:32:11.612988 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:11.612941    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72e046-669d4b786b-h7brn" podStartSLOduration=1.612924768 podStartE2EDuration="1.612924768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:32:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:32:11.610807252 +0000 UTC m=+1024.409442034" watchObservedRunningTime="2026-09-11 14:32:11.612924768 +0000 UTC m=+1024.411559549"
Sep 11 14:32:11.752457 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:11.752412    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:12.814349 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:12.814319    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:32:20.602270 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:20.602216    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:21.333591 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.333559    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:21.372473 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.372441    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-02723795-566867c4f7-fkxx5"]
Sep 11 14:32:21.372730 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.372665    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-02723795-566867c4f7-fkxx5" podUID="c3ff5a86-4172-45b4-bc73-50147004384b" containerName="payload-processing" containerID="cri-o://97c6e304267bc1101149498979082d2f6e272cfb97762ad2ec3adcbcedf6299a" gracePeriod=30
Sep 11 14:32:21.386720 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.386691    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-02723795-5d8c4f88c8-kwlj9"]
Sep 11 14:32:21.386933 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.386880    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-02723795-5d8c4f88c8-kwlj9" podUID="c9adc541-3155-4436-8e4d-4916b0b6c196" containerName="payload-pre-processing" containerID="cri-o://08d59bfee07640df8507fb6fc2e7acc35aebfb18cf154357d617a680af67383c" gracePeriod=30
Sep 11 14:32:21.432530 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.432504    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:21.497548 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.497486    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:21.566793 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.566701    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:21.589382 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.589354    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-02723795-kjwhm"]
Sep 11 14:32:21.592051 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.592025    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-02723795-kjwhm"]
Sep 11 14:32:21.628381 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.628352    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:21.633410 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.633389    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-02723795-566867c4f7-fkxx5"
Sep 11 14:32:21.646250 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.646224    2584 generic.go:356] "Generic (PLEG): container finished" podID="c3ff5a86-4172-45b4-bc73-50147004384b" containerID="97c6e304267bc1101149498979082d2f6e272cfb97762ad2ec3adcbcedf6299a" exitCode=0
Sep 11 14:32:21.646364 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.646267    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-02723795-566867c4f7-fkxx5"
Sep 11 14:32:21.646364 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.646301    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-02723795-566867c4f7-fkxx5" event={"ID":"c3ff5a86-4172-45b4-bc73-50147004384b","Type":"ContainerDied","Data":"97c6e304267bc1101149498979082d2f6e272cfb97762ad2ec3adcbcedf6299a"}
Sep 11 14:32:21.646364 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.646342    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-02723795-566867c4f7-fkxx5" event={"ID":"c3ff5a86-4172-45b4-bc73-50147004384b","Type":"ContainerDied","Data":"63a70839483343551031690a557889f8d5f93558e60f8dcd0cb147a4eb869934"}
Sep 11 14:32:21.646364 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.646357    2584 scope.go:117] "RemoveContainer" containerID="97c6e304267bc1101149498979082d2f6e272cfb97762ad2ec3adcbcedf6299a"
Sep 11 14:32:21.648179 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.648143    2584 generic.go:356] "Generic (PLEG): container finished" podID="c9adc541-3155-4436-8e4d-4916b0b6c196" containerID="08d59bfee07640df8507fb6fc2e7acc35aebfb18cf154357d617a680af67383c" exitCode=0
Sep 11 14:32:21.648283 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.648206    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-02723795-5d8c4f88c8-kwlj9" event={"ID":"c9adc541-3155-4436-8e4d-4916b0b6c196","Type":"ContainerDied","Data":"08d59bfee07640df8507fb6fc2e7acc35aebfb18cf154357d617a680af67383c"}
Sep 11 14:32:21.657365 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.657336    2584 scope.go:117] "RemoveContainer" containerID="97c6e304267bc1101149498979082d2f6e272cfb97762ad2ec3adcbcedf6299a"
Sep 11 14:32:21.657733 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:32:21.657651    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97c6e304267bc1101149498979082d2f6e272cfb97762ad2ec3adcbcedf6299a\": container with ID starting with 97c6e304267bc1101149498979082d2f6e272cfb97762ad2ec3adcbcedf6299a not found: ID does not exist" containerID="97c6e304267bc1101149498979082d2f6e272cfb97762ad2ec3adcbcedf6299a"
Sep 11 14:32:21.657733 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.657708    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97c6e304267bc1101149498979082d2f6e272cfb97762ad2ec3adcbcedf6299a"} err="failed to get container status \"97c6e304267bc1101149498979082d2f6e272cfb97762ad2ec3adcbcedf6299a\": rpc error: code = NotFound desc = could not find container \"97c6e304267bc1101149498979082d2f6e272cfb97762ad2ec3adcbcedf6299a\": container with ID starting with 97c6e304267bc1101149498979082d2f6e272cfb97762ad2ec3adcbcedf6299a not found: ID does not exist"
Sep 11 14:32:21.660498 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.660476    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-02723795-5d8c4f88c8-kwlj9"
Sep 11 14:32:21.684171 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.684142    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d1943ff-c1ac-49c4-bd72-76c80a4834a3" path="/var/lib/kubelet/pods/5d1943ff-c1ac-49c4-bd72-76c80a4834a3/volumes"
Sep 11 14:32:21.702739 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.702717    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3ff5a86-4172-45b4-bc73-50147004384b-plugins-config-volume\") pod \"c3ff5a86-4172-45b4-bc73-50147004384b\" (UID: \"c3ff5a86-4172-45b4-bc73-50147004384b\") "
Sep 11 14:32:21.702869 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.702753    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jw7l5\" (UniqueName: \"kubernetes.io/projected/c9adc541-3155-4436-8e4d-4916b0b6c196-kube-api-access-jw7l5\") pod \"c9adc541-3155-4436-8e4d-4916b0b6c196\" (UID: \"c9adc541-3155-4436-8e4d-4916b0b6c196\") "
Sep 11 14:32:21.702869 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.702835    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9adc541-3155-4436-8e4d-4916b0b6c196-plugins-config-volume\") pod \"c9adc541-3155-4436-8e4d-4916b0b6c196\" (UID: \"c9adc541-3155-4436-8e4d-4916b0b6c196\") "
Sep 11 14:32:21.702869 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.702861    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pq4qc\" (UniqueName: \"kubernetes.io/projected/c3ff5a86-4172-45b4-bc73-50147004384b-kube-api-access-pq4qc\") pod \"c3ff5a86-4172-45b4-bc73-50147004384b\" (UID: \"c3ff5a86-4172-45b4-bc73-50147004384b\") "
Sep 11 14:32:21.703158 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.703119    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3ff5a86-4172-45b4-bc73-50147004384b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c3ff5a86-4172-45b4-bc73-50147004384b" (UID: "c3ff5a86-4172-45b4-bc73-50147004384b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:32:21.703245 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.703205    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9adc541-3155-4436-8e4d-4916b0b6c196-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c9adc541-3155-4436-8e4d-4916b0b6c196" (UID: "c9adc541-3155-4436-8e4d-4916b0b6c196"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:32:21.704909 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.704883    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3ff5a86-4172-45b4-bc73-50147004384b-kube-api-access-pq4qc" (OuterVolumeSpecName: "kube-api-access-pq4qc") pod "c3ff5a86-4172-45b4-bc73-50147004384b" (UID: "c3ff5a86-4172-45b4-bc73-50147004384b"). InnerVolumeSpecName "kube-api-access-pq4qc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:32:21.705250 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.705234    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9adc541-3155-4436-8e4d-4916b0b6c196-kube-api-access-jw7l5" (OuterVolumeSpecName: "kube-api-access-jw7l5") pod "c9adc541-3155-4436-8e4d-4916b0b6c196" (UID: "c9adc541-3155-4436-8e4d-4916b0b6c196"). InnerVolumeSpecName "kube-api-access-jw7l5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:32:21.803408 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.803384    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3ff5a86-4172-45b4-bc73-50147004384b-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:32:21.803408 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.803406    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jw7l5\" (UniqueName: \"kubernetes.io/projected/c9adc541-3155-4436-8e4d-4916b0b6c196-kube-api-access-jw7l5\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:32:21.803550 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.803415    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9adc541-3155-4436-8e4d-4916b0b6c196-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:32:21.803550 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.803424    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pq4qc\" (UniqueName: \"kubernetes.io/projected/c3ff5a86-4172-45b4-bc73-50147004384b-kube-api-access-pq4qc\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:32:21.954174 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.954089    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:21.970594 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.970565    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-02723795-566867c4f7-fkxx5"]
Sep 11 14:32:21.978948 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:21.978926    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-02723795-566867c4f7-fkxx5"]
Sep 11 14:32:22.055158 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:22.055127    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:22.599920 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:22.599876    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72e046-669d4b786b-h7brn"
Sep 11 14:32:22.655857 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:22.655786    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-02723795-5d8c4f88c8-kwlj9"
Sep 11 14:32:22.655857 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:22.655834    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-02723795-5d8c4f88c8-kwlj9" event={"ID":"c9adc541-3155-4436-8e4d-4916b0b6c196","Type":"ContainerDied","Data":"07f8779dccb8de3a4dac516b27568b3e1c89dd88f23f3598bc0a8f63902b9897"}
Sep 11 14:32:22.656292 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:22.655884    2584 scope.go:117] "RemoveContainer" containerID="08d59bfee07640df8507fb6fc2e7acc35aebfb18cf154357d617a680af67383c"
Sep 11 14:32:22.683740 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:22.683717    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-02723795-5d8c4f88c8-kwlj9"]
Sep 11 14:32:22.692787 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:22.692762    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-02723795-5d8c4f88c8-kwlj9"]
Sep 11 14:32:23.065284 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:23.065248    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:23.678766 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:23.678725    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3ff5a86-4172-45b4-bc73-50147004384b" path="/var/lib/kubelet/pods/c3ff5a86-4172-45b4-bc73-50147004384b/volumes"
Sep 11 14:32:23.679106 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:23.679085    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9adc541-3155-4436-8e4d-4916b0b6c196" path="/var/lib/kubelet/pods/c9adc541-3155-4436-8e4d-4916b0b6c196/volumes"
Sep 11 14:32:24.048173 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:24.048133    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:24.613802 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:24.613770    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:32:24.937972 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:24.937891    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:28.159279 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:28.159240    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:28.561709 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:28.561659    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:28.940497 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:28.940422    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:29.161505 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:29.161471    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:29.262178 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:29.262108    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:29.508454 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:29.508417    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:29.930090 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:29.930060    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:30.027321 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:30.027282    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:30.220293 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:30.220220    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:32.223409 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:32.223367    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:32.439949 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:32.439918    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:32.527536 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:32.527460    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:33.622587 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:33.622553    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:33.720527 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:33.720495    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:34.048801 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.048759    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:34.148502 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.148468    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:34.249191 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.249158    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:34.283442 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.283418    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-344045-7f446f687c-jk27f"]
Sep 11 14:32:34.283813 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.283800    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9adc541-3155-4436-8e4d-4916b0b6c196" containerName="payload-pre-processing"
Sep 11 14:32:34.283855 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.283815    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9adc541-3155-4436-8e4d-4916b0b6c196" containerName="payload-pre-processing"
Sep 11 14:32:34.283855 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.283828    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3ff5a86-4172-45b4-bc73-50147004384b" containerName="payload-processing"
Sep 11 14:32:34.283855 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.283835    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3ff5a86-4172-45b4-bc73-50147004384b" containerName="payload-processing"
Sep 11 14:32:34.283947 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.283895    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9adc541-3155-4436-8e4d-4916b0b6c196" containerName="payload-pre-processing"
Sep 11 14:32:34.283947 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.283903    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3ff5a86-4172-45b4-bc73-50147004384b" containerName="payload-processing"
Sep 11 14:32:34.288373 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.288357    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-344045-7f446f687c-jk27f"
Sep 11 14:32:34.292209 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.292189    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-344045-dockercfg-fndsp\""
Sep 11 14:32:34.292320 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.292261    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-344045\""
Sep 11 14:32:34.303916 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.303861    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-344045-7f446f687c-jk27f"]
Sep 11 14:32:34.354975 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.354939    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-344045-c69864b46-92wtl"]
Sep 11 14:32:34.358584 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.358558    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-344045-c69864b46-92wtl"
Sep 11 14:32:34.367622 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.367598    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-344045-c69864b46-92wtl"]
Sep 11 14:32:34.409159 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.409131    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49693f8f-95cb-4f96-9414-eb4dda6768b7-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-344045-7f446f687c-jk27f\" (UID: \"49693f8f-95cb-4f96-9414-eb4dda6768b7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-344045-7f446f687c-jk27f"
Sep 11 14:32:34.409271 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.409207    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk6d8\" (UniqueName: \"kubernetes.io/projected/49693f8f-95cb-4f96-9414-eb4dda6768b7-kube-api-access-lk6d8\") pod \"payload-processing-e2e-shared-b-w3-344045-7f446f687c-jk27f\" (UID: \"49693f8f-95cb-4f96-9414-eb4dda6768b7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-344045-7f446f687c-jk27f"
Sep 11 14:32:34.409317 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.409273    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ba9d944-88bf-47f4-b1b4-fed2961af84e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-344045-c69864b46-92wtl\" (UID: \"4ba9d944-88bf-47f4-b1b4-fed2961af84e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-344045-c69864b46-92wtl"
Sep 11 14:32:34.409386 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.409369    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxwbt\" (UniqueName: \"kubernetes.io/projected/4ba9d944-88bf-47f4-b1b4-fed2961af84e-kube-api-access-gxwbt\") pod \"payload-pre-processing-e2e-shared-b-w3-344045-c69864b46-92wtl\" (UID: \"4ba9d944-88bf-47f4-b1b4-fed2961af84e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-344045-c69864b46-92wtl"
Sep 11 14:32:34.510485 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.510456    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49693f8f-95cb-4f96-9414-eb4dda6768b7-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-344045-7f446f687c-jk27f\" (UID: \"49693f8f-95cb-4f96-9414-eb4dda6768b7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-344045-7f446f687c-jk27f"
Sep 11 14:32:34.510598 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.510494    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk6d8\" (UniqueName: \"kubernetes.io/projected/49693f8f-95cb-4f96-9414-eb4dda6768b7-kube-api-access-lk6d8\") pod \"payload-processing-e2e-shared-b-w3-344045-7f446f687c-jk27f\" (UID: \"49693f8f-95cb-4f96-9414-eb4dda6768b7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-344045-7f446f687c-jk27f"
Sep 11 14:32:34.510598 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.510526    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ba9d944-88bf-47f4-b1b4-fed2961af84e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-344045-c69864b46-92wtl\" (UID: \"4ba9d944-88bf-47f4-b1b4-fed2961af84e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-344045-c69864b46-92wtl"
Sep 11 14:32:34.510598 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.510575    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxwbt\" (UniqueName: \"kubernetes.io/projected/4ba9d944-88bf-47f4-b1b4-fed2961af84e-kube-api-access-gxwbt\") pod \"payload-pre-processing-e2e-shared-b-w3-344045-c69864b46-92wtl\" (UID: \"4ba9d944-88bf-47f4-b1b4-fed2961af84e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-344045-c69864b46-92wtl"
Sep 11 14:32:34.511237 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.511217    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49693f8f-95cb-4f96-9414-eb4dda6768b7-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-344045-7f446f687c-jk27f\" (UID: \"49693f8f-95cb-4f96-9414-eb4dda6768b7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-344045-7f446f687c-jk27f"
Sep 11 14:32:34.511275 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.511246    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ba9d944-88bf-47f4-b1b4-fed2961af84e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-344045-c69864b46-92wtl\" (UID: \"4ba9d944-88bf-47f4-b1b4-fed2961af84e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-344045-c69864b46-92wtl"
Sep 11 14:32:34.519354 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.519327    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxwbt\" (UniqueName: \"kubernetes.io/projected/4ba9d944-88bf-47f4-b1b4-fed2961af84e-kube-api-access-gxwbt\") pod \"payload-pre-processing-e2e-shared-b-w3-344045-c69864b46-92wtl\" (UID: \"4ba9d944-88bf-47f4-b1b4-fed2961af84e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-344045-c69864b46-92wtl"
Sep 11 14:32:34.519661 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.519637    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk6d8\" (UniqueName: \"kubernetes.io/projected/49693f8f-95cb-4f96-9414-eb4dda6768b7-kube-api-access-lk6d8\") pod \"payload-processing-e2e-shared-b-w3-344045-7f446f687c-jk27f\" (UID: \"49693f8f-95cb-4f96-9414-eb4dda6768b7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-344045-7f446f687c-jk27f"
Sep 11 14:32:34.599562 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.599509    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-344045-7f446f687c-jk27f"
Sep 11 14:32:34.670010 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.669977    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-344045-c69864b46-92wtl"
Sep 11 14:32:34.875346 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.875316    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-344045-7f446f687c-jk27f"]
Sep 11 14:32:34.877228 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:32:34.877202    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49693f8f_95cb_4f96_9414_eb4dda6768b7.slice/crio-fc1fa3b9f8cb9abd3c535a0c3c4070bec8b0472c4960b31889beb23b131516e4 WatchSource:0}: Error finding container fc1fa3b9f8cb9abd3c535a0c3c4070bec8b0472c4960b31889beb23b131516e4: Status 404 returned error can't find the container with id fc1fa3b9f8cb9abd3c535a0c3c4070bec8b0472c4960b31889beb23b131516e4
Sep 11 14:32:34.950701 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:34.950659    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-344045-c69864b46-92wtl"]
Sep 11 14:32:34.951851 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:32:34.951823    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ba9d944_88bf_47f4_b1b4_fed2961af84e.slice/crio-f7a6d4456a4a46bd4e2fe55d29d4a03208fd47636501f70c9486181c13aeacde WatchSource:0}: Error finding container f7a6d4456a4a46bd4e2fe55d29d4a03208fd47636501f70c9486181c13aeacde: Status 404 returned error can't find the container with id f7a6d4456a4a46bd4e2fe55d29d4a03208fd47636501f70c9486181c13aeacde
Sep 11 14:32:35.730102 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:35.730068    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-344045-c69864b46-92wtl" event={"ID":"4ba9d944-88bf-47f4-b1b4-fed2961af84e","Type":"ContainerStarted","Data":"85b015e413705f15afcdf6a4e3c67398b2d79d2f6eb4966d745fd1eaf829f318"}
Sep 11 14:32:35.730528 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:35.730261    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-344045-c69864b46-92wtl"
Sep 11 14:32:35.730528 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:35.730295    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-344045-c69864b46-92wtl" event={"ID":"4ba9d944-88bf-47f4-b1b4-fed2961af84e","Type":"ContainerStarted","Data":"f7a6d4456a4a46bd4e2fe55d29d4a03208fd47636501f70c9486181c13aeacde"}
Sep 11 14:32:35.731953 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:35.731931    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-344045-7f446f687c-jk27f" event={"ID":"49693f8f-95cb-4f96-9414-eb4dda6768b7","Type":"ContainerStarted","Data":"e356f608b6074b51835ae16865e5add69999a8f83c583fb4476a28445089ee7d"}
Sep 11 14:32:35.732077 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:35.731968    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-344045-7f446f687c-jk27f" event={"ID":"49693f8f-95cb-4f96-9414-eb4dda6768b7","Type":"ContainerStarted","Data":"fc1fa3b9f8cb9abd3c535a0c3c4070bec8b0472c4960b31889beb23b131516e4"}
Sep 11 14:32:35.732122 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:35.732074    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-344045-7f446f687c-jk27f"
Sep 11 14:32:35.749480 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:35.749445    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-344045-c69864b46-92wtl" podStartSLOduration=1.749431513 podStartE2EDuration="1.749431513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:32:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:32:35.74811815 +0000 UTC m=+1048.546752923" watchObservedRunningTime="2026-09-11 14:32:35.749431513 +0000 UTC m=+1048.548066295"
Sep 11 14:32:35.767965 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:35.767910    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-344045-7f446f687c-jk27f" podStartSLOduration=1.76789394 podStartE2EDuration="1.76789394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:32:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:32:35.767231936 +0000 UTC m=+1048.565866718" watchObservedRunningTime="2026-09-11 14:32:35.76789394 +0000 UTC m=+1048.566528731"
Sep 11 14:32:36.703516 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:36.703484    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:32:37.150164 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:37.150129    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:37.251168 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:37.251131    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:37.414709 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:37.414613    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:37.557249 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:37.557221    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:37.695778 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:37.695713    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:44.362577 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:44.362536    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:44.463716 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:44.463658    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:45.504218 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:45.504171    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:45.901732 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:45.901700    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:46.116346 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:46.116309    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:46.739602 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:46.739571    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-344045-7f446f687c-jk27f"
Sep 11 14:32:46.740018 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:46.739881    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-344045-c69864b46-92wtl"
Sep 11 14:32:48.827363 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:48.827331    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:49.440880 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:49.440846    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:49.534312 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:49.534275    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:49.714892 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:49.714805    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:50.165574 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:50.165542    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:50.668482 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:50.668446    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:51.571049 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:51.571014    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:51.673437 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:51.673405    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:51.744419 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:51.744394    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:52.142817 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:52.142779    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:52.237613 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:52.237570    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:52.260939 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:52.260916    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b934e8-746b8dc7c4-m7zns"]
Sep 11 14:32:52.265278 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:52.265262    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b934e8-746b8dc7c4-m7zns"
Sep 11 14:32:52.267597 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:52.267576    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-b934e8\""
Sep 11 14:32:52.267787 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:52.267770    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-b934e8-dockercfg-sxnd9\""
Sep 11 14:32:52.277762 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:52.277741    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b934e8-746b8dc7c4-m7zns"]
Sep 11 14:32:52.337611 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:52.337582    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:52.350762 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:52.350734    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhpfs\" (UniqueName: \"kubernetes.io/projected/0c7e6f7c-e408-4097-a5fd-2e5da6526e6e-kube-api-access-qhpfs\") pod \"payload-pre-processing-e2e-shared-a-w2-b934e8-746b8dc7c4-m7zns\" (UID: \"0c7e6f7c-e408-4097-a5fd-2e5da6526e6e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b934e8-746b8dc7c4-m7zns"
Sep 11 14:32:52.350866 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:52.350797    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c7e6f7c-e408-4097-a5fd-2e5da6526e6e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-b934e8-746b8dc7c4-m7zns\" (UID: \"0c7e6f7c-e408-4097-a5fd-2e5da6526e6e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b934e8-746b8dc7c4-m7zns"
Sep 11 14:32:52.451505 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:52.451430    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c7e6f7c-e408-4097-a5fd-2e5da6526e6e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-b934e8-746b8dc7c4-m7zns\" (UID: \"0c7e6f7c-e408-4097-a5fd-2e5da6526e6e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b934e8-746b8dc7c4-m7zns"
Sep 11 14:32:52.451649 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:52.451515    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhpfs\" (UniqueName: \"kubernetes.io/projected/0c7e6f7c-e408-4097-a5fd-2e5da6526e6e-kube-api-access-qhpfs\") pod \"payload-pre-processing-e2e-shared-a-w2-b934e8-746b8dc7c4-m7zns\" (UID: \"0c7e6f7c-e408-4097-a5fd-2e5da6526e6e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b934e8-746b8dc7c4-m7zns"
Sep 11 14:32:52.452375 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:52.452350    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c7e6f7c-e408-4097-a5fd-2e5da6526e6e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-b934e8-746b8dc7c4-m7zns\" (UID: \"0c7e6f7c-e408-4097-a5fd-2e5da6526e6e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b934e8-746b8dc7c4-m7zns"
Sep 11 14:32:52.460556 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:52.460526    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhpfs\" (UniqueName: \"kubernetes.io/projected/0c7e6f7c-e408-4097-a5fd-2e5da6526e6e-kube-api-access-qhpfs\") pod \"payload-pre-processing-e2e-shared-a-w2-b934e8-746b8dc7c4-m7zns\" (UID: \"0c7e6f7c-e408-4097-a5fd-2e5da6526e6e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b934e8-746b8dc7c4-m7zns"
Sep 11 14:32:52.576630 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:52.576604    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b934e8-746b8dc7c4-m7zns"
Sep 11 14:32:52.625786 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:52.625750    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:52.867822 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:52.867779    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b934e8-746b8dc7c4-m7zns"]
Sep 11 14:32:52.869971 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:32:52.869947    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c7e6f7c_e408_4097_a5fd_2e5da6526e6e.slice/crio-33980c56233c7abcf380ce353e4662feb1c01705704dca30a19f710df17394b4 WatchSource:0}: Error finding container 33980c56233c7abcf380ce353e4662feb1c01705704dca30a19f710df17394b4: Status 404 returned error can't find the container with id 33980c56233c7abcf380ce353e4662feb1c01705704dca30a19f710df17394b4
Sep 11 14:32:53.826532 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:53.826198    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b934e8-746b8dc7c4-m7zns" event={"ID":"0c7e6f7c-e408-4097-a5fd-2e5da6526e6e","Type":"ContainerStarted","Data":"b1697f90136f4e037099f942f8e182138425cd141bea13e490f2b34bb79a1221"}
Sep 11 14:32:53.826532 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:53.826268    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b934e8-746b8dc7c4-m7zns" event={"ID":"0c7e6f7c-e408-4097-a5fd-2e5da6526e6e","Type":"ContainerStarted","Data":"33980c56233c7abcf380ce353e4662feb1c01705704dca30a19f710df17394b4"}
Sep 11 14:32:53.827035 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:53.826562    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b934e8-746b8dc7c4-m7zns"
Sep 11 14:32:53.859270 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:53.859217    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b934e8-746b8dc7c4-m7zns" podStartSLOduration=1.859202381 podStartE2EDuration="1.859202381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:32:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:32:53.857433918 +0000 UTC m=+1066.656068700" watchObservedRunningTime="2026-09-11 14:32:53.859202381 +0000 UTC m=+1066.657837206"
Sep 11 14:32:54.323079 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:54.323032    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:55.083168 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:55.083132    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:55.809988 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:55.809959    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:32:55.942223 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:55.942181    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:56.735491 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:56.735457    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:58.275215 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:58.275176    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:32:58.359625 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:32:58.359598    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:04.834833 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:04.834760    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b934e8-746b8dc7c4-m7zns"
Sep 11 14:33:06.292930 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:06.292897    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"]
Sep 11 14:33:06.296525 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:06.296500    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"
Sep 11 14:33:06.299129 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:06.299101    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-72e046\"/\"openshift-service-ca.crt\""
Sep 11 14:33:06.299993 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:06.299965    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-72e046\"/\"default-dockercfg-xd8jr\""
Sep 11 14:33:06.300164 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:06.300130    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-72e046\"/\"auth-test-model-72e046-kserve-self-signed-certs\""
Sep 11 14:33:06.300240 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:06.300155    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-72e046\"/\"kube-root-ca.crt\""
Sep 11 14:33:06.310150 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:06.310126    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"]
Sep 11 14:33:06.317944 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:06.317892    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:06.364035 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:06.364007    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v72bg\" (UniqueName: \"kubernetes.io/projected/24095eb5-1d1d-4265-b65e-83246736cf49-kube-api-access-v72bg\") pod \"auth-test-model-72e046-kserve-8bc5b5c95-lzgwf\" (UID: \"24095eb5-1d1d-4265-b65e-83246736cf49\") " pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"
Sep 11 14:33:06.364133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:06.364038    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24095eb5-1d1d-4265-b65e-83246736cf49-tls-certs\") pod \"auth-test-model-72e046-kserve-8bc5b5c95-lzgwf\" (UID: \"24095eb5-1d1d-4265-b65e-83246736cf49\") " pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"
Sep 11 14:33:06.364133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:06.364070    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24095eb5-1d1d-4265-b65e-83246736cf49-home\") pod \"auth-test-model-72e046-kserve-8bc5b5c95-lzgwf\" (UID: \"24095eb5-1d1d-4265-b65e-83246736cf49\") " pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"
Sep 11 14:33:06.364133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:06.364085    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24095eb5-1d1d-4265-b65e-83246736cf49-tmp-dir\") pod \"auth-test-model-72e046-kserve-8bc5b5c95-lzgwf\" (UID: \"24095eb5-1d1d-4265-b65e-83246736cf49\") " pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"
Sep 11 14:33:06.364255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:06.364150    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24095eb5-1d1d-4265-b65e-83246736cf49-dshm\") pod \"auth-test-model-72e046-kserve-8bc5b5c95-lzgwf\" (UID: \"24095eb5-1d1d-4265-b65e-83246736cf49\") " pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"
Sep 11 14:33:06.364255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:06.364183    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24095eb5-1d1d-4265-b65e-83246736cf49-model-cache\") pod \"auth-test-model-72e046-kserve-8bc5b5c95-lzgwf\" (UID: \"24095eb5-1d1d-4265-b65e-83246736cf49\") " pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"
Sep 11 14:33:06.465345 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:06.465300    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v72bg\" (UniqueName: \"kubernetes.io/projected/24095eb5-1d1d-4265-b65e-83246736cf49-kube-api-access-v72bg\") pod \"auth-test-model-72e046-kserve-8bc5b5c95-lzgwf\" (UID: \"24095eb5-1d1d-4265-b65e-83246736cf49\") " pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"
Sep 11 14:33:06.465490 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:06.465348    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24095eb5-1d1d-4265-b65e-83246736cf49-tls-certs\") pod \"auth-test-model-72e046-kserve-8bc5b5c95-lzgwf\" (UID: \"24095eb5-1d1d-4265-b65e-83246736cf49\") " pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"
Sep 11 14:33:06.465490 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:06.465385    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24095eb5-1d1d-4265-b65e-83246736cf49-home\") pod \"auth-test-model-72e046-kserve-8bc5b5c95-lzgwf\" (UID: \"24095eb5-1d1d-4265-b65e-83246736cf49\") " pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"
Sep 11 14:33:06.465490 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:06.465406    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24095eb5-1d1d-4265-b65e-83246736cf49-tmp-dir\") pod \"auth-test-model-72e046-kserve-8bc5b5c95-lzgwf\" (UID: \"24095eb5-1d1d-4265-b65e-83246736cf49\") " pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"
Sep 11 14:33:06.465490 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:06.465428    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24095eb5-1d1d-4265-b65e-83246736cf49-dshm\") pod \"auth-test-model-72e046-kserve-8bc5b5c95-lzgwf\" (UID: \"24095eb5-1d1d-4265-b65e-83246736cf49\") " pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"
Sep 11 14:33:06.465490 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:06.465458    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24095eb5-1d1d-4265-b65e-83246736cf49-model-cache\") pod \"auth-test-model-72e046-kserve-8bc5b5c95-lzgwf\" (UID: \"24095eb5-1d1d-4265-b65e-83246736cf49\") " pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"
Sep 11 14:33:06.465842 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:06.465816    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24095eb5-1d1d-4265-b65e-83246736cf49-home\") pod \"auth-test-model-72e046-kserve-8bc5b5c95-lzgwf\" (UID: \"24095eb5-1d1d-4265-b65e-83246736cf49\") " pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"
Sep 11 14:33:06.466029 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:06.465876    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24095eb5-1d1d-4265-b65e-83246736cf49-tmp-dir\") pod \"auth-test-model-72e046-kserve-8bc5b5c95-lzgwf\" (UID: \"24095eb5-1d1d-4265-b65e-83246736cf49\") " pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"
Sep 11 14:33:06.466120 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:06.466024    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24095eb5-1d1d-4265-b65e-83246736cf49-model-cache\") pod \"auth-test-model-72e046-kserve-8bc5b5c95-lzgwf\" (UID: \"24095eb5-1d1d-4265-b65e-83246736cf49\") " pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"
Sep 11 14:33:06.467735 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:06.467714    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24095eb5-1d1d-4265-b65e-83246736cf49-dshm\") pod \"auth-test-model-72e046-kserve-8bc5b5c95-lzgwf\" (UID: \"24095eb5-1d1d-4265-b65e-83246736cf49\") " pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"
Sep 11 14:33:06.468131 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:06.468106    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24095eb5-1d1d-4265-b65e-83246736cf49-tls-certs\") pod \"auth-test-model-72e046-kserve-8bc5b5c95-lzgwf\" (UID: \"24095eb5-1d1d-4265-b65e-83246736cf49\") " pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"
Sep 11 14:33:06.474172 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:06.474149    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v72bg\" (UniqueName: \"kubernetes.io/projected/24095eb5-1d1d-4265-b65e-83246736cf49-kube-api-access-v72bg\") pod \"auth-test-model-72e046-kserve-8bc5b5c95-lzgwf\" (UID: \"24095eb5-1d1d-4265-b65e-83246736cf49\") " pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"
Sep 11 14:33:06.606393 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:06.606324    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"
Sep 11 14:33:06.894936 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:06.894908    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"]
Sep 11 14:33:06.897500 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:33:06.897466    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24095eb5_1d1d_4265_b65e_83246736cf49.slice/crio-e74c069812f9f1be48b3b3f1875178d5f094cdba0f72640df124d1ff7e5c7a4f WatchSource:0}: Error finding container e74c069812f9f1be48b3b3f1875178d5f094cdba0f72640df124d1ff7e5c7a4f: Status 404 returned error can't find the container with id e74c069812f9f1be48b3b3f1875178d5f094cdba0f72640df124d1ff7e5c7a4f
Sep 11 14:33:07.908828 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:07.908790    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf" event={"ID":"24095eb5-1d1d-4265-b65e-83246736cf49","Type":"ContainerStarted","Data":"29ed7bdbd8c78f5b20c436ac898b46d04ff96815265337e4a2a1316329208050"}
Sep 11 14:33:07.909179 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:07.908847    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf" event={"ID":"24095eb5-1d1d-4265-b65e-83246736cf49","Type":"ContainerStarted","Data":"e74c069812f9f1be48b3b3f1875178d5f094cdba0f72640df124d1ff7e5c7a4f"}
Sep 11 14:33:07.929860 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:07.929811    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf" podStartSLOduration=1.929796369 podStartE2EDuration="1.929796369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:33:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:33:07.928202827 +0000 UTC m=+1080.726837610" watchObservedRunningTime="2026-09-11 14:33:07.929796369 +0000 UTC m=+1080.728431192"
Sep 11 14:33:09.699623 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:09.699595    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:33:12.724851 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:12.724814    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:14.344063 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:14.344025    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:14.588073 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:14.588035    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:14.981484 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:14.981453    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:15.151397 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:15.151369    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:15.370594 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:15.370565    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:15.462664 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:15.462634    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:16.032963 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:16.032927    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:16.606754 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:16.606722    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"
Sep 11 14:33:16.607197 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:16.606769    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"
Sep 11 14:33:16.619164 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:16.619133    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"
Sep 11 14:33:16.791686 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:16.791642    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:16.965972 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:16.965898    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"
Sep 11 14:33:18.214221 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:18.214186    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:18.735603 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:18.735561    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:18.822666 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:18.822612    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:19.271199 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:19.271167    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:20.209430 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:20.209395    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:20.964040 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:20.963990    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:21.702495 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:21.702461    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:21.771354 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:21.771321    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:21.872977 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:21.872939    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:22.215069 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:22.215040    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:22.338462 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:22.338431    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:22.443468 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:22.443436    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw"]
Sep 11 14:33:22.448461 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:22.448441    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw"
Sep 11 14:33:22.453545 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:33:22.453504    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"payload-processing-e2e-shared-b-w2-cd8e4a-dockercfg-k8mhz\" is forbidden: User \"system:node:ip-10-0-133-175.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-133-175.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-cd8e4a-dockercfg-k8mhz\"" type="*v1.Secret"
Sep 11 14:33:22.453545 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:33:22.453524    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw\" is forbidden: User \"system:node:ip-10-0-133-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-133-175.ec2.internal' and this object" podUID="217d55ad-149a-4640-b698-2770008e69b0" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw"
Sep 11 14:33:22.453737 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:33:22.453635    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"payload-processing-plugins-e2e-shared-b-w2-cd8e4a\" is forbidden: User \"system:node:ip-10-0-133-175.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-133-175.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-cd8e4a\"" type="*v1.ConfigMap"
Sep 11 14:33:22.470727 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:22.470652    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw"]
Sep 11 14:33:22.541361 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:22.541339    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-cd8e4a-bcc6b8cb5-nrjx5"]
Sep 11 14:33:22.544781 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:22.544765    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-cd8e4a-bcc6b8cb5-nrjx5"
Sep 11 14:33:22.559057 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:22.559037    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-cd8e4a-bcc6b8cb5-nrjx5"]
Sep 11 14:33:22.605862 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:22.605837    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lvhw\" (UniqueName: \"kubernetes.io/projected/217d55ad-149a-4640-b698-2770008e69b0-kube-api-access-4lvhw\") pod \"payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw\" (UID: \"217d55ad-149a-4640-b698-2770008e69b0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw"
Sep 11 14:33:22.606045 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:22.605917    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/217d55ad-149a-4640-b698-2770008e69b0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw\" (UID: \"217d55ad-149a-4640-b698-2770008e69b0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw"
Sep 11 14:33:22.706964 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:22.706930    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvn9w\" (UniqueName: \"kubernetes.io/projected/bb8d38ca-5021-4e76-8477-5df285f18fd0-kube-api-access-qvn9w\") pod \"payload-processing-e2e-shared-b-w2-cd8e4a-bcc6b8cb5-nrjx5\" (UID: \"bb8d38ca-5021-4e76-8477-5df285f18fd0\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-cd8e4a-bcc6b8cb5-nrjx5"
Sep 11 14:33:22.707116 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:22.706993    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lvhw\" (UniqueName: \"kubernetes.io/projected/217d55ad-149a-4640-b698-2770008e69b0-kube-api-access-4lvhw\") pod \"payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw\" (UID: \"217d55ad-149a-4640-b698-2770008e69b0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw"
Sep 11 14:33:22.707116 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:22.707021    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb8d38ca-5021-4e76-8477-5df285f18fd0-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-cd8e4a-bcc6b8cb5-nrjx5\" (UID: \"bb8d38ca-5021-4e76-8477-5df285f18fd0\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-cd8e4a-bcc6b8cb5-nrjx5"
Sep 11 14:33:22.707116 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:22.707061    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/217d55ad-149a-4640-b698-2770008e69b0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw\" (UID: \"217d55ad-149a-4640-b698-2770008e69b0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw"
Sep 11 14:33:22.719544 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:22.719513    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lvhw\" (UniqueName: \"kubernetes.io/projected/217d55ad-149a-4640-b698-2770008e69b0-kube-api-access-4lvhw\") pod \"payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw\" (UID: \"217d55ad-149a-4640-b698-2770008e69b0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw"
Sep 11 14:33:22.807459 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:22.807433    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvn9w\" (UniqueName: \"kubernetes.io/projected/bb8d38ca-5021-4e76-8477-5df285f18fd0-kube-api-access-qvn9w\") pod \"payload-processing-e2e-shared-b-w2-cd8e4a-bcc6b8cb5-nrjx5\" (UID: \"bb8d38ca-5021-4e76-8477-5df285f18fd0\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-cd8e4a-bcc6b8cb5-nrjx5"
Sep 11 14:33:22.807581 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:22.807475    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb8d38ca-5021-4e76-8477-5df285f18fd0-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-cd8e4a-bcc6b8cb5-nrjx5\" (UID: \"bb8d38ca-5021-4e76-8477-5df285f18fd0\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-cd8e4a-bcc6b8cb5-nrjx5"
Sep 11 14:33:22.818645 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:22.818616    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvn9w\" (UniqueName: \"kubernetes.io/projected/bb8d38ca-5021-4e76-8477-5df285f18fd0-kube-api-access-qvn9w\") pod \"payload-processing-e2e-shared-b-w2-cd8e4a-bcc6b8cb5-nrjx5\" (UID: \"bb8d38ca-5021-4e76-8477-5df285f18fd0\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-cd8e4a-bcc6b8cb5-nrjx5"
Sep 11 14:33:23.285633 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:23.285558    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-cd8e4a\""
Sep 11 14:33:23.288175 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:23.288148    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb8d38ca-5021-4e76-8477-5df285f18fd0-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-cd8e4a-bcc6b8cb5-nrjx5\" (UID: \"bb8d38ca-5021-4e76-8477-5df285f18fd0\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-cd8e4a-bcc6b8cb5-nrjx5"
Sep 11 14:33:23.288293 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:23.288192    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/217d55ad-149a-4640-b698-2770008e69b0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw\" (UID: \"217d55ad-149a-4640-b698-2770008e69b0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw"
Sep 11 14:33:23.768215 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:23.768180    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-cd8e4a-dockercfg-k8mhz\""
Sep 11 14:33:23.774737 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:23.774711    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-cd8e4a-bcc6b8cb5-nrjx5"
Sep 11 14:33:23.777922 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:23.777899    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw"
Sep 11 14:33:24.056903 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:24.056879    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-cd8e4a-bcc6b8cb5-nrjx5"]
Sep 11 14:33:24.059088 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:33:24.059061    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb8d38ca_5021_4e76_8477_5df285f18fd0.slice/crio-dd2f42ad1a57dfe43ffa8105a88c845d8c950241fd2bc060e4875ce97e33edcd WatchSource:0}: Error finding container dd2f42ad1a57dfe43ffa8105a88c845d8c950241fd2bc060e4875ce97e33edcd: Status 404 returned error can't find the container with id dd2f42ad1a57dfe43ffa8105a88c845d8c950241fd2bc060e4875ce97e33edcd
Sep 11 14:33:24.064980 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:24.064957    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw"]
Sep 11 14:33:24.066924 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:33:24.066896    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod217d55ad_149a_4640_b698_2770008e69b0.slice/crio-a933df36de588237b4207ee21a211dd95ca51620fd9ed7303e78b0f45e62ea81 WatchSource:0}: Error finding container a933df36de588237b4207ee21a211dd95ca51620fd9ed7303e78b0f45e62ea81: Status 404 returned error can't find the container with id a933df36de588237b4207ee21a211dd95ca51620fd9ed7303e78b0f45e62ea81
Sep 11 14:33:25.004926 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:25.004888    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-cd8e4a-bcc6b8cb5-nrjx5" event={"ID":"bb8d38ca-5021-4e76-8477-5df285f18fd0","Type":"ContainerStarted","Data":"20ecae8db1745c4de95a755ec660d4633e630ec732fc6910e8bd29719c7c0599"}
Sep 11 14:33:25.005338 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:25.004952    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-cd8e4a-bcc6b8cb5-nrjx5" event={"ID":"bb8d38ca-5021-4e76-8477-5df285f18fd0","Type":"ContainerStarted","Data":"dd2f42ad1a57dfe43ffa8105a88c845d8c950241fd2bc060e4875ce97e33edcd"}
Sep 11 14:33:25.005338 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:25.004986    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-cd8e4a-bcc6b8cb5-nrjx5"
Sep 11 14:33:25.006624 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:25.006590    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw" event={"ID":"217d55ad-149a-4640-b698-2770008e69b0","Type":"ContainerStarted","Data":"374b8abb96119e759a9f8b1d3407d32f83fe33a50983ae0f2ebb108c04a31558"}
Sep 11 14:33:25.006754 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:25.006650    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw" event={"ID":"217d55ad-149a-4640-b698-2770008e69b0","Type":"ContainerStarted","Data":"a933df36de588237b4207ee21a211dd95ca51620fd9ed7303e78b0f45e62ea81"}
Sep 11 14:33:25.006754 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:25.006708    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw"
Sep 11 14:33:25.070981 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:25.070942    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-cd8e4a-bcc6b8cb5-nrjx5" podStartSLOduration=3.070928153 podStartE2EDuration="3.070928153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:33:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:33:25.068785526 +0000 UTC m=+1097.867420309" watchObservedRunningTime="2026-09-11 14:33:25.070928153 +0000 UTC m=+1097.869562927"
Sep 11 14:33:25.304161 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:25.304120    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw" podStartSLOduration=3.304106228 podStartE2EDuration="3.304106228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:33:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:33:25.301445083 +0000 UTC m=+1098.100079866" watchObservedRunningTime="2026-09-11 14:33:25.304106228 +0000 UTC m=+1098.102741010"
Sep 11 14:33:30.783942 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:30.783911    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:33:36.014858 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:36.014817    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-cd8e4a-bcc6b8cb5-nrjx5"
Sep 11 14:33:36.015249 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:36.014974    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw"
Sep 11 14:33:45.159020 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:45.158945    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:45.259983 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:45.259949    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:46.005837 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:46.005800    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:46.077488 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:46.077459    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"]
Sep 11 14:33:46.081181 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:46.081157    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"
Sep 11 14:33:46.084500 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:46.084479    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-344045\"/\"default-dockercfg-nh856\""
Sep 11 14:33:46.084635 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:46.084529    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-344045\"/\"kube-root-ca.crt\""
Sep 11 14:33:46.084635 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:46.084529    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-344045\"/\"openshift-service-ca.crt\""
Sep 11 14:33:46.084821 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:46.084482    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-344045\"/\"auth-test-model-344045-kserve-self-signed-certs\""
Sep 11 14:33:46.092751 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:46.092731    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"]
Sep 11 14:33:46.113834 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:46.113798    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:46.193135 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:46.193109    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/936a3973-e603-4631-a881-cc51fed4a618-home\") pod \"auth-test-model-344045-kserve-54988886bc-bz67q\" (UID: \"936a3973-e603-4631-a881-cc51fed4a618\") " pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"
Sep 11 14:33:46.193472 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:46.193174    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/936a3973-e603-4631-a881-cc51fed4a618-tls-certs\") pod \"auth-test-model-344045-kserve-54988886bc-bz67q\" (UID: \"936a3973-e603-4631-a881-cc51fed4a618\") " pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"
Sep 11 14:33:46.193472 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:46.193210    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgfz2\" (UniqueName: \"kubernetes.io/projected/936a3973-e603-4631-a881-cc51fed4a618-kube-api-access-tgfz2\") pod \"auth-test-model-344045-kserve-54988886bc-bz67q\" (UID: \"936a3973-e603-4631-a881-cc51fed4a618\") " pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"
Sep 11 14:33:46.193472 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:46.193230    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/936a3973-e603-4631-a881-cc51fed4a618-tmp-dir\") pod \"auth-test-model-344045-kserve-54988886bc-bz67q\" (UID: \"936a3973-e603-4631-a881-cc51fed4a618\") " pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"
Sep 11 14:33:46.193472 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:46.193340    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/936a3973-e603-4631-a881-cc51fed4a618-dshm\") pod \"auth-test-model-344045-kserve-54988886bc-bz67q\" (UID: \"936a3973-e603-4631-a881-cc51fed4a618\") " pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"
Sep 11 14:33:46.193472 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:46.193366    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/936a3973-e603-4631-a881-cc51fed4a618-model-cache\") pod \"auth-test-model-344045-kserve-54988886bc-bz67q\" (UID: \"936a3973-e603-4631-a881-cc51fed4a618\") " pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"
Sep 11 14:33:46.294535 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:46.294502    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/936a3973-e603-4631-a881-cc51fed4a618-tls-certs\") pod \"auth-test-model-344045-kserve-54988886bc-bz67q\" (UID: \"936a3973-e603-4631-a881-cc51fed4a618\") " pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"
Sep 11 14:33:46.294723 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:46.294547    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgfz2\" (UniqueName: \"kubernetes.io/projected/936a3973-e603-4631-a881-cc51fed4a618-kube-api-access-tgfz2\") pod \"auth-test-model-344045-kserve-54988886bc-bz67q\" (UID: \"936a3973-e603-4631-a881-cc51fed4a618\") " pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"
Sep 11 14:33:46.294723 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:46.294575    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/936a3973-e603-4631-a881-cc51fed4a618-tmp-dir\") pod \"auth-test-model-344045-kserve-54988886bc-bz67q\" (UID: \"936a3973-e603-4631-a881-cc51fed4a618\") " pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"
Sep 11 14:33:46.294723 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:46.294647    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/936a3973-e603-4631-a881-cc51fed4a618-dshm\") pod \"auth-test-model-344045-kserve-54988886bc-bz67q\" (UID: \"936a3973-e603-4631-a881-cc51fed4a618\") " pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"
Sep 11 14:33:46.294723 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:46.294671    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/936a3973-e603-4631-a881-cc51fed4a618-model-cache\") pod \"auth-test-model-344045-kserve-54988886bc-bz67q\" (UID: \"936a3973-e603-4631-a881-cc51fed4a618\") " pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"
Sep 11 14:33:46.294919 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:46.294745    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/936a3973-e603-4631-a881-cc51fed4a618-home\") pod \"auth-test-model-344045-kserve-54988886bc-bz67q\" (UID: \"936a3973-e603-4631-a881-cc51fed4a618\") " pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"
Sep 11 14:33:46.295052 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:46.295029    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/936a3973-e603-4631-a881-cc51fed4a618-tmp-dir\") pod \"auth-test-model-344045-kserve-54988886bc-bz67q\" (UID: \"936a3973-e603-4631-a881-cc51fed4a618\") " pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"
Sep 11 14:33:46.295116 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:46.295065    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/936a3973-e603-4631-a881-cc51fed4a618-model-cache\") pod \"auth-test-model-344045-kserve-54988886bc-bz67q\" (UID: \"936a3973-e603-4631-a881-cc51fed4a618\") " pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"
Sep 11 14:33:46.295214 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:46.295194    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/936a3973-e603-4631-a881-cc51fed4a618-home\") pod \"auth-test-model-344045-kserve-54988886bc-bz67q\" (UID: \"936a3973-e603-4631-a881-cc51fed4a618\") " pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"
Sep 11 14:33:46.296937 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:46.296917    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/936a3973-e603-4631-a881-cc51fed4a618-dshm\") pod \"auth-test-model-344045-kserve-54988886bc-bz67q\" (UID: \"936a3973-e603-4631-a881-cc51fed4a618\") " pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"
Sep 11 14:33:46.297086 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:46.297071    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/936a3973-e603-4631-a881-cc51fed4a618-tls-certs\") pod \"auth-test-model-344045-kserve-54988886bc-bz67q\" (UID: \"936a3973-e603-4631-a881-cc51fed4a618\") " pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"
Sep 11 14:33:46.303879 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:46.303858    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgfz2\" (UniqueName: \"kubernetes.io/projected/936a3973-e603-4631-a881-cc51fed4a618-kube-api-access-tgfz2\") pod \"auth-test-model-344045-kserve-54988886bc-bz67q\" (UID: \"936a3973-e603-4631-a881-cc51fed4a618\") " pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"
Sep 11 14:33:46.394144 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:46.394114    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"
Sep 11 14:33:46.668236 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:46.668209    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"]
Sep 11 14:33:46.671107 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:33:46.671076    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod936a3973_e603_4631_a881_cc51fed4a618.slice/crio-b23c82eecc1a46f2212a49a38df954178bb0aea54306b246056636eb1039e1cb WatchSource:0}: Error finding container b23c82eecc1a46f2212a49a38df954178bb0aea54306b246056636eb1039e1cb: Status 404 returned error can't find the container with id b23c82eecc1a46f2212a49a38df954178bb0aea54306b246056636eb1039e1cb
Sep 11 14:33:46.799129 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:46.799069    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:47.132746 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:47.132710    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q" event={"ID":"936a3973-e603-4631-a881-cc51fed4a618","Type":"ContainerStarted","Data":"57806f61d2e6ff789a2e38dec61241e6677fff9eadf97b731cbb2b255d2c7eef"}
Sep 11 14:33:47.132746 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:47.132751    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q" event={"ID":"936a3973-e603-4631-a881-cc51fed4a618","Type":"ContainerStarted","Data":"b23c82eecc1a46f2212a49a38df954178bb0aea54306b246056636eb1039e1cb"}
Sep 11 14:33:47.941562 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:47.941525    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:48.840120 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:48.840075    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:50.299113 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:50.299056    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q" podStartSLOduration=4.299019921 podStartE2EDuration="4.299019921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:33:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:33:47.167112967 +0000 UTC m=+1119.965747749" watchObservedRunningTime="2026-09-11 14:33:50.299019921 +0000 UTC m=+1123.097654706"
Sep 11 14:33:50.300928 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:50.300905    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:33:55.147775 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:55.147741    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:55.502203 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:55.502111    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:55.893071 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:55.893033    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:56.394911 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:56.394878    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"
Sep 11 14:33:56.395334 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:56.395015    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"
Sep 11 14:33:56.407459 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:56.407435    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"
Sep 11 14:33:57.197806 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:57.197773    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"
Sep 11 14:33:58.648162 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:58.648131    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:58.850535 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:58.850503    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:58.946111 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:58.946026    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:33:59.779615 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:33:59.779582    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:34:00.820117 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:00.820073    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:34:01.571890 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:01.571850    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:34:02.482185 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:02.482156    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:34:02.584968 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:02.584929    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:34:02.648238 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:02.648199    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:34:02.986553 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:02.986517    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:34:03.087761 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:03.087719    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:34:03.101031 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:03.100999    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1c057e5e-5b6fd7cddb-hdcq8"]
Sep 11 14:34:03.106035 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:03.106013    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1c057e5e-5b6fd7cddb-hdcq8"
Sep 11 14:34:03.108767 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:03.108744    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-1c057e5e-dockercfg-jjfk7\""
Sep 11 14:34:03.108881 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:03.108763    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-1c057e5e\""
Sep 11 14:34:03.115409 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:03.115387    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1c057e5e-5b6fd7cddb-hdcq8"]
Sep 11 14:34:03.125323 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:03.125295    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1c057e5e-754f6554cc-tbmsf"]
Sep 11 14:34:03.129007 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:03.128990    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-1c057e5e-754f6554cc-tbmsf"
Sep 11 14:34:03.143693 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:03.143657    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1c057e5e-754f6554cc-tbmsf"]
Sep 11 14:34:03.237419 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:03.237342    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32bb6eee-ff17-4521-9204-e01b2f459c31-plugins-config-volume\") pod \"payload-processing-e2e-mt-1c057e5e-754f6554cc-tbmsf\" (UID: \"32bb6eee-ff17-4521-9204-e01b2f459c31\") " pod="openshift-ingress/payload-processing-e2e-mt-1c057e5e-754f6554cc-tbmsf"
Sep 11 14:34:03.237419 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:03.237387    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z22pf\" (UniqueName: \"kubernetes.io/projected/32bb6eee-ff17-4521-9204-e01b2f459c31-kube-api-access-z22pf\") pod \"payload-processing-e2e-mt-1c057e5e-754f6554cc-tbmsf\" (UID: \"32bb6eee-ff17-4521-9204-e01b2f459c31\") " pod="openshift-ingress/payload-processing-e2e-mt-1c057e5e-754f6554cc-tbmsf"
Sep 11 14:34:03.237608 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:03.237494    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8k6w\" (UniqueName: \"kubernetes.io/projected/95be7720-5963-4ba0-8d29-22ffae9ab29f-kube-api-access-b8k6w\") pod \"payload-pre-processing-e2e-mt-1c057e5e-5b6fd7cddb-hdcq8\" (UID: \"95be7720-5963-4ba0-8d29-22ffae9ab29f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1c057e5e-5b6fd7cddb-hdcq8"
Sep 11 14:34:03.237608 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:03.237524    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95be7720-5963-4ba0-8d29-22ffae9ab29f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1c057e5e-5b6fd7cddb-hdcq8\" (UID: \"95be7720-5963-4ba0-8d29-22ffae9ab29f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1c057e5e-5b6fd7cddb-hdcq8"
Sep 11 14:34:03.338202 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:03.338168    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8k6w\" (UniqueName: \"kubernetes.io/projected/95be7720-5963-4ba0-8d29-22ffae9ab29f-kube-api-access-b8k6w\") pod \"payload-pre-processing-e2e-mt-1c057e5e-5b6fd7cddb-hdcq8\" (UID: \"95be7720-5963-4ba0-8d29-22ffae9ab29f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1c057e5e-5b6fd7cddb-hdcq8"
Sep 11 14:34:03.338381 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:03.338210    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95be7720-5963-4ba0-8d29-22ffae9ab29f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1c057e5e-5b6fd7cddb-hdcq8\" (UID: \"95be7720-5963-4ba0-8d29-22ffae9ab29f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1c057e5e-5b6fd7cddb-hdcq8"
Sep 11 14:34:03.338451 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:03.338405    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32bb6eee-ff17-4521-9204-e01b2f459c31-plugins-config-volume\") pod \"payload-processing-e2e-mt-1c057e5e-754f6554cc-tbmsf\" (UID: \"32bb6eee-ff17-4521-9204-e01b2f459c31\") " pod="openshift-ingress/payload-processing-e2e-mt-1c057e5e-754f6554cc-tbmsf"
Sep 11 14:34:03.338507 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:03.338455    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z22pf\" (UniqueName: \"kubernetes.io/projected/32bb6eee-ff17-4521-9204-e01b2f459c31-kube-api-access-z22pf\") pod \"payload-processing-e2e-mt-1c057e5e-754f6554cc-tbmsf\" (UID: \"32bb6eee-ff17-4521-9204-e01b2f459c31\") " pod="openshift-ingress/payload-processing-e2e-mt-1c057e5e-754f6554cc-tbmsf"
Sep 11 14:34:03.338997 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:03.338977    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95be7720-5963-4ba0-8d29-22ffae9ab29f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1c057e5e-5b6fd7cddb-hdcq8\" (UID: \"95be7720-5963-4ba0-8d29-22ffae9ab29f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1c057e5e-5b6fd7cddb-hdcq8"
Sep 11 14:34:03.339079 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:03.339059    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32bb6eee-ff17-4521-9204-e01b2f459c31-plugins-config-volume\") pod \"payload-processing-e2e-mt-1c057e5e-754f6554cc-tbmsf\" (UID: \"32bb6eee-ff17-4521-9204-e01b2f459c31\") " pod="openshift-ingress/payload-processing-e2e-mt-1c057e5e-754f6554cc-tbmsf"
Sep 11 14:34:03.347119 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:03.347096    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z22pf\" (UniqueName: \"kubernetes.io/projected/32bb6eee-ff17-4521-9204-e01b2f459c31-kube-api-access-z22pf\") pod \"payload-processing-e2e-mt-1c057e5e-754f6554cc-tbmsf\" (UID: \"32bb6eee-ff17-4521-9204-e01b2f459c31\") " pod="openshift-ingress/payload-processing-e2e-mt-1c057e5e-754f6554cc-tbmsf"
Sep 11 14:34:03.347587 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:03.347567    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8k6w\" (UniqueName: \"kubernetes.io/projected/95be7720-5963-4ba0-8d29-22ffae9ab29f-kube-api-access-b8k6w\") pod \"payload-pre-processing-e2e-mt-1c057e5e-5b6fd7cddb-hdcq8\" (UID: \"95be7720-5963-4ba0-8d29-22ffae9ab29f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1c057e5e-5b6fd7cddb-hdcq8"
Sep 11 14:34:03.418352 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:03.418320    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1c057e5e-5b6fd7cddb-hdcq8"
Sep 11 14:34:03.440058 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:03.439553    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-1c057e5e-754f6554cc-tbmsf"
Sep 11 14:34:03.705948 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:03.705911    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1c057e5e-5b6fd7cddb-hdcq8"]
Sep 11 14:34:03.707567 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:34:03.707538    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95be7720_5963_4ba0_8d29_22ffae9ab29f.slice/crio-1b7e2f20e499c605228133a7e96c87cc0c9b12d9c8fded54c1b6feddc14c1fc2 WatchSource:0}: Error finding container 1b7e2f20e499c605228133a7e96c87cc0c9b12d9c8fded54c1b6feddc14c1fc2: Status 404 returned error can't find the container with id 1b7e2f20e499c605228133a7e96c87cc0c9b12d9c8fded54c1b6feddc14c1fc2
Sep 11 14:34:03.732212 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:03.732188    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1c057e5e-754f6554cc-tbmsf"]
Sep 11 14:34:03.743847 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:34:03.743822    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32bb6eee_ff17_4521_9204_e01b2f459c31.slice/crio-0c6a36aa1ce9068976046e60afe50dc30b72a868c49daf5017f118740c5f3d2f WatchSource:0}: Error finding container 0c6a36aa1ce9068976046e60afe50dc30b72a868c49daf5017f118740c5f3d2f: Status 404 returned error can't find the container with id 0c6a36aa1ce9068976046e60afe50dc30b72a868c49daf5017f118740c5f3d2f
Sep 11 14:34:04.229883 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:04.229837    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1c057e5e-5b6fd7cddb-hdcq8" event={"ID":"95be7720-5963-4ba0-8d29-22ffae9ab29f","Type":"ContainerStarted","Data":"128d6254b22b0a483c467e765b277a773125380a90ac901b91532d0c7d4e0719"}
Sep 11 14:34:04.230097 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:04.229904    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1c057e5e-5b6fd7cddb-hdcq8" event={"ID":"95be7720-5963-4ba0-8d29-22ffae9ab29f","Type":"ContainerStarted","Data":"1b7e2f20e499c605228133a7e96c87cc0c9b12d9c8fded54c1b6feddc14c1fc2"}
Sep 11 14:34:04.230097 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:04.229947    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-1c057e5e-5b6fd7cddb-hdcq8"
Sep 11 14:34:04.231516 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:04.231491    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-1c057e5e-754f6554cc-tbmsf" event={"ID":"32bb6eee-ff17-4521-9204-e01b2f459c31","Type":"ContainerStarted","Data":"7ce30b9fb69ebd81da81c89896d7e458d922542cf1004882bfc44460048e9188"}
Sep 11 14:34:04.231642 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:04.231540    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-1c057e5e-754f6554cc-tbmsf"
Sep 11 14:34:04.231642 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:04.231563    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-1c057e5e-754f6554cc-tbmsf" event={"ID":"32bb6eee-ff17-4521-9204-e01b2f459c31","Type":"ContainerStarted","Data":"0c6a36aa1ce9068976046e60afe50dc30b72a868c49daf5017f118740c5f3d2f"}
Sep 11 14:34:04.253454 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:04.253392    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-1c057e5e-5b6fd7cddb-hdcq8" podStartSLOduration=1.253373267 podStartE2EDuration="1.253373267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:34:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:34:04.250362533 +0000 UTC m=+1137.048997314" watchObservedRunningTime="2026-09-11 14:34:04.253373267 +0000 UTC m=+1137.052008054"
Sep 11 14:34:04.270211 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:04.270165    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-1c057e5e-754f6554cc-tbmsf" podStartSLOduration=1.270150359 podStartE2EDuration="1.270150359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:34:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:34:04.269142258 +0000 UTC m=+1137.067777039" watchObservedRunningTime="2026-09-11 14:34:04.270150359 +0000 UTC m=+1137.068785140"
Sep 11 14:34:06.839770 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:06.839728    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:34:06.907585 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:06.907549    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:34:07.774901 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:07.774870    2584 scope.go:117] "RemoveContainer" containerID="3d5cf89be103cf7cb4dd90bacfeb179b388fc1d8dfa3ea09228c894deaa69d4d"
Sep 11 14:34:07.783375 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:07.783351    2584 scope.go:117] "RemoveContainer" containerID="f5a494065779cbfb1328feb1de666fa03b6aa02e7c802a2cb5ce723b23b93c36"
Sep 11 14:34:09.705604 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:09.705573    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:34:15.242224 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:15.242192    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-1c057e5e-5b6fd7cddb-hdcq8"
Sep 11 14:34:15.242657 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:15.242388    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-1c057e5e-754f6554cc-tbmsf"
Sep 11 14:34:18.452021 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:18.451989    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:34:22.491697 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:22.491649    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:34:24.726313 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:24.726279    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:34:25.613882 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:25.613847    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:34:26.870276 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:26.870227    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:34:27.718083 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:27.718049    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:34:28.514156 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:28.514122    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:34:29.231451 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:29.231406    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:34:29.723902 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:29.723863    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:34:38.677050 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:38.677004    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:34:39.647664 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:39.647630    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:34:43.067792 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:43.067755    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:34:51.576359 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:51.576321    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:34:51.642142 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:51.642086    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:34:54.899089 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:34:54.899047    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:35:14.824016 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:14.823981    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:35:15.694388 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:15.694349    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:35:15.710702 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:15.710661    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:35:16.397253 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:16.397218    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:35:17.509107 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:17.509073    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:35:18.437802 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:18.437766    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:35:19.320662 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:19.320630    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:35:20.105280 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:20.105247    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:35:30.361817 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.361775    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:35:30.398312 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.398278    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1c057e5e-754f6554cc-tbmsf"]
Sep 11 14:35:30.398609 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.398580    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-1c057e5e-754f6554cc-tbmsf" podUID="32bb6eee-ff17-4521-9204-e01b2f459c31" containerName="payload-processing" containerID="cri-o://7ce30b9fb69ebd81da81c89896d7e458d922542cf1004882bfc44460048e9188" gracePeriod=30
Sep 11 14:35:30.407483 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.407455    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1c057e5e-5b6fd7cddb-hdcq8"]
Sep 11 14:35:30.407706 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.407644    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-1c057e5e-5b6fd7cddb-hdcq8" podUID="95be7720-5963-4ba0-8d29-22ffae9ab29f" containerName="payload-pre-processing" containerID="cri-o://128d6254b22b0a483c467e765b277a773125380a90ac901b91532d0c7d4e0719" gracePeriod=30
Sep 11 14:35:30.451496 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.451470    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:35:30.515535 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.515506    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:35:30.612369 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.612288    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:35:30.671825 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.671803    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-1c057e5e-754f6554cc-tbmsf"
Sep 11 14:35:30.695492 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.695458    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:35:30.698550 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.698501    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1c057e5e-5b6fd7cddb-hdcq8"
Sep 11 14:35:30.705365 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.705335    2584 generic.go:356] "Generic (PLEG): container finished" podID="95be7720-5963-4ba0-8d29-22ffae9ab29f" containerID="128d6254b22b0a483c467e765b277a773125380a90ac901b91532d0c7d4e0719" exitCode=0
Sep 11 14:35:30.705365 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.705358    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1c057e5e-5b6fd7cddb-hdcq8"
Sep 11 14:35:30.705532 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.705422    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1c057e5e-5b6fd7cddb-hdcq8" event={"ID":"95be7720-5963-4ba0-8d29-22ffae9ab29f","Type":"ContainerDied","Data":"128d6254b22b0a483c467e765b277a773125380a90ac901b91532d0c7d4e0719"}
Sep 11 14:35:30.705532 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.705478    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1c057e5e-5b6fd7cddb-hdcq8" event={"ID":"95be7720-5963-4ba0-8d29-22ffae9ab29f","Type":"ContainerDied","Data":"1b7e2f20e499c605228133a7e96c87cc0c9b12d9c8fded54c1b6feddc14c1fc2"}
Sep 11 14:35:30.705532 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.705510    2584 scope.go:117] "RemoveContainer" containerID="128d6254b22b0a483c467e765b277a773125380a90ac901b91532d0c7d4e0719"
Sep 11 14:35:30.707088 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.706977    2584 generic.go:356] "Generic (PLEG): container finished" podID="32bb6eee-ff17-4521-9204-e01b2f459c31" containerID="7ce30b9fb69ebd81da81c89896d7e458d922542cf1004882bfc44460048e9188" exitCode=0
Sep 11 14:35:30.707088 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.707015    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-1c057e5e-754f6554cc-tbmsf"
Sep 11 14:35:30.707088 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.707060    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-1c057e5e-754f6554cc-tbmsf" event={"ID":"32bb6eee-ff17-4521-9204-e01b2f459c31","Type":"ContainerDied","Data":"7ce30b9fb69ebd81da81c89896d7e458d922542cf1004882bfc44460048e9188"}
Sep 11 14:35:30.707243 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.707123    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-1c057e5e-754f6554cc-tbmsf" event={"ID":"32bb6eee-ff17-4521-9204-e01b2f459c31","Type":"ContainerDied","Data":"0c6a36aa1ce9068976046e60afe50dc30b72a868c49daf5017f118740c5f3d2f"}
Sep 11 14:35:30.715603 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.715585    2584 scope.go:117] "RemoveContainer" containerID="128d6254b22b0a483c467e765b277a773125380a90ac901b91532d0c7d4e0719"
Sep 11 14:35:30.715900 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:35:30.715879    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"128d6254b22b0a483c467e765b277a773125380a90ac901b91532d0c7d4e0719\": container with ID starting with 128d6254b22b0a483c467e765b277a773125380a90ac901b91532d0c7d4e0719 not found: ID does not exist" containerID="128d6254b22b0a483c467e765b277a773125380a90ac901b91532d0c7d4e0719"
Sep 11 14:35:30.715972 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.715906    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"128d6254b22b0a483c467e765b277a773125380a90ac901b91532d0c7d4e0719"} err="failed to get container status \"128d6254b22b0a483c467e765b277a773125380a90ac901b91532d0c7d4e0719\": rpc error: code = NotFound desc = could not find container \"128d6254b22b0a483c467e765b277a773125380a90ac901b91532d0c7d4e0719\": container with ID starting with 128d6254b22b0a483c467e765b277a773125380a90ac901b91532d0c7d4e0719 not found: ID does not exist"
Sep 11 14:35:30.715972 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.715922    2584 scope.go:117] "RemoveContainer" containerID="7ce30b9fb69ebd81da81c89896d7e458d922542cf1004882bfc44460048e9188"
Sep 11 14:35:30.727050 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.727027    2584 scope.go:117] "RemoveContainer" containerID="7ce30b9fb69ebd81da81c89896d7e458d922542cf1004882bfc44460048e9188"
Sep 11 14:35:30.727346 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:35:30.727319    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ce30b9fb69ebd81da81c89896d7e458d922542cf1004882bfc44460048e9188\": container with ID starting with 7ce30b9fb69ebd81da81c89896d7e458d922542cf1004882bfc44460048e9188 not found: ID does not exist" containerID="7ce30b9fb69ebd81da81c89896d7e458d922542cf1004882bfc44460048e9188"
Sep 11 14:35:30.727450 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.727354    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ce30b9fb69ebd81da81c89896d7e458d922542cf1004882bfc44460048e9188"} err="failed to get container status \"7ce30b9fb69ebd81da81c89896d7e458d922542cf1004882bfc44460048e9188\": rpc error: code = NotFound desc = could not find container \"7ce30b9fb69ebd81da81c89896d7e458d922542cf1004882bfc44460048e9188\": container with ID starting with 7ce30b9fb69ebd81da81c89896d7e458d922542cf1004882bfc44460048e9188 not found: ID does not exist"
Sep 11 14:35:30.782154 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.782126    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32bb6eee-ff17-4521-9204-e01b2f459c31-plugins-config-volume\") pod \"32bb6eee-ff17-4521-9204-e01b2f459c31\" (UID: \"32bb6eee-ff17-4521-9204-e01b2f459c31\") "
Sep 11 14:35:30.782251 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.782160    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95be7720-5963-4ba0-8d29-22ffae9ab29f-plugins-config-volume\") pod \"95be7720-5963-4ba0-8d29-22ffae9ab29f\" (UID: \"95be7720-5963-4ba0-8d29-22ffae9ab29f\") "
Sep 11 14:35:30.782251 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.782216    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z22pf\" (UniqueName: \"kubernetes.io/projected/32bb6eee-ff17-4521-9204-e01b2f459c31-kube-api-access-z22pf\") pod \"32bb6eee-ff17-4521-9204-e01b2f459c31\" (UID: \"32bb6eee-ff17-4521-9204-e01b2f459c31\") "
Sep 11 14:35:30.782335 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.782285    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8k6w\" (UniqueName: \"kubernetes.io/projected/95be7720-5963-4ba0-8d29-22ffae9ab29f-kube-api-access-b8k6w\") pod \"95be7720-5963-4ba0-8d29-22ffae9ab29f\" (UID: \"95be7720-5963-4ba0-8d29-22ffae9ab29f\") "
Sep 11 14:35:30.782571 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.782546    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32bb6eee-ff17-4521-9204-e01b2f459c31-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "32bb6eee-ff17-4521-9204-e01b2f459c31" (UID: "32bb6eee-ff17-4521-9204-e01b2f459c31"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:35:30.782641 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.782583    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95be7720-5963-4ba0-8d29-22ffae9ab29f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "95be7720-5963-4ba0-8d29-22ffae9ab29f" (UID: "95be7720-5963-4ba0-8d29-22ffae9ab29f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:35:30.782773 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.782752    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32bb6eee-ff17-4521-9204-e01b2f459c31-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:35:30.782850 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.782778    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95be7720-5963-4ba0-8d29-22ffae9ab29f-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:35:30.784358 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.784335    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32bb6eee-ff17-4521-9204-e01b2f459c31-kube-api-access-z22pf" (OuterVolumeSpecName: "kube-api-access-z22pf") pod "32bb6eee-ff17-4521-9204-e01b2f459c31" (UID: "32bb6eee-ff17-4521-9204-e01b2f459c31"). InnerVolumeSpecName "kube-api-access-z22pf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:35:30.784444 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.784377    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95be7720-5963-4ba0-8d29-22ffae9ab29f-kube-api-access-b8k6w" (OuterVolumeSpecName: "kube-api-access-b8k6w") pod "95be7720-5963-4ba0-8d29-22ffae9ab29f" (UID: "95be7720-5963-4ba0-8d29-22ffae9ab29f"). InnerVolumeSpecName "kube-api-access-b8k6w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:35:30.883796 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.883737    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z22pf\" (UniqueName: \"kubernetes.io/projected/32bb6eee-ff17-4521-9204-e01b2f459c31-kube-api-access-z22pf\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:35:30.883796 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:30.883758    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8k6w\" (UniqueName: \"kubernetes.io/projected/95be7720-5963-4ba0-8d29-22ffae9ab29f-kube-api-access-b8k6w\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:35:31.049427 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:31.049391    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1c057e5e-5b6fd7cddb-hdcq8"]
Sep 11 14:35:31.055986 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:31.055964    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1c057e5e-5b6fd7cddb-hdcq8"]
Sep 11 14:35:31.095376 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:31.095337    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1c057e5e-754f6554cc-tbmsf"]
Sep 11 14:35:31.100144 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:31.100118    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1c057e5e-754f6554cc-tbmsf"]
Sep 11 14:35:31.109699 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:31.109648    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:35:31.680009 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:31.679929    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32bb6eee-ff17-4521-9204-e01b2f459c31" path="/var/lib/kubelet/pods/32bb6eee-ff17-4521-9204-e01b2f459c31/volumes"
Sep 11 14:35:31.680343 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:31.680284    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95be7720-5963-4ba0-8d29-22ffae9ab29f" path="/var/lib/kubelet/pods/95be7720-5963-4ba0-8d29-22ffae9ab29f/volumes"
Sep 11 14:35:32.194957 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:32.194922    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:35:33.206041 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:33.206003    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:35:34.005493 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:34.005465    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:35:34.175041 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:34.175008    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:35:34.310457 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:34.310433    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:35:35.173984 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:35.173956    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:35:39.226041 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:39.226008    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:35:51.691536 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:35:51.691503    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:36:06.497518 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:06.497433    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:36:06.814646 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:06.814614    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"]
Sep 11 14:36:06.835743 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:06.835712    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:36:07.815086 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:07.815058    2584 scope.go:117] "RemoveContainer" containerID="94200f2f6a38b41215d8c33a458125b6cb94abfed56c11356ef4e884933d731b"
Sep 11 14:36:07.823907 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:07.823887    2584 scope.go:117] "RemoveContainer" containerID="48f2fb6e32b2662588cee3275d74ef3d45e70316b9a65ae87d86e2ecf47befa5"
Sep 11 14:36:07.831653 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:07.831622    2584 scope.go:117] "RemoveContainer" containerID="3e070aefa8bbb81e8e2ede6316da3e4b23227d1421fe49ec9d6914a5e6cc20e9"
Sep 11 14:36:07.878610 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:07.878580    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"]
Sep 11 14:36:07.908344 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:07.908304    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:36:15.378628 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:15.378592    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:36:16.905782 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:16.905741    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:36:20.106233 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:20.106196    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:36:20.523639 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:20.523550    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:36:21.835421 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:21.835361    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf" podUID="24095eb5-1d1d-4265-b65e-83246736cf49" containerName="main" containerID="cri-o://29ed7bdbd8c78f5b20c436ac898b46d04ff96815265337e4a2a1316329208050" gracePeriod=45
Sep 11 14:36:21.981290 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:21.981247    2584 generic.go:356] "Generic (PLEG): container finished" podID="24095eb5-1d1d-4265-b65e-83246736cf49" containerID="29ed7bdbd8c78f5b20c436ac898b46d04ff96815265337e4a2a1316329208050" exitCode=0
Sep 11 14:36:21.981491 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:21.981293    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf" event={"ID":"24095eb5-1d1d-4265-b65e-83246736cf49","Type":"ContainerDied","Data":"29ed7bdbd8c78f5b20c436ac898b46d04ff96815265337e4a2a1316329208050"}
Sep 11 14:36:22.099542 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:22.099476    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"
Sep 11 14:36:22.120545 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:22.120479    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v72bg\" (UniqueName: \"kubernetes.io/projected/24095eb5-1d1d-4265-b65e-83246736cf49-kube-api-access-v72bg\") pod \"24095eb5-1d1d-4265-b65e-83246736cf49\" (UID: \"24095eb5-1d1d-4265-b65e-83246736cf49\") "
Sep 11 14:36:22.120545 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:22.120540    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24095eb5-1d1d-4265-b65e-83246736cf49-dshm\") pod \"24095eb5-1d1d-4265-b65e-83246736cf49\" (UID: \"24095eb5-1d1d-4265-b65e-83246736cf49\") "
Sep 11 14:36:22.120813 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:22.120569    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24095eb5-1d1d-4265-b65e-83246736cf49-tmp-dir\") pod \"24095eb5-1d1d-4265-b65e-83246736cf49\" (UID: \"24095eb5-1d1d-4265-b65e-83246736cf49\") "
Sep 11 14:36:22.120813 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:22.120650    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24095eb5-1d1d-4265-b65e-83246736cf49-model-cache\") pod \"24095eb5-1d1d-4265-b65e-83246736cf49\" (UID: \"24095eb5-1d1d-4265-b65e-83246736cf49\") "
Sep 11 14:36:22.120813 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:22.120692    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24095eb5-1d1d-4265-b65e-83246736cf49-tls-certs\") pod \"24095eb5-1d1d-4265-b65e-83246736cf49\" (UID: \"24095eb5-1d1d-4265-b65e-83246736cf49\") "
Sep 11 14:36:22.120813 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:22.120745    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24095eb5-1d1d-4265-b65e-83246736cf49-home\") pod \"24095eb5-1d1d-4265-b65e-83246736cf49\" (UID: \"24095eb5-1d1d-4265-b65e-83246736cf49\") "
Sep 11 14:36:22.121040 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:22.120910    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24095eb5-1d1d-4265-b65e-83246736cf49-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "24095eb5-1d1d-4265-b65e-83246736cf49" (UID: "24095eb5-1d1d-4265-b65e-83246736cf49"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:36:22.121096 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:22.121052    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24095eb5-1d1d-4265-b65e-83246736cf49-tmp-dir\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:36:22.121171 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:22.121122    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24095eb5-1d1d-4265-b65e-83246736cf49-home" (OuterVolumeSpecName: "home") pod "24095eb5-1d1d-4265-b65e-83246736cf49" (UID: "24095eb5-1d1d-4265-b65e-83246736cf49"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:36:22.121330 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:22.121302    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24095eb5-1d1d-4265-b65e-83246736cf49-model-cache" (OuterVolumeSpecName: "model-cache") pod "24095eb5-1d1d-4265-b65e-83246736cf49" (UID: "24095eb5-1d1d-4265-b65e-83246736cf49"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:36:22.122980 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:22.122953    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24095eb5-1d1d-4265-b65e-83246736cf49-kube-api-access-v72bg" (OuterVolumeSpecName: "kube-api-access-v72bg") pod "24095eb5-1d1d-4265-b65e-83246736cf49" (UID: "24095eb5-1d1d-4265-b65e-83246736cf49"). InnerVolumeSpecName "kube-api-access-v72bg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:36:22.123232 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:22.123206    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24095eb5-1d1d-4265-b65e-83246736cf49-dshm" (OuterVolumeSpecName: "dshm") pod "24095eb5-1d1d-4265-b65e-83246736cf49" (UID: "24095eb5-1d1d-4265-b65e-83246736cf49"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:36:22.123287 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:22.123207    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24095eb5-1d1d-4265-b65e-83246736cf49-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "24095eb5-1d1d-4265-b65e-83246736cf49" (UID: "24095eb5-1d1d-4265-b65e-83246736cf49"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:36:22.222035 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:22.221994    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24095eb5-1d1d-4265-b65e-83246736cf49-model-cache\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:36:22.222035 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:22.222029    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24095eb5-1d1d-4265-b65e-83246736cf49-tls-certs\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:36:22.222035 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:22.222038    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24095eb5-1d1d-4265-b65e-83246736cf49-home\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:36:22.222269 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:22.222047    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v72bg\" (UniqueName: \"kubernetes.io/projected/24095eb5-1d1d-4265-b65e-83246736cf49-kube-api-access-v72bg\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:36:22.222269 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:22.222056    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24095eb5-1d1d-4265-b65e-83246736cf49-dshm\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:36:22.897441 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:22.897398    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q" podUID="936a3973-e603-4631-a881-cc51fed4a618" containerName="main" containerID="cri-o://57806f61d2e6ff789a2e38dec61241e6677fff9eadf97b731cbb2b255d2c7eef" gracePeriod=45
Sep 11 14:36:22.989284 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:22.989253    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"
Sep 11 14:36:22.989454 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:22.989285    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf" event={"ID":"24095eb5-1d1d-4265-b65e-83246736cf49","Type":"ContainerDied","Data":"e74c069812f9f1be48b3b3f1875178d5f094cdba0f72640df124d1ff7e5c7a4f"}
Sep 11 14:36:22.989454 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:22.989341    2584 scope.go:117] "RemoveContainer" containerID="29ed7bdbd8c78f5b20c436ac898b46d04ff96815265337e4a2a1316329208050"
Sep 11 14:36:23.012319 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:23.012256    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"]
Sep 11 14:36:23.017970 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:23.017943    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-72e046/auth-test-model-72e046-kserve-8bc5b5c95-lzgwf"]
Sep 11 14:36:23.160105 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:23.160047    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"
Sep 11 14:36:23.231313 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:23.231279    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/936a3973-e603-4631-a881-cc51fed4a618-model-cache\") pod \"936a3973-e603-4631-a881-cc51fed4a618\" (UID: \"936a3973-e603-4631-a881-cc51fed4a618\") "
Sep 11 14:36:23.231466 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:23.231321    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/936a3973-e603-4631-a881-cc51fed4a618-dshm\") pod \"936a3973-e603-4631-a881-cc51fed4a618\" (UID: \"936a3973-e603-4631-a881-cc51fed4a618\") "
Sep 11 14:36:23.231466 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:23.231345    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/936a3973-e603-4631-a881-cc51fed4a618-tls-certs\") pod \"936a3973-e603-4631-a881-cc51fed4a618\" (UID: \"936a3973-e603-4631-a881-cc51fed4a618\") "
Sep 11 14:36:23.231466 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:23.231410    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/936a3973-e603-4631-a881-cc51fed4a618-tmp-dir\") pod \"936a3973-e603-4631-a881-cc51fed4a618\" (UID: \"936a3973-e603-4631-a881-cc51fed4a618\") "
Sep 11 14:36:23.231466 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:23.231452    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/936a3973-e603-4631-a881-cc51fed4a618-home\") pod \"936a3973-e603-4631-a881-cc51fed4a618\" (UID: \"936a3973-e603-4631-a881-cc51fed4a618\") "
Sep 11 14:36:23.231707 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:23.231481    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgfz2\" (UniqueName: \"kubernetes.io/projected/936a3973-e603-4631-a881-cc51fed4a618-kube-api-access-tgfz2\") pod \"936a3973-e603-4631-a881-cc51fed4a618\" (UID: \"936a3973-e603-4631-a881-cc51fed4a618\") "
Sep 11 14:36:23.231707 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:23.231543    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/936a3973-e603-4631-a881-cc51fed4a618-model-cache" (OuterVolumeSpecName: "model-cache") pod "936a3973-e603-4631-a881-cc51fed4a618" (UID: "936a3973-e603-4631-a881-cc51fed4a618"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:36:23.231814 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:23.231748    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/936a3973-e603-4631-a881-cc51fed4a618-home" (OuterVolumeSpecName: "home") pod "936a3973-e603-4631-a881-cc51fed4a618" (UID: "936a3973-e603-4631-a881-cc51fed4a618"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:36:23.231814 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:23.231762    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/936a3973-e603-4631-a881-cc51fed4a618-model-cache\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:36:23.231814 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:23.231766    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/936a3973-e603-4631-a881-cc51fed4a618-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "936a3973-e603-4631-a881-cc51fed4a618" (UID: "936a3973-e603-4631-a881-cc51fed4a618"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:36:23.233708 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:23.233665    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/936a3973-e603-4631-a881-cc51fed4a618-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "936a3973-e603-4631-a881-cc51fed4a618" (UID: "936a3973-e603-4631-a881-cc51fed4a618"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:36:23.233820 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:23.233745    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/936a3973-e603-4631-a881-cc51fed4a618-dshm" (OuterVolumeSpecName: "dshm") pod "936a3973-e603-4631-a881-cc51fed4a618" (UID: "936a3973-e603-4631-a881-cc51fed4a618"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:36:23.233820 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:23.233796    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/936a3973-e603-4631-a881-cc51fed4a618-kube-api-access-tgfz2" (OuterVolumeSpecName: "kube-api-access-tgfz2") pod "936a3973-e603-4631-a881-cc51fed4a618" (UID: "936a3973-e603-4631-a881-cc51fed4a618"). InnerVolumeSpecName "kube-api-access-tgfz2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:36:23.282353 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:23.282321    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:36:23.332301 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:23.332270    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/936a3973-e603-4631-a881-cc51fed4a618-tmp-dir\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:36:23.332301 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:23.332296    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/936a3973-e603-4631-a881-cc51fed4a618-home\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:36:23.332301 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:23.332306    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgfz2\" (UniqueName: \"kubernetes.io/projected/936a3973-e603-4631-a881-cc51fed4a618-kube-api-access-tgfz2\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:36:23.332503 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:23.332316    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/936a3973-e603-4631-a881-cc51fed4a618-dshm\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:36:23.332503 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:23.332324    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/936a3973-e603-4631-a881-cc51fed4a618-tls-certs\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:36:23.381180 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:23.381137    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:36:23.633061 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:23.633013    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:36:23.679514 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:23.679478    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24095eb5-1d1d-4265-b65e-83246736cf49" path="/var/lib/kubelet/pods/24095eb5-1d1d-4265-b65e-83246736cf49/volumes"
Sep 11 14:36:23.998939 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:23.998841    2584 generic.go:356] "Generic (PLEG): container finished" podID="936a3973-e603-4631-a881-cc51fed4a618" containerID="57806f61d2e6ff789a2e38dec61241e6677fff9eadf97b731cbb2b255d2c7eef" exitCode=0
Sep 11 14:36:23.998939 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:23.998893    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"
Sep 11 14:36:23.999441 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:23.998931    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q" event={"ID":"936a3973-e603-4631-a881-cc51fed4a618","Type":"ContainerDied","Data":"57806f61d2e6ff789a2e38dec61241e6677fff9eadf97b731cbb2b255d2c7eef"}
Sep 11 14:36:23.999441 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:23.998975    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q" event={"ID":"936a3973-e603-4631-a881-cc51fed4a618","Type":"ContainerDied","Data":"b23c82eecc1a46f2212a49a38df954178bb0aea54306b246056636eb1039e1cb"}
Sep 11 14:36:23.999441 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:23.998993    2584 scope.go:117] "RemoveContainer" containerID="57806f61d2e6ff789a2e38dec61241e6677fff9eadf97b731cbb2b255d2c7eef"
Sep 11 14:36:24.007997 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:24.007973    2584 scope.go:117] "RemoveContainer" containerID="57806f61d2e6ff789a2e38dec61241e6677fff9eadf97b731cbb2b255d2c7eef"
Sep 11 14:36:24.008249 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:36:24.008230    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57806f61d2e6ff789a2e38dec61241e6677fff9eadf97b731cbb2b255d2c7eef\": container with ID starting with 57806f61d2e6ff789a2e38dec61241e6677fff9eadf97b731cbb2b255d2c7eef not found: ID does not exist" containerID="57806f61d2e6ff789a2e38dec61241e6677fff9eadf97b731cbb2b255d2c7eef"
Sep 11 14:36:24.008325 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:24.008256    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57806f61d2e6ff789a2e38dec61241e6677fff9eadf97b731cbb2b255d2c7eef"} err="failed to get container status \"57806f61d2e6ff789a2e38dec61241e6677fff9eadf97b731cbb2b255d2c7eef\": rpc error: code = NotFound desc = could not find container \"57806f61d2e6ff789a2e38dec61241e6677fff9eadf97b731cbb2b255d2c7eef\": container with ID starting with 57806f61d2e6ff789a2e38dec61241e6677fff9eadf97b731cbb2b255d2c7eef not found: ID does not exist"
Sep 11 14:36:24.014673 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:24.014650    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"]
Sep 11 14:36:24.018709 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:24.018673    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-344045/auth-test-model-344045-kserve-54988886bc-bz67q"]
Sep 11 14:36:25.037809 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:25.037777    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:36:25.131567 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:25.131529    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:36:25.231076 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:25.231044    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:36:25.679754 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:25.679716    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="936a3973-e603-4631-a881-cc51fed4a618" path="/var/lib/kubelet/pods/936a3973-e603-4631-a881-cc51fed4a618/volumes"
Sep 11 14:36:25.971717 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:25.971615    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:36:26.067597 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:26.067565    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:36:26.168802 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:26.168774    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:36:26.635783 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:26.635753    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:36:27.609606 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:27.609561    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:36:33.985501 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:33.985462    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:36:34.061041 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:34.061001    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:36:34.710947 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:34.710913    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:36:37.493627 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:37.493589    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:36:40.656483 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:40.656443    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:36:40.734812 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:40.734778    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:36:40.807666 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:40.807631    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:36:40.908740 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:40.908652    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:36:44.698713 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.698666    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"]
Sep 11 14:36:44.699130 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.699116    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24095eb5-1d1d-4265-b65e-83246736cf49" containerName="main"
Sep 11 14:36:44.699183 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.699132    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="24095eb5-1d1d-4265-b65e-83246736cf49" containerName="main"
Sep 11 14:36:44.699183 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.699140    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32bb6eee-ff17-4521-9204-e01b2f459c31" containerName="payload-processing"
Sep 11 14:36:44.699183 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.699146    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="32bb6eee-ff17-4521-9204-e01b2f459c31" containerName="payload-processing"
Sep 11 14:36:44.699183 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.699154    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="936a3973-e603-4631-a881-cc51fed4a618" containerName="main"
Sep 11 14:36:44.699183 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.699163    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="936a3973-e603-4631-a881-cc51fed4a618" containerName="main"
Sep 11 14:36:44.699183 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.699179    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95be7720-5963-4ba0-8d29-22ffae9ab29f" containerName="payload-pre-processing"
Sep 11 14:36:44.699183 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.699185    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="95be7720-5963-4ba0-8d29-22ffae9ab29f" containerName="payload-pre-processing"
Sep 11 14:36:44.699391 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.699241    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="936a3973-e603-4631-a881-cc51fed4a618" containerName="main"
Sep 11 14:36:44.699391 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.699251    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="24095eb5-1d1d-4265-b65e-83246736cf49" containerName="main"
Sep 11 14:36:44.699391 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.699259    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="32bb6eee-ff17-4521-9204-e01b2f459c31" containerName="payload-processing"
Sep 11 14:36:44.699391 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.699264    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="95be7720-5963-4ba0-8d29-22ffae9ab29f" containerName="payload-pre-processing"
Sep 11 14:36:44.702302 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.702286    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"
Sep 11 14:36:44.706545 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.706516    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-344045\"/\"kube-root-ca.crt\""
Sep 11 14:36:44.709130 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.706899    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-344045\"/\"sub-test-model-344045-kserve-self-signed-certs\""
Sep 11 14:36:44.709130 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.707771    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-344045\"/\"default-dockercfg-nh856\""
Sep 11 14:36:44.709130 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.708037    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-344045\"/\"openshift-service-ca.crt\""
Sep 11 14:36:44.714224 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.714195    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"]
Sep 11 14:36:44.741953 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.741910    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:36:44.799063 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.799035    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df679bad-54bb-45ad-95fb-2aacc36fe9be-model-cache\") pod \"sub-test-model-344045-kserve-5bd8ddcb75-6xfjm\" (UID: \"df679bad-54bb-45ad-95fb-2aacc36fe9be\") " pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"
Sep 11 14:36:44.799063 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.799065    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df679bad-54bb-45ad-95fb-2aacc36fe9be-home\") pod \"sub-test-model-344045-kserve-5bd8ddcb75-6xfjm\" (UID: \"df679bad-54bb-45ad-95fb-2aacc36fe9be\") " pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"
Sep 11 14:36:44.799213 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.799086    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkql6\" (UniqueName: \"kubernetes.io/projected/df679bad-54bb-45ad-95fb-2aacc36fe9be-kube-api-access-tkql6\") pod \"sub-test-model-344045-kserve-5bd8ddcb75-6xfjm\" (UID: \"df679bad-54bb-45ad-95fb-2aacc36fe9be\") " pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"
Sep 11 14:36:44.799213 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.799168    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df679bad-54bb-45ad-95fb-2aacc36fe9be-dshm\") pod \"sub-test-model-344045-kserve-5bd8ddcb75-6xfjm\" (UID: \"df679bad-54bb-45ad-95fb-2aacc36fe9be\") " pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"
Sep 11 14:36:44.799213 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.799195    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df679bad-54bb-45ad-95fb-2aacc36fe9be-tmp-dir\") pod \"sub-test-model-344045-kserve-5bd8ddcb75-6xfjm\" (UID: \"df679bad-54bb-45ad-95fb-2aacc36fe9be\") " pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"
Sep 11 14:36:44.799317 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.799222    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df679bad-54bb-45ad-95fb-2aacc36fe9be-tls-certs\") pod \"sub-test-model-344045-kserve-5bd8ddcb75-6xfjm\" (UID: \"df679bad-54bb-45ad-95fb-2aacc36fe9be\") " pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"
Sep 11 14:36:44.899823 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.899793    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkql6\" (UniqueName: \"kubernetes.io/projected/df679bad-54bb-45ad-95fb-2aacc36fe9be-kube-api-access-tkql6\") pod \"sub-test-model-344045-kserve-5bd8ddcb75-6xfjm\" (UID: \"df679bad-54bb-45ad-95fb-2aacc36fe9be\") " pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"
Sep 11 14:36:44.899949 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.899848    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df679bad-54bb-45ad-95fb-2aacc36fe9be-dshm\") pod \"sub-test-model-344045-kserve-5bd8ddcb75-6xfjm\" (UID: \"df679bad-54bb-45ad-95fb-2aacc36fe9be\") " pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"
Sep 11 14:36:44.899949 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.899867    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df679bad-54bb-45ad-95fb-2aacc36fe9be-tmp-dir\") pod \"sub-test-model-344045-kserve-5bd8ddcb75-6xfjm\" (UID: \"df679bad-54bb-45ad-95fb-2aacc36fe9be\") " pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"
Sep 11 14:36:44.899949 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.899897    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df679bad-54bb-45ad-95fb-2aacc36fe9be-tls-certs\") pod \"sub-test-model-344045-kserve-5bd8ddcb75-6xfjm\" (UID: \"df679bad-54bb-45ad-95fb-2aacc36fe9be\") " pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"
Sep 11 14:36:44.900114 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.899993    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df679bad-54bb-45ad-95fb-2aacc36fe9be-model-cache\") pod \"sub-test-model-344045-kserve-5bd8ddcb75-6xfjm\" (UID: \"df679bad-54bb-45ad-95fb-2aacc36fe9be\") " pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"
Sep 11 14:36:44.900114 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.900034    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df679bad-54bb-45ad-95fb-2aacc36fe9be-home\") pod \"sub-test-model-344045-kserve-5bd8ddcb75-6xfjm\" (UID: \"df679bad-54bb-45ad-95fb-2aacc36fe9be\") " pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"
Sep 11 14:36:44.900298 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.900271    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df679bad-54bb-45ad-95fb-2aacc36fe9be-tmp-dir\") pod \"sub-test-model-344045-kserve-5bd8ddcb75-6xfjm\" (UID: \"df679bad-54bb-45ad-95fb-2aacc36fe9be\") " pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"
Sep 11 14:36:44.900410 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.900313    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df679bad-54bb-45ad-95fb-2aacc36fe9be-model-cache\") pod \"sub-test-model-344045-kserve-5bd8ddcb75-6xfjm\" (UID: \"df679bad-54bb-45ad-95fb-2aacc36fe9be\") " pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"
Sep 11 14:36:44.900410 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.900396    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df679bad-54bb-45ad-95fb-2aacc36fe9be-home\") pod \"sub-test-model-344045-kserve-5bd8ddcb75-6xfjm\" (UID: \"df679bad-54bb-45ad-95fb-2aacc36fe9be\") " pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"
Sep 11 14:36:44.902170 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.902149    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df679bad-54bb-45ad-95fb-2aacc36fe9be-dshm\") pod \"sub-test-model-344045-kserve-5bd8ddcb75-6xfjm\" (UID: \"df679bad-54bb-45ad-95fb-2aacc36fe9be\") " pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"
Sep 11 14:36:44.902292 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.902276    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df679bad-54bb-45ad-95fb-2aacc36fe9be-tls-certs\") pod \"sub-test-model-344045-kserve-5bd8ddcb75-6xfjm\" (UID: \"df679bad-54bb-45ad-95fb-2aacc36fe9be\") " pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"
Sep 11 14:36:44.908649 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:44.908625    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkql6\" (UniqueName: \"kubernetes.io/projected/df679bad-54bb-45ad-95fb-2aacc36fe9be-kube-api-access-tkql6\") pod \"sub-test-model-344045-kserve-5bd8ddcb75-6xfjm\" (UID: \"df679bad-54bb-45ad-95fb-2aacc36fe9be\") " pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"
Sep 11 14:36:45.013762 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:45.013708    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"
Sep 11 14:36:45.289471 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:45.289445    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"]
Sep 11 14:36:45.290814 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:36:45.290783    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf679bad_54bb_45ad_95fb_2aacc36fe9be.slice/crio-7640db9c3faea3b91d743e75669558f56f34b34f00fac43770840f96327fcea4 WatchSource:0}: Error finding container 7640db9c3faea3b91d743e75669558f56f34b34f00fac43770840f96327fcea4: Status 404 returned error can't find the container with id 7640db9c3faea3b91d743e75669558f56f34b34f00fac43770840f96327fcea4
Sep 11 14:36:46.113313 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:46.113269    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm" event={"ID":"df679bad-54bb-45ad-95fb-2aacc36fe9be","Type":"ContainerStarted","Data":"8ab1e35d00ddda3c3c429ddc8af18d2daa9dee684066cb77b781b9352e547dac"}
Sep 11 14:36:46.113313 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:46.113310    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm" event={"ID":"df679bad-54bb-45ad-95fb-2aacc36fe9be","Type":"ContainerStarted","Data":"7640db9c3faea3b91d743e75669558f56f34b34f00fac43770840f96327fcea4"}
Sep 11 14:36:55.014656 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:55.014620    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"
Sep 11 14:36:55.015136 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:55.014692    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"
Sep 11 14:36:55.027192 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:55.027160    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"
Sep 11 14:36:55.170417 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:55.170390    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"
Sep 11 14:36:57.597764 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:57.597650    2584 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6gwgr" podUID="506192d2-fbe0-4023-8fd0-393328fb95d4" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.23:8081/healthz\": dial tcp 10.134.0.23:8081: connect: connection refused"
Sep 11 14:36:57.616961 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:57.616928    2584 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f656b" podUID="2eca4de8-e58d-466e-a0d2-f2c615190b65" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.24:8081/healthz\": dial tcp 10.134.0.24:8081: connect: connection refused"
Sep 11 14:36:58.104156 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:58.104119    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f656b" podUID="2eca4de8-e58d-466e-a0d2-f2c615190b65" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.24:8081/readyz\": dial tcp 10.134.0.24:8081: connect: connection refused"
Sep 11 14:36:58.104282 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:58.104119    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6gwgr" podUID="506192d2-fbe0-4023-8fd0-393328fb95d4" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.23:8081/readyz\": dial tcp 10.134.0.23:8081: connect: connection refused"
Sep 11 14:36:58.176487 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:58.176462    2584 generic.go:356] "Generic (PLEG): container finished" podID="99eaa447-82dd-41b3-ac95-e2faf55d52a2" containerID="ed26908114bcdd2eecccc2da1e9b752371e27e4c91ca0bbb0f2916838e0b3b85" exitCode=1
Sep 11 14:36:58.176597 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:58.176537    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxc6b" event={"ID":"99eaa447-82dd-41b3-ac95-e2faf55d52a2","Type":"ContainerDied","Data":"ed26908114bcdd2eecccc2da1e9b752371e27e4c91ca0bbb0f2916838e0b3b85"}
Sep 11 14:36:58.176891 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:58.176875    2584 scope.go:117] "RemoveContainer" containerID="ed26908114bcdd2eecccc2da1e9b752371e27e4c91ca0bbb0f2916838e0b3b85"
Sep 11 14:36:58.178178 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:58.178160    2584 generic.go:356] "Generic (PLEG): container finished" podID="2eca4de8-e58d-466e-a0d2-f2c615190b65" containerID="fc280a57ac9f4478980adbd46a2e01f55b977f5fa60c1fb1202bca93987d7cb1" exitCode=1
Sep 11 14:36:58.178255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:58.178224    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f656b" event={"ID":"2eca4de8-e58d-466e-a0d2-f2c615190b65","Type":"ContainerDied","Data":"fc280a57ac9f4478980adbd46a2e01f55b977f5fa60c1fb1202bca93987d7cb1"}
Sep 11 14:36:58.178504 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:58.178480    2584 scope.go:117] "RemoveContainer" containerID="fc280a57ac9f4478980adbd46a2e01f55b977f5fa60c1fb1202bca93987d7cb1"
Sep 11 14:36:58.178802 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:58.178785    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 14:36:58.179755 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:58.179734    2584 generic.go:356] "Generic (PLEG): container finished" podID="c2bf1285-c840-4b0a-8f39-b157fedbd628" containerID="ae8a5d5e6b86222e9369fdebd72b420aa8178cce3ca7b0f757a6f82ea6d5de7b" exitCode=1
Sep 11 14:36:58.179822 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:58.179804    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57d567598c-tmjd8" event={"ID":"c2bf1285-c840-4b0a-8f39-b157fedbd628","Type":"ContainerDied","Data":"ae8a5d5e6b86222e9369fdebd72b420aa8178cce3ca7b0f757a6f82ea6d5de7b"}
Sep 11 14:36:58.180106 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:58.180087    2584 scope.go:117] "RemoveContainer" containerID="ae8a5d5e6b86222e9369fdebd72b420aa8178cce3ca7b0f757a6f82ea6d5de7b"
Sep 11 14:36:58.180810 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:58.180697    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 11 14:36:58.181503 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:58.181484    2584 generic.go:356] "Generic (PLEG): container finished" podID="506192d2-fbe0-4023-8fd0-393328fb95d4" containerID="9eaa22a95b1d05d7f9ad53128aa520132e0442eb03930c574ed4f4a8d56452b2" exitCode=1
Sep 11 14:36:58.181569 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:58.181549    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6gwgr" event={"ID":"506192d2-fbe0-4023-8fd0-393328fb95d4","Type":"ContainerDied","Data":"9eaa22a95b1d05d7f9ad53128aa520132e0442eb03930c574ed4f4a8d56452b2"}
Sep 11 14:36:58.181865 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:58.181846    2584 scope.go:117] "RemoveContainer" containerID="9eaa22a95b1d05d7f9ad53128aa520132e0442eb03930c574ed4f4a8d56452b2"
Sep 11 14:36:58.183763 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:58.183742    2584 generic.go:356] "Generic (PLEG): container finished" podID="025f6490-ce00-4263-8836-6782fbe82a49" containerID="927a84e2655b1e0cc39e3064086250b2e5e7b09e5258c1264cebf99f285a8746" exitCode=1
Sep 11 14:36:58.183873 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:58.183779    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs" event={"ID":"025f6490-ce00-4263-8836-6782fbe82a49","Type":"ContainerDied","Data":"927a84e2655b1e0cc39e3064086250b2e5e7b09e5258c1264cebf99f285a8746"}
Sep 11 14:36:58.184107 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:58.184090    2584 scope.go:117] "RemoveContainer" containerID="927a84e2655b1e0cc39e3064086250b2e5e7b09e5258c1264cebf99f285a8746"
Sep 11 14:36:58.294840 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:58.294792    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm" podStartSLOduration=14.294777859 podStartE2EDuration="14.294777859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:36:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:36:58.291646332 +0000 UTC m=+1311.090281115" watchObservedRunningTime="2026-09-11 14:36:58.294777859 +0000 UTC m=+1311.093412640"
Sep 11 14:36:58.335914 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:58.335863    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:36:58.451752 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:58.451627    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:36:58.646736 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:58.646704    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:36:58.893845 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:58.893824    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 14:36:58.911252 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:58.911225    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs"
Sep 11 14:36:58.959344 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:58.959323    2584 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxc6b"
Sep 11 14:36:59.190621 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:59.190531    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57d567598c-tmjd8" event={"ID":"c2bf1285-c840-4b0a-8f39-b157fedbd628","Type":"ContainerStarted","Data":"e8f89b4222080d4e6d380fc94690215a020e9428d5ca18250024becefea14301"}
Sep 11 14:36:59.190867 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:59.190847    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57d567598c-tmjd8"
Sep 11 14:36:59.192428 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:59.192407    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6gwgr" event={"ID":"506192d2-fbe0-4023-8fd0-393328fb95d4","Type":"ContainerStarted","Data":"3e83b775229726ac04ee4d40343c5b138ca2e3d28048ceae7027bdef6697fa91"}
Sep 11 14:36:59.192613 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:59.192598    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6gwgr"
Sep 11 14:36:59.194566 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:59.194542    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs" event={"ID":"025f6490-ce00-4263-8836-6782fbe82a49","Type":"ContainerStarted","Data":"2396bf3799fe95fcdefbe09993b67131da22faa684efce5e7a4b5332c7e6fb1c"}
Sep 11 14:36:59.194825 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:59.194802    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs"
Sep 11 14:36:59.196581 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:59.196563    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxc6b" event={"ID":"99eaa447-82dd-41b3-ac95-e2faf55d52a2","Type":"ContainerStarted","Data":"a3097ce4d6bb6ba6c40643ece0a506bf60708a2166cbeb89d9f918464c636384"}
Sep 11 14:36:59.196697 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:36:59.196639    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxc6b"
Sep 11 14:37:00.204419 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:00.204384    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f656b" event={"ID":"2eca4de8-e58d-466e-a0d2-f2c615190b65","Type":"ContainerStarted","Data":"befa771100f59f2874c043e000adc76a2061cea1667ccb5e8e9bc5ce328c921b"}
Sep 11 14:37:00.205146 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:00.205124    2584 status_manager.go:444] "Container readiness changed for unknown container" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f656b" containerID="cri-o://fc280a57ac9f4478980adbd46a2e01f55b977f5fa60c1fb1202bca93987d7cb1"
Sep 11 14:37:00.205146 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:00.205146    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f656b"
Sep 11 14:37:01.209657 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:01.209623    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f656b"
Sep 11 14:37:07.874179 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:07.874151    2584 scope.go:117] "RemoveContainer" containerID="8ffd0e9e9b24285d068315bef39b75218b99683b5a507beefe8fa5b870a4ee8c"
Sep 11 14:37:10.206933 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:10.206906    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxc6b"
Sep 11 14:37:10.207300 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:10.207089    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-p4zrs"
Sep 11 14:37:10.207300 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:10.207154    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-57d567598c-tmjd8"
Sep 11 14:37:19.486443 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:19.486406    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:37:19.634070 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:19.634037    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:37:20.534273 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:20.534235    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:37:20.555970 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:20.555931    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:37:21.760171 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:21.760136    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:37:22.836848 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:22.836814    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:37:23.896963 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:23.896934    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:37:30.211270 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:30.211189    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6gwgr"
Sep 11 14:37:32.217800 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:32.217763    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f656b"
Sep 11 14:37:40.589993 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:40.589925    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:37:44.614268 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:44.614235    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:37:47.899613 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:47.899574    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:37:47.999305 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:47.999278    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:37:48.277536 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:48.277459    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:37:48.673085 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:48.673042    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:37:49.060514 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:49.060464    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:37:51.536371 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:51.536336    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:37:52.312844 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:52.312801    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:37:52.422325 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:52.422288    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:37:52.644081 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:52.643956    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:37:53.834209 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:53.834155    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:37:54.726628 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:54.726590    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:37:55.536732 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:55.536698    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:37:56.564854 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:56.564819    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:37:56.657458 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:56.657426    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:37:57.127145 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:57.127110    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:37:57.225947 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:57.225884    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:37:57.339766 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:57.339733    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2cabda-5474dd8cb6-k89fw"]
Sep 11 14:37:57.343770 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:57.343753    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2cabda-5474dd8cb6-k89fw"
Sep 11 14:37:57.347231 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:57.347211    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-2cabda-dockercfg-bzbjr\""
Sep 11 14:37:57.347469 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:57.347453    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-2cabda\""
Sep 11 14:37:57.355713 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:57.355674    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2cabda-5474dd8cb6-k89fw"]
Sep 11 14:37:57.400304 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:57.400248    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2cabda-5b9c4895b5-c25vg"]
Sep 11 14:37:57.403787 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:57.403770    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-2cabda-5b9c4895b5-c25vg"
Sep 11 14:37:57.418762 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:57.418741    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2cabda-5b9c4895b5-c25vg"]
Sep 11 14:37:57.443526 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:57.443497    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bffd1b08-0d4c-4b91-bfcf-b1d4738376f0-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-2cabda-5474dd8cb6-k89fw\" (UID: \"bffd1b08-0d4c-4b91-bfcf-b1d4738376f0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2cabda-5474dd8cb6-k89fw"
Sep 11 14:37:57.443647 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:57.443544    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmj8x\" (UniqueName: \"kubernetes.io/projected/bffd1b08-0d4c-4b91-bfcf-b1d4738376f0-kube-api-access-vmj8x\") pod \"payload-pre-processing-e2e-api-a-2cabda-5474dd8cb6-k89fw\" (UID: \"bffd1b08-0d4c-4b91-bfcf-b1d4738376f0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2cabda-5474dd8cb6-k89fw"
Sep 11 14:37:57.544517 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:57.544484    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2b75a62-f4ee-4e05-a017-656e74b9598e-plugins-config-volume\") pod \"payload-processing-e2e-api-a-2cabda-5b9c4895b5-c25vg\" (UID: \"b2b75a62-f4ee-4e05-a017-656e74b9598e\") " pod="openshift-ingress/payload-processing-e2e-api-a-2cabda-5b9c4895b5-c25vg"
Sep 11 14:37:57.544517 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:57.544521    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flm92\" (UniqueName: \"kubernetes.io/projected/b2b75a62-f4ee-4e05-a017-656e74b9598e-kube-api-access-flm92\") pod \"payload-processing-e2e-api-a-2cabda-5b9c4895b5-c25vg\" (UID: \"b2b75a62-f4ee-4e05-a017-656e74b9598e\") " pod="openshift-ingress/payload-processing-e2e-api-a-2cabda-5b9c4895b5-c25vg"
Sep 11 14:37:57.544705 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:57.544604    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bffd1b08-0d4c-4b91-bfcf-b1d4738376f0-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-2cabda-5474dd8cb6-k89fw\" (UID: \"bffd1b08-0d4c-4b91-bfcf-b1d4738376f0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2cabda-5474dd8cb6-k89fw"
Sep 11 14:37:57.544705 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:57.544638    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmj8x\" (UniqueName: \"kubernetes.io/projected/bffd1b08-0d4c-4b91-bfcf-b1d4738376f0-kube-api-access-vmj8x\") pod \"payload-pre-processing-e2e-api-a-2cabda-5474dd8cb6-k89fw\" (UID: \"bffd1b08-0d4c-4b91-bfcf-b1d4738376f0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2cabda-5474dd8cb6-k89fw"
Sep 11 14:37:57.545288 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:57.545269    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bffd1b08-0d4c-4b91-bfcf-b1d4738376f0-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-2cabda-5474dd8cb6-k89fw\" (UID: \"bffd1b08-0d4c-4b91-bfcf-b1d4738376f0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2cabda-5474dd8cb6-k89fw"
Sep 11 14:37:57.553496 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:57.553469    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmj8x\" (UniqueName: \"kubernetes.io/projected/bffd1b08-0d4c-4b91-bfcf-b1d4738376f0-kube-api-access-vmj8x\") pod \"payload-pre-processing-e2e-api-a-2cabda-5474dd8cb6-k89fw\" (UID: \"bffd1b08-0d4c-4b91-bfcf-b1d4738376f0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2cabda-5474dd8cb6-k89fw"
Sep 11 14:37:57.645352 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:57.645327    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2b75a62-f4ee-4e05-a017-656e74b9598e-plugins-config-volume\") pod \"payload-processing-e2e-api-a-2cabda-5b9c4895b5-c25vg\" (UID: \"b2b75a62-f4ee-4e05-a017-656e74b9598e\") " pod="openshift-ingress/payload-processing-e2e-api-a-2cabda-5b9c4895b5-c25vg"
Sep 11 14:37:57.645659 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:57.645359    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flm92\" (UniqueName: \"kubernetes.io/projected/b2b75a62-f4ee-4e05-a017-656e74b9598e-kube-api-access-flm92\") pod \"payload-processing-e2e-api-a-2cabda-5b9c4895b5-c25vg\" (UID: \"b2b75a62-f4ee-4e05-a017-656e74b9598e\") " pod="openshift-ingress/payload-processing-e2e-api-a-2cabda-5b9c4895b5-c25vg"
Sep 11 14:37:57.646065 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:57.646044    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2b75a62-f4ee-4e05-a017-656e74b9598e-plugins-config-volume\") pod \"payload-processing-e2e-api-a-2cabda-5b9c4895b5-c25vg\" (UID: \"b2b75a62-f4ee-4e05-a017-656e74b9598e\") " pod="openshift-ingress/payload-processing-e2e-api-a-2cabda-5b9c4895b5-c25vg"
Sep 11 14:37:57.653804 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:57.653755    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2cabda-5474dd8cb6-k89fw"
Sep 11 14:37:57.656010 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:57.655995    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flm92\" (UniqueName: \"kubernetes.io/projected/b2b75a62-f4ee-4e05-a017-656e74b9598e-kube-api-access-flm92\") pod \"payload-processing-e2e-api-a-2cabda-5b9c4895b5-c25vg\" (UID: \"b2b75a62-f4ee-4e05-a017-656e74b9598e\") " pod="openshift-ingress/payload-processing-e2e-api-a-2cabda-5b9c4895b5-c25vg"
Sep 11 14:37:57.714484 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:57.714157    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-2cabda-5b9c4895b5-c25vg"
Sep 11 14:37:57.945353 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:57.945329    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2cabda-5474dd8cb6-k89fw"]
Sep 11 14:37:57.947670 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:37:57.947645    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbffd1b08_0d4c_4b91_bfcf_b1d4738376f0.slice/crio-13573f7426c8f022d2397b4d726fd0d12604aefa475c0a893f520b85dd7e05c7 WatchSource:0}: Error finding container 13573f7426c8f022d2397b4d726fd0d12604aefa475c0a893f520b85dd7e05c7: Status 404 returned error can't find the container with id 13573f7426c8f022d2397b4d726fd0d12604aefa475c0a893f520b85dd7e05c7
Sep 11 14:37:58.006493 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:58.006472    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2cabda-5b9c4895b5-c25vg"]
Sep 11 14:37:58.008407 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:37:58.008377    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2b75a62_f4ee_4e05_a017_656e74b9598e.slice/crio-9aee909cb3fb0a913ccf9cb90a88ab8c2ae60d9cbc6c8935afd6c1ec615e083a WatchSource:0}: Error finding container 9aee909cb3fb0a913ccf9cb90a88ab8c2ae60d9cbc6c8935afd6c1ec615e083a: Status 404 returned error can't find the container with id 9aee909cb3fb0a913ccf9cb90a88ab8c2ae60d9cbc6c8935afd6c1ec615e083a
Sep 11 14:37:58.515895 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:58.515861    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-2cabda-5b9c4895b5-c25vg" event={"ID":"b2b75a62-f4ee-4e05-a017-656e74b9598e","Type":"ContainerStarted","Data":"d03f684c8c123a9cd77b0a1bd66cbc0a97fd2dcef20acada361d410cf3f4db3c"}
Sep 11 14:37:58.516083 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:58.515926    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-2cabda-5b9c4895b5-c25vg" event={"ID":"b2b75a62-f4ee-4e05-a017-656e74b9598e","Type":"ContainerStarted","Data":"9aee909cb3fb0a913ccf9cb90a88ab8c2ae60d9cbc6c8935afd6c1ec615e083a"}
Sep 11 14:37:58.516083 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:58.515960    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-2cabda-5b9c4895b5-c25vg"
Sep 11 14:37:58.517546 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:58.517517    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2cabda-5474dd8cb6-k89fw" event={"ID":"bffd1b08-0d4c-4b91-bfcf-b1d4738376f0","Type":"ContainerStarted","Data":"bc206fd8149360aa7a5d37fb05e2b7ad907c4ba904ed1ebfd2c12abe02b25cf3"}
Sep 11 14:37:58.517658 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:58.517568    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2cabda-5474dd8cb6-k89fw" event={"ID":"bffd1b08-0d4c-4b91-bfcf-b1d4738376f0","Type":"ContainerStarted","Data":"13573f7426c8f022d2397b4d726fd0d12604aefa475c0a893f520b85dd7e05c7"}
Sep 11 14:37:58.517658 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:58.517595    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2cabda-5474dd8cb6-k89fw"
Sep 11 14:37:58.545038 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:58.544988    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-2cabda-5b9c4895b5-c25vg" podStartSLOduration=1.544969709 podStartE2EDuration="1.544969709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:37:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:37:58.543860921 +0000 UTC m=+1371.342495703" watchObservedRunningTime="2026-09-11 14:37:58.544969709 +0000 UTC m=+1371.343604490"
Sep 11 14:37:58.584203 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:37:58.584161    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2cabda-5474dd8cb6-k89fw" podStartSLOduration=1.5841455199999999 podStartE2EDuration="1.58414552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:37:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:37:58.582901058 +0000 UTC m=+1371.381535842" watchObservedRunningTime="2026-09-11 14:37:58.58414552 +0000 UTC m=+1371.382780302"
Sep 11 14:38:03.015513 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:03.015478    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:38:07.899886 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:07.899856    2584 scope.go:117] "RemoveContainer" containerID="b29e2d5efc79249f207665d0b0853fdb4729c09280b0de257e1c3ed87cf01bf9"
Sep 11 14:38:07.907852 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:07.907830    2584 scope.go:117] "RemoveContainer" containerID="0570834577ffd7404fbb99cb0ad8bc5e4a33d13a3a412ee2a03adcad0765095e"
Sep 11 14:38:07.915455 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:07.915435    2584 scope.go:117] "RemoveContainer" containerID="dd45e8fc3b13281113c49ccf06f88f524936c07554b8d97c759c321559bdb3cf"
Sep 11 14:38:09.525756 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:09.525708    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2cabda-5474dd8cb6-k89fw"
Sep 11 14:38:09.526126 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:09.525935    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-2cabda-5b9c4895b5-c25vg"
Sep 11 14:38:13.390900 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:13.390851    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:38:14.207329 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:14.207293    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"]
Sep 11 14:38:14.227880 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:14.227849    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:38:17.352969 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:17.352936    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:38:17.460200 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:17.460171    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"]
Sep 11 14:38:17.465605 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:17.465583    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"
Sep 11 14:38:17.469503 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:17.469480    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-72e046\"/\"default-dockercfg-xd8jr\""
Sep 11 14:38:17.470583 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:17.470566    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-72e046\"/\"rate-test-model-72e046-kserve-self-signed-certs\""
Sep 11 14:38:17.472152 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:17.472130    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-72e046\"/\"kube-root-ca.crt\""
Sep 11 14:38:17.480511 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:17.480492    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-72e046\"/\"openshift-service-ca.crt\""
Sep 11 14:38:17.503415 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:17.503390    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7125a67-f5b3-4287-91b5-751fae157148-dshm\") pod \"rate-test-model-72e046-kserve-bd5f8db7-r4mbn\" (UID: \"a7125a67-f5b3-4287-91b5-751fae157148\") " pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"
Sep 11 14:38:17.503506 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:17.503435    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7125a67-f5b3-4287-91b5-751fae157148-model-cache\") pod \"rate-test-model-72e046-kserve-bd5f8db7-r4mbn\" (UID: \"a7125a67-f5b3-4287-91b5-751fae157148\") " pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"
Sep 11 14:38:17.503599 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:17.503533    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb2s2\" (UniqueName: \"kubernetes.io/projected/a7125a67-f5b3-4287-91b5-751fae157148-kube-api-access-bb2s2\") pod \"rate-test-model-72e046-kserve-bd5f8db7-r4mbn\" (UID: \"a7125a67-f5b3-4287-91b5-751fae157148\") " pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"
Sep 11 14:38:17.503718 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:17.503608    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7125a67-f5b3-4287-91b5-751fae157148-home\") pod \"rate-test-model-72e046-kserve-bd5f8db7-r4mbn\" (UID: \"a7125a67-f5b3-4287-91b5-751fae157148\") " pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"
Sep 11 14:38:17.503718 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:17.503644    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7125a67-f5b3-4287-91b5-751fae157148-tls-certs\") pod \"rate-test-model-72e046-kserve-bd5f8db7-r4mbn\" (UID: \"a7125a67-f5b3-4287-91b5-751fae157148\") " pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"
Sep 11 14:38:17.503844 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:17.503753    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7125a67-f5b3-4287-91b5-751fae157148-tmp-dir\") pod \"rate-test-model-72e046-kserve-bd5f8db7-r4mbn\" (UID: \"a7125a67-f5b3-4287-91b5-751fae157148\") " pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"
Sep 11 14:38:17.506788 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:17.506762    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"]
Sep 11 14:38:17.519797 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:17.519768    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:38:17.604706 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:17.604636    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7125a67-f5b3-4287-91b5-751fae157148-dshm\") pod \"rate-test-model-72e046-kserve-bd5f8db7-r4mbn\" (UID: \"a7125a67-f5b3-4287-91b5-751fae157148\") " pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"
Sep 11 14:38:17.604706 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:17.604674    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7125a67-f5b3-4287-91b5-751fae157148-model-cache\") pod \"rate-test-model-72e046-kserve-bd5f8db7-r4mbn\" (UID: \"a7125a67-f5b3-4287-91b5-751fae157148\") " pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"
Sep 11 14:38:17.604885 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:17.604728    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb2s2\" (UniqueName: \"kubernetes.io/projected/a7125a67-f5b3-4287-91b5-751fae157148-kube-api-access-bb2s2\") pod \"rate-test-model-72e046-kserve-bd5f8db7-r4mbn\" (UID: \"a7125a67-f5b3-4287-91b5-751fae157148\") " pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"
Sep 11 14:38:17.604885 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:17.604754    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7125a67-f5b3-4287-91b5-751fae157148-home\") pod \"rate-test-model-72e046-kserve-bd5f8db7-r4mbn\" (UID: \"a7125a67-f5b3-4287-91b5-751fae157148\") " pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"
Sep 11 14:38:17.604885 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:17.604769    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7125a67-f5b3-4287-91b5-751fae157148-tls-certs\") pod \"rate-test-model-72e046-kserve-bd5f8db7-r4mbn\" (UID: \"a7125a67-f5b3-4287-91b5-751fae157148\") " pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"
Sep 11 14:38:17.604885 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:17.604810    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7125a67-f5b3-4287-91b5-751fae157148-tmp-dir\") pod \"rate-test-model-72e046-kserve-bd5f8db7-r4mbn\" (UID: \"a7125a67-f5b3-4287-91b5-751fae157148\") " pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"
Sep 11 14:38:17.605121 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:17.605098    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7125a67-f5b3-4287-91b5-751fae157148-model-cache\") pod \"rate-test-model-72e046-kserve-bd5f8db7-r4mbn\" (UID: \"a7125a67-f5b3-4287-91b5-751fae157148\") " pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"
Sep 11 14:38:17.605202 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:17.605127    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7125a67-f5b3-4287-91b5-751fae157148-home\") pod \"rate-test-model-72e046-kserve-bd5f8db7-r4mbn\" (UID: \"a7125a67-f5b3-4287-91b5-751fae157148\") " pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"
Sep 11 14:38:17.605202 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:17.605181    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7125a67-f5b3-4287-91b5-751fae157148-tmp-dir\") pod \"rate-test-model-72e046-kserve-bd5f8db7-r4mbn\" (UID: \"a7125a67-f5b3-4287-91b5-751fae157148\") " pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"
Sep 11 14:38:17.607131 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:17.607107    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7125a67-f5b3-4287-91b5-751fae157148-dshm\") pod \"rate-test-model-72e046-kserve-bd5f8db7-r4mbn\" (UID: \"a7125a67-f5b3-4287-91b5-751fae157148\") " pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"
Sep 11 14:38:17.607456 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:17.607441    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7125a67-f5b3-4287-91b5-751fae157148-tls-certs\") pod \"rate-test-model-72e046-kserve-bd5f8db7-r4mbn\" (UID: \"a7125a67-f5b3-4287-91b5-751fae157148\") " pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"
Sep 11 14:38:17.619459 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:17.619435    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb2s2\" (UniqueName: \"kubernetes.io/projected/a7125a67-f5b3-4287-91b5-751fae157148-kube-api-access-bb2s2\") pod \"rate-test-model-72e046-kserve-bd5f8db7-r4mbn\" (UID: \"a7125a67-f5b3-4287-91b5-751fae157148\") " pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"
Sep 11 14:38:17.775318 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:17.775291    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"
Sep 11 14:38:18.054048 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:18.054008    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"]
Sep 11 14:38:18.056157 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:38:18.056128    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7125a67_f5b3_4287_91b5_751fae157148.slice/crio-f806bb6e807ce9a08e4baa6817ac353f5a3186a73e5c6ef311f2dea5f3dd1cd9 WatchSource:0}: Error finding container f806bb6e807ce9a08e4baa6817ac353f5a3186a73e5c6ef311f2dea5f3dd1cd9: Status 404 returned error can't find the container with id f806bb6e807ce9a08e4baa6817ac353f5a3186a73e5c6ef311f2dea5f3dd1cd9
Sep 11 14:38:18.629379 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:18.629343    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn" event={"ID":"a7125a67-f5b3-4287-91b5-751fae157148","Type":"ContainerStarted","Data":"02ca662efa6b7c5edc69801566a5f4db5137bb6581539feee61b0af322052ffd"}
Sep 11 14:38:18.629744 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:18.629390    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn" event={"ID":"a7125a67-f5b3-4287-91b5-751fae157148","Type":"ContainerStarted","Data":"f806bb6e807ce9a08e4baa6817ac353f5a3186a73e5c6ef311f2dea5f3dd1cd9"}
Sep 11 14:38:18.658054 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:18.658005    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn" podStartSLOduration=1.6579885399999998 podStartE2EDuration="1.65798854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:38:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:38:18.656564822 +0000 UTC m=+1391.455199605" watchObservedRunningTime="2026-09-11 14:38:18.65798854 +0000 UTC m=+1391.456623321"
Sep 11 14:38:18.959422 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:18.959347    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:38:19.823407 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:19.823371    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:38:20.640228 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:20.640190    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:38:21.649935 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:21.649893    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:38:22.481616 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:22.481579    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:38:22.616661 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:22.616630    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:38:23.016334 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:23.016304    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:38:23.383170 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:23.383125    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:38:23.655074 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:23.654994    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:38:23.752961 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:23.752908    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:38:27.775757 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:27.775722    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"
Sep 11 14:38:27.775757 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:27.775764    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"
Sep 11 14:38:27.788666 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:27.788642    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"
Sep 11 14:38:28.690314 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:28.690283    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"
Sep 11 14:38:29.226026 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:29.225980    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm" podUID="df679bad-54bb-45ad-95fb-2aacc36fe9be" containerName="main" containerID="cri-o://8ab1e35d00ddda3c3c429ddc8af18d2daa9dee684066cb77b781b9352e547dac" gracePeriod=45
Sep 11 14:38:29.484006 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:29.483955    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"
Sep 11 14:38:29.610059 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:29.610037    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df679bad-54bb-45ad-95fb-2aacc36fe9be-dshm\") pod \"df679bad-54bb-45ad-95fb-2aacc36fe9be\" (UID: \"df679bad-54bb-45ad-95fb-2aacc36fe9be\") "
Sep 11 14:38:29.610181 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:29.610121    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkql6\" (UniqueName: \"kubernetes.io/projected/df679bad-54bb-45ad-95fb-2aacc36fe9be-kube-api-access-tkql6\") pod \"df679bad-54bb-45ad-95fb-2aacc36fe9be\" (UID: \"df679bad-54bb-45ad-95fb-2aacc36fe9be\") "
Sep 11 14:38:29.610181 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:29.610157    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df679bad-54bb-45ad-95fb-2aacc36fe9be-model-cache\") pod \"df679bad-54bb-45ad-95fb-2aacc36fe9be\" (UID: \"df679bad-54bb-45ad-95fb-2aacc36fe9be\") "
Sep 11 14:38:29.610181 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:29.610178    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df679bad-54bb-45ad-95fb-2aacc36fe9be-home\") pod \"df679bad-54bb-45ad-95fb-2aacc36fe9be\" (UID: \"df679bad-54bb-45ad-95fb-2aacc36fe9be\") "
Sep 11 14:38:29.610315 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:29.610211    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df679bad-54bb-45ad-95fb-2aacc36fe9be-tmp-dir\") pod \"df679bad-54bb-45ad-95fb-2aacc36fe9be\" (UID: \"df679bad-54bb-45ad-95fb-2aacc36fe9be\") "
Sep 11 14:38:29.610315 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:29.610239    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df679bad-54bb-45ad-95fb-2aacc36fe9be-tls-certs\") pod \"df679bad-54bb-45ad-95fb-2aacc36fe9be\" (UID: \"df679bad-54bb-45ad-95fb-2aacc36fe9be\") "
Sep 11 14:38:29.610469 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:29.610442    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df679bad-54bb-45ad-95fb-2aacc36fe9be-model-cache" (OuterVolumeSpecName: "model-cache") pod "df679bad-54bb-45ad-95fb-2aacc36fe9be" (UID: "df679bad-54bb-45ad-95fb-2aacc36fe9be"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:38:29.610469 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:29.610447    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df679bad-54bb-45ad-95fb-2aacc36fe9be-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "df679bad-54bb-45ad-95fb-2aacc36fe9be" (UID: "df679bad-54bb-45ad-95fb-2aacc36fe9be"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:38:29.610469 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:29.610461    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df679bad-54bb-45ad-95fb-2aacc36fe9be-home" (OuterVolumeSpecName: "home") pod "df679bad-54bb-45ad-95fb-2aacc36fe9be" (UID: "df679bad-54bb-45ad-95fb-2aacc36fe9be"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:38:29.610648 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:29.610525    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df679bad-54bb-45ad-95fb-2aacc36fe9be-model-cache\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:38:29.610648 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:29.610537    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df679bad-54bb-45ad-95fb-2aacc36fe9be-home\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:38:29.610648 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:29.610550    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df679bad-54bb-45ad-95fb-2aacc36fe9be-tmp-dir\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:38:29.612020 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:29.612000    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df679bad-54bb-45ad-95fb-2aacc36fe9be-dshm" (OuterVolumeSpecName: "dshm") pod "df679bad-54bb-45ad-95fb-2aacc36fe9be" (UID: "df679bad-54bb-45ad-95fb-2aacc36fe9be"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:38:29.612249 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:29.612217    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df679bad-54bb-45ad-95fb-2aacc36fe9be-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "df679bad-54bb-45ad-95fb-2aacc36fe9be" (UID: "df679bad-54bb-45ad-95fb-2aacc36fe9be"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:38:29.612327 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:29.612272    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df679bad-54bb-45ad-95fb-2aacc36fe9be-kube-api-access-tkql6" (OuterVolumeSpecName: "kube-api-access-tkql6") pod "df679bad-54bb-45ad-95fb-2aacc36fe9be" (UID: "df679bad-54bb-45ad-95fb-2aacc36fe9be"). InnerVolumeSpecName "kube-api-access-tkql6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:38:29.684992 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:29.684967    2584 generic.go:356] "Generic (PLEG): container finished" podID="df679bad-54bb-45ad-95fb-2aacc36fe9be" containerID="8ab1e35d00ddda3c3c429ddc8af18d2daa9dee684066cb77b781b9352e547dac" exitCode=0
Sep 11 14:38:29.685096 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:29.685006    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"
Sep 11 14:38:29.685096 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:29.685043    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm" event={"ID":"df679bad-54bb-45ad-95fb-2aacc36fe9be","Type":"ContainerDied","Data":"8ab1e35d00ddda3c3c429ddc8af18d2daa9dee684066cb77b781b9352e547dac"}
Sep 11 14:38:29.685170 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:29.685094    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm" event={"ID":"df679bad-54bb-45ad-95fb-2aacc36fe9be","Type":"ContainerDied","Data":"7640db9c3faea3b91d743e75669558f56f34b34f00fac43770840f96327fcea4"}
Sep 11 14:38:29.685170 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:29.685116    2584 scope.go:117] "RemoveContainer" containerID="8ab1e35d00ddda3c3c429ddc8af18d2daa9dee684066cb77b781b9352e547dac"
Sep 11 14:38:29.694655 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:29.694639    2584 scope.go:117] "RemoveContainer" containerID="8ab1e35d00ddda3c3c429ddc8af18d2daa9dee684066cb77b781b9352e547dac"
Sep 11 14:38:29.694935 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:38:29.694916    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ab1e35d00ddda3c3c429ddc8af18d2daa9dee684066cb77b781b9352e547dac\": container with ID starting with 8ab1e35d00ddda3c3c429ddc8af18d2daa9dee684066cb77b781b9352e547dac not found: ID does not exist" containerID="8ab1e35d00ddda3c3c429ddc8af18d2daa9dee684066cb77b781b9352e547dac"
Sep 11 14:38:29.694981 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:29.694945    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ab1e35d00ddda3c3c429ddc8af18d2daa9dee684066cb77b781b9352e547dac"} err="failed to get container status \"8ab1e35d00ddda3c3c429ddc8af18d2daa9dee684066cb77b781b9352e547dac\": rpc error: code = NotFound desc = could not find container \"8ab1e35d00ddda3c3c429ddc8af18d2daa9dee684066cb77b781b9352e547dac\": container with ID starting with 8ab1e35d00ddda3c3c429ddc8af18d2daa9dee684066cb77b781b9352e547dac not found: ID does not exist"
Sep 11 14:38:29.711329 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:29.711309    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkql6\" (UniqueName: \"kubernetes.io/projected/df679bad-54bb-45ad-95fb-2aacc36fe9be-kube-api-access-tkql6\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:38:29.711329 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:29.711328    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df679bad-54bb-45ad-95fb-2aacc36fe9be-tls-certs\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:38:29.711414 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:29.711337    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df679bad-54bb-45ad-95fb-2aacc36fe9be-dshm\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:38:34.592779 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:34.592740    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"]
Sep 11 14:38:35.352450 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:35.352418    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-344045/sub-test-model-344045-kserve-5bd8ddcb75-6xfjm"]
Sep 11 14:38:35.679388 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:35.679301    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df679bad-54bb-45ad-95fb-2aacc36fe9be" path="/var/lib/kubelet/pods/df679bad-54bb-45ad-95fb-2aacc36fe9be/volumes"
Sep 11 14:38:48.018052 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:48.018016    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:38:48.099956 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:48.099922    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:38:48.530718 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:48.530651    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:38:49.323947 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:49.323909    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:38:50.318319 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:50.318278    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:38:51.402200 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:51.402164    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:38:53.037016 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:53.036985    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:38:53.922917 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:53.922879    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:38:54.703642 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:54.703605    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:38:54.806800 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:54.806753    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:38:54.959597 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:54.959515    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:38:55.233256 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:55.233169    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:38:55.336181 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:55.336147    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:38:55.443917 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:55.443892    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-96e743-d99d79498-cf98r"]
Sep 11 14:38:55.444380 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:55.444366    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df679bad-54bb-45ad-95fb-2aacc36fe9be" containerName="main"
Sep 11 14:38:55.444423 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:55.444382    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="df679bad-54bb-45ad-95fb-2aacc36fe9be" containerName="main"
Sep 11 14:38:55.444476 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:55.444467    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="df679bad-54bb-45ad-95fb-2aacc36fe9be" containerName="main"
Sep 11 14:38:55.448108 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:55.448092    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-96e743-d99d79498-cf98r"
Sep 11 14:38:55.450774 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:55.450737    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-96e743\""
Sep 11 14:38:55.450957 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:55.450943    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-96e743-dockercfg-n9mwt\""
Sep 11 14:38:55.462530 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:55.462511    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-96e743-d99d79498-cf98r"]
Sep 11 14:38:55.523660 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:55.523595    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4grx7\" (UniqueName: \"kubernetes.io/projected/46f6a42a-0142-48af-8894-4bfbae026c7d-kube-api-access-4grx7\") pod \"payload-pre-processing-e2e-api-b-96e743-d99d79498-cf98r\" (UID: \"46f6a42a-0142-48af-8894-4bfbae026c7d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-96e743-d99d79498-cf98r"
Sep 11 14:38:55.523660 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:55.523633    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46f6a42a-0142-48af-8894-4bfbae026c7d-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-96e743-d99d79498-cf98r\" (UID: \"46f6a42a-0142-48af-8894-4bfbae026c7d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-96e743-d99d79498-cf98r"
Sep 11 14:38:55.625033 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:55.624990    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4grx7\" (UniqueName: \"kubernetes.io/projected/46f6a42a-0142-48af-8894-4bfbae026c7d-kube-api-access-4grx7\") pod \"payload-pre-processing-e2e-api-b-96e743-d99d79498-cf98r\" (UID: \"46f6a42a-0142-48af-8894-4bfbae026c7d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-96e743-d99d79498-cf98r"
Sep 11 14:38:55.625192 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:55.625050    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46f6a42a-0142-48af-8894-4bfbae026c7d-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-96e743-d99d79498-cf98r\" (UID: \"46f6a42a-0142-48af-8894-4bfbae026c7d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-96e743-d99d79498-cf98r"
Sep 11 14:38:55.625820 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:55.625799    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46f6a42a-0142-48af-8894-4bfbae026c7d-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-96e743-d99d79498-cf98r\" (UID: \"46f6a42a-0142-48af-8894-4bfbae026c7d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-96e743-d99d79498-cf98r"
Sep 11 14:38:55.634712 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:55.634667    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4grx7\" (UniqueName: \"kubernetes.io/projected/46f6a42a-0142-48af-8894-4bfbae026c7d-kube-api-access-4grx7\") pod \"payload-pre-processing-e2e-api-b-96e743-d99d79498-cf98r\" (UID: \"46f6a42a-0142-48af-8894-4bfbae026c7d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-96e743-d99d79498-cf98r"
Sep 11 14:38:55.758395 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:55.758373    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-96e743-d99d79498-cf98r"
Sep 11 14:38:56.033406 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:56.033383    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-96e743-d99d79498-cf98r"]
Sep 11 14:38:56.035276 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:38:56.035250    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46f6a42a_0142_48af_8894_4bfbae026c7d.slice/crio-afcecec796541c9ffe8e01f55fb568cd5d7f2856fb1332a7cb7539762d6850cb WatchSource:0}: Error finding container afcecec796541c9ffe8e01f55fb568cd5d7f2856fb1332a7cb7539762d6850cb: Status 404 returned error can't find the container with id afcecec796541c9ffe8e01f55fb568cd5d7f2856fb1332a7cb7539762d6850cb
Sep 11 14:38:56.530917 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:56.530841    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:38:56.823852 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:56.823816    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-96e743-d99d79498-cf98r" event={"ID":"46f6a42a-0142-48af-8894-4bfbae026c7d","Type":"ContainerStarted","Data":"c296f0c7e6408eab33da477c1e5ee5530bb1cb4f72150cb7baac7659d86afa4a"}
Sep 11 14:38:56.824233 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:56.823865    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-96e743-d99d79498-cf98r" event={"ID":"46f6a42a-0142-48af-8894-4bfbae026c7d","Type":"ContainerStarted","Data":"afcecec796541c9ffe8e01f55fb568cd5d7f2856fb1332a7cb7539762d6850cb"}
Sep 11 14:38:56.824233 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:56.823930    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-96e743-d99d79498-cf98r"
Sep 11 14:38:56.848997 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:38:56.848956    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-96e743-d99d79498-cf98r" podStartSLOduration=1.848942257 podStartE2EDuration="1.848942257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:38:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:38:56.848183124 +0000 UTC m=+1429.646817909" watchObservedRunningTime="2026-09-11 14:38:56.848942257 +0000 UTC m=+1429.647577039"
Sep 11 14:39:07.830895 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:07.830814    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-96e743-d99d79498-cf98r"
Sep 11 14:39:08.920821 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:08.920789    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:39:11.431832 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:11.431798    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"]
Sep 11 14:39:11.435440 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:11.435418    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"
Sep 11 14:39:11.442293 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:11.442270    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-344045\"/\"rate-test-model-344045-kserve-self-signed-certs\""
Sep 11 14:39:11.443023 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:11.443007    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-344045\"/\"kube-root-ca.crt\""
Sep 11 14:39:11.444453 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:11.444437    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-344045\"/\"openshift-service-ca.crt\""
Sep 11 14:39:11.445709 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:11.445668    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-344045\"/\"default-dockercfg-nh856\""
Sep 11 14:39:11.450271 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:11.450251    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"]
Sep 11 14:39:11.454848 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:11.454821    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:11.458888 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:11.458865    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac096169-d5da-4351-8e56-f44f2f182f07-tls-certs\") pod \"rate-test-model-344045-kserve-64c9fd8b7f-mtmh9\" (UID: \"ac096169-d5da-4351-8e56-f44f2f182f07\") " pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"
Sep 11 14:39:11.458979 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:11.458911    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c9sz\" (UniqueName: \"kubernetes.io/projected/ac096169-d5da-4351-8e56-f44f2f182f07-kube-api-access-5c9sz\") pod \"rate-test-model-344045-kserve-64c9fd8b7f-mtmh9\" (UID: \"ac096169-d5da-4351-8e56-f44f2f182f07\") " pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"
Sep 11 14:39:11.459031 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:11.459004    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac096169-d5da-4351-8e56-f44f2f182f07-model-cache\") pod \"rate-test-model-344045-kserve-64c9fd8b7f-mtmh9\" (UID: \"ac096169-d5da-4351-8e56-f44f2f182f07\") " pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"
Sep 11 14:39:11.459068 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:11.459034    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac096169-d5da-4351-8e56-f44f2f182f07-home\") pod \"rate-test-model-344045-kserve-64c9fd8b7f-mtmh9\" (UID: \"ac096169-d5da-4351-8e56-f44f2f182f07\") " pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"
Sep 11 14:39:11.459119 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:11.459106    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac096169-d5da-4351-8e56-f44f2f182f07-tmp-dir\") pod \"rate-test-model-344045-kserve-64c9fd8b7f-mtmh9\" (UID: \"ac096169-d5da-4351-8e56-f44f2f182f07\") " pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"
Sep 11 14:39:11.459160 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:11.459132    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac096169-d5da-4351-8e56-f44f2f182f07-dshm\") pod \"rate-test-model-344045-kserve-64c9fd8b7f-mtmh9\" (UID: \"ac096169-d5da-4351-8e56-f44f2f182f07\") " pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"
Sep 11 14:39:11.560006 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:11.559984    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac096169-d5da-4351-8e56-f44f2f182f07-tmp-dir\") pod \"rate-test-model-344045-kserve-64c9fd8b7f-mtmh9\" (UID: \"ac096169-d5da-4351-8e56-f44f2f182f07\") " pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"
Sep 11 14:39:11.560115 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:11.560020    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac096169-d5da-4351-8e56-f44f2f182f07-dshm\") pod \"rate-test-model-344045-kserve-64c9fd8b7f-mtmh9\" (UID: \"ac096169-d5da-4351-8e56-f44f2f182f07\") " pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"
Sep 11 14:39:11.560115 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:11.560045    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac096169-d5da-4351-8e56-f44f2f182f07-tls-certs\") pod \"rate-test-model-344045-kserve-64c9fd8b7f-mtmh9\" (UID: \"ac096169-d5da-4351-8e56-f44f2f182f07\") " pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"
Sep 11 14:39:11.560115 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:11.560084    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c9sz\" (UniqueName: \"kubernetes.io/projected/ac096169-d5da-4351-8e56-f44f2f182f07-kube-api-access-5c9sz\") pod \"rate-test-model-344045-kserve-64c9fd8b7f-mtmh9\" (UID: \"ac096169-d5da-4351-8e56-f44f2f182f07\") " pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"
Sep 11 14:39:11.560272 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:11.560144    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac096169-d5da-4351-8e56-f44f2f182f07-model-cache\") pod \"rate-test-model-344045-kserve-64c9fd8b7f-mtmh9\" (UID: \"ac096169-d5da-4351-8e56-f44f2f182f07\") " pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"
Sep 11 14:39:11.560272 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:11.560169    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac096169-d5da-4351-8e56-f44f2f182f07-home\") pod \"rate-test-model-344045-kserve-64c9fd8b7f-mtmh9\" (UID: \"ac096169-d5da-4351-8e56-f44f2f182f07\") " pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"
Sep 11 14:39:11.560419 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:11.560399    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac096169-d5da-4351-8e56-f44f2f182f07-tmp-dir\") pod \"rate-test-model-344045-kserve-64c9fd8b7f-mtmh9\" (UID: \"ac096169-d5da-4351-8e56-f44f2f182f07\") " pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"
Sep 11 14:39:11.560485 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:11.560454    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac096169-d5da-4351-8e56-f44f2f182f07-home\") pod \"rate-test-model-344045-kserve-64c9fd8b7f-mtmh9\" (UID: \"ac096169-d5da-4351-8e56-f44f2f182f07\") " pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"
Sep 11 14:39:11.560542 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:11.560517    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac096169-d5da-4351-8e56-f44f2f182f07-model-cache\") pod \"rate-test-model-344045-kserve-64c9fd8b7f-mtmh9\" (UID: \"ac096169-d5da-4351-8e56-f44f2f182f07\") " pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"
Sep 11 14:39:11.562314 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:11.562285    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac096169-d5da-4351-8e56-f44f2f182f07-dshm\") pod \"rate-test-model-344045-kserve-64c9fd8b7f-mtmh9\" (UID: \"ac096169-d5da-4351-8e56-f44f2f182f07\") " pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"
Sep 11 14:39:11.562533 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:11.562513    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac096169-d5da-4351-8e56-f44f2f182f07-tls-certs\") pod \"rate-test-model-344045-kserve-64c9fd8b7f-mtmh9\" (UID: \"ac096169-d5da-4351-8e56-f44f2f182f07\") " pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"
Sep 11 14:39:11.569376 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:11.569352    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c9sz\" (UniqueName: \"kubernetes.io/projected/ac096169-d5da-4351-8e56-f44f2f182f07-kube-api-access-5c9sz\") pod \"rate-test-model-344045-kserve-64c9fd8b7f-mtmh9\" (UID: \"ac096169-d5da-4351-8e56-f44f2f182f07\") " pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"
Sep 11 14:39:11.744712 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:11.744612    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"
Sep 11 14:39:12.026100 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:12.026065    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"]
Sep 11 14:39:12.029074 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:39:12.029047    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac096169_d5da_4351_8e56_f44f2f182f07.slice/crio-02a06a73b9ec6e0ab1b9a72d709310f86e5445ceb68ee7b2ee607357f9a210c4 WatchSource:0}: Error finding container 02a06a73b9ec6e0ab1b9a72d709310f86e5445ceb68ee7b2ee607357f9a210c4: Status 404 returned error can't find the container with id 02a06a73b9ec6e0ab1b9a72d709310f86e5445ceb68ee7b2ee607357f9a210c4
Sep 11 14:39:12.910235 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:12.910200    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9" event={"ID":"ac096169-d5da-4351-8e56-f44f2f182f07","Type":"ContainerStarted","Data":"5c7a107a3ad18c997af16f329987eea59e3c4a2db081061938e64700280b2cc2"}
Sep 11 14:39:12.910709 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:12.910244    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9" event={"ID":"ac096169-d5da-4351-8e56-f44f2f182f07","Type":"ContainerStarted","Data":"02a06a73b9ec6e0ab1b9a72d709310f86e5445ceb68ee7b2ee607357f9a210c4"}
Sep 11 14:39:12.939084 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:12.939032    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9" podStartSLOduration=1.9390169579999998 podStartE2EDuration="1.939016958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:39:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:39:12.937957871 +0000 UTC m=+1445.736592653" watchObservedRunningTime="2026-09-11 14:39:12.939016958 +0000 UTC m=+1445.737651737"
Sep 11 14:39:17.253152 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:17.253117    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:17.536650 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:17.536570    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:18.844061 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:18.844031    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:19.789160 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:19.789126    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:20.751636 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:20.751591    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:21.744979 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:21.744947    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"
Sep 11 14:39:21.745174 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:21.744993    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"
Sep 11 14:39:21.757748 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:21.757727    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"
Sep 11 14:39:21.766593 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:21.766570    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:21.971528 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:21.971505    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"
Sep 11 14:39:22.645442 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:22.645407    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:23.518283 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:23.518251    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:24.537295 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:24.537250    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:25.288173 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:25.288131    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:26.267487 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:26.267449    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:26.928477 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:26.928439    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:39:27.341496 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:27.341462    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:31.331429 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:31.331386    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:37.246056 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:37.246018    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:37.375630 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:37.375599    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2cabda-5b9c4895b5-c25vg"]
Sep 11 14:39:37.375904 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:37.375875    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-2cabda-5b9c4895b5-c25vg" podUID="b2b75a62-f4ee-4e05-a017-656e74b9598e" containerName="payload-processing" containerID="cri-o://d03f684c8c123a9cd77b0a1bd66cbc0a97fd2dcef20acada361d410cf3f4db3c" gracePeriod=30
Sep 11 14:39:37.409274 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:37.409247    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2cabda-5474dd8cb6-k89fw"]
Sep 11 14:39:37.409501 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:37.409478    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2cabda-5474dd8cb6-k89fw" podUID="bffd1b08-0d4c-4b91-bfcf-b1d4738376f0" containerName="payload-pre-processing" containerID="cri-o://bc206fd8149360aa7a5d37fb05e2b7ad907c4ba904ed1ebfd2c12abe02b25cf3" gracePeriod=30
Sep 11 14:39:37.456712 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:37.456662    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:37.560859 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:37.560799    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:37.656059 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:37.656035    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-2cabda-5b9c4895b5-c25vg"
Sep 11 14:39:37.693744 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:37.693721    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2cabda-5474dd8cb6-k89fw"
Sep 11 14:39:37.712292 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:37.712269    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:37.781983 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:37.781910    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmj8x\" (UniqueName: \"kubernetes.io/projected/bffd1b08-0d4c-4b91-bfcf-b1d4738376f0-kube-api-access-vmj8x\") pod \"bffd1b08-0d4c-4b91-bfcf-b1d4738376f0\" (UID: \"bffd1b08-0d4c-4b91-bfcf-b1d4738376f0\") "
Sep 11 14:39:37.782280 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:37.782253    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flm92\" (UniqueName: \"kubernetes.io/projected/b2b75a62-f4ee-4e05-a017-656e74b9598e-kube-api-access-flm92\") pod \"b2b75a62-f4ee-4e05-a017-656e74b9598e\" (UID: \"b2b75a62-f4ee-4e05-a017-656e74b9598e\") "
Sep 11 14:39:37.782407 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:37.782369    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2b75a62-f4ee-4e05-a017-656e74b9598e-plugins-config-volume\") pod \"b2b75a62-f4ee-4e05-a017-656e74b9598e\" (UID: \"b2b75a62-f4ee-4e05-a017-656e74b9598e\") "
Sep 11 14:39:37.782468 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:37.782415    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bffd1b08-0d4c-4b91-bfcf-b1d4738376f0-plugins-config-volume\") pod \"bffd1b08-0d4c-4b91-bfcf-b1d4738376f0\" (UID: \"bffd1b08-0d4c-4b91-bfcf-b1d4738376f0\") "
Sep 11 14:39:37.782895 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:37.782865    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bffd1b08-0d4c-4b91-bfcf-b1d4738376f0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bffd1b08-0d4c-4b91-bfcf-b1d4738376f0" (UID: "bffd1b08-0d4c-4b91-bfcf-b1d4738376f0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:39:37.783293 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:37.783264    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2b75a62-f4ee-4e05-a017-656e74b9598e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b2b75a62-f4ee-4e05-a017-656e74b9598e" (UID: "b2b75a62-f4ee-4e05-a017-656e74b9598e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:39:37.784700 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:37.784645    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bffd1b08-0d4c-4b91-bfcf-b1d4738376f0-kube-api-access-vmj8x" (OuterVolumeSpecName: "kube-api-access-vmj8x") pod "bffd1b08-0d4c-4b91-bfcf-b1d4738376f0" (UID: "bffd1b08-0d4c-4b91-bfcf-b1d4738376f0"). InnerVolumeSpecName "kube-api-access-vmj8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:39:37.784857 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:37.784833    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2b75a62-f4ee-4e05-a017-656e74b9598e-kube-api-access-flm92" (OuterVolumeSpecName: "kube-api-access-flm92") pod "b2b75a62-f4ee-4e05-a017-656e74b9598e" (UID: "b2b75a62-f4ee-4e05-a017-656e74b9598e"). InnerVolumeSpecName "kube-api-access-flm92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:39:37.837347 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:37.837319    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:37.883633 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:37.883607    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flm92\" (UniqueName: \"kubernetes.io/projected/b2b75a62-f4ee-4e05-a017-656e74b9598e-kube-api-access-flm92\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:39:37.883633 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:37.883630    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2b75a62-f4ee-4e05-a017-656e74b9598e-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:39:37.883633 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:37.883639    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bffd1b08-0d4c-4b91-bfcf-b1d4738376f0-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:39:37.883833 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:37.883647    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmj8x\" (UniqueName: \"kubernetes.io/projected/bffd1b08-0d4c-4b91-bfcf-b1d4738376f0-kube-api-access-vmj8x\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:39:38.046984 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:38.046952    2584 generic.go:356] "Generic (PLEG): container finished" podID="b2b75a62-f4ee-4e05-a017-656e74b9598e" containerID="d03f684c8c123a9cd77b0a1bd66cbc0a97fd2dcef20acada361d410cf3f4db3c" exitCode=0
Sep 11 14:39:38.047142 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:38.046989    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-2cabda-5b9c4895b5-c25vg"
Sep 11 14:39:38.047142 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:38.047047    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-2cabda-5b9c4895b5-c25vg" event={"ID":"b2b75a62-f4ee-4e05-a017-656e74b9598e","Type":"ContainerDied","Data":"d03f684c8c123a9cd77b0a1bd66cbc0a97fd2dcef20acada361d410cf3f4db3c"}
Sep 11 14:39:38.047142 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:38.047112    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-2cabda-5b9c4895b5-c25vg" event={"ID":"b2b75a62-f4ee-4e05-a017-656e74b9598e","Type":"ContainerDied","Data":"9aee909cb3fb0a913ccf9cb90a88ab8c2ae60d9cbc6c8935afd6c1ec615e083a"}
Sep 11 14:39:38.047142 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:38.047141    2584 scope.go:117] "RemoveContainer" containerID="d03f684c8c123a9cd77b0a1bd66cbc0a97fd2dcef20acada361d410cf3f4db3c"
Sep 11 14:39:38.048917 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:38.048883    2584 generic.go:356] "Generic (PLEG): container finished" podID="bffd1b08-0d4c-4b91-bfcf-b1d4738376f0" containerID="bc206fd8149360aa7a5d37fb05e2b7ad907c4ba904ed1ebfd2c12abe02b25cf3" exitCode=0
Sep 11 14:39:38.049032 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:38.048933    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2cabda-5474dd8cb6-k89fw"
Sep 11 14:39:38.049032 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:38.049020    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2cabda-5474dd8cb6-k89fw" event={"ID":"bffd1b08-0d4c-4b91-bfcf-b1d4738376f0","Type":"ContainerDied","Data":"bc206fd8149360aa7a5d37fb05e2b7ad907c4ba904ed1ebfd2c12abe02b25cf3"}
Sep 11 14:39:38.049152 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:38.049056    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2cabda-5474dd8cb6-k89fw" event={"ID":"bffd1b08-0d4c-4b91-bfcf-b1d4738376f0","Type":"ContainerDied","Data":"13573f7426c8f022d2397b4d726fd0d12604aefa475c0a893f520b85dd7e05c7"}
Sep 11 14:39:38.058436 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:38.058419    2584 scope.go:117] "RemoveContainer" containerID="d03f684c8c123a9cd77b0a1bd66cbc0a97fd2dcef20acada361d410cf3f4db3c"
Sep 11 14:39:38.058829 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:39:38.058800    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d03f684c8c123a9cd77b0a1bd66cbc0a97fd2dcef20acada361d410cf3f4db3c\": container with ID starting with d03f684c8c123a9cd77b0a1bd66cbc0a97fd2dcef20acada361d410cf3f4db3c not found: ID does not exist" containerID="d03f684c8c123a9cd77b0a1bd66cbc0a97fd2dcef20acada361d410cf3f4db3c"
Sep 11 14:39:38.058904 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:38.058842    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d03f684c8c123a9cd77b0a1bd66cbc0a97fd2dcef20acada361d410cf3f4db3c"} err="failed to get container status \"d03f684c8c123a9cd77b0a1bd66cbc0a97fd2dcef20acada361d410cf3f4db3c\": rpc error: code = NotFound desc = could not find container \"d03f684c8c123a9cd77b0a1bd66cbc0a97fd2dcef20acada361d410cf3f4db3c\": container with ID starting with d03f684c8c123a9cd77b0a1bd66cbc0a97fd2dcef20acada361d410cf3f4db3c not found: ID does not exist"
Sep 11 14:39:38.058904 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:38.058866    2584 scope.go:117] "RemoveContainer" containerID="bc206fd8149360aa7a5d37fb05e2b7ad907c4ba904ed1ebfd2c12abe02b25cf3"
Sep 11 14:39:38.066839 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:38.066823    2584 scope.go:117] "RemoveContainer" containerID="bc206fd8149360aa7a5d37fb05e2b7ad907c4ba904ed1ebfd2c12abe02b25cf3"
Sep 11 14:39:38.067105 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:39:38.067077    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc206fd8149360aa7a5d37fb05e2b7ad907c4ba904ed1ebfd2c12abe02b25cf3\": container with ID starting with bc206fd8149360aa7a5d37fb05e2b7ad907c4ba904ed1ebfd2c12abe02b25cf3 not found: ID does not exist" containerID="bc206fd8149360aa7a5d37fb05e2b7ad907c4ba904ed1ebfd2c12abe02b25cf3"
Sep 11 14:39:38.067144 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:38.067110    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc206fd8149360aa7a5d37fb05e2b7ad907c4ba904ed1ebfd2c12abe02b25cf3"} err="failed to get container status \"bc206fd8149360aa7a5d37fb05e2b7ad907c4ba904ed1ebfd2c12abe02b25cf3\": rpc error: code = NotFound desc = could not find container \"bc206fd8149360aa7a5d37fb05e2b7ad907c4ba904ed1ebfd2c12abe02b25cf3\": container with ID starting with bc206fd8149360aa7a5d37fb05e2b7ad907c4ba904ed1ebfd2c12abe02b25cf3 not found: ID does not exist"
Sep 11 14:39:38.089424 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:38.089403    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2cabda-5474dd8cb6-k89fw"]
Sep 11 14:39:38.099238 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:38.099220    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2cabda-5474dd8cb6-k89fw"]
Sep 11 14:39:38.116815 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:38.116793    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2cabda-5b9c4895b5-c25vg"]
Sep 11 14:39:38.122064 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:38.122036    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2cabda-5b9c4895b5-c25vg"]
Sep 11 14:39:38.260431 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:38.260393    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:38.425254 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:38.425223    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:39.416610 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:39.416572    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:39.680153 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:39.680087    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2b75a62-f4ee-4e05-a017-656e74b9598e" path="/var/lib/kubelet/pods/b2b75a62-f4ee-4e05-a017-656e74b9598e/volumes"
Sep 11 14:39:39.680674 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:39.680652    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bffd1b08-0d4c-4b91-bfcf-b1d4738376f0" path="/var/lib/kubelet/pods/bffd1b08-0d4c-4b91-bfcf-b1d4738376f0/volumes"
Sep 11 14:39:40.473266 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:40.473228    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:41.331748 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:41.331716    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:39:41.487872 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:41.487840    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:42.443286 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:42.443242    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:43.425730 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:43.425697    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:45.665043 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:45.665009    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:45.765592 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:45.765562    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:46.000535 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:46.000439    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:46.423894 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:46.423864    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-96e743-nk4jv"]
Sep 11 14:39:46.424318 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:46.424302    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bffd1b08-0d4c-4b91-bfcf-b1d4738376f0" containerName="payload-pre-processing"
Sep 11 14:39:46.424318 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:46.424318    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="bffd1b08-0d4c-4b91-bfcf-b1d4738376f0" containerName="payload-pre-processing"
Sep 11 14:39:46.424453 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:46.424345    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2b75a62-f4ee-4e05-a017-656e74b9598e" containerName="payload-processing"
Sep 11 14:39:46.424453 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:46.424351    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2b75a62-f4ee-4e05-a017-656e74b9598e" containerName="payload-processing"
Sep 11 14:39:46.424453 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:46.424412    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="bffd1b08-0d4c-4b91-bfcf-b1d4738376f0" containerName="payload-pre-processing"
Sep 11 14:39:46.424453 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:46.424420    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2b75a62-f4ee-4e05-a017-656e74b9598e" containerName="payload-processing"
Sep 11 14:39:46.429108 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:46.429086    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-96e743-nk4jv"
Sep 11 14:39:46.432178 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:46.432156    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dp8gp\""
Sep 11 14:39:46.440967 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:46.440945    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-96e743-nk4jv"]
Sep 11 14:39:46.557541 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:46.557507    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33ab79b0-a95e-4c98-a5fa-93aa85e65786-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-96e743-nk4jv\" (UID: \"33ab79b0-a95e-4c98-a5fa-93aa85e65786\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-96e743-nk4jv"
Sep 11 14:39:46.658520 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:46.658494    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33ab79b0-a95e-4c98-a5fa-93aa85e65786-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-96e743-nk4jv\" (UID: \"33ab79b0-a95e-4c98-a5fa-93aa85e65786\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-96e743-nk4jv"
Sep 11 14:39:46.659088 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:46.659069    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33ab79b0-a95e-4c98-a5fa-93aa85e65786-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-96e743-nk4jv\" (UID: \"33ab79b0-a95e-4c98-a5fa-93aa85e65786\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-96e743-nk4jv"
Sep 11 14:39:46.740693 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:46.740624    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-96e743-nk4jv"
Sep 11 14:39:47.055878 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:47.055808    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-96e743-nk4jv"]
Sep 11 14:39:47.058373 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:39:47.058344    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33ab79b0_a95e_4c98_a5fa_93aa85e65786.slice/crio-471158282a59f87a227451d57482158f9c74fc5edc746dd2329a9e42202feccd WatchSource:0}: Error finding container 471158282a59f87a227451d57482158f9c74fc5edc746dd2329a9e42202feccd: Status 404 returned error can't find the container with id 471158282a59f87a227451d57482158f9c74fc5edc746dd2329a9e42202feccd
Sep 11 14:39:47.097734 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:47.097707    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-96e743-nk4jv" event={"ID":"33ab79b0-a95e-4c98-a5fa-93aa85e65786","Type":"ContainerStarted","Data":"471158282a59f87a227451d57482158f9c74fc5edc746dd2329a9e42202feccd"}
Sep 11 14:39:47.580141 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:47.580063    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:48.104564 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:48.104534    2584 generic.go:356] "Generic (PLEG): container finished" podID="33ab79b0-a95e-4c98-a5fa-93aa85e65786" containerID="25c3d43f0ef1670d51e4eedde442731e1f55a39620a174ad59268fc4906cbf54" exitCode=0
Sep 11 14:39:48.104949 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:48.104625    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-96e743-nk4jv" event={"ID":"33ab79b0-a95e-4c98-a5fa-93aa85e65786","Type":"ContainerDied","Data":"25c3d43f0ef1670d51e4eedde442731e1f55a39620a174ad59268fc4906cbf54"}
Sep 11 14:39:48.395484 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:48.395394    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:49.240920 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:49.240896    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-96e743-nk4jv"
Sep 11 14:39:49.378854 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:49.378775    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:49.383763 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:49.383735    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33ab79b0-a95e-4c98-a5fa-93aa85e65786-maas-api-service-ca\") pod \"33ab79b0-a95e-4c98-a5fa-93aa85e65786\" (UID: \"33ab79b0-a95e-4c98-a5fa-93aa85e65786\") "
Sep 11 14:39:49.384084 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:49.384062    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33ab79b0-a95e-4c98-a5fa-93aa85e65786-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "33ab79b0-a95e-4c98-a5fa-93aa85e65786" (UID: "33ab79b0-a95e-4c98-a5fa-93aa85e65786"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:39:49.484327 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:49.484298    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33ab79b0-a95e-4c98-a5fa-93aa85e65786-maas-api-service-ca\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:39:50.120238 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:50.120193    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-96e743-nk4jv" event={"ID":"33ab79b0-a95e-4c98-a5fa-93aa85e65786","Type":"ContainerDied","Data":"471158282a59f87a227451d57482158f9c74fc5edc746dd2329a9e42202feccd"}
Sep 11 14:39:50.120426 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:50.120308    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="471158282a59f87a227451d57482158f9c74fc5edc746dd2329a9e42202feccd"
Sep 11 14:39:50.120426 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:50.120392    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-96e743-nk4jv"
Sep 11 14:39:50.146838 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:50.146810    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:50.951305 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:50.951271    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:39:51.665003 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:39:51.664972    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:00.817632 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:00.817598    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:40:02.367977 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:02.367936    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-96e743-d99d79498-cf98r"]
Sep 11 14:40:02.368419 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:02.368173    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-96e743-d99d79498-cf98r" podUID="46f6a42a-0142-48af-8894-4bfbae026c7d" containerName="payload-pre-processing" containerID="cri-o://c296f0c7e6408eab33da477c1e5ee5530bb1cb4f72150cb7baac7659d86afa4a" gracePeriod=30
Sep 11 14:40:02.569500 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:02.569440    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:02.575180 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:02.575148    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-96e743-nk4jv"]
Sep 11 14:40:02.587390 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:02.587358    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-96e743-nk4jv"]
Sep 11 14:40:02.651004 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:02.650970    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:02.657624 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:02.657602    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-96e743-d99d79498-cf98r"
Sep 11 14:40:02.798940 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:02.798906    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4grx7\" (UniqueName: \"kubernetes.io/projected/46f6a42a-0142-48af-8894-4bfbae026c7d-kube-api-access-4grx7\") pod \"46f6a42a-0142-48af-8894-4bfbae026c7d\" (UID: \"46f6a42a-0142-48af-8894-4bfbae026c7d\") "
Sep 11 14:40:02.799101 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:02.798975    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46f6a42a-0142-48af-8894-4bfbae026c7d-plugins-config-volume\") pod \"46f6a42a-0142-48af-8894-4bfbae026c7d\" (UID: \"46f6a42a-0142-48af-8894-4bfbae026c7d\") "
Sep 11 14:40:02.799433 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:02.799408    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46f6a42a-0142-48af-8894-4bfbae026c7d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "46f6a42a-0142-48af-8894-4bfbae026c7d" (UID: "46f6a42a-0142-48af-8894-4bfbae026c7d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:40:02.801091 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:02.801061    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46f6a42a-0142-48af-8894-4bfbae026c7d-kube-api-access-4grx7" (OuterVolumeSpecName: "kube-api-access-4grx7") pod "46f6a42a-0142-48af-8894-4bfbae026c7d" (UID: "46f6a42a-0142-48af-8894-4bfbae026c7d"). InnerVolumeSpecName "kube-api-access-4grx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:40:02.900079 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:02.900012    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46f6a42a-0142-48af-8894-4bfbae026c7d-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:40:02.900079 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:02.900035    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4grx7\" (UniqueName: \"kubernetes.io/projected/46f6a42a-0142-48af-8894-4bfbae026c7d-kube-api-access-4grx7\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:40:03.088838 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:03.088799    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:03.185986 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:03.185890    2584 generic.go:356] "Generic (PLEG): container finished" podID="46f6a42a-0142-48af-8894-4bfbae026c7d" containerID="c296f0c7e6408eab33da477c1e5ee5530bb1cb4f72150cb7baac7659d86afa4a" exitCode=0
Sep 11 14:40:03.185986 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:03.185950    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-96e743-d99d79498-cf98r"
Sep 11 14:40:03.186163 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:03.185975    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-96e743-d99d79498-cf98r" event={"ID":"46f6a42a-0142-48af-8894-4bfbae026c7d","Type":"ContainerDied","Data":"c296f0c7e6408eab33da477c1e5ee5530bb1cb4f72150cb7baac7659d86afa4a"}
Sep 11 14:40:03.186163 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:03.186032    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-96e743-d99d79498-cf98r" event={"ID":"46f6a42a-0142-48af-8894-4bfbae026c7d","Type":"ContainerDied","Data":"afcecec796541c9ffe8e01f55fb568cd5d7f2856fb1332a7cb7539762d6850cb"}
Sep 11 14:40:03.186163 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:03.186055    2584 scope.go:117] "RemoveContainer" containerID="c296f0c7e6408eab33da477c1e5ee5530bb1cb4f72150cb7baac7659d86afa4a"
Sep 11 14:40:03.196238 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:03.196220    2584 scope.go:117] "RemoveContainer" containerID="c296f0c7e6408eab33da477c1e5ee5530bb1cb4f72150cb7baac7659d86afa4a"
Sep 11 14:40:03.196513 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:40:03.196489    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c296f0c7e6408eab33da477c1e5ee5530bb1cb4f72150cb7baac7659d86afa4a\": container with ID starting with c296f0c7e6408eab33da477c1e5ee5530bb1cb4f72150cb7baac7659d86afa4a not found: ID does not exist" containerID="c296f0c7e6408eab33da477c1e5ee5530bb1cb4f72150cb7baac7659d86afa4a"
Sep 11 14:40:03.196593 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:03.196526    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c296f0c7e6408eab33da477c1e5ee5530bb1cb4f72150cb7baac7659d86afa4a"} err="failed to get container status \"c296f0c7e6408eab33da477c1e5ee5530bb1cb4f72150cb7baac7659d86afa4a\": rpc error: code = NotFound desc = could not find container \"c296f0c7e6408eab33da477c1e5ee5530bb1cb4f72150cb7baac7659d86afa4a\": container with ID starting with c296f0c7e6408eab33da477c1e5ee5530bb1cb4f72150cb7baac7659d86afa4a not found: ID does not exist"
Sep 11 14:40:03.212075 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:03.212055    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:03.222830 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:03.222806    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-96e743-d99d79498-cf98r"]
Sep 11 14:40:03.234613 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:03.234593    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-96e743-d99d79498-cf98r"]
Sep 11 14:40:03.680590 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:03.680547    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33ab79b0-a95e-4c98-a5fa-93aa85e65786" path="/var/lib/kubelet/pods/33ab79b0-a95e-4c98-a5fa-93aa85e65786/volumes"
Sep 11 14:40:03.681044 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:03.680920    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46f6a42a-0142-48af-8894-4bfbae026c7d" path="/var/lib/kubelet/pods/46f6a42a-0142-48af-8894-4bfbae026c7d/volumes"
Sep 11 14:40:04.560390 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:04.560352    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:04.872799 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:04.872727    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"]
Sep 11 14:40:04.895038 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:04.895009    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:05.330420 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:05.330386    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:05.702195 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:05.702123    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"]
Sep 11 14:40:05.730638 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:05.730612    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:06.693185 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:06.693147    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:06.832479 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:06.832446    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:06.957104 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:06.957023    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:07.491177 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:07.491140    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:07.629067 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:07.629036    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:09.724612 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:09.724580    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:10.370750 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:10.370710    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:10.487828 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:10.487796    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:10.841985 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:10.841952    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:11.658187 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:11.658150    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:11.753584 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:11.753552    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:11.959400 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:11.959305    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:12.345815 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:12.345783    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b934e8-nf489"]
Sep 11 14:40:12.346268 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:12.346249    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46f6a42a-0142-48af-8894-4bfbae026c7d" containerName="payload-pre-processing"
Sep 11 14:40:12.346268 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:12.346268    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="46f6a42a-0142-48af-8894-4bfbae026c7d" containerName="payload-pre-processing"
Sep 11 14:40:12.346429 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:12.346293    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33ab79b0-a95e-4c98-a5fa-93aa85e65786" containerName="revoke-keys"
Sep 11 14:40:12.346429 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:12.346298    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="33ab79b0-a95e-4c98-a5fa-93aa85e65786" containerName="revoke-keys"
Sep 11 14:40:12.346429 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:12.346376    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="46f6a42a-0142-48af-8894-4bfbae026c7d" containerName="payload-pre-processing"
Sep 11 14:40:12.346429 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:12.346398    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="33ab79b0-a95e-4c98-a5fa-93aa85e65786" containerName="revoke-keys"
Sep 11 14:40:12.356194 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:12.356156    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b934e8-nf489"
Sep 11 14:40:12.359137 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:12.359113    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dp8gp\""
Sep 11 14:40:12.360229 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:12.360206    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b934e8-nf489"]
Sep 11 14:40:12.381008 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:12.380975    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61115f9b-49fb-4e6a-8d91-d00848944218-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-b934e8-nf489\" (UID: \"61115f9b-49fb-4e6a-8d91-d00848944218\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b934e8-nf489"
Sep 11 14:40:12.481723 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:12.481665    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61115f9b-49fb-4e6a-8d91-d00848944218-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-b934e8-nf489\" (UID: \"61115f9b-49fb-4e6a-8d91-d00848944218\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b934e8-nf489"
Sep 11 14:40:12.482242 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:12.482224    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61115f9b-49fb-4e6a-8d91-d00848944218-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-b934e8-nf489\" (UID: \"61115f9b-49fb-4e6a-8d91-d00848944218\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b934e8-nf489"
Sep 11 14:40:12.669188 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:12.669116    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b934e8-nf489"
Sep 11 14:40:12.894600 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:12.894564    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:12.939919 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:12.939894    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b934e8-nf489"]
Sep 11 14:40:12.941813 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:40:12.941790    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61115f9b_49fb_4e6a_8d91_d00848944218.slice/crio-4c7e8b85d8383ec83e9c0418615ad689d109a83b3a6423bf00b9bfc92baa860d WatchSource:0}: Error finding container 4c7e8b85d8383ec83e9c0418615ad689d109a83b3a6423bf00b9bfc92baa860d: Status 404 returned error can't find the container with id 4c7e8b85d8383ec83e9c0418615ad689d109a83b3a6423bf00b9bfc92baa860d
Sep 11 14:40:13.241426 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:13.241344    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b934e8-nf489" event={"ID":"61115f9b-49fb-4e6a-8d91-d00848944218","Type":"ContainerStarted","Data":"573085c92bb93565ca914a437a7c7554cc5781600f44162b3a7afd694594b61c"}
Sep 11 14:40:13.241426 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:13.241400    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b934e8-nf489" event={"ID":"61115f9b-49fb-4e6a-8d91-d00848944218","Type":"ContainerStarted","Data":"4c7e8b85d8383ec83e9c0418615ad689d109a83b3a6423bf00b9bfc92baa860d"}
Sep 11 14:40:13.272441 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:13.272395    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b934e8-nf489" podStartSLOduration=1.272378539 podStartE2EDuration="1.272378539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:40:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:40:13.27191821 +0000 UTC m=+1506.070552992" watchObservedRunningTime="2026-09-11 14:40:13.272378539 +0000 UTC m=+1506.071013326"
Sep 11 14:40:13.931732 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:13.931673    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:14.248991 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:14.248901    2584 generic.go:356] "Generic (PLEG): container finished" podID="61115f9b-49fb-4e6a-8d91-d00848944218" containerID="573085c92bb93565ca914a437a7c7554cc5781600f44162b3a7afd694594b61c" exitCode=0
Sep 11 14:40:14.249371 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:14.248986    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b934e8-nf489" event={"ID":"61115f9b-49fb-4e6a-8d91-d00848944218","Type":"ContainerDied","Data":"573085c92bb93565ca914a437a7c7554cc5781600f44162b3a7afd694594b61c"}
Sep 11 14:40:14.823073 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:14.823033    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:14.923439 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:14.923399    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:15.086813 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.086743    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:15.325102 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.325064    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:15.393113 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.393091    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b934e8-nf489"
Sep 11 14:40:15.404362 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.404338    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61115f9b-49fb-4e6a-8d91-d00848944218-maas-api-service-ca\") pod \"61115f9b-49fb-4e6a-8d91-d00848944218\" (UID: \"61115f9b-49fb-4e6a-8d91-d00848944218\") "
Sep 11 14:40:15.404642 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.404619    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61115f9b-49fb-4e6a-8d91-d00848944218-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "61115f9b-49fb-4e6a-8d91-d00848944218" (UID: "61115f9b-49fb-4e6a-8d91-d00848944218"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:40:15.416188 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.416165    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:15.429107 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.429082    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a6c3fc-5cfcf6d4fd-2ms92"]
Sep 11 14:40:15.429495 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.429483    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61115f9b-49fb-4e6a-8d91-d00848944218" containerName="revoke-keys"
Sep 11 14:40:15.429544 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.429496    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="61115f9b-49fb-4e6a-8d91-d00848944218" containerName="revoke-keys"
Sep 11 14:40:15.429583 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.429566    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="61115f9b-49fb-4e6a-8d91-d00848944218" containerName="revoke-keys"
Sep 11 14:40:15.432557 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.432541    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a6c3fc-5cfcf6d4fd-2ms92"
Sep 11 14:40:15.435146 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.435128    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-a6c3fc\""
Sep 11 14:40:15.435256 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.435160    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-a6c3fc-dockercfg-gfcfj\""
Sep 11 14:40:15.446654 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.446629    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a6c3fc-5cfcf6d4fd-2ms92"]
Sep 11 14:40:15.467428 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.467405    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk"]
Sep 11 14:40:15.470868 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.470853    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk"
Sep 11 14:40:15.482338 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.482316    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk"]
Sep 11 14:40:15.505311 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.505289    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f4c02d7-e6f4-448f-b317-016c2b083384-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-a6c3fc-5cfcf6d4fd-2ms92\" (UID: \"9f4c02d7-e6f4-448f-b317-016c2b083384\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a6c3fc-5cfcf6d4fd-2ms92"
Sep 11 14:40:15.505403 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.505321    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/168b59e7-c911-4a2c-8573-8dbc3e91e9f9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk\" (UID: \"168b59e7-c911-4a2c-8573-8dbc3e91e9f9\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk"
Sep 11 14:40:15.505450 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.505400    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qw8b\" (UniqueName: \"kubernetes.io/projected/168b59e7-c911-4a2c-8573-8dbc3e91e9f9-kube-api-access-6qw8b\") pod \"payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk\" (UID: \"168b59e7-c911-4a2c-8573-8dbc3e91e9f9\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk"
Sep 11 14:40:15.505484 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.505458    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7nq6\" (UniqueName: \"kubernetes.io/projected/9f4c02d7-e6f4-448f-b317-016c2b083384-kube-api-access-p7nq6\") pod \"payload-pre-processing-e2e-ipp-a-a6c3fc-5cfcf6d4fd-2ms92\" (UID: \"9f4c02d7-e6f4-448f-b317-016c2b083384\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a6c3fc-5cfcf6d4fd-2ms92"
Sep 11 14:40:15.505516 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.505491    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61115f9b-49fb-4e6a-8d91-d00848944218-maas-api-service-ca\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:40:15.605966 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.605932    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qw8b\" (UniqueName: \"kubernetes.io/projected/168b59e7-c911-4a2c-8573-8dbc3e91e9f9-kube-api-access-6qw8b\") pod \"payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk\" (UID: \"168b59e7-c911-4a2c-8573-8dbc3e91e9f9\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk"
Sep 11 14:40:15.606110 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.606015    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7nq6\" (UniqueName: \"kubernetes.io/projected/9f4c02d7-e6f4-448f-b317-016c2b083384-kube-api-access-p7nq6\") pod \"payload-pre-processing-e2e-ipp-a-a6c3fc-5cfcf6d4fd-2ms92\" (UID: \"9f4c02d7-e6f4-448f-b317-016c2b083384\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a6c3fc-5cfcf6d4fd-2ms92"
Sep 11 14:40:15.606110 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.606063    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f4c02d7-e6f4-448f-b317-016c2b083384-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-a6c3fc-5cfcf6d4fd-2ms92\" (UID: \"9f4c02d7-e6f4-448f-b317-016c2b083384\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a6c3fc-5cfcf6d4fd-2ms92"
Sep 11 14:40:15.606230 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.606213    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/168b59e7-c911-4a2c-8573-8dbc3e91e9f9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk\" (UID: \"168b59e7-c911-4a2c-8573-8dbc3e91e9f9\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk"
Sep 11 14:40:15.606762 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.606745    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f4c02d7-e6f4-448f-b317-016c2b083384-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-a6c3fc-5cfcf6d4fd-2ms92\" (UID: \"9f4c02d7-e6f4-448f-b317-016c2b083384\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a6c3fc-5cfcf6d4fd-2ms92"
Sep 11 14:40:15.607124 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.607103    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/168b59e7-c911-4a2c-8573-8dbc3e91e9f9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk\" (UID: \"168b59e7-c911-4a2c-8573-8dbc3e91e9f9\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk"
Sep 11 14:40:15.614535 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.614511    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7nq6\" (UniqueName: \"kubernetes.io/projected/9f4c02d7-e6f4-448f-b317-016c2b083384-kube-api-access-p7nq6\") pod \"payload-pre-processing-e2e-ipp-a-a6c3fc-5cfcf6d4fd-2ms92\" (UID: \"9f4c02d7-e6f4-448f-b317-016c2b083384\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a6c3fc-5cfcf6d4fd-2ms92"
Sep 11 14:40:15.614646 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.614525    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qw8b\" (UniqueName: \"kubernetes.io/projected/168b59e7-c911-4a2c-8573-8dbc3e91e9f9-kube-api-access-6qw8b\") pod \"payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk\" (UID: \"168b59e7-c911-4a2c-8573-8dbc3e91e9f9\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk"
Sep 11 14:40:15.709120 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.709026    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:15.755276 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.755253    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a6c3fc-5cfcf6d4fd-2ms92"
Sep 11 14:40:15.780880 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:15.780848    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk"
Sep 11 14:40:16.015444 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:16.015363    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:40:16.030567 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:16.030544    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a6c3fc-5cfcf6d4fd-2ms92"]
Sep 11 14:40:16.032361 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:40:16.032326    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f4c02d7_e6f4_448f_b317_016c2b083384.slice/crio-61944aaa51df532d1fd07e20e9622300cea6c81bd8aef631da7a0def4e2b05ef WatchSource:0}: Error finding container 61944aaa51df532d1fd07e20e9622300cea6c81bd8aef631da7a0def4e2b05ef: Status 404 returned error can't find the container with id 61944aaa51df532d1fd07e20e9622300cea6c81bd8aef631da7a0def4e2b05ef
Sep 11 14:40:16.083672 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:16.083651    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk"]
Sep 11 14:40:16.085416 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:40:16.085389    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod168b59e7_c911_4a2c_8573_8dbc3e91e9f9.slice/crio-8dacf646ae9ff8b7d54e7bafb5e0d0869b37e1affe2d8edf2b21d36352900702 WatchSource:0}: Error finding container 8dacf646ae9ff8b7d54e7bafb5e0d0869b37e1affe2d8edf2b21d36352900702: Status 404 returned error can't find the container with id 8dacf646ae9ff8b7d54e7bafb5e0d0869b37e1affe2d8edf2b21d36352900702
Sep 11 14:40:16.262447 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:16.262412    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk" event={"ID":"168b59e7-c911-4a2c-8573-8dbc3e91e9f9","Type":"ContainerStarted","Data":"fe74ab5e737fc267b05439f5c02bb9d93236b1760219814ce1658b09d2af2a97"}
Sep 11 14:40:16.262640 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:16.262480    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk"
Sep 11 14:40:16.262640 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:16.262506    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk" event={"ID":"168b59e7-c911-4a2c-8573-8dbc3e91e9f9","Type":"ContainerStarted","Data":"8dacf646ae9ff8b7d54e7bafb5e0d0869b37e1affe2d8edf2b21d36352900702"}
Sep 11 14:40:16.263923 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:16.263901    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b934e8-nf489"
Sep 11 14:40:16.264037 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:16.263941    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b934e8-nf489" event={"ID":"61115f9b-49fb-4e6a-8d91-d00848944218","Type":"ContainerDied","Data":"4c7e8b85d8383ec83e9c0418615ad689d109a83b3a6423bf00b9bfc92baa860d"}
Sep 11 14:40:16.264037 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:16.263995    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c7e8b85d8383ec83e9c0418615ad689d109a83b3a6423bf00b9bfc92baa860d"
Sep 11 14:40:16.265827 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:16.265771    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a6c3fc-5cfcf6d4fd-2ms92" event={"ID":"9f4c02d7-e6f4-448f-b317-016c2b083384","Type":"ContainerStarted","Data":"636f21e7d7d135a177c786cc837167693cb8c2c82848e1265fa851f1ef511e1c"}
Sep 11 14:40:16.265827 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:16.265814    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a6c3fc-5cfcf6d4fd-2ms92" event={"ID":"9f4c02d7-e6f4-448f-b317-016c2b083384","Type":"ContainerStarted","Data":"61944aaa51df532d1fd07e20e9622300cea6c81bd8aef631da7a0def4e2b05ef"}
Sep 11 14:40:16.265988 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:16.265844    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a6c3fc-5cfcf6d4fd-2ms92"
Sep 11 14:40:16.343163 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:16.343121    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk" podStartSLOduration=1.343107148 podStartE2EDuration="1.343107148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:40:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:40:16.341764708 +0000 UTC m=+1509.140399523" watchObservedRunningTime="2026-09-11 14:40:16.343107148 +0000 UTC m=+1509.141741977"
Sep 11 14:40:16.388128 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:16.388076    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a6c3fc-5cfcf6d4fd-2ms92" podStartSLOduration=1.388057788 podStartE2EDuration="1.388057788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:40:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:40:16.387661023 +0000 UTC m=+1509.186295811" watchObservedRunningTime="2026-09-11 14:40:16.388057788 +0000 UTC m=+1509.186692571"
Sep 11 14:40:18.238723 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:18.238672    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:18.332398 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:18.332359    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:18.672421 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:18.672394    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:19.891087 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:19.891050    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn" podUID="a7125a67-f5b3-4287-91b5-751fae157148" containerName="main" containerID="cri-o://02ca662efa6b7c5edc69801566a5f4db5137bb6581539feee61b0af322052ffd" gracePeriod=45
Sep 11 14:40:20.140295 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:20.140269    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"
Sep 11 14:40:20.243261 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:20.243189    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bb2s2\" (UniqueName: \"kubernetes.io/projected/a7125a67-f5b3-4287-91b5-751fae157148-kube-api-access-bb2s2\") pod \"a7125a67-f5b3-4287-91b5-751fae157148\" (UID: \"a7125a67-f5b3-4287-91b5-751fae157148\") "
Sep 11 14:40:20.243261 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:20.243241    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7125a67-f5b3-4287-91b5-751fae157148-dshm\") pod \"a7125a67-f5b3-4287-91b5-751fae157148\" (UID: \"a7125a67-f5b3-4287-91b5-751fae157148\") "
Sep 11 14:40:20.243431 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:20.243280    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7125a67-f5b3-4287-91b5-751fae157148-home\") pod \"a7125a67-f5b3-4287-91b5-751fae157148\" (UID: \"a7125a67-f5b3-4287-91b5-751fae157148\") "
Sep 11 14:40:20.243431 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:20.243303    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7125a67-f5b3-4287-91b5-751fae157148-tls-certs\") pod \"a7125a67-f5b3-4287-91b5-751fae157148\" (UID: \"a7125a67-f5b3-4287-91b5-751fae157148\") "
Sep 11 14:40:20.243431 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:20.243319    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7125a67-f5b3-4287-91b5-751fae157148-tmp-dir\") pod \"a7125a67-f5b3-4287-91b5-751fae157148\" (UID: \"a7125a67-f5b3-4287-91b5-751fae157148\") "
Sep 11 14:40:20.243431 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:20.243387    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7125a67-f5b3-4287-91b5-751fae157148-model-cache\") pod \"a7125a67-f5b3-4287-91b5-751fae157148\" (UID: \"a7125a67-f5b3-4287-91b5-751fae157148\") "
Sep 11 14:40:20.243641 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:20.243522    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7125a67-f5b3-4287-91b5-751fae157148-home" (OuterVolumeSpecName: "home") pod "a7125a67-f5b3-4287-91b5-751fae157148" (UID: "a7125a67-f5b3-4287-91b5-751fae157148"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:40:20.243641 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:20.243601    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7125a67-f5b3-4287-91b5-751fae157148-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a7125a67-f5b3-4287-91b5-751fae157148" (UID: "a7125a67-f5b3-4287-91b5-751fae157148"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:40:20.243785 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:20.243732    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7125a67-f5b3-4287-91b5-751fae157148-model-cache" (OuterVolumeSpecName: "model-cache") pod "a7125a67-f5b3-4287-91b5-751fae157148" (UID: "a7125a67-f5b3-4287-91b5-751fae157148"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:40:20.243831 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:20.243793    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7125a67-f5b3-4287-91b5-751fae157148-home\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:40:20.243831 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:20.243811    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7125a67-f5b3-4287-91b5-751fae157148-tmp-dir\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:40:20.245307 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:20.245286    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7125a67-f5b3-4287-91b5-751fae157148-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a7125a67-f5b3-4287-91b5-751fae157148" (UID: "a7125a67-f5b3-4287-91b5-751fae157148"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:40:20.245749 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:20.245733    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7125a67-f5b3-4287-91b5-751fae157148-kube-api-access-bb2s2" (OuterVolumeSpecName: "kube-api-access-bb2s2") pod "a7125a67-f5b3-4287-91b5-751fae157148" (UID: "a7125a67-f5b3-4287-91b5-751fae157148"). InnerVolumeSpecName "kube-api-access-bb2s2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:40:20.245749 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:20.245739    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7125a67-f5b3-4287-91b5-751fae157148-dshm" (OuterVolumeSpecName: "dshm") pod "a7125a67-f5b3-4287-91b5-751fae157148" (UID: "a7125a67-f5b3-4287-91b5-751fae157148"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:40:20.288239 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:20.288208    2584 generic.go:356] "Generic (PLEG): container finished" podID="a7125a67-f5b3-4287-91b5-751fae157148" containerID="02ca662efa6b7c5edc69801566a5f4db5137bb6581539feee61b0af322052ffd" exitCode=0
Sep 11 14:40:20.288338 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:20.288251    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"
Sep 11 14:40:20.288338 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:20.288249    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn" event={"ID":"a7125a67-f5b3-4287-91b5-751fae157148","Type":"ContainerDied","Data":"02ca662efa6b7c5edc69801566a5f4db5137bb6581539feee61b0af322052ffd"}
Sep 11 14:40:20.288424 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:20.288354    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn" event={"ID":"a7125a67-f5b3-4287-91b5-751fae157148","Type":"ContainerDied","Data":"f806bb6e807ce9a08e4baa6817ac353f5a3186a73e5c6ef311f2dea5f3dd1cd9"}
Sep 11 14:40:20.288424 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:20.288372    2584 scope.go:117] "RemoveContainer" containerID="02ca662efa6b7c5edc69801566a5f4db5137bb6581539feee61b0af322052ffd"
Sep 11 14:40:20.298013 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:20.297998    2584 scope.go:117] "RemoveContainer" containerID="02ca662efa6b7c5edc69801566a5f4db5137bb6581539feee61b0af322052ffd"
Sep 11 14:40:20.298243 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:40:20.298221    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02ca662efa6b7c5edc69801566a5f4db5137bb6581539feee61b0af322052ffd\": container with ID starting with 02ca662efa6b7c5edc69801566a5f4db5137bb6581539feee61b0af322052ffd not found: ID does not exist" containerID="02ca662efa6b7c5edc69801566a5f4db5137bb6581539feee61b0af322052ffd"
Sep 11 14:40:20.298288 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:20.298250    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02ca662efa6b7c5edc69801566a5f4db5137bb6581539feee61b0af322052ffd"} err="failed to get container status \"02ca662efa6b7c5edc69801566a5f4db5137bb6581539feee61b0af322052ffd\": rpc error: code = NotFound desc = could not find container \"02ca662efa6b7c5edc69801566a5f4db5137bb6581539feee61b0af322052ffd\": container with ID starting with 02ca662efa6b7c5edc69801566a5f4db5137bb6581539feee61b0af322052ffd not found: ID does not exist"
Sep 11 14:40:20.311011 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:20.310987    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"]
Sep 11 14:40:20.316367 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:20.316345    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-72e046/rate-test-model-72e046-kserve-bd5f8db7-r4mbn"]
Sep 11 14:40:20.344578 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:20.344559    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7125a67-f5b3-4287-91b5-751fae157148-model-cache\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:40:20.344665 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:20.344580    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bb2s2\" (UniqueName: \"kubernetes.io/projected/a7125a67-f5b3-4287-91b5-751fae157148-kube-api-access-bb2s2\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:40:20.344665 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:20.344589    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7125a67-f5b3-4287-91b5-751fae157148-dshm\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:40:20.344665 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:20.344599    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7125a67-f5b3-4287-91b5-751fae157148-tls-certs\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:40:20.720778 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:20.720748    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9" podUID="ac096169-d5da-4351-8e56-f44f2f182f07" containerName="main" containerID="cri-o://5c7a107a3ad18c997af16f329987eea59e3c4a2db081061938e64700280b2cc2" gracePeriod=45
Sep 11 14:40:20.978041 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:20.977987    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"
Sep 11 14:40:21.051374 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:21.051348    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5c9sz\" (UniqueName: \"kubernetes.io/projected/ac096169-d5da-4351-8e56-f44f2f182f07-kube-api-access-5c9sz\") pod \"ac096169-d5da-4351-8e56-f44f2f182f07\" (UID: \"ac096169-d5da-4351-8e56-f44f2f182f07\") "
Sep 11 14:40:21.051518 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:21.051424    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac096169-d5da-4351-8e56-f44f2f182f07-tmp-dir\") pod \"ac096169-d5da-4351-8e56-f44f2f182f07\" (UID: \"ac096169-d5da-4351-8e56-f44f2f182f07\") "
Sep 11 14:40:21.051518 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:21.051477    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac096169-d5da-4351-8e56-f44f2f182f07-model-cache\") pod \"ac096169-d5da-4351-8e56-f44f2f182f07\" (UID: \"ac096169-d5da-4351-8e56-f44f2f182f07\") "
Sep 11 14:40:21.051518 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:21.051507    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac096169-d5da-4351-8e56-f44f2f182f07-tls-certs\") pod \"ac096169-d5da-4351-8e56-f44f2f182f07\" (UID: \"ac096169-d5da-4351-8e56-f44f2f182f07\") "
Sep 11 14:40:21.051717 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:21.051560    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac096169-d5da-4351-8e56-f44f2f182f07-home\") pod \"ac096169-d5da-4351-8e56-f44f2f182f07\" (UID: \"ac096169-d5da-4351-8e56-f44f2f182f07\") "
Sep 11 14:40:21.051717 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:21.051583    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac096169-d5da-4351-8e56-f44f2f182f07-dshm\") pod \"ac096169-d5da-4351-8e56-f44f2f182f07\" (UID: \"ac096169-d5da-4351-8e56-f44f2f182f07\") "
Sep 11 14:40:21.051825 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:21.051716    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac096169-d5da-4351-8e56-f44f2f182f07-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ac096169-d5da-4351-8e56-f44f2f182f07" (UID: "ac096169-d5da-4351-8e56-f44f2f182f07"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:40:21.051825 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:21.051743    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac096169-d5da-4351-8e56-f44f2f182f07-model-cache" (OuterVolumeSpecName: "model-cache") pod "ac096169-d5da-4351-8e56-f44f2f182f07" (UID: "ac096169-d5da-4351-8e56-f44f2f182f07"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:40:21.051905 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:21.051840    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac096169-d5da-4351-8e56-f44f2f182f07-home" (OuterVolumeSpecName: "home") pod "ac096169-d5da-4351-8e56-f44f2f182f07" (UID: "ac096169-d5da-4351-8e56-f44f2f182f07"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:40:21.051945 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:21.051927    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac096169-d5da-4351-8e56-f44f2f182f07-home\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:40:21.052002 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:21.051946    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac096169-d5da-4351-8e56-f44f2f182f07-tmp-dir\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:40:21.052002 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:21.051961    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac096169-d5da-4351-8e56-f44f2f182f07-model-cache\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:40:21.053443 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:21.053417    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac096169-d5da-4351-8e56-f44f2f182f07-kube-api-access-5c9sz" (OuterVolumeSpecName: "kube-api-access-5c9sz") pod "ac096169-d5da-4351-8e56-f44f2f182f07" (UID: "ac096169-d5da-4351-8e56-f44f2f182f07"). InnerVolumeSpecName "kube-api-access-5c9sz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:40:21.053608 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:21.053587    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac096169-d5da-4351-8e56-f44f2f182f07-dshm" (OuterVolumeSpecName: "dshm") pod "ac096169-d5da-4351-8e56-f44f2f182f07" (UID: "ac096169-d5da-4351-8e56-f44f2f182f07"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:40:21.053657 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:21.053587    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac096169-d5da-4351-8e56-f44f2f182f07-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ac096169-d5da-4351-8e56-f44f2f182f07" (UID: "ac096169-d5da-4351-8e56-f44f2f182f07"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:40:21.153312 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:21.153293    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5c9sz\" (UniqueName: \"kubernetes.io/projected/ac096169-d5da-4351-8e56-f44f2f182f07-kube-api-access-5c9sz\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:40:21.153312 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:21.153313    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac096169-d5da-4351-8e56-f44f2f182f07-tls-certs\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:40:21.153461 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:21.153323    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac096169-d5da-4351-8e56-f44f2f182f07-dshm\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:40:21.299043 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:21.299018    2584 generic.go:356] "Generic (PLEG): container finished" podID="ac096169-d5da-4351-8e56-f44f2f182f07" containerID="5c7a107a3ad18c997af16f329987eea59e3c4a2db081061938e64700280b2cc2" exitCode=0
Sep 11 14:40:21.299144 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:21.299063    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"
Sep 11 14:40:21.299144 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:21.299101    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9" event={"ID":"ac096169-d5da-4351-8e56-f44f2f182f07","Type":"ContainerDied","Data":"5c7a107a3ad18c997af16f329987eea59e3c4a2db081061938e64700280b2cc2"}
Sep 11 14:40:21.299144 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:21.299143    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9" event={"ID":"ac096169-d5da-4351-8e56-f44f2f182f07","Type":"ContainerDied","Data":"02a06a73b9ec6e0ab1b9a72d709310f86e5445ceb68ee7b2ee607357f9a210c4"}
Sep 11 14:40:21.299344 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:21.299161    2584 scope.go:117] "RemoveContainer" containerID="5c7a107a3ad18c997af16f329987eea59e3c4a2db081061938e64700280b2cc2"
Sep 11 14:40:21.307858 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:21.307840    2584 scope.go:117] "RemoveContainer" containerID="5c7a107a3ad18c997af16f329987eea59e3c4a2db081061938e64700280b2cc2"
Sep 11 14:40:21.308100 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:40:21.308082    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c7a107a3ad18c997af16f329987eea59e3c4a2db081061938e64700280b2cc2\": container with ID starting with 5c7a107a3ad18c997af16f329987eea59e3c4a2db081061938e64700280b2cc2 not found: ID does not exist" containerID="5c7a107a3ad18c997af16f329987eea59e3c4a2db081061938e64700280b2cc2"
Sep 11 14:40:21.308139 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:21.308112    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c7a107a3ad18c997af16f329987eea59e3c4a2db081061938e64700280b2cc2"} err="failed to get container status \"5c7a107a3ad18c997af16f329987eea59e3c4a2db081061938e64700280b2cc2\": rpc error: code = NotFound desc = could not find container \"5c7a107a3ad18c997af16f329987eea59e3c4a2db081061938e64700280b2cc2\": container with ID starting with 5c7a107a3ad18c997af16f329987eea59e3c4a2db081061938e64700280b2cc2 not found: ID does not exist"
Sep 11 14:40:21.323976 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:21.323957    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"]
Sep 11 14:40:21.326906 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:21.326887    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-344045/rate-test-model-344045-kserve-64c9fd8b7f-mtmh9"]
Sep 11 14:40:21.679307 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:21.679243    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7125a67-f5b3-4287-91b5-751fae157148" path="/var/lib/kubelet/pods/a7125a67-f5b3-4287-91b5-751fae157148/volumes"
Sep 11 14:40:21.679614 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:21.679601    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac096169-d5da-4351-8e56-f44f2f182f07" path="/var/lib/kubelet/pods/ac096169-d5da-4351-8e56-f44f2f182f07/volumes"
Sep 11 14:40:22.500350 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:22.500315    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:23.334507 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:23.334476    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:23.428200 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:23.428155    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b934e8-746b8dc7c4-m7zns"]
Sep 11 14:40:23.429032 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:23.428999    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b934e8-746b8dc7c4-m7zns" podUID="0c7e6f7c-e408-4097-a5fd-2e5da6526e6e" containerName="payload-pre-processing" containerID="cri-o://b1697f90136f4e037099f942f8e182138425cd141bea13e490f2b34bb79a1221" gracePeriod=30
Sep 11 14:40:23.471574 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:23.471529    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:23.578948 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:23.578916    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:23.701150 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:23.701123    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b934e8-746b8dc7c4-m7zns"
Sep 11 14:40:23.775086 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:23.775061    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c7e6f7c-e408-4097-a5fd-2e5da6526e6e-plugins-config-volume\") pod \"0c7e6f7c-e408-4097-a5fd-2e5da6526e6e\" (UID: \"0c7e6f7c-e408-4097-a5fd-2e5da6526e6e\") "
Sep 11 14:40:23.775243 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:23.775223    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhpfs\" (UniqueName: \"kubernetes.io/projected/0c7e6f7c-e408-4097-a5fd-2e5da6526e6e-kube-api-access-qhpfs\") pod \"0c7e6f7c-e408-4097-a5fd-2e5da6526e6e\" (UID: \"0c7e6f7c-e408-4097-a5fd-2e5da6526e6e\") "
Sep 11 14:40:23.775408 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:23.775379    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c7e6f7c-e408-4097-a5fd-2e5da6526e6e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0c7e6f7c-e408-4097-a5fd-2e5da6526e6e" (UID: "0c7e6f7c-e408-4097-a5fd-2e5da6526e6e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:40:23.775533 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:23.775514    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c7e6f7c-e408-4097-a5fd-2e5da6526e6e-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:40:23.777250 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:23.777211    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:23.777825 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:23.777804    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c7e6f7c-e408-4097-a5fd-2e5da6526e6e-kube-api-access-qhpfs" (OuterVolumeSpecName: "kube-api-access-qhpfs") pod "0c7e6f7c-e408-4097-a5fd-2e5da6526e6e" (UID: "0c7e6f7c-e408-4097-a5fd-2e5da6526e6e"). InnerVolumeSpecName "kube-api-access-qhpfs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:40:23.802218 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:23.802199    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b934e8-nf489"]
Sep 11 14:40:23.806258 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:23.806236    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b934e8-nf489"]
Sep 11 14:40:23.876294 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:23.876237    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhpfs\" (UniqueName: \"kubernetes.io/projected/0c7e6f7c-e408-4097-a5fd-2e5da6526e6e-kube-api-access-qhpfs\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:40:23.936092 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:23.936057    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:24.270605 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:24.270506    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:24.317733 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:24.317693    2584 generic.go:356] "Generic (PLEG): container finished" podID="0c7e6f7c-e408-4097-a5fd-2e5da6526e6e" containerID="b1697f90136f4e037099f942f8e182138425cd141bea13e490f2b34bb79a1221" exitCode=0
Sep 11 14:40:24.317733 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:24.317712    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b934e8-746b8dc7c4-m7zns" event={"ID":"0c7e6f7c-e408-4097-a5fd-2e5da6526e6e","Type":"ContainerDied","Data":"b1697f90136f4e037099f942f8e182138425cd141bea13e490f2b34bb79a1221"}
Sep 11 14:40:24.317977 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:24.317762    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b934e8-746b8dc7c4-m7zns"
Sep 11 14:40:24.317977 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:24.317780    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b934e8-746b8dc7c4-m7zns" event={"ID":"0c7e6f7c-e408-4097-a5fd-2e5da6526e6e","Type":"ContainerDied","Data":"33980c56233c7abcf380ce353e4662feb1c01705704dca30a19f710df17394b4"}
Sep 11 14:40:24.317977 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:24.317813    2584 scope.go:117] "RemoveContainer" containerID="b1697f90136f4e037099f942f8e182138425cd141bea13e490f2b34bb79a1221"
Sep 11 14:40:24.327207 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:24.327192    2584 scope.go:117] "RemoveContainer" containerID="b1697f90136f4e037099f942f8e182138425cd141bea13e490f2b34bb79a1221"
Sep 11 14:40:24.327465 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:40:24.327443    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1697f90136f4e037099f942f8e182138425cd141bea13e490f2b34bb79a1221\": container with ID starting with b1697f90136f4e037099f942f8e182138425cd141bea13e490f2b34bb79a1221 not found: ID does not exist" containerID="b1697f90136f4e037099f942f8e182138425cd141bea13e490f2b34bb79a1221"
Sep 11 14:40:24.327529 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:24.327471    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1697f90136f4e037099f942f8e182138425cd141bea13e490f2b34bb79a1221"} err="failed to get container status \"b1697f90136f4e037099f942f8e182138425cd141bea13e490f2b34bb79a1221\": rpc error: code = NotFound desc = could not find container \"b1697f90136f4e037099f942f8e182138425cd141bea13e490f2b34bb79a1221\": container with ID starting with b1697f90136f4e037099f942f8e182138425cd141bea13e490f2b34bb79a1221 not found: ID does not exist"
Sep 11 14:40:24.353545 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:24.353522    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b934e8-746b8dc7c4-m7zns"]
Sep 11 14:40:24.362106 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:24.362087    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b934e8-746b8dc7c4-m7zns"]
Sep 11 14:40:24.370386 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:24.370359    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:25.319125 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:25.319082    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:25.679758 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:25.679657    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c7e6f7c-e408-4097-a5fd-2e5da6526e6e" path="/var/lib/kubelet/pods/0c7e6f7c-e408-4097-a5fd-2e5da6526e6e/volumes"
Sep 11 14:40:25.680048 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:25.680032    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61115f9b-49fb-4e6a-8d91-d00848944218" path="/var/lib/kubelet/pods/61115f9b-49fb-4e6a-8d91-d00848944218/volumes"
Sep 11 14:40:26.373180 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:26.373147    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:27.273875 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:27.273843    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk"
Sep 11 14:40:27.274047 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:27.274031    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a6c3fc-5cfcf6d4fd-2ms92"
Sep 11 14:40:27.467568 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:27.467538    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:28.127652 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:28.127621    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:40:28.462794 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:28.462697    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:29.416605 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:29.416573    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:30.396357 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:30.396271    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:30.525129 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:30.525093    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:31.184737 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:31.184705    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:31.895744 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:31.895700    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:31.999456 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:31.999427    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:32.412256 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:32.412217    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:32.512657 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:32.512608    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:32.613460 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:32.613430    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:32.699400 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:32.699333    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-cd8e4a-8hwbz"]
Sep 11 14:40:32.699764 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:32.699749    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7125a67-f5b3-4287-91b5-751fae157148" containerName="main"
Sep 11 14:40:32.699764 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:32.699764    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7125a67-f5b3-4287-91b5-751fae157148" containerName="main"
Sep 11 14:40:32.699899 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:32.699791    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c7e6f7c-e408-4097-a5fd-2e5da6526e6e" containerName="payload-pre-processing"
Sep 11 14:40:32.699899 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:32.699797    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c7e6f7c-e408-4097-a5fd-2e5da6526e6e" containerName="payload-pre-processing"
Sep 11 14:40:32.699899 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:32.699812    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac096169-d5da-4351-8e56-f44f2f182f07" containerName="main"
Sep 11 14:40:32.699899 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:32.699819    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac096169-d5da-4351-8e56-f44f2f182f07" containerName="main"
Sep 11 14:40:32.699899 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:32.699884    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac096169-d5da-4351-8e56-f44f2f182f07" containerName="main"
Sep 11 14:40:32.699899 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:32.699892    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7125a67-f5b3-4287-91b5-751fae157148" containerName="main"
Sep 11 14:40:32.699899 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:32.699899    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c7e6f7c-e408-4097-a5fd-2e5da6526e6e" containerName="payload-pre-processing"
Sep 11 14:40:32.704305 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:32.704288    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-cd8e4a-8hwbz"
Sep 11 14:40:32.706836 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:32.706817    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dp8gp\""
Sep 11 14:40:32.712486 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:32.712452    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-cd8e4a-8hwbz"]
Sep 11 14:40:32.749990 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:32.749958    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/89a0dab6-b7ad-421c-a1cc-121b301ec94b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-cd8e4a-8hwbz\" (UID: \"89a0dab6-b7ad-421c-a1cc-121b301ec94b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-cd8e4a-8hwbz"
Sep 11 14:40:32.850748 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:32.850712    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/89a0dab6-b7ad-421c-a1cc-121b301ec94b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-cd8e4a-8hwbz\" (UID: \"89a0dab6-b7ad-421c-a1cc-121b301ec94b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-cd8e4a-8hwbz"
Sep 11 14:40:32.851219 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:32.851202    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/89a0dab6-b7ad-421c-a1cc-121b301ec94b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-cd8e4a-8hwbz\" (UID: \"89a0dab6-b7ad-421c-a1cc-121b301ec94b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-cd8e4a-8hwbz"
Sep 11 14:40:33.017261 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:33.017181    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-cd8e4a-8hwbz"
Sep 11 14:40:33.299416 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:33.299388    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-cd8e4a-8hwbz"]
Sep 11 14:40:33.301016 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:40:33.300987    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89a0dab6_b7ad_421c_a1cc_121b301ec94b.slice/crio-e71c585d64f62e53dcf2a9a98fe6d89a2a12f1ba0e6da7294348e795c631d092 WatchSource:0}: Error finding container e71c585d64f62e53dcf2a9a98fe6d89a2a12f1ba0e6da7294348e795c631d092: Status 404 returned error can't find the container with id e71c585d64f62e53dcf2a9a98fe6d89a2a12f1ba0e6da7294348e795c631d092
Sep 11 14:40:33.368285 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:33.368251    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:33.368520 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:33.368495    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-cd8e4a-8hwbz" event={"ID":"89a0dab6-b7ad-421c-a1cc-121b301ec94b","Type":"ContainerStarted","Data":"e71c585d64f62e53dcf2a9a98fe6d89a2a12f1ba0e6da7294348e795c631d092"}
Sep 11 14:40:34.375413 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:34.375377    2584 generic.go:356] "Generic (PLEG): container finished" podID="89a0dab6-b7ad-421c-a1cc-121b301ec94b" containerID="089d4cdcf79d99c55995fca49b1ae10747a6f06d6dd5dd24830b88a876b68e7a" exitCode=0
Sep 11 14:40:34.375804 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:34.375458    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-cd8e4a-8hwbz" event={"ID":"89a0dab6-b7ad-421c-a1cc-121b301ec94b","Type":"ContainerDied","Data":"089d4cdcf79d99c55995fca49b1ae10747a6f06d6dd5dd24830b88a876b68e7a"}
Sep 11 14:40:34.405206 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:34.405171    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:34.639460 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:34.639383    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:34.793898 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:34.793846    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:35.517116 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:35.517091    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-cd8e4a-8hwbz"
Sep 11 14:40:35.575799 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:35.575770    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/89a0dab6-b7ad-421c-a1cc-121b301ec94b-maas-api-service-ca\") pod \"89a0dab6-b7ad-421c-a1cc-121b301ec94b\" (UID: \"89a0dab6-b7ad-421c-a1cc-121b301ec94b\") "
Sep 11 14:40:35.576088 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:35.576065    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89a0dab6-b7ad-421c-a1cc-121b301ec94b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "89a0dab6-b7ad-421c-a1cc-121b301ec94b" (UID: "89a0dab6-b7ad-421c-a1cc-121b301ec94b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:40:35.677208 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:35.677138    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/89a0dab6-b7ad-421c-a1cc-121b301ec94b-maas-api-service-ca\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:40:35.790256 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:35.790230    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:36.387767 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:36.387733    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-cd8e4a-8hwbz"
Sep 11 14:40:36.387961 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:36.387739    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-cd8e4a-8hwbz" event={"ID":"89a0dab6-b7ad-421c-a1cc-121b301ec94b","Type":"ContainerDied","Data":"e71c585d64f62e53dcf2a9a98fe6d89a2a12f1ba0e6da7294348e795c631d092"}
Sep 11 14:40:36.387961 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:36.387851    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e71c585d64f62e53dcf2a9a98fe6d89a2a12f1ba0e6da7294348e795c631d092"
Sep 11 14:40:36.610267 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:36.610224    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:37.489497 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:37.489462    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:38.305156 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:38.305116    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:38.404787 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:38.404753    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:38.829989 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:38.829954    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:38.924381 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:38.924350    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:39.024538 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:39.024504    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-625d10-9d8479986-9rdzt"]
Sep 11 14:40:39.024962 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:39.024949    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89a0dab6-b7ad-421c-a1cc-121b301ec94b" containerName="revoke-keys"
Sep 11 14:40:39.025016 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:39.024963    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="89a0dab6-b7ad-421c-a1cc-121b301ec94b" containerName="revoke-keys"
Sep 11 14:40:39.025052 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:39.025029    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="89a0dab6-b7ad-421c-a1cc-121b301ec94b" containerName="revoke-keys"
Sep 11 14:40:39.028096 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:39.028079    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-625d10-9d8479986-9rdzt"
Sep 11 14:40:39.030660 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:39.030642    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-625d10\""
Sep 11 14:40:39.030839 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:39.030820    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-625d10-dockercfg-xgrdk\""
Sep 11 14:40:39.040236 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:39.040213    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-625d10-9d8479986-9rdzt"]
Sep 11 14:40:39.107473 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:39.107410    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzsvm\" (UniqueName: \"kubernetes.io/projected/eb93e5fb-1765-4565-9c92-b326b8558682-kube-api-access-zzsvm\") pod \"payload-pre-processing-e2e-ipp-b-625d10-9d8479986-9rdzt\" (UID: \"eb93e5fb-1765-4565-9c92-b326b8558682\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-625d10-9d8479986-9rdzt"
Sep 11 14:40:39.107570 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:39.107482    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb93e5fb-1765-4565-9c92-b326b8558682-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-625d10-9d8479986-9rdzt\" (UID: \"eb93e5fb-1765-4565-9c92-b326b8558682\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-625d10-9d8479986-9rdzt"
Sep 11 14:40:39.207939 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:39.207908    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzsvm\" (UniqueName: \"kubernetes.io/projected/eb93e5fb-1765-4565-9c92-b326b8558682-kube-api-access-zzsvm\") pod \"payload-pre-processing-e2e-ipp-b-625d10-9d8479986-9rdzt\" (UID: \"eb93e5fb-1765-4565-9c92-b326b8558682\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-625d10-9d8479986-9rdzt"
Sep 11 14:40:39.208065 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:39.207958    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb93e5fb-1765-4565-9c92-b326b8558682-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-625d10-9d8479986-9rdzt\" (UID: \"eb93e5fb-1765-4565-9c92-b326b8558682\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-625d10-9d8479986-9rdzt"
Sep 11 14:40:39.208639 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:39.208619    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb93e5fb-1765-4565-9c92-b326b8558682-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-625d10-9d8479986-9rdzt\" (UID: \"eb93e5fb-1765-4565-9c92-b326b8558682\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-625d10-9d8479986-9rdzt"
Sep 11 14:40:39.218475 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:39.218450    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzsvm\" (UniqueName: \"kubernetes.io/projected/eb93e5fb-1765-4565-9c92-b326b8558682-kube-api-access-zzsvm\") pod \"payload-pre-processing-e2e-ipp-b-625d10-9d8479986-9rdzt\" (UID: \"eb93e5fb-1765-4565-9c92-b326b8558682\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-625d10-9d8479986-9rdzt"
Sep 11 14:40:39.338732 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:39.338702    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-625d10-9d8479986-9rdzt"
Sep 11 14:40:39.478526 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:39.478490    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:39.616012 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:39.615982    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-625d10-9d8479986-9rdzt"]
Sep 11 14:40:39.617002 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:40:39.616971    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb93e5fb_1765_4565_9c92_b326b8558682.slice/crio-c909cde17852ff2177d9990ee312ee9e8b86b96b6516d16fcede559bb9114368 WatchSource:0}: Error finding container c909cde17852ff2177d9990ee312ee9e8b86b96b6516d16fcede559bb9114368: Status 404 returned error can't find the container with id c909cde17852ff2177d9990ee312ee9e8b86b96b6516d16fcede559bb9114368
Sep 11 14:40:40.230362 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:40.230321    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:40.413611 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:40.413574    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-625d10-9d8479986-9rdzt" event={"ID":"eb93e5fb-1765-4565-9c92-b326b8558682","Type":"ContainerStarted","Data":"be38fa9155975587f3f9ea85850dc3c132470e2d549a7fc837fdddb265de3dc6"}
Sep 11 14:40:40.413988 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:40.413628    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-625d10-9d8479986-9rdzt" event={"ID":"eb93e5fb-1765-4565-9c92-b326b8558682","Type":"ContainerStarted","Data":"c909cde17852ff2177d9990ee312ee9e8b86b96b6516d16fcede559bb9114368"}
Sep 11 14:40:40.413988 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:40.413695    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-625d10-9d8479986-9rdzt"
Sep 11 14:40:40.438294 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:40.438244    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-625d10-9d8479986-9rdzt" podStartSLOduration=1.438209248 podStartE2EDuration="1.438209248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:40:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:40:40.43651123 +0000 UTC m=+1533.235146013" watchObservedRunningTime="2026-09-11 14:40:40.438209248 +0000 UTC m=+1533.236844029"
Sep 11 14:40:41.082460 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:41.082426    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:42.609104 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:42.609067    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:40:42.866246 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:42.866163    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:43.915348 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:43.915307    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:43.952302 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:43.952275    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-cd8e4a-bcc6b8cb5-nrjx5"]
Sep 11 14:40:43.952495 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:43.952469    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-cd8e4a-bcc6b8cb5-nrjx5" podUID="bb8d38ca-5021-4e76-8477-5df285f18fd0" containerName="payload-processing" containerID="cri-o://20ecae8db1745c4de95a755ec660d4633e630ec732fc6910e8bd29719c7c0599" gracePeriod=30
Sep 11 14:40:43.964276 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:43.964253    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw"]
Sep 11 14:40:43.964435 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:43.964416    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw" podUID="217d55ad-149a-4640-b698-2770008e69b0" containerName="payload-pre-processing" containerID="cri-o://374b8abb96119e759a9f8b1d3407d32f83fe33a50983ae0f2ebb108c04a31558" gracePeriod=30
Sep 11 14:40:44.014637 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.014595    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:44.111459 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.111406    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:44.206926 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.206901    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-cd8e4a-8hwbz"]
Sep 11 14:40:44.210562 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.210535    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-cd8e4a-bcc6b8cb5-nrjx5"
Sep 11 14:40:44.217935 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.217861    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:44.218834 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.218812    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-cd8e4a-8hwbz"]
Sep 11 14:40:44.250926 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.250902    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw"
Sep 11 14:40:44.301873 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.301846    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:44.353520 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.353490    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lvhw\" (UniqueName: \"kubernetes.io/projected/217d55ad-149a-4640-b698-2770008e69b0-kube-api-access-4lvhw\") pod \"217d55ad-149a-4640-b698-2770008e69b0\" (UID: \"217d55ad-149a-4640-b698-2770008e69b0\") "
Sep 11 14:40:44.353647 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.353555    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb8d38ca-5021-4e76-8477-5df285f18fd0-plugins-config-volume\") pod \"bb8d38ca-5021-4e76-8477-5df285f18fd0\" (UID: \"bb8d38ca-5021-4e76-8477-5df285f18fd0\") "
Sep 11 14:40:44.353647 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.353616    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/217d55ad-149a-4640-b698-2770008e69b0-plugins-config-volume\") pod \"217d55ad-149a-4640-b698-2770008e69b0\" (UID: \"217d55ad-149a-4640-b698-2770008e69b0\") "
Sep 11 14:40:44.353785 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.353707    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvn9w\" (UniqueName: \"kubernetes.io/projected/bb8d38ca-5021-4e76-8477-5df285f18fd0-kube-api-access-qvn9w\") pod \"bb8d38ca-5021-4e76-8477-5df285f18fd0\" (UID: \"bb8d38ca-5021-4e76-8477-5df285f18fd0\") "
Sep 11 14:40:44.353965 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.353937    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb8d38ca-5021-4e76-8477-5df285f18fd0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bb8d38ca-5021-4e76-8477-5df285f18fd0" (UID: "bb8d38ca-5021-4e76-8477-5df285f18fd0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:40:44.354088 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.353980    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/217d55ad-149a-4640-b698-2770008e69b0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "217d55ad-149a-4640-b698-2770008e69b0" (UID: "217d55ad-149a-4640-b698-2770008e69b0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:40:44.354088 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.354027    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb8d38ca-5021-4e76-8477-5df285f18fd0-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:40:44.355646 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.355624    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/217d55ad-149a-4640-b698-2770008e69b0-kube-api-access-4lvhw" (OuterVolumeSpecName: "kube-api-access-4lvhw") pod "217d55ad-149a-4640-b698-2770008e69b0" (UID: "217d55ad-149a-4640-b698-2770008e69b0"). InnerVolumeSpecName "kube-api-access-4lvhw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:40:44.355918 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.355899    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb8d38ca-5021-4e76-8477-5df285f18fd0-kube-api-access-qvn9w" (OuterVolumeSpecName: "kube-api-access-qvn9w") pod "bb8d38ca-5021-4e76-8477-5df285f18fd0" (UID: "bb8d38ca-5021-4e76-8477-5df285f18fd0"). InnerVolumeSpecName "kube-api-access-qvn9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:40:44.435312 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.435242    2584 generic.go:356] "Generic (PLEG): container finished" podID="bb8d38ca-5021-4e76-8477-5df285f18fd0" containerID="20ecae8db1745c4de95a755ec660d4633e630ec732fc6910e8bd29719c7c0599" exitCode=0
Sep 11 14:40:44.435312 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.435287    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-cd8e4a-bcc6b8cb5-nrjx5"
Sep 11 14:40:44.435486 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.435324    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-cd8e4a-bcc6b8cb5-nrjx5" event={"ID":"bb8d38ca-5021-4e76-8477-5df285f18fd0","Type":"ContainerDied","Data":"20ecae8db1745c4de95a755ec660d4633e630ec732fc6910e8bd29719c7c0599"}
Sep 11 14:40:44.435486 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.435394    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-cd8e4a-bcc6b8cb5-nrjx5" event={"ID":"bb8d38ca-5021-4e76-8477-5df285f18fd0","Type":"ContainerDied","Data":"dd2f42ad1a57dfe43ffa8105a88c845d8c950241fd2bc060e4875ce97e33edcd"}
Sep 11 14:40:44.435486 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.435429    2584 scope.go:117] "RemoveContainer" containerID="20ecae8db1745c4de95a755ec660d4633e630ec732fc6910e8bd29719c7c0599"
Sep 11 14:40:44.437086 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.437057    2584 generic.go:356] "Generic (PLEG): container finished" podID="217d55ad-149a-4640-b698-2770008e69b0" containerID="374b8abb96119e759a9f8b1d3407d32f83fe33a50983ae0f2ebb108c04a31558" exitCode=0
Sep 11 14:40:44.437211 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.437088    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw" event={"ID":"217d55ad-149a-4640-b698-2770008e69b0","Type":"ContainerDied","Data":"374b8abb96119e759a9f8b1d3407d32f83fe33a50983ae0f2ebb108c04a31558"}
Sep 11 14:40:44.437211 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.437109    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw"
Sep 11 14:40:44.437211 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.437146    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw" event={"ID":"217d55ad-149a-4640-b698-2770008e69b0","Type":"ContainerDied","Data":"a933df36de588237b4207ee21a211dd95ca51620fd9ed7303e78b0f45e62ea81"}
Sep 11 14:40:44.446441 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.446412    2584 scope.go:117] "RemoveContainer" containerID="20ecae8db1745c4de95a755ec660d4633e630ec732fc6910e8bd29719c7c0599"
Sep 11 14:40:44.450358 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:40:44.450331    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20ecae8db1745c4de95a755ec660d4633e630ec732fc6910e8bd29719c7c0599\": container with ID starting with 20ecae8db1745c4de95a755ec660d4633e630ec732fc6910e8bd29719c7c0599 not found: ID does not exist" containerID="20ecae8db1745c4de95a755ec660d4633e630ec732fc6910e8bd29719c7c0599"
Sep 11 14:40:44.450462 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.450362    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20ecae8db1745c4de95a755ec660d4633e630ec732fc6910e8bd29719c7c0599"} err="failed to get container status \"20ecae8db1745c4de95a755ec660d4633e630ec732fc6910e8bd29719c7c0599\": rpc error: code = NotFound desc = could not find container \"20ecae8db1745c4de95a755ec660d4633e630ec732fc6910e8bd29719c7c0599\": container with ID starting with 20ecae8db1745c4de95a755ec660d4633e630ec732fc6910e8bd29719c7c0599 not found: ID does not exist"
Sep 11 14:40:44.450462 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.450379    2584 scope.go:117] "RemoveContainer" containerID="374b8abb96119e759a9f8b1d3407d32f83fe33a50983ae0f2ebb108c04a31558"
Sep 11 14:40:44.454435 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.454411    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lvhw\" (UniqueName: \"kubernetes.io/projected/217d55ad-149a-4640-b698-2770008e69b0-kube-api-access-4lvhw\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:40:44.454513 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.454441    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/217d55ad-149a-4640-b698-2770008e69b0-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:40:44.454513 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.454455    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvn9w\" (UniqueName: \"kubernetes.io/projected/bb8d38ca-5021-4e76-8477-5df285f18fd0-kube-api-access-qvn9w\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:40:44.458650 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.458631    2584 scope.go:117] "RemoveContainer" containerID="374b8abb96119e759a9f8b1d3407d32f83fe33a50983ae0f2ebb108c04a31558"
Sep 11 14:40:44.458907 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:40:44.458888    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"374b8abb96119e759a9f8b1d3407d32f83fe33a50983ae0f2ebb108c04a31558\": container with ID starting with 374b8abb96119e759a9f8b1d3407d32f83fe33a50983ae0f2ebb108c04a31558 not found: ID does not exist" containerID="374b8abb96119e759a9f8b1d3407d32f83fe33a50983ae0f2ebb108c04a31558"
Sep 11 14:40:44.458959 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.458913    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"374b8abb96119e759a9f8b1d3407d32f83fe33a50983ae0f2ebb108c04a31558"} err="failed to get container status \"374b8abb96119e759a9f8b1d3407d32f83fe33a50983ae0f2ebb108c04a31558\": rpc error: code = NotFound desc = could not find container \"374b8abb96119e759a9f8b1d3407d32f83fe33a50983ae0f2ebb108c04a31558\": container with ID starting with 374b8abb96119e759a9f8b1d3407d32f83fe33a50983ae0f2ebb108c04a31558 not found: ID does not exist"
Sep 11 14:40:44.468007 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.467985    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw"]
Sep 11 14:40:44.477693 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.477658    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-cd8e4a-5dbd98768b-5tqqw"]
Sep 11 14:40:44.491735 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.491715    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-cd8e4a-bcc6b8cb5-nrjx5"]
Sep 11 14:40:44.495711 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.495688    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-cd8e4a-bcc6b8cb5-nrjx5"]
Sep 11 14:40:44.617028 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.616995    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:44.768192 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:44.768114    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:45.631883 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:45.631846    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:45.680050 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:45.680023    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="217d55ad-149a-4640-b698-2770008e69b0" path="/var/lib/kubelet/pods/217d55ad-149a-4640-b698-2770008e69b0/volumes"
Sep 11 14:40:45.680337 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:45.680323    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89a0dab6-b7ad-421c-a1cc-121b301ec94b" path="/var/lib/kubelet/pods/89a0dab6-b7ad-421c-a1cc-121b301ec94b/volumes"
Sep 11 14:40:45.680673 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:45.680658    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb8d38ca-5021-4e76-8477-5df285f18fd0" path="/var/lib/kubelet/pods/bb8d38ca-5021-4e76-8477-5df285f18fd0/volumes"
Sep 11 14:40:46.678314 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:46.678279    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:47.970166 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:47.970128    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:48.803152 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:48.803106    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:49.320348 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:49.320312    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:49.849837 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:49.849804    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:51.051934 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:51.051902    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:51.421267 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:51.421199    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-625d10-9d8479986-9rdzt"
Sep 11 14:40:51.815148 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:51.815109    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:52.570970 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:52.570936    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:52.776996 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:52.776966    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:52.881328 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:52.881262    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:53.148828 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:53.148738    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:53.596240 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:53.596204    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:40:56.247871 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:56.247835    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:40:59.317254 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:40:59.317212    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:41:00.013446 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:00.013416    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-7v489_6f7d76f2-d602-4dfa-a01c-67d6294ea8ac/payload-processing/0.log"
Sep 11 14:41:18.398482 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:18.398451    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:41:28.937752 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:28.937719    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"]
Sep 11 14:41:28.938332 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:28.938311    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb8d38ca-5021-4e76-8477-5df285f18fd0" containerName="payload-processing"
Sep 11 14:41:28.938418 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:28.938335    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb8d38ca-5021-4e76-8477-5df285f18fd0" containerName="payload-processing"
Sep 11 14:41:28.938418 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:28.938348    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="217d55ad-149a-4640-b698-2770008e69b0" containerName="payload-pre-processing"
Sep 11 14:41:28.938418 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:28.938358    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="217d55ad-149a-4640-b698-2770008e69b0" containerName="payload-pre-processing"
Sep 11 14:41:28.938574 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:28.938464    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb8d38ca-5021-4e76-8477-5df285f18fd0" containerName="payload-processing"
Sep 11 14:41:28.938574 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:28.938480    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="217d55ad-149a-4640-b698-2770008e69b0" containerName="payload-pre-processing"
Sep 11 14:41:28.941810 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:28.941789    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"
Sep 11 14:41:28.964085 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:28.964055    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"]
Sep 11 14:41:28.970817 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:28.970797    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-a6c3fc\"/\"kube-root-ca.crt\""
Sep 11 14:41:28.971620 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:28.971599    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-a6c3fc\"/\"default-dockercfg-knf7m\""
Sep 11 14:41:28.971754 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:28.971625    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-a6c3fc\"/\"openshift-service-ca.crt\""
Sep 11 14:41:28.974297 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:28.974279    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-a6c3fc\"/\"ipp-route-a6c3fc-kserve-self-signed-certs\""
Sep 11 14:41:29.019065 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:29.019041    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/472cd276-653a-4092-8711-bbf1cd20a038-tls-certs\") pod \"ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f\" (UID: \"472cd276-653a-4092-8711-bbf1cd20a038\") " pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"
Sep 11 14:41:29.019182 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:29.019073    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/472cd276-653a-4092-8711-bbf1cd20a038-home\") pod \"ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f\" (UID: \"472cd276-653a-4092-8711-bbf1cd20a038\") " pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"
Sep 11 14:41:29.019182 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:29.019096    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/472cd276-653a-4092-8711-bbf1cd20a038-model-cache\") pod \"ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f\" (UID: \"472cd276-653a-4092-8711-bbf1cd20a038\") " pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"
Sep 11 14:41:29.019182 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:29.019152    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d74gk\" (UniqueName: \"kubernetes.io/projected/472cd276-653a-4092-8711-bbf1cd20a038-kube-api-access-d74gk\") pod \"ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f\" (UID: \"472cd276-653a-4092-8711-bbf1cd20a038\") " pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"
Sep 11 14:41:29.019353 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:29.019262    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/472cd276-653a-4092-8711-bbf1cd20a038-tmp-dir\") pod \"ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f\" (UID: \"472cd276-653a-4092-8711-bbf1cd20a038\") " pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"
Sep 11 14:41:29.019353 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:29.019316    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/472cd276-653a-4092-8711-bbf1cd20a038-dshm\") pod \"ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f\" (UID: \"472cd276-653a-4092-8711-bbf1cd20a038\") " pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"
Sep 11 14:41:29.022064 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:29.022025    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:41:29.120707 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:29.120667    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/472cd276-653a-4092-8711-bbf1cd20a038-tls-certs\") pod \"ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f\" (UID: \"472cd276-653a-4092-8711-bbf1cd20a038\") " pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"
Sep 11 14:41:29.120822 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:29.120715    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/472cd276-653a-4092-8711-bbf1cd20a038-home\") pod \"ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f\" (UID: \"472cd276-653a-4092-8711-bbf1cd20a038\") " pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"
Sep 11 14:41:29.120822 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:29.120750    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/472cd276-653a-4092-8711-bbf1cd20a038-model-cache\") pod \"ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f\" (UID: \"472cd276-653a-4092-8711-bbf1cd20a038\") " pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"
Sep 11 14:41:29.120822 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:29.120776    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d74gk\" (UniqueName: \"kubernetes.io/projected/472cd276-653a-4092-8711-bbf1cd20a038-kube-api-access-d74gk\") pod \"ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f\" (UID: \"472cd276-653a-4092-8711-bbf1cd20a038\") " pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"
Sep 11 14:41:29.120998 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:29.120866    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/472cd276-653a-4092-8711-bbf1cd20a038-tmp-dir\") pod \"ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f\" (UID: \"472cd276-653a-4092-8711-bbf1cd20a038\") " pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"
Sep 11 14:41:29.120998 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:29.120920    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/472cd276-653a-4092-8711-bbf1cd20a038-dshm\") pod \"ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f\" (UID: \"472cd276-653a-4092-8711-bbf1cd20a038\") " pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"
Sep 11 14:41:29.121302 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:29.121280    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/472cd276-653a-4092-8711-bbf1cd20a038-home\") pod \"ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f\" (UID: \"472cd276-653a-4092-8711-bbf1cd20a038\") " pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"
Sep 11 14:41:29.121404 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:29.121354    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/472cd276-653a-4092-8711-bbf1cd20a038-model-cache\") pod \"ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f\" (UID: \"472cd276-653a-4092-8711-bbf1cd20a038\") " pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"
Sep 11 14:41:29.121404 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:29.121294    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/472cd276-653a-4092-8711-bbf1cd20a038-tmp-dir\") pod \"ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f\" (UID: \"472cd276-653a-4092-8711-bbf1cd20a038\") " pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"
Sep 11 14:41:29.123123 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:29.123103    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/472cd276-653a-4092-8711-bbf1cd20a038-dshm\") pod \"ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f\" (UID: \"472cd276-653a-4092-8711-bbf1cd20a038\") " pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"
Sep 11 14:41:29.123707 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:29.123672    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/472cd276-653a-4092-8711-bbf1cd20a038-tls-certs\") pod \"ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f\" (UID: \"472cd276-653a-4092-8711-bbf1cd20a038\") " pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"
Sep 11 14:41:29.138982 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:29.138955    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d74gk\" (UniqueName: \"kubernetes.io/projected/472cd276-653a-4092-8711-bbf1cd20a038-kube-api-access-d74gk\") pod \"ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f\" (UID: \"472cd276-653a-4092-8711-bbf1cd20a038\") " pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"
Sep 11 14:41:29.250397 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:29.250335    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"
Sep 11 14:41:29.534729 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:29.534706    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"]
Sep 11 14:41:29.536426 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:41:29.536403    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod472cd276_653a_4092_8711_bbf1cd20a038.slice/crio-8146af28bc9854b1a34777f1af5e920b713145171195c78e430d0d6a51bd30e6 WatchSource:0}: Error finding container 8146af28bc9854b1a34777f1af5e920b713145171195c78e430d0d6a51bd30e6: Status 404 returned error can't find the container with id 8146af28bc9854b1a34777f1af5e920b713145171195c78e430d0d6a51bd30e6
Sep 11 14:41:29.680327 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:29.680290    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f" event={"ID":"472cd276-653a-4092-8711-bbf1cd20a038","Type":"ContainerStarted","Data":"c8f9647b76ab1e0c859e4516d0b1e5411c39e90a5bcde0cb8fc8c371992e986f"}
Sep 11 14:41:29.680478 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:29.680336    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f" event={"ID":"472cd276-653a-4092-8711-bbf1cd20a038","Type":"ContainerStarted","Data":"8146af28bc9854b1a34777f1af5e920b713145171195c78e430d0d6a51bd30e6"}
Sep 11 14:41:29.703200 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:29.703157    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f" podStartSLOduration=1.7031415060000001 podStartE2EDuration="1.703141506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:41:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:41:29.702659671 +0000 UTC m=+1582.501294454" watchObservedRunningTime="2026-09-11 14:41:29.703141506 +0000 UTC m=+1582.501776288"
Sep 11 14:41:33.004961 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:33.004927    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:41:39.251461 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:39.251429    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"
Sep 11 14:41:39.251461 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:39.251469    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"
Sep 11 14:41:39.263478 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:39.263455    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"
Sep 11 14:41:39.746969 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:39.746938    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"
Sep 11 14:41:46.000875 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:46.000844    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:41:51.474998 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:51.474966    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk_168b59e7-c911-4a2c-8573-8dbc3e91e9f9/payload-processing/0.log"
Sep 11 14:41:51.609796 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:51.609771    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-7v489_6f7d76f2-d602-4dfa-a01c-67d6294ea8ac/payload-processing/0.log"
Sep 11 14:41:52.068620 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:52.068593    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:41:52.421927 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:52.421846    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:41:52.595879 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:52.595851    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:41:55.216212 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:55.216177    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:41:55.906648 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:55.906611    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:41:55.994308 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:55.994259    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:41:56.884998 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:56.884953    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:41:57.827480 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:57.827441    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:41:58.775374 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:58.775336    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:41:59.621054 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:59.621020    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:41:59.722522 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:59.722489    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:41:59.824769 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:41:59.824732    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:00.099890 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:00.099855    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:00.201878 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:00.201847    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:00.226207 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:00.226179    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-902e45-8698c47dfd-v4l5m"]
Sep 11 14:42:00.229988 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:00.229964    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-902e45-8698c47dfd-v4l5m"
Sep 11 14:42:00.232597 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:00.232573    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-902e45\""
Sep 11 14:42:00.232729 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:00.232602    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-902e45-dockercfg-pcv82\""
Sep 11 14:42:00.244467 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:00.244445    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-902e45-8698c47dfd-v4l5m"]
Sep 11 14:42:00.254951 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:00.254929    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-902e45-7bd755469c-2wqrs"]
Sep 11 14:42:00.258258 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:00.258241    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-902e45-7bd755469c-2wqrs"
Sep 11 14:42:00.272836 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:00.272816    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-902e45-7bd755469c-2wqrs"]
Sep 11 14:42:00.289801 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:00.289768    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:00.375838 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:00.375772    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stmrf\" (UniqueName: \"kubernetes.io/projected/37fd735c-57c0-4823-b30c-69050c409776-kube-api-access-stmrf\") pod \"payload-processing-e2e-ipp-cleanup-902e45-7bd755469c-2wqrs\" (UID: \"37fd735c-57c0-4823-b30c-69050c409776\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-902e45-7bd755469c-2wqrs"
Sep 11 14:42:00.375838 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:00.375816    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37fd735c-57c0-4823-b30c-69050c409776-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-902e45-7bd755469c-2wqrs\" (UID: \"37fd735c-57c0-4823-b30c-69050c409776\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-902e45-7bd755469c-2wqrs"
Sep 11 14:42:00.375990 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:00.375912    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qptw6\" (UniqueName: \"kubernetes.io/projected/c66fefb9-6c2f-428d-b94a-57dd0a907ad1-kube-api-access-qptw6\") pod \"payload-pre-processing-e2e-ipp-cleanup-902e45-8698c47dfd-v4l5m\" (UID: \"c66fefb9-6c2f-428d-b94a-57dd0a907ad1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-902e45-8698c47dfd-v4l5m"
Sep 11 14:42:00.375990 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:00.375938    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c66fefb9-6c2f-428d-b94a-57dd0a907ad1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-902e45-8698c47dfd-v4l5m\" (UID: \"c66fefb9-6c2f-428d-b94a-57dd0a907ad1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-902e45-8698c47dfd-v4l5m"
Sep 11 14:42:00.476800 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:00.476769    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stmrf\" (UniqueName: \"kubernetes.io/projected/37fd735c-57c0-4823-b30c-69050c409776-kube-api-access-stmrf\") pod \"payload-processing-e2e-ipp-cleanup-902e45-7bd755469c-2wqrs\" (UID: \"37fd735c-57c0-4823-b30c-69050c409776\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-902e45-7bd755469c-2wqrs"
Sep 11 14:42:00.476930 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:00.476808    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37fd735c-57c0-4823-b30c-69050c409776-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-902e45-7bd755469c-2wqrs\" (UID: \"37fd735c-57c0-4823-b30c-69050c409776\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-902e45-7bd755469c-2wqrs"
Sep 11 14:42:00.476930 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:00.476869    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qptw6\" (UniqueName: \"kubernetes.io/projected/c66fefb9-6c2f-428d-b94a-57dd0a907ad1-kube-api-access-qptw6\") pod \"payload-pre-processing-e2e-ipp-cleanup-902e45-8698c47dfd-v4l5m\" (UID: \"c66fefb9-6c2f-428d-b94a-57dd0a907ad1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-902e45-8698c47dfd-v4l5m"
Sep 11 14:42:00.476930 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:00.476887    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c66fefb9-6c2f-428d-b94a-57dd0a907ad1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-902e45-8698c47dfd-v4l5m\" (UID: \"c66fefb9-6c2f-428d-b94a-57dd0a907ad1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-902e45-8698c47dfd-v4l5m"
Sep 11 14:42:00.477778 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:00.477756    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37fd735c-57c0-4823-b30c-69050c409776-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-902e45-7bd755469c-2wqrs\" (UID: \"37fd735c-57c0-4823-b30c-69050c409776\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-902e45-7bd755469c-2wqrs"
Sep 11 14:42:00.477843 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:00.477761    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c66fefb9-6c2f-428d-b94a-57dd0a907ad1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-902e45-8698c47dfd-v4l5m\" (UID: \"c66fefb9-6c2f-428d-b94a-57dd0a907ad1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-902e45-8698c47dfd-v4l5m"
Sep 11 14:42:00.491811 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:00.491787    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stmrf\" (UniqueName: \"kubernetes.io/projected/37fd735c-57c0-4823-b30c-69050c409776-kube-api-access-stmrf\") pod \"payload-processing-e2e-ipp-cleanup-902e45-7bd755469c-2wqrs\" (UID: \"37fd735c-57c0-4823-b30c-69050c409776\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-902e45-7bd755469c-2wqrs"
Sep 11 14:42:00.491895 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:00.491867    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qptw6\" (UniqueName: \"kubernetes.io/projected/c66fefb9-6c2f-428d-b94a-57dd0a907ad1-kube-api-access-qptw6\") pod \"payload-pre-processing-e2e-ipp-cleanup-902e45-8698c47dfd-v4l5m\" (UID: \"c66fefb9-6c2f-428d-b94a-57dd0a907ad1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-902e45-8698c47dfd-v4l5m"
Sep 11 14:42:00.541039 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:00.541011    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-902e45-8698c47dfd-v4l5m"
Sep 11 14:42:00.568783 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:00.568748    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-902e45-7bd755469c-2wqrs"
Sep 11 14:42:00.820455 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:00.820279    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-902e45-8698c47dfd-v4l5m"]
Sep 11 14:42:00.822981 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:42:00.822952    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc66fefb9_6c2f_428d_b94a_57dd0a907ad1.slice/crio-e5933bdb56d3c08f1a895459afef0a6dfa843f5fa25c71012cdad45a567a23c2 WatchSource:0}: Error finding container e5933bdb56d3c08f1a895459afef0a6dfa843f5fa25c71012cdad45a567a23c2: Status 404 returned error can't find the container with id e5933bdb56d3c08f1a895459afef0a6dfa843f5fa25c71012cdad45a567a23c2
Sep 11 14:42:00.847099 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:00.847075    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-902e45-8698c47dfd-v4l5m" event={"ID":"c66fefb9-6c2f-428d-b94a-57dd0a907ad1","Type":"ContainerStarted","Data":"e5933bdb56d3c08f1a895459afef0a6dfa843f5fa25c71012cdad45a567a23c2"}
Sep 11 14:42:00.855047 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:00.855025    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-902e45-7bd755469c-2wqrs"]
Sep 11 14:42:00.859793 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:42:00.859772    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37fd735c_57c0_4823_b30c_69050c409776.slice/crio-9757a295072b15fcad0db8b36cf1cde3a8788a6e2cffe3638e1c93d6f4633b83 WatchSource:0}: Error finding container 9757a295072b15fcad0db8b36cf1cde3a8788a6e2cffe3638e1c93d6f4633b83: Status 404 returned error can't find the container with id 9757a295072b15fcad0db8b36cf1cde3a8788a6e2cffe3638e1c93d6f4633b83
Sep 11 14:42:01.854231 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:01.854188    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-902e45-8698c47dfd-v4l5m" event={"ID":"c66fefb9-6c2f-428d-b94a-57dd0a907ad1","Type":"ContainerStarted","Data":"94bf3cc98d188e0f75f263d206f5e343caac54026458d85d6ac7e627a7c0c5e4"}
Sep 11 14:42:01.854743 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:01.854292    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-902e45-8698c47dfd-v4l5m"
Sep 11 14:42:01.855885 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:01.855862    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-902e45-7bd755469c-2wqrs" event={"ID":"37fd735c-57c0-4823-b30c-69050c409776","Type":"ContainerStarted","Data":"5eeafea558b08017852883aade7b146c3aea5ac2f88cb8cbffb29726bf79db76"}
Sep 11 14:42:01.856007 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:01.855898    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-902e45-7bd755469c-2wqrs" event={"ID":"37fd735c-57c0-4823-b30c-69050c409776","Type":"ContainerStarted","Data":"9757a295072b15fcad0db8b36cf1cde3a8788a6e2cffe3638e1c93d6f4633b83"}
Sep 11 14:42:01.856007 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:01.855953    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-902e45-7bd755469c-2wqrs"
Sep 11 14:42:01.873439 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:01.873398    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-902e45-8698c47dfd-v4l5m" podStartSLOduration=1.873385361 podStartE2EDuration="1.873385361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:42:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:42:01.871900756 +0000 UTC m=+1614.670535539" watchObservedRunningTime="2026-09-11 14:42:01.873385361 +0000 UTC m=+1614.672020143"
Sep 11 14:42:01.896095 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:01.896056    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-902e45-7bd755469c-2wqrs" podStartSLOduration=1.89604349 podStartE2EDuration="1.89604349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:42:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:42:01.893813967 +0000 UTC m=+1614.692448749" watchObservedRunningTime="2026-09-11 14:42:01.89604349 +0000 UTC m=+1614.694678305"
Sep 11 14:42:04.507222 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:04.507190    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:42:08.376287 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:08.376255    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:08.463658 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:08.463630    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:12.863213 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:12.863186    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-902e45-8698c47dfd-v4l5m"
Sep 11 14:42:12.863703 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:12.863284    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-902e45-7bd755469c-2wqrs"
Sep 11 14:42:21.801261 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:21.801225    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:22.600321 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:22.600287    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:24.153096 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:24.153062    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:25.082577 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:25.082543    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:25.988370 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:25.988333    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:26.128972 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:26.128941    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:27.130545 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:27.130492    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:28.005250 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:28.005217    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:28.756766 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:28.756735    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:29.485668 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:29.485625    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:30.410810 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:30.410774    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:31.279439 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:31.279411    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:32.128156 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:32.128115    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:35.906308 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:35.906272    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:36.007839 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:36.007809    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:37.451356 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:37.451320    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:38.096303 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:38.096263    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:38.135313 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:38.135283    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-902e45-7bd755469c-2wqrs"]
Sep 11 14:42:38.135528 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:38.135500    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-902e45-7bd755469c-2wqrs" podUID="37fd735c-57c0-4823-b30c-69050c409776" containerName="payload-processing" containerID="cri-o://5eeafea558b08017852883aade7b146c3aea5ac2f88cb8cbffb29726bf79db76" gracePeriod=30
Sep 11 14:42:38.141948 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:38.141911    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-902e45-8698c47dfd-v4l5m"]
Sep 11 14:42:38.142272 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:38.142125    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-902e45-8698c47dfd-v4l5m" podUID="c66fefb9-6c2f-428d-b94a-57dd0a907ad1" containerName="payload-pre-processing" containerID="cri-o://94bf3cc98d188e0f75f263d206f5e343caac54026458d85d6ac7e627a7c0c5e4" gracePeriod=30
Sep 11 14:42:38.188076 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:38.188045    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:38.277440 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:38.277411    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:38.426873 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:38.426848    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-902e45-7bd755469c-2wqrs"
Sep 11 14:42:38.430014 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:38.429985    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-902e45-8698c47dfd-v4l5m"
Sep 11 14:42:38.473457 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:38.473408    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:38.483520 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:38.483487    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qptw6\" (UniqueName: \"kubernetes.io/projected/c66fefb9-6c2f-428d-b94a-57dd0a907ad1-kube-api-access-qptw6\") pod \"c66fefb9-6c2f-428d-b94a-57dd0a907ad1\" (UID: \"c66fefb9-6c2f-428d-b94a-57dd0a907ad1\") "
Sep 11 14:42:38.483664 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:38.483559    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37fd735c-57c0-4823-b30c-69050c409776-plugins-config-volume\") pod \"37fd735c-57c0-4823-b30c-69050c409776\" (UID: \"37fd735c-57c0-4823-b30c-69050c409776\") "
Sep 11 14:42:38.483664 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:38.483656    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stmrf\" (UniqueName: \"kubernetes.io/projected/37fd735c-57c0-4823-b30c-69050c409776-kube-api-access-stmrf\") pod \"37fd735c-57c0-4823-b30c-69050c409776\" (UID: \"37fd735c-57c0-4823-b30c-69050c409776\") "
Sep 11 14:42:38.483796 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:38.483757    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c66fefb9-6c2f-428d-b94a-57dd0a907ad1-plugins-config-volume\") pod \"c66fefb9-6c2f-428d-b94a-57dd0a907ad1\" (UID: \"c66fefb9-6c2f-428d-b94a-57dd0a907ad1\") "
Sep 11 14:42:38.483980 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:38.483953    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37fd735c-57c0-4823-b30c-69050c409776-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "37fd735c-57c0-4823-b30c-69050c409776" (UID: "37fd735c-57c0-4823-b30c-69050c409776"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:42:38.484273 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:38.484254    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37fd735c-57c0-4823-b30c-69050c409776-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:42:38.484372 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:38.484325    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c66fefb9-6c2f-428d-b94a-57dd0a907ad1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c66fefb9-6c2f-428d-b94a-57dd0a907ad1" (UID: "c66fefb9-6c2f-428d-b94a-57dd0a907ad1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:42:38.485732 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:38.485707    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37fd735c-57c0-4823-b30c-69050c409776-kube-api-access-stmrf" (OuterVolumeSpecName: "kube-api-access-stmrf") pod "37fd735c-57c0-4823-b30c-69050c409776" (UID: "37fd735c-57c0-4823-b30c-69050c409776"). InnerVolumeSpecName "kube-api-access-stmrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:42:38.485843 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:38.485816    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c66fefb9-6c2f-428d-b94a-57dd0a907ad1-kube-api-access-qptw6" (OuterVolumeSpecName: "kube-api-access-qptw6") pod "c66fefb9-6c2f-428d-b94a-57dd0a907ad1" (UID: "c66fefb9-6c2f-428d-b94a-57dd0a907ad1"). InnerVolumeSpecName "kube-api-access-qptw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:42:38.584849 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:38.584826    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c66fefb9-6c2f-428d-b94a-57dd0a907ad1-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:42:38.584849 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:38.584849    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qptw6\" (UniqueName: \"kubernetes.io/projected/c66fefb9-6c2f-428d-b94a-57dd0a907ad1-kube-api-access-qptw6\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:42:38.584993 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:38.584858    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stmrf\" (UniqueName: \"kubernetes.io/projected/37fd735c-57c0-4823-b30c-69050c409776-kube-api-access-stmrf\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:42:38.651032 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:38.650961    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:38.797030 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:38.796994    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:38.924185 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:38.924114    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:39.054621 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:39.054590    2584 generic.go:356] "Generic (PLEG): container finished" podID="c66fefb9-6c2f-428d-b94a-57dd0a907ad1" containerID="94bf3cc98d188e0f75f263d206f5e343caac54026458d85d6ac7e627a7c0c5e4" exitCode=0
Sep 11 14:42:39.054778 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:39.054634    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-902e45-8698c47dfd-v4l5m"
Sep 11 14:42:39.054778 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:39.054652    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-902e45-8698c47dfd-v4l5m" event={"ID":"c66fefb9-6c2f-428d-b94a-57dd0a907ad1","Type":"ContainerDied","Data":"94bf3cc98d188e0f75f263d206f5e343caac54026458d85d6ac7e627a7c0c5e4"}
Sep 11 14:42:39.054778 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:39.054731    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-902e45-8698c47dfd-v4l5m" event={"ID":"c66fefb9-6c2f-428d-b94a-57dd0a907ad1","Type":"ContainerDied","Data":"e5933bdb56d3c08f1a895459afef0a6dfa843f5fa25c71012cdad45a567a23c2"}
Sep 11 14:42:39.054778 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:39.054763    2584 scope.go:117] "RemoveContainer" containerID="94bf3cc98d188e0f75f263d206f5e343caac54026458d85d6ac7e627a7c0c5e4"
Sep 11 14:42:39.056156 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:39.056121    2584 generic.go:356] "Generic (PLEG): container finished" podID="37fd735c-57c0-4823-b30c-69050c409776" containerID="5eeafea558b08017852883aade7b146c3aea5ac2f88cb8cbffb29726bf79db76" exitCode=0
Sep 11 14:42:39.056289 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:39.056188    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-902e45-7bd755469c-2wqrs"
Sep 11 14:42:39.056289 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:39.056183    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-902e45-7bd755469c-2wqrs" event={"ID":"37fd735c-57c0-4823-b30c-69050c409776","Type":"ContainerDied","Data":"5eeafea558b08017852883aade7b146c3aea5ac2f88cb8cbffb29726bf79db76"}
Sep 11 14:42:39.056289 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:39.056240    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-902e45-7bd755469c-2wqrs" event={"ID":"37fd735c-57c0-4823-b30c-69050c409776","Type":"ContainerDied","Data":"9757a295072b15fcad0db8b36cf1cde3a8788a6e2cffe3638e1c93d6f4633b83"}
Sep 11 14:42:39.066531 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:39.066512    2584 scope.go:117] "RemoveContainer" containerID="94bf3cc98d188e0f75f263d206f5e343caac54026458d85d6ac7e627a7c0c5e4"
Sep 11 14:42:39.066825 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:42:39.066805    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94bf3cc98d188e0f75f263d206f5e343caac54026458d85d6ac7e627a7c0c5e4\": container with ID starting with 94bf3cc98d188e0f75f263d206f5e343caac54026458d85d6ac7e627a7c0c5e4 not found: ID does not exist" containerID="94bf3cc98d188e0f75f263d206f5e343caac54026458d85d6ac7e627a7c0c5e4"
Sep 11 14:42:39.066971 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:39.066831    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94bf3cc98d188e0f75f263d206f5e343caac54026458d85d6ac7e627a7c0c5e4"} err="failed to get container status \"94bf3cc98d188e0f75f263d206f5e343caac54026458d85d6ac7e627a7c0c5e4\": rpc error: code = NotFound desc = could not find container \"94bf3cc98d188e0f75f263d206f5e343caac54026458d85d6ac7e627a7c0c5e4\": container with ID starting with 94bf3cc98d188e0f75f263d206f5e343caac54026458d85d6ac7e627a7c0c5e4 not found: ID does not exist"
Sep 11 14:42:39.066971 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:39.066849    2584 scope.go:117] "RemoveContainer" containerID="5eeafea558b08017852883aade7b146c3aea5ac2f88cb8cbffb29726bf79db76"
Sep 11 14:42:39.075264 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:39.075246    2584 scope.go:117] "RemoveContainer" containerID="5eeafea558b08017852883aade7b146c3aea5ac2f88cb8cbffb29726bf79db76"
Sep 11 14:42:39.075512 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:42:39.075494    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5eeafea558b08017852883aade7b146c3aea5ac2f88cb8cbffb29726bf79db76\": container with ID starting with 5eeafea558b08017852883aade7b146c3aea5ac2f88cb8cbffb29726bf79db76 not found: ID does not exist" containerID="5eeafea558b08017852883aade7b146c3aea5ac2f88cb8cbffb29726bf79db76"
Sep 11 14:42:39.075561 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:39.075520    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5eeafea558b08017852883aade7b146c3aea5ac2f88cb8cbffb29726bf79db76"} err="failed to get container status \"5eeafea558b08017852883aade7b146c3aea5ac2f88cb8cbffb29726bf79db76\": rpc error: code = NotFound desc = could not find container \"5eeafea558b08017852883aade7b146c3aea5ac2f88cb8cbffb29726bf79db76\": container with ID starting with 5eeafea558b08017852883aade7b146c3aea5ac2f88cb8cbffb29726bf79db76 not found: ID does not exist"
Sep 11 14:42:39.088936 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:39.088914    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-902e45-8698c47dfd-v4l5m"]
Sep 11 14:42:39.099464 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:39.099443    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-902e45-8698c47dfd-v4l5m"]
Sep 11 14:42:39.110018 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:39.109998    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-902e45-7bd755469c-2wqrs"]
Sep 11 14:42:39.116024 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:39.115999    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-902e45-7bd755469c-2wqrs"]
Sep 11 14:42:39.684280 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:39.684247    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37fd735c-57c0-4823-b30c-69050c409776" path="/var/lib/kubelet/pods/37fd735c-57c0-4823-b30c-69050c409776/volumes"
Sep 11 14:42:39.684742 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:39.684594    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c66fefb9-6c2f-428d-b94a-57dd0a907ad1" path="/var/lib/kubelet/pods/c66fefb9-6c2f-428d-b94a-57dd0a907ad1/volumes"
Sep 11 14:42:39.730173 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:39.730143    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:40.623800 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:40.623761    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:41.397846 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:41.397815    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:42.345178 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:42.345144    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:42.702604 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:42.702522    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:42:45.078475 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:45.078445    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:45.185551 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:45.185482    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:45.405672 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:45.405637    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:46.664815 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:46.664780    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:46.764645 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:46.764615    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:49.426248 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:49.426208    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a6c3fc-z2wrm"]
Sep 11 14:42:49.426747 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:49.426727    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c66fefb9-6c2f-428d-b94a-57dd0a907ad1" containerName="payload-pre-processing"
Sep 11 14:42:49.426747 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:49.426747    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c66fefb9-6c2f-428d-b94a-57dd0a907ad1" containerName="payload-pre-processing"
Sep 11 14:42:49.426899 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:49.426758    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37fd735c-57c0-4823-b30c-69050c409776" containerName="payload-processing"
Sep 11 14:42:49.426899 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:49.426764    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="37fd735c-57c0-4823-b30c-69050c409776" containerName="payload-processing"
Sep 11 14:42:49.426899 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:49.426847    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="37fd735c-57c0-4823-b30c-69050c409776" containerName="payload-processing"
Sep 11 14:42:49.426899 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:49.426858    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="c66fefb9-6c2f-428d-b94a-57dd0a907ad1" containerName="payload-pre-processing"
Sep 11 14:42:49.430977 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:49.430954    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a6c3fc-z2wrm"
Sep 11 14:42:49.434059 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:49.434034    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dp8gp\""
Sep 11 14:42:49.439335 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:49.438419    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a6c3fc-z2wrm"]
Sep 11 14:42:49.572810 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:49.572779    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3715a44-ecbb-42ac-8534-775d41e03448-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-a6c3fc-z2wrm\" (UID: \"d3715a44-ecbb-42ac-8534-775d41e03448\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a6c3fc-z2wrm"
Sep 11 14:42:49.593590 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:49.593561    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:49.673421 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:49.673390    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3715a44-ecbb-42ac-8534-775d41e03448-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-a6c3fc-z2wrm\" (UID: \"d3715a44-ecbb-42ac-8534-775d41e03448\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a6c3fc-z2wrm"
Sep 11 14:42:49.674260 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:49.674231    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3715a44-ecbb-42ac-8534-775d41e03448-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-a6c3fc-z2wrm\" (UID: \"d3715a44-ecbb-42ac-8534-775d41e03448\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a6c3fc-z2wrm"
Sep 11 14:42:49.743841 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:49.743783    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a6c3fc-z2wrm"
Sep 11 14:42:50.029122 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:50.029091    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a6c3fc-z2wrm"]
Sep 11 14:42:50.029496 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:42:50.029474    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3715a44_ecbb_42ac_8534_775d41e03448.slice/crio-469b29914f88d300a464153660d5890fd5dace4f7719ec3517e4833a1a80ebfe WatchSource:0}: Error finding container 469b29914f88d300a464153660d5890fd5dace4f7719ec3517e4833a1a80ebfe: Status 404 returned error can't find the container with id 469b29914f88d300a464153660d5890fd5dace4f7719ec3517e4833a1a80ebfe
Sep 11 14:42:50.113023 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:50.112998    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a6c3fc-z2wrm" event={"ID":"d3715a44-ecbb-42ac-8534-775d41e03448","Type":"ContainerStarted","Data":"469b29914f88d300a464153660d5890fd5dace4f7719ec3517e4833a1a80ebfe"}
Sep 11 14:42:50.512185 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:50.512156    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:51.119562 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:51.119534    2584 generic.go:356] "Generic (PLEG): container finished" podID="d3715a44-ecbb-42ac-8534-775d41e03448" containerID="ebde170c42e905fdd9d50729c47e7bf35f9e0acba9170275b930707353939d43" exitCode=0
Sep 11 14:42:51.119707 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:51.119659    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a6c3fc-z2wrm" event={"ID":"d3715a44-ecbb-42ac-8534-775d41e03448","Type":"ContainerDied","Data":"ebde170c42e905fdd9d50729c47e7bf35f9e0acba9170275b930707353939d43"}
Sep 11 14:42:51.384500 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:51.384414    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:52.096568 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:52.096531    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:52.255577 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:52.255552    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a6c3fc-z2wrm"
Sep 11 14:42:52.397566 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:52.397506    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3715a44-ecbb-42ac-8534-775d41e03448-maas-api-service-ca\") pod \"d3715a44-ecbb-42ac-8534-775d41e03448\" (UID: \"d3715a44-ecbb-42ac-8534-775d41e03448\") "
Sep 11 14:42:52.397861 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:52.397836    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3715a44-ecbb-42ac-8534-775d41e03448-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d3715a44-ecbb-42ac-8534-775d41e03448" (UID: "d3715a44-ecbb-42ac-8534-775d41e03448"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:42:52.499153 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:52.499121    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3715a44-ecbb-42ac-8534-775d41e03448-maas-api-service-ca\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:42:52.933047 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:52.933010    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:42:53.131545 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:53.131513    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a6c3fc-z2wrm" event={"ID":"d3715a44-ecbb-42ac-8534-775d41e03448","Type":"ContainerDied","Data":"469b29914f88d300a464153660d5890fd5dace4f7719ec3517e4833a1a80ebfe"}
Sep 11 14:42:53.131545 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:53.131549    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a6c3fc-z2wrm"
Sep 11 14:42:53.132088 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:53.131558    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="469b29914f88d300a464153660d5890fd5dace4f7719ec3517e4833a1a80ebfe"
Sep 11 14:42:53.753202 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:42:53.753165    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:43:02.400347 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:02.400308    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:43:05.210131 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:05.210091    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:43:05.258614 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:05.258582    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk"]
Sep 11 14:43:05.258887 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:05.258858    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk" podUID="168b59e7-c911-4a2c-8573-8dbc3e91e9f9" containerName="payload-processing" containerID="cri-o://fe74ab5e737fc267b05439f5c02bb9d93236b1760219814ce1658b09d2af2a97" gracePeriod=30
Sep 11 14:43:05.297615 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:05.297589    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a6c3fc-5cfcf6d4fd-2ms92"]
Sep 11 14:43:05.297816 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:05.297793    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a6c3fc-5cfcf6d4fd-2ms92" podUID="9f4c02d7-e6f4-448f-b317-016c2b083384" containerName="payload-pre-processing" containerID="cri-o://636f21e7d7d135a177c786cc837167693cb8c2c82848e1265fa851f1ef511e1c" gracePeriod=30
Sep 11 14:43:05.337365 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:05.337331    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:43:05.434638 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:05.434604    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:43:05.539614 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:05.539576    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:43:05.582738 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:05.582714    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk"
Sep 11 14:43:05.585617 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:05.585593    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a6c3fc-5cfcf6d4fd-2ms92"
Sep 11 14:43:05.588843 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:05.588819    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a6c3fc-z2wrm"]
Sep 11 14:43:05.594535 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:05.594512    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a6c3fc-z2wrm"]
Sep 11 14:43:05.617631 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:05.617608    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:43:05.679620 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:05.679582    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3715a44-ecbb-42ac-8534-775d41e03448" path="/var/lib/kubelet/pods/d3715a44-ecbb-42ac-8534-775d41e03448/volumes"
Sep 11 14:43:05.702216 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:05.702195    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/168b59e7-c911-4a2c-8573-8dbc3e91e9f9-plugins-config-volume\") pod \"168b59e7-c911-4a2c-8573-8dbc3e91e9f9\" (UID: \"168b59e7-c911-4a2c-8573-8dbc3e91e9f9\") "
Sep 11 14:43:05.702338 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:05.702231    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qw8b\" (UniqueName: \"kubernetes.io/projected/168b59e7-c911-4a2c-8573-8dbc3e91e9f9-kube-api-access-6qw8b\") pod \"168b59e7-c911-4a2c-8573-8dbc3e91e9f9\" (UID: \"168b59e7-c911-4a2c-8573-8dbc3e91e9f9\") "
Sep 11 14:43:05.702338 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:05.702255    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7nq6\" (UniqueName: \"kubernetes.io/projected/9f4c02d7-e6f4-448f-b317-016c2b083384-kube-api-access-p7nq6\") pod \"9f4c02d7-e6f4-448f-b317-016c2b083384\" (UID: \"9f4c02d7-e6f4-448f-b317-016c2b083384\") "
Sep 11 14:43:05.702338 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:05.702275    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f4c02d7-e6f4-448f-b317-016c2b083384-plugins-config-volume\") pod \"9f4c02d7-e6f4-448f-b317-016c2b083384\" (UID: \"9f4c02d7-e6f4-448f-b317-016c2b083384\") "
Sep 11 14:43:05.702574 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:05.702549    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/168b59e7-c911-4a2c-8573-8dbc3e91e9f9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "168b59e7-c911-4a2c-8573-8dbc3e91e9f9" (UID: "168b59e7-c911-4a2c-8573-8dbc3e91e9f9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:43:05.702669 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:05.702648    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f4c02d7-e6f4-448f-b317-016c2b083384-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9f4c02d7-e6f4-448f-b317-016c2b083384" (UID: "9f4c02d7-e6f4-448f-b317-016c2b083384"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:43:05.704354 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:05.704331    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/168b59e7-c911-4a2c-8573-8dbc3e91e9f9-kube-api-access-6qw8b" (OuterVolumeSpecName: "kube-api-access-6qw8b") pod "168b59e7-c911-4a2c-8573-8dbc3e91e9f9" (UID: "168b59e7-c911-4a2c-8573-8dbc3e91e9f9"). InnerVolumeSpecName "kube-api-access-6qw8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:43:05.704456 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:05.704394    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f4c02d7-e6f4-448f-b317-016c2b083384-kube-api-access-p7nq6" (OuterVolumeSpecName: "kube-api-access-p7nq6") pod "9f4c02d7-e6f4-448f-b317-016c2b083384" (UID: "9f4c02d7-e6f4-448f-b317-016c2b083384"). InnerVolumeSpecName "kube-api-access-p7nq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:43:05.803777 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:05.803752    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/168b59e7-c911-4a2c-8573-8dbc3e91e9f9-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:43:05.803777 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:05.803778    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qw8b\" (UniqueName: \"kubernetes.io/projected/168b59e7-c911-4a2c-8573-8dbc3e91e9f9-kube-api-access-6qw8b\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:43:05.803922 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:05.803787    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7nq6\" (UniqueName: \"kubernetes.io/projected/9f4c02d7-e6f4-448f-b317-016c2b083384-kube-api-access-p7nq6\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:43:05.803922 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:05.803795    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f4c02d7-e6f4-448f-b317-016c2b083384-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:43:06.036110 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:06.036071    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:43:06.138060 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:06.137990    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:43:06.204488 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:06.204458    2584 generic.go:356] "Generic (PLEG): container finished" podID="9f4c02d7-e6f4-448f-b317-016c2b083384" containerID="636f21e7d7d135a177c786cc837167693cb8c2c82848e1265fa851f1ef511e1c" exitCode=0
Sep 11 14:43:06.204705 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:06.204489    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a6c3fc-5cfcf6d4fd-2ms92" event={"ID":"9f4c02d7-e6f4-448f-b317-016c2b083384","Type":"ContainerDied","Data":"636f21e7d7d135a177c786cc837167693cb8c2c82848e1265fa851f1ef511e1c"}
Sep 11 14:43:06.204705 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:06.204506    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a6c3fc-5cfcf6d4fd-2ms92"
Sep 11 14:43:06.204705 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:06.204541    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a6c3fc-5cfcf6d4fd-2ms92" event={"ID":"9f4c02d7-e6f4-448f-b317-016c2b083384","Type":"ContainerDied","Data":"61944aaa51df532d1fd07e20e9622300cea6c81bd8aef631da7a0def4e2b05ef"}
Sep 11 14:43:06.204705 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:06.204563    2584 scope.go:117] "RemoveContainer" containerID="636f21e7d7d135a177c786cc837167693cb8c2c82848e1265fa851f1ef511e1c"
Sep 11 14:43:06.206147 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:06.206124    2584 generic.go:356] "Generic (PLEG): container finished" podID="168b59e7-c911-4a2c-8573-8dbc3e91e9f9" containerID="fe74ab5e737fc267b05439f5c02bb9d93236b1760219814ce1658b09d2af2a97" exitCode=0
Sep 11 14:43:06.206268 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:06.206163    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk"
Sep 11 14:43:06.206268 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:06.206180    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk" event={"ID":"168b59e7-c911-4a2c-8573-8dbc3e91e9f9","Type":"ContainerDied","Data":"fe74ab5e737fc267b05439f5c02bb9d93236b1760219814ce1658b09d2af2a97"}
Sep 11 14:43:06.206268 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:06.206216    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk" event={"ID":"168b59e7-c911-4a2c-8573-8dbc3e91e9f9","Type":"ContainerDied","Data":"8dacf646ae9ff8b7d54e7bafb5e0d0869b37e1affe2d8edf2b21d36352900702"}
Sep 11 14:43:06.215085 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:06.215064    2584 scope.go:117] "RemoveContainer" containerID="636f21e7d7d135a177c786cc837167693cb8c2c82848e1265fa851f1ef511e1c"
Sep 11 14:43:06.215362 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:43:06.215346    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"636f21e7d7d135a177c786cc837167693cb8c2c82848e1265fa851f1ef511e1c\": container with ID starting with 636f21e7d7d135a177c786cc837167693cb8c2c82848e1265fa851f1ef511e1c not found: ID does not exist" containerID="636f21e7d7d135a177c786cc837167693cb8c2c82848e1265fa851f1ef511e1c"
Sep 11 14:43:06.215413 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:06.215369    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"636f21e7d7d135a177c786cc837167693cb8c2c82848e1265fa851f1ef511e1c"} err="failed to get container status \"636f21e7d7d135a177c786cc837167693cb8c2c82848e1265fa851f1ef511e1c\": rpc error: code = NotFound desc = could not find container \"636f21e7d7d135a177c786cc837167693cb8c2c82848e1265fa851f1ef511e1c\": container with ID starting with 636f21e7d7d135a177c786cc837167693cb8c2c82848e1265fa851f1ef511e1c not found: ID does not exist"
Sep 11 14:43:06.215413 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:06.215385    2584 scope.go:117] "RemoveContainer" containerID="fe74ab5e737fc267b05439f5c02bb9d93236b1760219814ce1658b09d2af2a97"
Sep 11 14:43:06.223546 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:06.223529    2584 scope.go:117] "RemoveContainer" containerID="fe74ab5e737fc267b05439f5c02bb9d93236b1760219814ce1658b09d2af2a97"
Sep 11 14:43:06.223866 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:43:06.223848    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe74ab5e737fc267b05439f5c02bb9d93236b1760219814ce1658b09d2af2a97\": container with ID starting with fe74ab5e737fc267b05439f5c02bb9d93236b1760219814ce1658b09d2af2a97 not found: ID does not exist" containerID="fe74ab5e737fc267b05439f5c02bb9d93236b1760219814ce1658b09d2af2a97"
Sep 11 14:43:06.223940 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:06.223870    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe74ab5e737fc267b05439f5c02bb9d93236b1760219814ce1658b09d2af2a97"} err="failed to get container status \"fe74ab5e737fc267b05439f5c02bb9d93236b1760219814ce1658b09d2af2a97\": rpc error: code = NotFound desc = could not find container \"fe74ab5e737fc267b05439f5c02bb9d93236b1760219814ce1658b09d2af2a97\": container with ID starting with fe74ab5e737fc267b05439f5c02bb9d93236b1760219814ce1658b09d2af2a97 not found: ID does not exist"
Sep 11 14:43:06.236104 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:06.236072    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a6c3fc-5cfcf6d4fd-2ms92"]
Sep 11 14:43:06.239202 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:06.239184    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a6c3fc-5cfcf6d4fd-2ms92"]
Sep 11 14:43:06.256290 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:06.256272    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk"]
Sep 11 14:43:06.260913 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:06.260891    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a6c3fc-6fc645b64f-fstjk"]
Sep 11 14:43:07.254208 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:07.254171    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:43:07.678928 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:07.678898    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="168b59e7-c911-4a2c-8573-8dbc3e91e9f9" path="/var/lib/kubelet/pods/168b59e7-c911-4a2c-8573-8dbc3e91e9f9/volumes"
Sep 11 14:43:07.679248 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:07.679236    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f4c02d7-e6f4-448f-b317-016c2b083384" path="/var/lib/kubelet/pods/9f4c02d7-e6f4-448f-b317-016c2b083384/volumes"
Sep 11 14:43:08.288981 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:08.288952    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:43:09.376668 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:09.376635    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:43:10.991134 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:10.991104    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"]
Sep 11 14:43:11.089225 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:11.089193    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:43:14.693521 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:14.693490    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:43:21.045187 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:21.045139    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:43:26.010031 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:26.009974    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f" podUID="472cd276-653a-4092-8711-bbf1cd20a038" containerName="main" containerID="cri-o://c8f9647b76ab1e0c859e4516d0b1e5411c39e90a5bcde0cb8fc8c371992e986f" gracePeriod=45
Sep 11 14:43:26.262247 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:26.262191    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"
Sep 11 14:43:26.315366 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:26.315333    2584 generic.go:356] "Generic (PLEG): container finished" podID="472cd276-653a-4092-8711-bbf1cd20a038" containerID="c8f9647b76ab1e0c859e4516d0b1e5411c39e90a5bcde0cb8fc8c371992e986f" exitCode=0
Sep 11 14:43:26.315470 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:26.315380    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"
Sep 11 14:43:26.315470 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:26.315412    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f" event={"ID":"472cd276-653a-4092-8711-bbf1cd20a038","Type":"ContainerDied","Data":"c8f9647b76ab1e0c859e4516d0b1e5411c39e90a5bcde0cb8fc8c371992e986f"}
Sep 11 14:43:26.315470 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:26.315455    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f" event={"ID":"472cd276-653a-4092-8711-bbf1cd20a038","Type":"ContainerDied","Data":"8146af28bc9854b1a34777f1af5e920b713145171195c78e430d0d6a51bd30e6"}
Sep 11 14:43:26.315577 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:26.315472    2584 scope.go:117] "RemoveContainer" containerID="c8f9647b76ab1e0c859e4516d0b1e5411c39e90a5bcde0cb8fc8c371992e986f"
Sep 11 14:43:26.323474 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:26.323457    2584 scope.go:117] "RemoveContainer" containerID="c8f9647b76ab1e0c859e4516d0b1e5411c39e90a5bcde0cb8fc8c371992e986f"
Sep 11 14:43:26.323746 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:43:26.323721    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8f9647b76ab1e0c859e4516d0b1e5411c39e90a5bcde0cb8fc8c371992e986f\": container with ID starting with c8f9647b76ab1e0c859e4516d0b1e5411c39e90a5bcde0cb8fc8c371992e986f not found: ID does not exist" containerID="c8f9647b76ab1e0c859e4516d0b1e5411c39e90a5bcde0cb8fc8c371992e986f"
Sep 11 14:43:26.323839 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:26.323753    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8f9647b76ab1e0c859e4516d0b1e5411c39e90a5bcde0cb8fc8c371992e986f"} err="failed to get container status \"c8f9647b76ab1e0c859e4516d0b1e5411c39e90a5bcde0cb8fc8c371992e986f\": rpc error: code = NotFound desc = could not find container \"c8f9647b76ab1e0c859e4516d0b1e5411c39e90a5bcde0cb8fc8c371992e986f\": container with ID starting with c8f9647b76ab1e0c859e4516d0b1e5411c39e90a5bcde0cb8fc8c371992e986f not found: ID does not exist"
Sep 11 14:43:26.366848 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:26.366822    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/472cd276-653a-4092-8711-bbf1cd20a038-dshm\") pod \"472cd276-653a-4092-8711-bbf1cd20a038\" (UID: \"472cd276-653a-4092-8711-bbf1cd20a038\") "
Sep 11 14:43:26.366947 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:26.366873    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/472cd276-653a-4092-8711-bbf1cd20a038-tmp-dir\") pod \"472cd276-653a-4092-8711-bbf1cd20a038\" (UID: \"472cd276-653a-4092-8711-bbf1cd20a038\") "
Sep 11 14:43:26.366947 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:26.366899    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/472cd276-653a-4092-8711-bbf1cd20a038-home\") pod \"472cd276-653a-4092-8711-bbf1cd20a038\" (UID: \"472cd276-653a-4092-8711-bbf1cd20a038\") "
Sep 11 14:43:26.367061 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:26.366999    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/472cd276-653a-4092-8711-bbf1cd20a038-tls-certs\") pod \"472cd276-653a-4092-8711-bbf1cd20a038\" (UID: \"472cd276-653a-4092-8711-bbf1cd20a038\") "
Sep 11 14:43:26.367061 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:26.367034    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d74gk\" (UniqueName: \"kubernetes.io/projected/472cd276-653a-4092-8711-bbf1cd20a038-kube-api-access-d74gk\") pod \"472cd276-653a-4092-8711-bbf1cd20a038\" (UID: \"472cd276-653a-4092-8711-bbf1cd20a038\") "
Sep 11 14:43:26.367168 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:26.367073    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/472cd276-653a-4092-8711-bbf1cd20a038-model-cache\") pod \"472cd276-653a-4092-8711-bbf1cd20a038\" (UID: \"472cd276-653a-4092-8711-bbf1cd20a038\") "
Sep 11 14:43:26.367212 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:26.367167    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/472cd276-653a-4092-8711-bbf1cd20a038-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "472cd276-653a-4092-8711-bbf1cd20a038" (UID: "472cd276-653a-4092-8711-bbf1cd20a038"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:43:26.367255 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:26.367208    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/472cd276-653a-4092-8711-bbf1cd20a038-home" (OuterVolumeSpecName: "home") pod "472cd276-653a-4092-8711-bbf1cd20a038" (UID: "472cd276-653a-4092-8711-bbf1cd20a038"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:43:26.367393 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:26.367369    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/472cd276-653a-4092-8711-bbf1cd20a038-tmp-dir\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:43:26.367463 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:26.367386    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/472cd276-653a-4092-8711-bbf1cd20a038-model-cache" (OuterVolumeSpecName: "model-cache") pod "472cd276-653a-4092-8711-bbf1cd20a038" (UID: "472cd276-653a-4092-8711-bbf1cd20a038"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:43:26.367463 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:26.367400    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/472cd276-653a-4092-8711-bbf1cd20a038-home\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:43:26.368927 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:26.368905    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/472cd276-653a-4092-8711-bbf1cd20a038-dshm" (OuterVolumeSpecName: "dshm") pod "472cd276-653a-4092-8711-bbf1cd20a038" (UID: "472cd276-653a-4092-8711-bbf1cd20a038"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:43:26.369089 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:26.369067    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/472cd276-653a-4092-8711-bbf1cd20a038-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "472cd276-653a-4092-8711-bbf1cd20a038" (UID: "472cd276-653a-4092-8711-bbf1cd20a038"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:43:26.369160 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:26.369068    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/472cd276-653a-4092-8711-bbf1cd20a038-kube-api-access-d74gk" (OuterVolumeSpecName: "kube-api-access-d74gk") pod "472cd276-653a-4092-8711-bbf1cd20a038" (UID: "472cd276-653a-4092-8711-bbf1cd20a038"). InnerVolumeSpecName "kube-api-access-d74gk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:43:26.468185 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:26.468166    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/472cd276-653a-4092-8711-bbf1cd20a038-tls-certs\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:43:26.468266 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:26.468185    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d74gk\" (UniqueName: \"kubernetes.io/projected/472cd276-653a-4092-8711-bbf1cd20a038-kube-api-access-d74gk\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:43:26.468266 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:26.468196    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/472cd276-653a-4092-8711-bbf1cd20a038-model-cache\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:43:26.468266 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:26.468205    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/472cd276-653a-4092-8711-bbf1cd20a038-dshm\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:43:27.423767 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:27.423730    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"]
Sep 11 14:43:27.668781 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:27.668752    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-a6c3fc/ipp-route-a6c3fc-kserve-6c4fc867dc-hb67f"]
Sep 11 14:43:27.680190 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:27.680128    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="472cd276-653a-4092-8711-bbf1cd20a038" path="/var/lib/kubelet/pods/472cd276-653a-4092-8711-bbf1cd20a038/volumes"
Sep 11 14:43:41.201947 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:41.201903    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:43:42.414569 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:42.414539    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:43:47.943525 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:47.943483    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:43:49.024146 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:49.024104    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:43:55.165315 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:55.165278    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:43:55.271297 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:55.271263    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:43:55.603462 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:55.603427    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:43:55.956195 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:55.956124    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-625d10-vk9r7"]
Sep 11 14:43:55.956521 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:55.956508    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="472cd276-653a-4092-8711-bbf1cd20a038" containerName="main"
Sep 11 14:43:55.956564 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:55.956522    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="472cd276-653a-4092-8711-bbf1cd20a038" containerName="main"
Sep 11 14:43:55.956564 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:55.956537    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f4c02d7-e6f4-448f-b317-016c2b083384" containerName="payload-pre-processing"
Sep 11 14:43:55.956564 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:55.956542    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f4c02d7-e6f4-448f-b317-016c2b083384" containerName="payload-pre-processing"
Sep 11 14:43:55.956564 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:55.956553    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="168b59e7-c911-4a2c-8573-8dbc3e91e9f9" containerName="payload-processing"
Sep 11 14:43:55.956564 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:55.956559    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="168b59e7-c911-4a2c-8573-8dbc3e91e9f9" containerName="payload-processing"
Sep 11 14:43:55.956564 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:55.956565    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3715a44-ecbb-42ac-8534-775d41e03448" containerName="revoke-keys"
Sep 11 14:43:55.956780 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:55.956571    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3715a44-ecbb-42ac-8534-775d41e03448" containerName="revoke-keys"
Sep 11 14:43:55.956780 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:55.956636    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="472cd276-653a-4092-8711-bbf1cd20a038" containerName="main"
Sep 11 14:43:55.956780 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:55.956643    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f4c02d7-e6f4-448f-b317-016c2b083384" containerName="payload-pre-processing"
Sep 11 14:43:55.956780 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:55.956651    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="168b59e7-c911-4a2c-8573-8dbc3e91e9f9" containerName="payload-processing"
Sep 11 14:43:55.956780 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:55.956658    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3715a44-ecbb-42ac-8534-775d41e03448" containerName="revoke-keys"
Sep 11 14:43:55.959907 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:55.959888    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-625d10-vk9r7"
Sep 11 14:43:55.966300 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:55.966278    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dp8gp\""
Sep 11 14:43:55.975593 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:55.975570    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-625d10-vk9r7"]
Sep 11 14:43:56.093159 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:56.093127    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/07fa02a0-fb46-475c-a71b-13e849c2a264-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-625d10-vk9r7\" (UID: \"07fa02a0-fb46-475c-a71b-13e849c2a264\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-625d10-vk9r7"
Sep 11 14:43:56.194094 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:56.194065    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/07fa02a0-fb46-475c-a71b-13e849c2a264-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-625d10-vk9r7\" (UID: \"07fa02a0-fb46-475c-a71b-13e849c2a264\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-625d10-vk9r7"
Sep 11 14:43:56.194661 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:56.194637    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/07fa02a0-fb46-475c-a71b-13e849c2a264-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-625d10-vk9r7\" (UID: \"07fa02a0-fb46-475c-a71b-13e849c2a264\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-625d10-vk9r7"
Sep 11 14:43:56.261975 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:56.261897    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:43:56.269647 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:56.269627    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-625d10-vk9r7"
Sep 11 14:43:56.546698 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:56.546593    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-625d10-vk9r7"]
Sep 11 14:43:56.549404 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:43:56.549372    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07fa02a0_fb46_475c_a71b_13e849c2a264.slice/crio-51b968b04cd6db133a235ec1b67a74b8a11eac87a0066166fb519231a987bb74 WatchSource:0}: Error finding container 51b968b04cd6db133a235ec1b67a74b8a11eac87a0066166fb519231a987bb74: Status 404 returned error can't find the container with id 51b968b04cd6db133a235ec1b67a74b8a11eac87a0066166fb519231a987bb74
Sep 11 14:43:57.365731 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:57.365695    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:43:57.477873 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:57.477800    2584 generic.go:356] "Generic (PLEG): container finished" podID="07fa02a0-fb46-475c-a71b-13e849c2a264" containerID="d7656593369302fc3aa2dc647dff4974ce384f54880775eac912e87b8748fa63" exitCode=0
Sep 11 14:43:57.477873 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:57.477839    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-625d10-vk9r7" event={"ID":"07fa02a0-fb46-475c-a71b-13e849c2a264","Type":"ContainerDied","Data":"d7656593369302fc3aa2dc647dff4974ce384f54880775eac912e87b8748fa63"}
Sep 11 14:43:57.478040 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:57.477924    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-625d10-vk9r7" event={"ID":"07fa02a0-fb46-475c-a71b-13e849c2a264","Type":"ContainerStarted","Data":"51b968b04cd6db133a235ec1b67a74b8a11eac87a0066166fb519231a987bb74"}
Sep 11 14:43:58.259648 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:58.259611    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:43:58.619727 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:58.619705    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-625d10-vk9r7"
Sep 11 14:43:58.715148 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:58.715121    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/07fa02a0-fb46-475c-a71b-13e849c2a264-maas-api-service-ca\") pod \"07fa02a0-fb46-475c-a71b-13e849c2a264\" (UID: \"07fa02a0-fb46-475c-a71b-13e849c2a264\") "
Sep 11 14:43:58.715438 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:58.715417    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07fa02a0-fb46-475c-a71b-13e849c2a264-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "07fa02a0-fb46-475c-a71b-13e849c2a264" (UID: "07fa02a0-fb46-475c-a71b-13e849c2a264"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:43:58.816219 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:58.816194    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/07fa02a0-fb46-475c-a71b-13e849c2a264-maas-api-service-ca\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:43:59.303129 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:59.303094    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:43:59.489878 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:59.489851    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-625d10-vk9r7"
Sep 11 14:43:59.490016 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:59.489853    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-625d10-vk9r7" event={"ID":"07fa02a0-fb46-475c-a71b-13e849c2a264","Type":"ContainerDied","Data":"51b968b04cd6db133a235ec1b67a74b8a11eac87a0066166fb519231a987bb74"}
Sep 11 14:43:59.490016 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:43:59.489965    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="51b968b04cd6db133a235ec1b67a74b8a11eac87a0066166fb519231a987bb74"
Sep 11 14:44:00.104598 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:00.104562    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:06.519767 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:06.519728    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:06.568799 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:06.568765    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-625d10-9d8479986-9rdzt"]
Sep 11 14:44:06.569102 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:06.569015    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-625d10-9d8479986-9rdzt" podUID="eb93e5fb-1765-4565-9c92-b326b8558682" containerName="payload-pre-processing" containerID="cri-o://be38fa9155975587f3f9ea85850dc3c132470e2d549a7fc837fdddb265de3dc6" gracePeriod=30
Sep 11 14:44:06.596670 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:06.596648    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:06.700232 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:06.700198    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:06.742288 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:06.742238    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-625d10-vk9r7"]
Sep 11 14:44:06.748629 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:06.748601    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-625d10-vk9r7"]
Sep 11 14:44:06.782389 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:06.782321    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:06.824507 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:06.824478    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-625d10-9d8479986-9rdzt"
Sep 11 14:44:06.978040 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:06.978009    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzsvm\" (UniqueName: \"kubernetes.io/projected/eb93e5fb-1765-4565-9c92-b326b8558682-kube-api-access-zzsvm\") pod \"eb93e5fb-1765-4565-9c92-b326b8558682\" (UID: \"eb93e5fb-1765-4565-9c92-b326b8558682\") "
Sep 11 14:44:06.978179 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:06.978113    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb93e5fb-1765-4565-9c92-b326b8558682-plugins-config-volume\") pod \"eb93e5fb-1765-4565-9c92-b326b8558682\" (UID: \"eb93e5fb-1765-4565-9c92-b326b8558682\") "
Sep 11 14:44:06.978514 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:06.978486    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb93e5fb-1765-4565-9c92-b326b8558682-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "eb93e5fb-1765-4565-9c92-b326b8558682" (UID: "eb93e5fb-1765-4565-9c92-b326b8558682"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:44:06.980257 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:06.980231    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb93e5fb-1765-4565-9c92-b326b8558682-kube-api-access-zzsvm" (OuterVolumeSpecName: "kube-api-access-zzsvm") pod "eb93e5fb-1765-4565-9c92-b326b8558682" (UID: "eb93e5fb-1765-4565-9c92-b326b8558682"). InnerVolumeSpecName "kube-api-access-zzsvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:44:07.079789 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:07.079768    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzsvm\" (UniqueName: \"kubernetes.io/projected/eb93e5fb-1765-4565-9c92-b326b8558682-kube-api-access-zzsvm\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:44:07.079789 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:07.079791    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb93e5fb-1765-4565-9c92-b326b8558682-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:44:07.138980 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:07.138948    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:07.245172 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:07.245135    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:07.531147 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:07.531068    2584 generic.go:356] "Generic (PLEG): container finished" podID="eb93e5fb-1765-4565-9c92-b326b8558682" containerID="be38fa9155975587f3f9ea85850dc3c132470e2d549a7fc837fdddb265de3dc6" exitCode=0
Sep 11 14:44:07.531147 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:07.531113    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-625d10-9d8479986-9rdzt"
Sep 11 14:44:07.531589 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:07.531154    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-625d10-9d8479986-9rdzt" event={"ID":"eb93e5fb-1765-4565-9c92-b326b8558682","Type":"ContainerDied","Data":"be38fa9155975587f3f9ea85850dc3c132470e2d549a7fc837fdddb265de3dc6"}
Sep 11 14:44:07.531589 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:07.531209    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-625d10-9d8479986-9rdzt" event={"ID":"eb93e5fb-1765-4565-9c92-b326b8558682","Type":"ContainerDied","Data":"c909cde17852ff2177d9990ee312ee9e8b86b96b6516d16fcede559bb9114368"}
Sep 11 14:44:07.531589 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:07.531235    2584 scope.go:117] "RemoveContainer" containerID="be38fa9155975587f3f9ea85850dc3c132470e2d549a7fc837fdddb265de3dc6"
Sep 11 14:44:07.540555 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:07.540539    2584 scope.go:117] "RemoveContainer" containerID="be38fa9155975587f3f9ea85850dc3c132470e2d549a7fc837fdddb265de3dc6"
Sep 11 14:44:07.540811 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:44:07.540794    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be38fa9155975587f3f9ea85850dc3c132470e2d549a7fc837fdddb265de3dc6\": container with ID starting with be38fa9155975587f3f9ea85850dc3c132470e2d549a7fc837fdddb265de3dc6 not found: ID does not exist" containerID="be38fa9155975587f3f9ea85850dc3c132470e2d549a7fc837fdddb265de3dc6"
Sep 11 14:44:07.540857 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:07.540820    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be38fa9155975587f3f9ea85850dc3c132470e2d549a7fc837fdddb265de3dc6"} err="failed to get container status \"be38fa9155975587f3f9ea85850dc3c132470e2d549a7fc837fdddb265de3dc6\": rpc error: code = NotFound desc = could not find container \"be38fa9155975587f3f9ea85850dc3c132470e2d549a7fc837fdddb265de3dc6\": container with ID starting with be38fa9155975587f3f9ea85850dc3c132470e2d549a7fc837fdddb265de3dc6 not found: ID does not exist"
Sep 11 14:44:07.560434 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:07.560412    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-625d10-9d8479986-9rdzt"]
Sep 11 14:44:07.572814 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:07.572793    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-625d10-9d8479986-9rdzt"]
Sep 11 14:44:07.687154 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:07.687130    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07fa02a0-fb46-475c-a71b-13e849c2a264" path="/var/lib/kubelet/pods/07fa02a0-fb46-475c-a71b-13e849c2a264/volumes"
Sep 11 14:44:07.687466 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:07.687454    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb93e5fb-1765-4565-9c92-b326b8558682" path="/var/lib/kubelet/pods/eb93e5fb-1765-4565-9c92-b326b8558682/volumes"
Sep 11 14:44:08.136248 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:08.136213    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:08.935883 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:08.935846    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:09.824961 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:09.824926    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:44:14.398252 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:14.398204    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:14.511556 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:14.511526    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:14.766225 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:14.766121    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:15.391343 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:15.391308    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72e046-995dn"]
Sep 11 14:44:15.391765 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:15.391749    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb93e5fb-1765-4565-9c92-b326b8558682" containerName="payload-pre-processing"
Sep 11 14:44:15.391828 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:15.391767    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb93e5fb-1765-4565-9c92-b326b8558682" containerName="payload-pre-processing"
Sep 11 14:44:15.391828 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:15.391775    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07fa02a0-fb46-475c-a71b-13e849c2a264" containerName="revoke-keys"
Sep 11 14:44:15.391828 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:15.391781    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="07fa02a0-fb46-475c-a71b-13e849c2a264" containerName="revoke-keys"
Sep 11 14:44:15.391929 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:15.391842    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb93e5fb-1765-4565-9c92-b326b8558682" containerName="payload-pre-processing"
Sep 11 14:44:15.391929 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:15.391851    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="07fa02a0-fb46-475c-a71b-13e849c2a264" containerName="revoke-keys"
Sep 11 14:44:15.395002 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:15.394987    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72e046-995dn"
Sep 11 14:44:15.398781 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:15.398758    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dp8gp\""
Sep 11 14:44:15.411862 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:15.411839    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72e046-995dn"]
Sep 11 14:44:15.547330 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:15.547304    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b85847cc-ba31-4461-b2e2-10cfd4dc2a91-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-72e046-995dn\" (UID: \"b85847cc-ba31-4461-b2e2-10cfd4dc2a91\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72e046-995dn"
Sep 11 14:44:15.648367 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:15.648300    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b85847cc-ba31-4461-b2e2-10cfd4dc2a91-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-72e046-995dn\" (UID: \"b85847cc-ba31-4461-b2e2-10cfd4dc2a91\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72e046-995dn"
Sep 11 14:44:15.648913 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:15.648894    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b85847cc-ba31-4461-b2e2-10cfd4dc2a91-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-72e046-995dn\" (UID: \"b85847cc-ba31-4461-b2e2-10cfd4dc2a91\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72e046-995dn"
Sep 11 14:44:15.705138 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:15.705113    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72e046-995dn"
Sep 11 14:44:15.716767 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:15.716740    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:16.005479 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:16.005449    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72e046-995dn"]
Sep 11 14:44:16.007747 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:44:16.007718    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb85847cc_ba31_4461_b2e2_10cfd4dc2a91.slice/crio-c7a5674730f8acb3b9ea6706db664064dee31b4b5996df2fb5d24893de7649a0 WatchSource:0}: Error finding container c7a5674730f8acb3b9ea6706db664064dee31b4b5996df2fb5d24893de7649a0: Status 404 returned error can't find the container with id c7a5674730f8acb3b9ea6706db664064dee31b4b5996df2fb5d24893de7649a0
Sep 11 14:44:16.579028 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:16.578993    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72e046-995dn" event={"ID":"b85847cc-ba31-4461-b2e2-10cfd4dc2a91","Type":"ContainerStarted","Data":"f2e032aa187e724709ef053a9ab552759257965cc52c5634dac0172864fc6ceb"}
Sep 11 14:44:16.579370 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:16.579059    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72e046-995dn" event={"ID":"b85847cc-ba31-4461-b2e2-10cfd4dc2a91","Type":"ContainerStarted","Data":"c7a5674730f8acb3b9ea6706db664064dee31b4b5996df2fb5d24893de7649a0"}
Sep 11 14:44:16.617439 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:16.617395    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72e046-995dn" podStartSLOduration=1.6173795499999999 podStartE2EDuration="1.61737955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:44:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:44:16.616586251 +0000 UTC m=+1749.415221029" watchObservedRunningTime="2026-09-11 14:44:16.61737955 +0000 UTC m=+1749.416014331"
Sep 11 14:44:17.150641 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:17.150607    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:17.585535 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:17.585502    2584 generic.go:356] "Generic (PLEG): container finished" podID="b85847cc-ba31-4461-b2e2-10cfd4dc2a91" containerID="f2e032aa187e724709ef053a9ab552759257965cc52c5634dac0172864fc6ceb" exitCode=0
Sep 11 14:44:17.585934 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:17.585536    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72e046-995dn" event={"ID":"b85847cc-ba31-4461-b2e2-10cfd4dc2a91","Type":"ContainerDied","Data":"f2e032aa187e724709ef053a9ab552759257965cc52c5634dac0172864fc6ceb"}
Sep 11 14:44:18.723446 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:18.723416    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72e046-995dn"
Sep 11 14:44:18.728776 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:18.728748    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:18.875770 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:18.875716    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b85847cc-ba31-4461-b2e2-10cfd4dc2a91-maas-api-service-ca\") pod \"b85847cc-ba31-4461-b2e2-10cfd4dc2a91\" (UID: \"b85847cc-ba31-4461-b2e2-10cfd4dc2a91\") "
Sep 11 14:44:18.876030 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:18.876006    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b85847cc-ba31-4461-b2e2-10cfd4dc2a91-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b85847cc-ba31-4461-b2e2-10cfd4dc2a91" (UID: "b85847cc-ba31-4461-b2e2-10cfd4dc2a91"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:44:18.976612 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:18.976591    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b85847cc-ba31-4461-b2e2-10cfd4dc2a91-maas-api-service-ca\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:44:19.598519 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:19.598488    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72e046-995dn"
Sep 11 14:44:19.598519 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:19.598505    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72e046-995dn" event={"ID":"b85847cc-ba31-4461-b2e2-10cfd4dc2a91","Type":"ContainerDied","Data":"c7a5674730f8acb3b9ea6706db664064dee31b4b5996df2fb5d24893de7649a0"}
Sep 11 14:44:19.598736 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:19.598580    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7a5674730f8acb3b9ea6706db664064dee31b4b5996df2fb5d24893de7649a0"
Sep 11 14:44:19.979959 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:19.979874    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:26.220910 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:26.220858    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:26.271410 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:26.271378    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72e046-669d4b786b-h7brn"]
Sep 11 14:44:26.271658 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:26.271623    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72e046-669d4b786b-h7brn" podUID="49d9d520-2902-4cf1-8415-6ff82d607531" containerName="payload-pre-processing" containerID="cri-o://308e9e94f7acdcc3850e5ea7e56617b51e05789c87bd324ff85a30bdef26c726" gracePeriod=30
Sep 11 14:44:26.319782 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:26.319751    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:26.401276 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:26.401248    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:26.475498 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:26.475432    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72e046-995dn"]
Sep 11 14:44:26.480030 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:26.480006    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72e046-995dn"]
Sep 11 14:44:26.495548 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:26.495517    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:26.526180 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:26.526149    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72e046-669d4b786b-h7brn"
Sep 11 14:44:26.594848 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:26.594819    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:26.635499 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:26.635471    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49d9d520-2902-4cf1-8415-6ff82d607531-plugins-config-volume\") pod \"49d9d520-2902-4cf1-8415-6ff82d607531\" (UID: \"49d9d520-2902-4cf1-8415-6ff82d607531\") "
Sep 11 14:44:26.635649 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:26.635590    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9j97\" (UniqueName: \"kubernetes.io/projected/49d9d520-2902-4cf1-8415-6ff82d607531-kube-api-access-g9j97\") pod \"49d9d520-2902-4cf1-8415-6ff82d607531\" (UID: \"49d9d520-2902-4cf1-8415-6ff82d607531\") "
Sep 11 14:44:26.635928 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:26.635881    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49d9d520-2902-4cf1-8415-6ff82d607531-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "49d9d520-2902-4cf1-8415-6ff82d607531" (UID: "49d9d520-2902-4cf1-8415-6ff82d607531"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:44:26.636039 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:26.635968    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49d9d520-2902-4cf1-8415-6ff82d607531-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:44:26.636039 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:26.636018    2584 generic.go:356] "Generic (PLEG): container finished" podID="49d9d520-2902-4cf1-8415-6ff82d607531" containerID="308e9e94f7acdcc3850e5ea7e56617b51e05789c87bd324ff85a30bdef26c726" exitCode=0
Sep 11 14:44:26.636147 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:26.636082    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72e046-669d4b786b-h7brn"
Sep 11 14:44:26.636223 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:26.636195    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72e046-669d4b786b-h7brn" event={"ID":"49d9d520-2902-4cf1-8415-6ff82d607531","Type":"ContainerDied","Data":"308e9e94f7acdcc3850e5ea7e56617b51e05789c87bd324ff85a30bdef26c726"}
Sep 11 14:44:26.636345 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:26.636257    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72e046-669d4b786b-h7brn" event={"ID":"49d9d520-2902-4cf1-8415-6ff82d607531","Type":"ContainerDied","Data":"5861f31889c431eef5fb6085540d847138c8938eb305f96b8edbd5d257586cb7"}
Sep 11 14:44:26.636345 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:26.636297    2584 scope.go:117] "RemoveContainer" containerID="308e9e94f7acdcc3850e5ea7e56617b51e05789c87bd324ff85a30bdef26c726"
Sep 11 14:44:26.638267 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:26.638238    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49d9d520-2902-4cf1-8415-6ff82d607531-kube-api-access-g9j97" (OuterVolumeSpecName: "kube-api-access-g9j97") pod "49d9d520-2902-4cf1-8415-6ff82d607531" (UID: "49d9d520-2902-4cf1-8415-6ff82d607531"). InnerVolumeSpecName "kube-api-access-g9j97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:44:26.650463 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:26.650448    2584 scope.go:117] "RemoveContainer" containerID="308e9e94f7acdcc3850e5ea7e56617b51e05789c87bd324ff85a30bdef26c726"
Sep 11 14:44:26.650774 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:44:26.650755    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"308e9e94f7acdcc3850e5ea7e56617b51e05789c87bd324ff85a30bdef26c726\": container with ID starting with 308e9e94f7acdcc3850e5ea7e56617b51e05789c87bd324ff85a30bdef26c726 not found: ID does not exist" containerID="308e9e94f7acdcc3850e5ea7e56617b51e05789c87bd324ff85a30bdef26c726"
Sep 11 14:44:26.650846 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:26.650781    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"308e9e94f7acdcc3850e5ea7e56617b51e05789c87bd324ff85a30bdef26c726"} err="failed to get container status \"308e9e94f7acdcc3850e5ea7e56617b51e05789c87bd324ff85a30bdef26c726\": rpc error: code = NotFound desc = could not find container \"308e9e94f7acdcc3850e5ea7e56617b51e05789c87bd324ff85a30bdef26c726\": container with ID starting with 308e9e94f7acdcc3850e5ea7e56617b51e05789c87bd324ff85a30bdef26c726 not found: ID does not exist"
Sep 11 14:44:26.737265 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:26.737211    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9j97\" (UniqueName: \"kubernetes.io/projected/49d9d520-2902-4cf1-8415-6ff82d607531-kube-api-access-g9j97\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:44:26.892990 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:26.892961    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:26.968721 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:26.968672    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72e046-669d4b786b-h7brn"]
Sep 11 14:44:26.975923 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:26.975902    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72e046-669d4b786b-h7brn"]
Sep 11 14:44:27.001640 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:27.001581    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:27.679607 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:27.679575    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49d9d520-2902-4cf1-8415-6ff82d607531" path="/var/lib/kubelet/pods/49d9d520-2902-4cf1-8415-6ff82d607531/volumes"
Sep 11 14:44:27.679977 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:27.679894    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b85847cc-ba31-4461-b2e2-10cfd4dc2a91" path="/var/lib/kubelet/pods/b85847cc-ba31-4461-b2e2-10cfd4dc2a91/volumes"
Sep 11 14:44:27.931085 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:27.930998    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:29.311801 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:29.311770    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:44:33.819330 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:33.819294    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:33.916427 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:33.916380    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:34.155428 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:34.155353    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:34.534113 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:34.534039    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-344045-79tr6"]
Sep 11 14:44:34.534410 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:34.534398    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49d9d520-2902-4cf1-8415-6ff82d607531" containerName="payload-pre-processing"
Sep 11 14:44:34.534457 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:34.534412    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="49d9d520-2902-4cf1-8415-6ff82d607531" containerName="payload-pre-processing"
Sep 11 14:44:34.534457 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:34.534428    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b85847cc-ba31-4461-b2e2-10cfd4dc2a91" containerName="revoke-keys"
Sep 11 14:44:34.534457 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:34.534435    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b85847cc-ba31-4461-b2e2-10cfd4dc2a91" containerName="revoke-keys"
Sep 11 14:44:34.534554 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:34.534494    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="49d9d520-2902-4cf1-8415-6ff82d607531" containerName="payload-pre-processing"
Sep 11 14:44:34.534554 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:34.534506    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b85847cc-ba31-4461-b2e2-10cfd4dc2a91" containerName="revoke-keys"
Sep 11 14:44:34.538992 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:34.538974    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-344045-79tr6"
Sep 11 14:44:34.542268 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:34.542246    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dp8gp\""
Sep 11 14:44:34.554590 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:34.554564    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-344045-79tr6"]
Sep 11 14:44:34.600810 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:34.600780    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e81adbb6-a892-43e2-814f-02953d9cdddd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-344045-79tr6\" (UID: \"e81adbb6-a892-43e2-814f-02953d9cdddd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-344045-79tr6"
Sep 11 14:44:34.702210 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:34.702182    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e81adbb6-a892-43e2-814f-02953d9cdddd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-344045-79tr6\" (UID: \"e81adbb6-a892-43e2-814f-02953d9cdddd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-344045-79tr6"
Sep 11 14:44:34.702793 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:34.702774    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e81adbb6-a892-43e2-814f-02953d9cdddd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-344045-79tr6\" (UID: \"e81adbb6-a892-43e2-814f-02953d9cdddd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-344045-79tr6"
Sep 11 14:44:34.848632 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:34.848599    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-344045-79tr6"
Sep 11 14:44:34.926712 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:34.926659    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:35.127856 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:35.127827    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-344045-79tr6"]
Sep 11 14:44:35.130798 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:44:35.130774    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode81adbb6_a892_43e2_814f_02953d9cdddd.slice/crio-1fa53f645f8c9359acb55d86e4463cf249411ed52a7837ff410df929260e227e WatchSource:0}: Error finding container 1fa53f645f8c9359acb55d86e4463cf249411ed52a7837ff410df929260e227e: Status 404 returned error can't find the container with id 1fa53f645f8c9359acb55d86e4463cf249411ed52a7837ff410df929260e227e
Sep 11 14:44:35.684660 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:35.684625    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-344045-79tr6" event={"ID":"e81adbb6-a892-43e2-814f-02953d9cdddd","Type":"ContainerStarted","Data":"ee6ed6d84a97edae5c7b43a84df5bb4960b295e12ad0abfd5bdcc8d35c4154dd"}
Sep 11 14:44:35.684854 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:35.684711    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-344045-79tr6" event={"ID":"e81adbb6-a892-43e2-814f-02953d9cdddd","Type":"ContainerStarted","Data":"1fa53f645f8c9359acb55d86e4463cf249411ed52a7837ff410df929260e227e"}
Sep 11 14:44:35.712487 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:35.712444    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-344045-79tr6" podStartSLOduration=1.7124284250000001 podStartE2EDuration="1.712428425s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:44:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:44:35.709763506 +0000 UTC m=+1768.508398288" watchObservedRunningTime="2026-09-11 14:44:35.712428425 +0000 UTC m=+1768.511063206"
Sep 11 14:44:36.117504 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:36.117470    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:36.691593 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:36.691555    2584 generic.go:356] "Generic (PLEG): container finished" podID="e81adbb6-a892-43e2-814f-02953d9cdddd" containerID="ee6ed6d84a97edae5c7b43a84df5bb4960b295e12ad0abfd5bdcc8d35c4154dd" exitCode=0
Sep 11 14:44:36.691784 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:36.691635    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-344045-79tr6" event={"ID":"e81adbb6-a892-43e2-814f-02953d9cdddd","Type":"ContainerDied","Data":"ee6ed6d84a97edae5c7b43a84df5bb4960b295e12ad0abfd5bdcc8d35c4154dd"}
Sep 11 14:44:37.048881 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:37.048847    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:37.835126 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:37.835104    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-344045-79tr6"
Sep 11 14:44:37.925766 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:37.925732    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e81adbb6-a892-43e2-814f-02953d9cdddd-maas-api-service-ca\") pod \"e81adbb6-a892-43e2-814f-02953d9cdddd\" (UID: \"e81adbb6-a892-43e2-814f-02953d9cdddd\") "
Sep 11 14:44:37.926086 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:37.926064    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e81adbb6-a892-43e2-814f-02953d9cdddd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e81adbb6-a892-43e2-814f-02953d9cdddd" (UID: "e81adbb6-a892-43e2-814f-02953d9cdddd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:44:38.026418 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:38.026363    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e81adbb6-a892-43e2-814f-02953d9cdddd-maas-api-service-ca\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:44:38.703088 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:38.703058    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-344045-79tr6"
Sep 11 14:44:38.703226 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:38.703107    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-344045-79tr6" event={"ID":"e81adbb6-a892-43e2-814f-02953d9cdddd","Type":"ContainerDied","Data":"1fa53f645f8c9359acb55d86e4463cf249411ed52a7837ff410df929260e227e"}
Sep 11 14:44:38.703226 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:38.703150    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1fa53f645f8c9359acb55d86e4463cf249411ed52a7837ff410df929260e227e"
Sep 11 14:44:45.198278 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.198198    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:45.218027 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.217994    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-344045-7f446f687c-jk27f"]
Sep 11 14:44:45.218672 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.218636    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-344045-7f446f687c-jk27f" podUID="49693f8f-95cb-4f96-9414-eb4dda6768b7" containerName="payload-processing" containerID="cri-o://e356f608b6074b51835ae16865e5add69999a8f83c583fb4476a28445089ee7d" gracePeriod=30
Sep 11 14:44:45.229068 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.229043    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-344045-c69864b46-92wtl"]
Sep 11 14:44:45.229288 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.229259    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-344045-c69864b46-92wtl" podUID="4ba9d944-88bf-47f4-b1b4-fed2961af84e" containerName="payload-pre-processing" containerID="cri-o://85b015e413705f15afcdf6a4e3c67398b2d79d2f6eb4966d745fd1eaf829f318" gracePeriod=30
Sep 11 14:44:45.290811 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.290781    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:45.386242 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.386182    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:45.495843 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.495814    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:45.506983 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.506961    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-344045-7f446f687c-jk27f"
Sep 11 14:44:45.510210 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.510191    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-344045-c69864b46-92wtl"
Sep 11 14:44:45.547940 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.547904    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-344045-79tr6"]
Sep 11 14:44:45.559713 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.559670    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-344045-79tr6"]
Sep 11 14:44:45.584075 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.584054    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lk6d8\" (UniqueName: \"kubernetes.io/projected/49693f8f-95cb-4f96-9414-eb4dda6768b7-kube-api-access-lk6d8\") pod \"49693f8f-95cb-4f96-9414-eb4dda6768b7\" (UID: \"49693f8f-95cb-4f96-9414-eb4dda6768b7\") "
Sep 11 14:44:45.584171 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.584096    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxwbt\" (UniqueName: \"kubernetes.io/projected/4ba9d944-88bf-47f4-b1b4-fed2961af84e-kube-api-access-gxwbt\") pod \"4ba9d944-88bf-47f4-b1b4-fed2961af84e\" (UID: \"4ba9d944-88bf-47f4-b1b4-fed2961af84e\") "
Sep 11 14:44:45.584171 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.584142    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ba9d944-88bf-47f4-b1b4-fed2961af84e-plugins-config-volume\") pod \"4ba9d944-88bf-47f4-b1b4-fed2961af84e\" (UID: \"4ba9d944-88bf-47f4-b1b4-fed2961af84e\") "
Sep 11 14:44:45.584257 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.584174    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49693f8f-95cb-4f96-9414-eb4dda6768b7-plugins-config-volume\") pod \"49693f8f-95cb-4f96-9414-eb4dda6768b7\" (UID: \"49693f8f-95cb-4f96-9414-eb4dda6768b7\") "
Sep 11 14:44:45.584575 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.584545    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ba9d944-88bf-47f4-b1b4-fed2961af84e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4ba9d944-88bf-47f4-b1b4-fed2961af84e" (UID: "4ba9d944-88bf-47f4-b1b4-fed2961af84e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:44:45.584662 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.584587    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49693f8f-95cb-4f96-9414-eb4dda6768b7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "49693f8f-95cb-4f96-9414-eb4dda6768b7" (UID: "49693f8f-95cb-4f96-9414-eb4dda6768b7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:44:45.586272 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.586249    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ba9d944-88bf-47f4-b1b4-fed2961af84e-kube-api-access-gxwbt" (OuterVolumeSpecName: "kube-api-access-gxwbt") pod "4ba9d944-88bf-47f4-b1b4-fed2961af84e" (UID: "4ba9d944-88bf-47f4-b1b4-fed2961af84e"). InnerVolumeSpecName "kube-api-access-gxwbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:44:45.586358 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.586299    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49693f8f-95cb-4f96-9414-eb4dda6768b7-kube-api-access-lk6d8" (OuterVolumeSpecName: "kube-api-access-lk6d8") pod "49693f8f-95cb-4f96-9414-eb4dda6768b7" (UID: "49693f8f-95cb-4f96-9414-eb4dda6768b7"). InnerVolumeSpecName "kube-api-access-lk6d8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:44:45.617480 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.617448    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:45.680547 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.680511    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e81adbb6-a892-43e2-814f-02953d9cdddd" path="/var/lib/kubelet/pods/e81adbb6-a892-43e2-814f-02953d9cdddd/volumes"
Sep 11 14:44:45.684923 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.684891    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ba9d944-88bf-47f4-b1b4-fed2961af84e-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:44:45.685046 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.684926    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49693f8f-95cb-4f96-9414-eb4dda6768b7-plugins-config-volume\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:44:45.685046 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.684941    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lk6d8\" (UniqueName: \"kubernetes.io/projected/49693f8f-95cb-4f96-9414-eb4dda6768b7-kube-api-access-lk6d8\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:44:45.685046 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.684955    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxwbt\" (UniqueName: \"kubernetes.io/projected/4ba9d944-88bf-47f4-b1b4-fed2961af84e-kube-api-access-gxwbt\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:44:45.737441 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.737376    2584 generic.go:356] "Generic (PLEG): container finished" podID="4ba9d944-88bf-47f4-b1b4-fed2961af84e" containerID="85b015e413705f15afcdf6a4e3c67398b2d79d2f6eb4966d745fd1eaf829f318" exitCode=0
Sep 11 14:44:45.737441 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.737432    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-344045-c69864b46-92wtl"
Sep 11 14:44:45.737586 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.737465    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-344045-c69864b46-92wtl" event={"ID":"4ba9d944-88bf-47f4-b1b4-fed2961af84e","Type":"ContainerDied","Data":"85b015e413705f15afcdf6a4e3c67398b2d79d2f6eb4966d745fd1eaf829f318"}
Sep 11 14:44:45.737586 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.737514    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-344045-c69864b46-92wtl" event={"ID":"4ba9d944-88bf-47f4-b1b4-fed2961af84e","Type":"ContainerDied","Data":"f7a6d4456a4a46bd4e2fe55d29d4a03208fd47636501f70c9486181c13aeacde"}
Sep 11 14:44:45.737586 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.737537    2584 scope.go:117] "RemoveContainer" containerID="85b015e413705f15afcdf6a4e3c67398b2d79d2f6eb4966d745fd1eaf829f318"
Sep 11 14:44:45.739140 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.739117    2584 generic.go:356] "Generic (PLEG): container finished" podID="49693f8f-95cb-4f96-9414-eb4dda6768b7" containerID="e356f608b6074b51835ae16865e5add69999a8f83c583fb4476a28445089ee7d" exitCode=0
Sep 11 14:44:45.739277 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.739159    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-344045-7f446f687c-jk27f"
Sep 11 14:44:45.739277 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.739204    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-344045-7f446f687c-jk27f" event={"ID":"49693f8f-95cb-4f96-9414-eb4dda6768b7","Type":"ContainerDied","Data":"e356f608b6074b51835ae16865e5add69999a8f83c583fb4476a28445089ee7d"}
Sep 11 14:44:45.739277 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.739254    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-344045-7f446f687c-jk27f" event={"ID":"49693f8f-95cb-4f96-9414-eb4dda6768b7","Type":"ContainerDied","Data":"fc1fa3b9f8cb9abd3c535a0c3c4070bec8b0472c4960b31889beb23b131516e4"}
Sep 11 14:44:45.746608 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.746588    2584 scope.go:117] "RemoveContainer" containerID="85b015e413705f15afcdf6a4e3c67398b2d79d2f6eb4966d745fd1eaf829f318"
Sep 11 14:44:45.746902 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:44:45.746882    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85b015e413705f15afcdf6a4e3c67398b2d79d2f6eb4966d745fd1eaf829f318\": container with ID starting with 85b015e413705f15afcdf6a4e3c67398b2d79d2f6eb4966d745fd1eaf829f318 not found: ID does not exist" containerID="85b015e413705f15afcdf6a4e3c67398b2d79d2f6eb4966d745fd1eaf829f318"
Sep 11 14:44:45.746965 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.746909    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85b015e413705f15afcdf6a4e3c67398b2d79d2f6eb4966d745fd1eaf829f318"} err="failed to get container status \"85b015e413705f15afcdf6a4e3c67398b2d79d2f6eb4966d745fd1eaf829f318\": rpc error: code = NotFound desc = could not find container \"85b015e413705f15afcdf6a4e3c67398b2d79d2f6eb4966d745fd1eaf829f318\": container with ID starting with 85b015e413705f15afcdf6a4e3c67398b2d79d2f6eb4966d745fd1eaf829f318 not found: ID does not exist"
Sep 11 14:44:45.746965 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.746926    2584 scope.go:117] "RemoveContainer" containerID="e356f608b6074b51835ae16865e5add69999a8f83c583fb4476a28445089ee7d"
Sep 11 14:44:45.758219 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.758196    2584 scope.go:117] "RemoveContainer" containerID="e356f608b6074b51835ae16865e5add69999a8f83c583fb4476a28445089ee7d"
Sep 11 14:44:45.758499 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:44:45.758470    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e356f608b6074b51835ae16865e5add69999a8f83c583fb4476a28445089ee7d\": container with ID starting with e356f608b6074b51835ae16865e5add69999a8f83c583fb4476a28445089ee7d not found: ID does not exist" containerID="e356f608b6074b51835ae16865e5add69999a8f83c583fb4476a28445089ee7d"
Sep 11 14:44:45.758579 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.758506    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e356f608b6074b51835ae16865e5add69999a8f83c583fb4476a28445089ee7d"} err="failed to get container status \"e356f608b6074b51835ae16865e5add69999a8f83c583fb4476a28445089ee7d\": rpc error: code = NotFound desc = could not find container \"e356f608b6074b51835ae16865e5add69999a8f83c583fb4476a28445089ee7d\": container with ID starting with e356f608b6074b51835ae16865e5add69999a8f83c583fb4476a28445089ee7d not found: ID does not exist"
Sep 11 14:44:45.763855 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.763832    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-344045-c69864b46-92wtl"]
Sep 11 14:44:45.769476 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.769452    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-344045-c69864b46-92wtl"]
Sep 11 14:44:45.782204 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.782180    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-344045-7f446f687c-jk27f"]
Sep 11 14:44:45.789850 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.789830    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-344045-7f446f687c-jk27f"]
Sep 11 14:44:45.957706 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:45.957639    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:46.061624 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:46.061593    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:47.679097 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:47.679063    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49693f8f-95cb-4f96-9414-eb4dda6768b7" path="/var/lib/kubelet/pods/49693f8f-95cb-4f96-9414-eb4dda6768b7/volumes"
Sep 11 14:44:47.679450 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:47.679400    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ba9d944-88bf-47f4-b1b4-fed2961af84e" path="/var/lib/kubelet/pods/4ba9d944-88bf-47f4-b1b4-fed2961af84e/volumes"
Sep 11 14:44:47.721769 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:47.721745    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:44:52.391208 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:52.391161    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:52.581292 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:52.581254    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:52.720379 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:52.720276    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:44:55.590697 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:55.590650    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57d567598c-tmjd8"]
Sep 11 14:44:55.591135 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:55.590927    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-57d567598c-tmjd8" podUID="c2bf1285-c840-4b0a-8f39-b157fedbd628" containerName="manager" containerID="cri-o://e8f89b4222080d4e6d380fc94690215a020e9428d5ca18250024becefea14301" gracePeriod=30
Sep 11 14:44:55.799112 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:55.799082    2584 generic.go:356] "Generic (PLEG): container finished" podID="c2bf1285-c840-4b0a-8f39-b157fedbd628" containerID="e8f89b4222080d4e6d380fc94690215a020e9428d5ca18250024becefea14301" exitCode=0
Sep 11 14:44:55.799256 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:55.799115    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57d567598c-tmjd8" event={"ID":"c2bf1285-c840-4b0a-8f39-b157fedbd628","Type":"ContainerDied","Data":"e8f89b4222080d4e6d380fc94690215a020e9428d5ca18250024becefea14301"}
Sep 11 14:44:55.799256 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:55.799173    2584 scope.go:117] "RemoveContainer" containerID="ae8a5d5e6b86222e9369fdebd72b420aa8178cce3ca7b0f757a6f82ea6d5de7b"
Sep 11 14:44:55.836787 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:55.836762    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57d567598c-tmjd8"
Sep 11 14:44:55.968082 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:55.968018    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6x9c\" (UniqueName: \"kubernetes.io/projected/c2bf1285-c840-4b0a-8f39-b157fedbd628-kube-api-access-l6x9c\") pod \"c2bf1285-c840-4b0a-8f39-b157fedbd628\" (UID: \"c2bf1285-c840-4b0a-8f39-b157fedbd628\") "
Sep 11 14:44:55.968211 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:55.968133    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2bf1285-c840-4b0a-8f39-b157fedbd628-webhook-cert\") pod \"c2bf1285-c840-4b0a-8f39-b157fedbd628\" (UID: \"c2bf1285-c840-4b0a-8f39-b157fedbd628\") "
Sep 11 14:44:55.968211 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:55.968195    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2bf1285-c840-4b0a-8f39-b157fedbd628-metrics-certs\") pod \"c2bf1285-c840-4b0a-8f39-b157fedbd628\" (UID: \"c2bf1285-c840-4b0a-8f39-b157fedbd628\") "
Sep 11 14:44:55.970257 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:55.970219    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2bf1285-c840-4b0a-8f39-b157fedbd628-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c2bf1285-c840-4b0a-8f39-b157fedbd628" (UID: "c2bf1285-c840-4b0a-8f39-b157fedbd628"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:44:55.970257 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:55.970238    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2bf1285-c840-4b0a-8f39-b157fedbd628-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c2bf1285-c840-4b0a-8f39-b157fedbd628" (UID: "c2bf1285-c840-4b0a-8f39-b157fedbd628"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:44:55.970443 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:55.970286    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2bf1285-c840-4b0a-8f39-b157fedbd628-kube-api-access-l6x9c" (OuterVolumeSpecName: "kube-api-access-l6x9c") pod "c2bf1285-c840-4b0a-8f39-b157fedbd628" (UID: "c2bf1285-c840-4b0a-8f39-b157fedbd628"). InnerVolumeSpecName "kube-api-access-l6x9c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:44:56.069711 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:56.069660    2584 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2bf1285-c840-4b0a-8f39-b157fedbd628-webhook-cert\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:44:56.069711 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:56.069710    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2bf1285-c840-4b0a-8f39-b157fedbd628-metrics-certs\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:44:56.069711 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:56.069720    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6x9c\" (UniqueName: \"kubernetes.io/projected/c2bf1285-c840-4b0a-8f39-b157fedbd628-kube-api-access-l6x9c\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:44:56.805490 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:56.805467    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57d567598c-tmjd8"
Sep 11 14:44:56.805868 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:56.805474    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57d567598c-tmjd8" event={"ID":"c2bf1285-c840-4b0a-8f39-b157fedbd628","Type":"ContainerDied","Data":"7876689e443b2ebe0a17f14d579ff90881aa774020bf922c170f51531094e0fa"}
Sep 11 14:44:56.805868 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:56.805588    2584 scope.go:117] "RemoveContainer" containerID="e8f89b4222080d4e6d380fc94690215a020e9428d5ca18250024becefea14301"
Sep 11 14:44:56.829165 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:56.829141    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:44:56.838843 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:56.838822    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57d567598c-tmjd8"]
Sep 11 14:44:56.844312 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:56.844292    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-57d567598c-tmjd8"]
Sep 11 14:44:57.679459 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:44:57.679428    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2bf1285-c840-4b0a-8f39-b157fedbd628" path="/var/lib/kubelet/pods/c2bf1285-c840-4b0a-8f39-b157fedbd628/volumes"
Sep 11 14:45:00.151133 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:00.151054    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818965-ln2d6"]
Sep 11 14:45:00.151599 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:00.151577    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49693f8f-95cb-4f96-9414-eb4dda6768b7" containerName="payload-processing"
Sep 11 14:45:00.151671 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:00.151603    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="49693f8f-95cb-4f96-9414-eb4dda6768b7" containerName="payload-processing"
Sep 11 14:45:00.151671 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:00.151621    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ba9d944-88bf-47f4-b1b4-fed2961af84e" containerName="payload-pre-processing"
Sep 11 14:45:00.151671 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:00.151631    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ba9d944-88bf-47f4-b1b4-fed2961af84e" containerName="payload-pre-processing"
Sep 11 14:45:00.151671 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:00.151652    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e81adbb6-a892-43e2-814f-02953d9cdddd" containerName="revoke-keys"
Sep 11 14:45:00.151671 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:00.151663    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="e81adbb6-a892-43e2-814f-02953d9cdddd" containerName="revoke-keys"
Sep 11 14:45:00.151949 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:00.151707    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2bf1285-c840-4b0a-8f39-b157fedbd628" containerName="manager"
Sep 11 14:45:00.151949 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:00.151718    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2bf1285-c840-4b0a-8f39-b157fedbd628" containerName="manager"
Sep 11 14:45:00.151949 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:00.151734    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2bf1285-c840-4b0a-8f39-b157fedbd628" containerName="manager"
Sep 11 14:45:00.151949 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:00.151742    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2bf1285-c840-4b0a-8f39-b157fedbd628" containerName="manager"
Sep 11 14:45:00.151949 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:00.151833    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2bf1285-c840-4b0a-8f39-b157fedbd628" containerName="manager"
Sep 11 14:45:00.151949 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:00.151845    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2bf1285-c840-4b0a-8f39-b157fedbd628" containerName="manager"
Sep 11 14:45:00.151949 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:00.151857    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="49693f8f-95cb-4f96-9414-eb4dda6768b7" containerName="payload-processing"
Sep 11 14:45:00.151949 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:00.151866    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="e81adbb6-a892-43e2-814f-02953d9cdddd" containerName="revoke-keys"
Sep 11 14:45:00.151949 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:00.151875    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ba9d944-88bf-47f4-b1b4-fed2961af84e" containerName="payload-pre-processing"
Sep 11 14:45:00.156388 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:00.156366    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818965-ln2d6"
Sep 11 14:45:00.159837 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:00.159819    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dp8gp\""
Sep 11 14:45:00.165931 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:00.165904    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818965-ln2d6"
Sep 11 14:45:00.167823 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:00.167803    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818965-ln2d6"]
Sep 11 14:45:00.462628 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:00.462587    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818965-ln2d6"]
Sep 11 14:45:00.462825 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:45:00.462749    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf26db12b_4ba6_4551_a685_bd3e291a9d03.slice/crio-c45440c276a3fea1919e4a873e25fb9b099c9d549348332a6d05c0edc1ab015d WatchSource:0}: Error finding container c45440c276a3fea1919e4a873e25fb9b099c9d549348332a6d05c0edc1ab015d: Status 404 returned error can't find the container with id c45440c276a3fea1919e4a873e25fb9b099c9d549348332a6d05c0edc1ab015d
Sep 11 14:45:00.828114 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:00.828086    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818965-ln2d6" event={"ID":"f26db12b-4ba6-4551-a685-bd3e291a9d03","Type":"ContainerStarted","Data":"f6a846e6912f1341c35e85da975a4f774f1e0ce8f468b35b12f9d01aec8c1349"}
Sep 11 14:45:00.828249 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:00.828133    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818965-ln2d6" event={"ID":"f26db12b-4ba6-4551-a685-bd3e291a9d03","Type":"ContainerStarted","Data":"c45440c276a3fea1919e4a873e25fb9b099c9d549348332a6d05c0edc1ab015d"}
Sep 11 14:45:00.854379 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:00.854331    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818965-ln2d6" podStartSLOduration=0.854316544 podStartE2EDuration="854.316544ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:45:00.851638269 +0000 UTC m=+1793.650273051" watchObservedRunningTime="2026-09-11 14:45:00.854316544 +0000 UTC m=+1793.652951381"
Sep 11 14:45:01.834056 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:01.834027    2584 generic.go:356] "Generic (PLEG): container finished" podID="f26db12b-4ba6-4551-a685-bd3e291a9d03" containerID="f6a846e6912f1341c35e85da975a4f774f1e0ce8f468b35b12f9d01aec8c1349" exitCode=0
Sep 11 14:45:01.834375 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:01.834114    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818965-ln2d6" event={"ID":"f26db12b-4ba6-4551-a685-bd3e291a9d03","Type":"ContainerDied","Data":"f6a846e6912f1341c35e85da975a4f774f1e0ce8f468b35b12f9d01aec8c1349"}
Sep 11 14:45:02.963243 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:02.963219    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818965-ln2d6"
Sep 11 14:45:03.845632 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:03.845607    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818965-ln2d6"
Sep 11 14:45:03.845803 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:03.845631    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818965-ln2d6" event={"ID":"f26db12b-4ba6-4551-a685-bd3e291a9d03","Type":"ContainerDied","Data":"c45440c276a3fea1919e4a873e25fb9b099c9d549348332a6d05c0edc1ab015d"}
Sep 11 14:45:03.845803 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:03.845698    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c45440c276a3fea1919e4a873e25fb9b099c9d549348332a6d05c0edc1ab015d"
Sep 11 14:45:57.740166 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:57.740134    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-57d567598c-4f2g4"]
Sep 11 14:45:57.740602 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:57.740506    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f26db12b-4ba6-4551-a685-bd3e291a9d03" containerName="cleanup"
Sep 11 14:45:57.740602 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:57.740518    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="f26db12b-4ba6-4551-a685-bd3e291a9d03" containerName="cleanup"
Sep 11 14:45:57.740602 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:57.740582    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="f26db12b-4ba6-4551-a685-bd3e291a9d03" containerName="cleanup"
Sep 11 14:45:57.743549 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:57.743529    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57d567598c-4f2g4"
Sep 11 14:45:57.746328 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:57.746308    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 14:45:57.747543 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:57.747517    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pgmvd\""
Sep 11 14:45:57.747543 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:57.747536    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 14:45:57.747718 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:57.747600    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 14:45:57.757577 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:57.757552    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57d567598c-4f2g4"]
Sep 11 14:45:57.841146 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:57.841118    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnmv7\" (UniqueName: \"kubernetes.io/projected/9800469a-9f5c-4368-ae8c-4ce4329cecc7-kube-api-access-hnmv7\") pod \"maas-controller-57d567598c-4f2g4\" (UID: \"9800469a-9f5c-4368-ae8c-4ce4329cecc7\") " pod="opendatahub/maas-controller-57d567598c-4f2g4"
Sep 11 14:45:57.841241 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:57.841164    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9800469a-9f5c-4368-ae8c-4ce4329cecc7-metrics-certs\") pod \"maas-controller-57d567598c-4f2g4\" (UID: \"9800469a-9f5c-4368-ae8c-4ce4329cecc7\") " pod="opendatahub/maas-controller-57d567598c-4f2g4"
Sep 11 14:45:57.841241 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:57.841183    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9800469a-9f5c-4368-ae8c-4ce4329cecc7-webhook-cert\") pod \"maas-controller-57d567598c-4f2g4\" (UID: \"9800469a-9f5c-4368-ae8c-4ce4329cecc7\") " pod="opendatahub/maas-controller-57d567598c-4f2g4"
Sep 11 14:45:57.941923 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:57.941891    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9800469a-9f5c-4368-ae8c-4ce4329cecc7-webhook-cert\") pod \"maas-controller-57d567598c-4f2g4\" (UID: \"9800469a-9f5c-4368-ae8c-4ce4329cecc7\") " pod="opendatahub/maas-controller-57d567598c-4f2g4"
Sep 11 14:45:57.942013 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:57.941978    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnmv7\" (UniqueName: \"kubernetes.io/projected/9800469a-9f5c-4368-ae8c-4ce4329cecc7-kube-api-access-hnmv7\") pod \"maas-controller-57d567598c-4f2g4\" (UID: \"9800469a-9f5c-4368-ae8c-4ce4329cecc7\") " pod="opendatahub/maas-controller-57d567598c-4f2g4"
Sep 11 14:45:57.942013 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:57.942009    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9800469a-9f5c-4368-ae8c-4ce4329cecc7-metrics-certs\") pod \"maas-controller-57d567598c-4f2g4\" (UID: \"9800469a-9f5c-4368-ae8c-4ce4329cecc7\") " pod="opendatahub/maas-controller-57d567598c-4f2g4"
Sep 11 14:45:57.944157 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:57.944131    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9800469a-9f5c-4368-ae8c-4ce4329cecc7-webhook-cert\") pod \"maas-controller-57d567598c-4f2g4\" (UID: \"9800469a-9f5c-4368-ae8c-4ce4329cecc7\") " pod="opendatahub/maas-controller-57d567598c-4f2g4"
Sep 11 14:45:57.944246 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:57.944159    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9800469a-9f5c-4368-ae8c-4ce4329cecc7-metrics-certs\") pod \"maas-controller-57d567598c-4f2g4\" (UID: \"9800469a-9f5c-4368-ae8c-4ce4329cecc7\") " pod="opendatahub/maas-controller-57d567598c-4f2g4"
Sep 11 14:45:57.950514 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:57.950493    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnmv7\" (UniqueName: \"kubernetes.io/projected/9800469a-9f5c-4368-ae8c-4ce4329cecc7-kube-api-access-hnmv7\") pod \"maas-controller-57d567598c-4f2g4\" (UID: \"9800469a-9f5c-4368-ae8c-4ce4329cecc7\") " pod="opendatahub/maas-controller-57d567598c-4f2g4"
Sep 11 14:45:58.053885 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:58.053858    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57d567598c-4f2g4"
Sep 11 14:45:58.329987 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:58.329921    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57d567598c-4f2g4"]
Sep 11 14:45:58.333081 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:45:58.333054    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9800469a_9f5c_4368_ae8c_4ce4329cecc7.slice/crio-a606f95e5b4abffcd64ddf1428764f65521d795682a3f2c5aeda492cf7b50926 WatchSource:0}: Error finding container a606f95e5b4abffcd64ddf1428764f65521d795682a3f2c5aeda492cf7b50926: Status 404 returned error can't find the container with id a606f95e5b4abffcd64ddf1428764f65521d795682a3f2c5aeda492cf7b50926
Sep 11 14:45:58.334331 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:58.334314    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 14:45:59.123214 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:59.123175    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57d567598c-4f2g4" event={"ID":"9800469a-9f5c-4368-ae8c-4ce4329cecc7","Type":"ContainerStarted","Data":"383da18d886cca1aeb9ee0afafce0bd59cda4bec503b906d3386d25add4c459b"}
Sep 11 14:45:59.123583 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:59.123238    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57d567598c-4f2g4" event={"ID":"9800469a-9f5c-4368-ae8c-4ce4329cecc7","Type":"ContainerStarted","Data":"a606f95e5b4abffcd64ddf1428764f65521d795682a3f2c5aeda492cf7b50926"}
Sep 11 14:45:59.123583 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:59.123265    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57d567598c-4f2g4"
Sep 11 14:45:59.142722 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:45:59.142660    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-57d567598c-4f2g4" podStartSLOduration=1.7738824210000002 podStartE2EDuration="2.142645244s" totalImagesPullingTime="368.762823ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:45:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:45:59.141896185 +0000 UTC m=+1851.940530967" watchObservedRunningTime="2026-09-11 14:45:59.142645244 +0000 UTC m=+1851.941280017"
Sep 11 14:46:08.079379 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:08.079345    2584 scope.go:117] "RemoveContainer" containerID="25c3d43f0ef1670d51e4eedde442731e1f55a39620a174ad59268fc4906cbf54"
Sep 11 14:46:10.130706 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:10.130655    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-57d567598c-4f2g4"
Sep 11 14:46:18.106979 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:18.106944    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:46:19.473906 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:19.473854    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:46:19.542352 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:19.542317    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57d567598c-4f2g4"]
Sep 11 14:46:19.542555 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:19.542512    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-57d567598c-4f2g4" podUID="9800469a-9f5c-4368-ae8c-4ce4329cecc7" containerName="manager" containerID="cri-o://383da18d886cca1aeb9ee0afafce0bd59cda4bec503b906d3386d25add4c459b" gracePeriod=30
Sep 11 14:46:19.789743 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:19.789720    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57d567598c-4f2g4"
Sep 11 14:46:19.921499 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:19.921476    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hnmv7\" (UniqueName: \"kubernetes.io/projected/9800469a-9f5c-4368-ae8c-4ce4329cecc7-kube-api-access-hnmv7\") pod \"9800469a-9f5c-4368-ae8c-4ce4329cecc7\" (UID: \"9800469a-9f5c-4368-ae8c-4ce4329cecc7\") "
Sep 11 14:46:19.921669 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:19.921531    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9800469a-9f5c-4368-ae8c-4ce4329cecc7-metrics-certs\") pod \"9800469a-9f5c-4368-ae8c-4ce4329cecc7\" (UID: \"9800469a-9f5c-4368-ae8c-4ce4329cecc7\") "
Sep 11 14:46:19.921669 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:19.921565    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9800469a-9f5c-4368-ae8c-4ce4329cecc7-webhook-cert\") pod \"9800469a-9f5c-4368-ae8c-4ce4329cecc7\" (UID: \"9800469a-9f5c-4368-ae8c-4ce4329cecc7\") "
Sep 11 14:46:19.923641 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:19.923614    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9800469a-9f5c-4368-ae8c-4ce4329cecc7-kube-api-access-hnmv7" (OuterVolumeSpecName: "kube-api-access-hnmv7") pod "9800469a-9f5c-4368-ae8c-4ce4329cecc7" (UID: "9800469a-9f5c-4368-ae8c-4ce4329cecc7"). InnerVolumeSpecName "kube-api-access-hnmv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:46:19.923641 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:19.923627    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9800469a-9f5c-4368-ae8c-4ce4329cecc7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9800469a-9f5c-4368-ae8c-4ce4329cecc7" (UID: "9800469a-9f5c-4368-ae8c-4ce4329cecc7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:46:19.923838 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:19.923647    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9800469a-9f5c-4368-ae8c-4ce4329cecc7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9800469a-9f5c-4368-ae8c-4ce4329cecc7" (UID: "9800469a-9f5c-4368-ae8c-4ce4329cecc7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:46:20.022267 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:20.022213    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9800469a-9f5c-4368-ae8c-4ce4329cecc7-metrics-certs\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:46:20.022267 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:20.022234    2584 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9800469a-9f5c-4368-ae8c-4ce4329cecc7-webhook-cert\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:46:20.022267 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:20.022242    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnmv7\" (UniqueName: \"kubernetes.io/projected/9800469a-9f5c-4368-ae8c-4ce4329cecc7-kube-api-access-hnmv7\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:46:20.234119 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:20.234094    2584 generic.go:356] "Generic (PLEG): container finished" podID="9800469a-9f5c-4368-ae8c-4ce4329cecc7" containerID="383da18d886cca1aeb9ee0afafce0bd59cda4bec503b906d3386d25add4c459b" exitCode=0
Sep 11 14:46:20.234235 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:20.234134    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57d567598c-4f2g4"
Sep 11 14:46:20.234235 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:20.234150    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57d567598c-4f2g4" event={"ID":"9800469a-9f5c-4368-ae8c-4ce4329cecc7","Type":"ContainerDied","Data":"383da18d886cca1aeb9ee0afafce0bd59cda4bec503b906d3386d25add4c459b"}
Sep 11 14:46:20.234235 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:20.234198    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57d567598c-4f2g4" event={"ID":"9800469a-9f5c-4368-ae8c-4ce4329cecc7","Type":"ContainerDied","Data":"a606f95e5b4abffcd64ddf1428764f65521d795682a3f2c5aeda492cf7b50926"}
Sep 11 14:46:20.234235 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:20.234222    2584 scope.go:117] "RemoveContainer" containerID="383da18d886cca1aeb9ee0afafce0bd59cda4bec503b906d3386d25add4c459b"
Sep 11 14:46:20.243411 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:20.243395    2584 scope.go:117] "RemoveContainer" containerID="383da18d886cca1aeb9ee0afafce0bd59cda4bec503b906d3386d25add4c459b"
Sep 11 14:46:20.243660 ip-10-0-133-175 kubenswrapper[2584]: E0911 14:46:20.243640    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"383da18d886cca1aeb9ee0afafce0bd59cda4bec503b906d3386d25add4c459b\": container with ID starting with 383da18d886cca1aeb9ee0afafce0bd59cda4bec503b906d3386d25add4c459b not found: ID does not exist" containerID="383da18d886cca1aeb9ee0afafce0bd59cda4bec503b906d3386d25add4c459b"
Sep 11 14:46:20.243739 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:20.243668    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"383da18d886cca1aeb9ee0afafce0bd59cda4bec503b906d3386d25add4c459b"} err="failed to get container status \"383da18d886cca1aeb9ee0afafce0bd59cda4bec503b906d3386d25add4c459b\": rpc error: code = NotFound desc = could not find container \"383da18d886cca1aeb9ee0afafce0bd59cda4bec503b906d3386d25add4c459b\": container with ID starting with 383da18d886cca1aeb9ee0afafce0bd59cda4bec503b906d3386d25add4c459b not found: ID does not exist"
Sep 11 14:46:20.256970 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:20.256946    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57d567598c-4f2g4"]
Sep 11 14:46:20.261616 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:20.261596    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-57d567598c-4f2g4"]
Sep 11 14:46:21.679902 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:21.679855    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9800469a-9f5c-4368-ae8c-4ce4329cecc7" path="/var/lib/kubelet/pods/9800469a-9f5c-4368-ae8c-4ce4329cecc7/volumes"
Sep 11 14:46:21.904539 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:21.904505    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:46:22.142330 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:22.142299    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-57d567598c-j982k"]
Sep 11 14:46:22.142699 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:22.142671    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9800469a-9f5c-4368-ae8c-4ce4329cecc7" containerName="manager"
Sep 11 14:46:22.142755 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:22.142701    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9800469a-9f5c-4368-ae8c-4ce4329cecc7" containerName="manager"
Sep 11 14:46:22.142793 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:22.142763    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9800469a-9f5c-4368-ae8c-4ce4329cecc7" containerName="manager"
Sep 11 14:46:22.145728 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:22.145710    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57d567598c-j982k"
Sep 11 14:46:22.149385 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:22.149363    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 14:46:22.149497 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:22.149394    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 14:46:22.149497 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:22.149415    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 14:46:22.149497 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:22.149398    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pgmvd\""
Sep 11 14:46:22.157095 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:22.157072    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57d567598c-j982k"]
Sep 11 14:46:22.239272 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:22.239233    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjqsh\" (UniqueName: \"kubernetes.io/projected/b4567dbc-42e8-4f19-a467-1f3599697867-kube-api-access-xjqsh\") pod \"maas-controller-57d567598c-j982k\" (UID: \"b4567dbc-42e8-4f19-a467-1f3599697867\") " pod="opendatahub/maas-controller-57d567598c-j982k"
Sep 11 14:46:22.239272 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:22.239276    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4567dbc-42e8-4f19-a467-1f3599697867-metrics-certs\") pod \"maas-controller-57d567598c-j982k\" (UID: \"b4567dbc-42e8-4f19-a467-1f3599697867\") " pod="opendatahub/maas-controller-57d567598c-j982k"
Sep 11 14:46:22.239436 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:22.239299    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4567dbc-42e8-4f19-a467-1f3599697867-webhook-cert\") pod \"maas-controller-57d567598c-j982k\" (UID: \"b4567dbc-42e8-4f19-a467-1f3599697867\") " pod="opendatahub/maas-controller-57d567598c-j982k"
Sep 11 14:46:22.340142 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:22.340113    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjqsh\" (UniqueName: \"kubernetes.io/projected/b4567dbc-42e8-4f19-a467-1f3599697867-kube-api-access-xjqsh\") pod \"maas-controller-57d567598c-j982k\" (UID: \"b4567dbc-42e8-4f19-a467-1f3599697867\") " pod="opendatahub/maas-controller-57d567598c-j982k"
Sep 11 14:46:22.340262 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:22.340145    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4567dbc-42e8-4f19-a467-1f3599697867-metrics-certs\") pod \"maas-controller-57d567598c-j982k\" (UID: \"b4567dbc-42e8-4f19-a467-1f3599697867\") " pod="opendatahub/maas-controller-57d567598c-j982k"
Sep 11 14:46:22.340262 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:22.340170    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4567dbc-42e8-4f19-a467-1f3599697867-webhook-cert\") pod \"maas-controller-57d567598c-j982k\" (UID: \"b4567dbc-42e8-4f19-a467-1f3599697867\") " pod="opendatahub/maas-controller-57d567598c-j982k"
Sep 11 14:46:22.342787 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:22.342763    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4567dbc-42e8-4f19-a467-1f3599697867-metrics-certs\") pod \"maas-controller-57d567598c-j982k\" (UID: \"b4567dbc-42e8-4f19-a467-1f3599697867\") " pod="opendatahub/maas-controller-57d567598c-j982k"
Sep 11 14:46:22.342879 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:22.342806    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4567dbc-42e8-4f19-a467-1f3599697867-webhook-cert\") pod \"maas-controller-57d567598c-j982k\" (UID: \"b4567dbc-42e8-4f19-a467-1f3599697867\") " pod="opendatahub/maas-controller-57d567598c-j982k"
Sep 11 14:46:22.348910 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:22.348890    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjqsh\" (UniqueName: \"kubernetes.io/projected/b4567dbc-42e8-4f19-a467-1f3599697867-kube-api-access-xjqsh\") pod \"maas-controller-57d567598c-j982k\" (UID: \"b4567dbc-42e8-4f19-a467-1f3599697867\") " pod="opendatahub/maas-controller-57d567598c-j982k"
Sep 11 14:46:22.457161 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:22.457094    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57d567598c-j982k"
Sep 11 14:46:22.733673 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:22.733480    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57d567598c-j982k"]
Sep 11 14:46:22.736564 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:46:22.736537    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4567dbc_42e8_4f19_a467_1f3599697867.slice/crio-9a4d47a86f61da8056c0aaed9d90c536ae7eb49401ad26bfd9220ace8a83bc56 WatchSource:0}: Error finding container 9a4d47a86f61da8056c0aaed9d90c536ae7eb49401ad26bfd9220ace8a83bc56: Status 404 returned error can't find the container with id 9a4d47a86f61da8056c0aaed9d90c536ae7eb49401ad26bfd9220ace8a83bc56
Sep 11 14:46:23.253524 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:23.253492    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57d567598c-j982k" event={"ID":"b4567dbc-42e8-4f19-a467-1f3599697867","Type":"ContainerStarted","Data":"0f5bd68b4229da42f9abaf40e91d32659eba7c4d4e8b471404efc29dee40d0f3"}
Sep 11 14:46:23.253663 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:23.253548    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57d567598c-j982k" event={"ID":"b4567dbc-42e8-4f19-a467-1f3599697867","Type":"ContainerStarted","Data":"9a4d47a86f61da8056c0aaed9d90c536ae7eb49401ad26bfd9220ace8a83bc56"}
Sep 11 14:46:23.253663 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:23.253587    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57d567598c-j982k"
Sep 11 14:46:23.274622 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:23.274580    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-57d567598c-j982k" podStartSLOduration=0.928734889 podStartE2EDuration="1.274567063s" totalImagesPullingTime="345.832174ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:46:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:46:23.273609466 +0000 UTC m=+1876.072244262" watchObservedRunningTime="2026-09-11 14:46:23.274567063 +0000 UTC m=+1876.073201845"
Sep 11 14:46:34.260855 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:34.260772    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-57d567598c-j982k"
Sep 11 14:46:46.417875 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:46.417840    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:46:54.200692 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:46:54.200650    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:47:01.494512 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:47:01.494466    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:47:08.098863 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:47:08.098832    2584 scope.go:117] "RemoveContainer" containerID="089d4cdcf79d99c55995fca49b1ae10747a6f06d6dd5dd24830b88a876b68e7a"
Sep 11 14:47:08.107201 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:47:08.107180    2584 scope.go:117] "RemoveContainer" containerID="573085c92bb93565ca914a437a7c7554cc5781600f44162b3a7afd694594b61c"
Sep 11 14:47:09.004061 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:47:09.004026    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:47:23.429328 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:47:23.429299    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:47:31.590960 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:47:31.590924    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:47:45.517570 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:47:45.517532    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:47:45.617382 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:47:45.617347    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:47:51.730174 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:47:51.730134    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:48:58.591545 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:48:58.591474    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:49:04.171624 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:04.171589    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:49:08.143224 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:08.143194    2584 scope.go:117] "RemoveContainer" containerID="ebde170c42e905fdd9d50729c47e7bf35f9e0acba9170275b930707353939d43"
Sep 11 14:49:09.765923 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:09.765887    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:49:15.596149 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:15.596110    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:49:19.430353 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:19.430315    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:49:22.902341 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:22.902308    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:49:31.990647 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:31.990567    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"]
Sep 11 14:49:31.993933 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:31.993915    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"
Sep 11 14:49:31.996241 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:31.996220    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-d67d15eb-kserve-self-signed-certs\""
Sep 11 14:49:32.002694 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:32.002629    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"]
Sep 11 14:49:32.036783 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:32.036731    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:49:32.066416 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:32.066382    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48dfa24e-7710-4f70-8228-cb4f80b86a38-model-cache\") pod \"e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr\" (UID: \"48dfa24e-7710-4f70-8228-cb4f80b86a38\") " pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"
Sep 11 14:49:32.066532 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:32.066501    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48dfa24e-7710-4f70-8228-cb4f80b86a38-dshm\") pod \"e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr\" (UID: \"48dfa24e-7710-4f70-8228-cb4f80b86a38\") " pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"
Sep 11 14:49:32.066597 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:32.066554    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48dfa24e-7710-4f70-8228-cb4f80b86a38-home\") pod \"e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr\" (UID: \"48dfa24e-7710-4f70-8228-cb4f80b86a38\") " pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"
Sep 11 14:49:32.066597 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:32.066583    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48dfa24e-7710-4f70-8228-cb4f80b86a38-tls-certs\") pod \"e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr\" (UID: \"48dfa24e-7710-4f70-8228-cb4f80b86a38\") " pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"
Sep 11 14:49:32.066736 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:32.066625    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48dfa24e-7710-4f70-8228-cb4f80b86a38-tmp-dir\") pod \"e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr\" (UID: \"48dfa24e-7710-4f70-8228-cb4f80b86a38\") " pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"
Sep 11 14:49:32.066736 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:32.066661    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9vv8\" (UniqueName: \"kubernetes.io/projected/48dfa24e-7710-4f70-8228-cb4f80b86a38-kube-api-access-f9vv8\") pod \"e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr\" (UID: \"48dfa24e-7710-4f70-8228-cb4f80b86a38\") " pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"
Sep 11 14:49:32.167415 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:32.167385    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48dfa24e-7710-4f70-8228-cb4f80b86a38-dshm\") pod \"e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr\" (UID: \"48dfa24e-7710-4f70-8228-cb4f80b86a38\") " pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"
Sep 11 14:49:32.167566 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:32.167429    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48dfa24e-7710-4f70-8228-cb4f80b86a38-home\") pod \"e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr\" (UID: \"48dfa24e-7710-4f70-8228-cb4f80b86a38\") " pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"
Sep 11 14:49:32.167566 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:32.167456    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48dfa24e-7710-4f70-8228-cb4f80b86a38-tls-certs\") pod \"e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr\" (UID: \"48dfa24e-7710-4f70-8228-cb4f80b86a38\") " pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"
Sep 11 14:49:32.167566 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:32.167485    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48dfa24e-7710-4f70-8228-cb4f80b86a38-tmp-dir\") pod \"e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr\" (UID: \"48dfa24e-7710-4f70-8228-cb4f80b86a38\") " pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"
Sep 11 14:49:32.167566 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:32.167510    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9vv8\" (UniqueName: \"kubernetes.io/projected/48dfa24e-7710-4f70-8228-cb4f80b86a38-kube-api-access-f9vv8\") pod \"e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr\" (UID: \"48dfa24e-7710-4f70-8228-cb4f80b86a38\") " pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"
Sep 11 14:49:32.167812 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:32.167568    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48dfa24e-7710-4f70-8228-cb4f80b86a38-model-cache\") pod \"e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr\" (UID: \"48dfa24e-7710-4f70-8228-cb4f80b86a38\") " pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"
Sep 11 14:49:32.167877 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:32.167856    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48dfa24e-7710-4f70-8228-cb4f80b86a38-home\") pod \"e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr\" (UID: \"48dfa24e-7710-4f70-8228-cb4f80b86a38\") " pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"
Sep 11 14:49:32.167957 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:32.167915    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48dfa24e-7710-4f70-8228-cb4f80b86a38-tmp-dir\") pod \"e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr\" (UID: \"48dfa24e-7710-4f70-8228-cb4f80b86a38\") " pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"
Sep 11 14:49:32.168016 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:32.167985    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48dfa24e-7710-4f70-8228-cb4f80b86a38-model-cache\") pod \"e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr\" (UID: \"48dfa24e-7710-4f70-8228-cb4f80b86a38\") " pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"
Sep 11 14:49:32.169602 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:32.169585    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48dfa24e-7710-4f70-8228-cb4f80b86a38-dshm\") pod \"e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr\" (UID: \"48dfa24e-7710-4f70-8228-cb4f80b86a38\") " pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"
Sep 11 14:49:32.170059 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:32.170037    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48dfa24e-7710-4f70-8228-cb4f80b86a38-tls-certs\") pod \"e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr\" (UID: \"48dfa24e-7710-4f70-8228-cb4f80b86a38\") " pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"
Sep 11 14:49:32.175384 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:32.175366    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9vv8\" (UniqueName: \"kubernetes.io/projected/48dfa24e-7710-4f70-8228-cb4f80b86a38-kube-api-access-f9vv8\") pod \"e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr\" (UID: \"48dfa24e-7710-4f70-8228-cb4f80b86a38\") " pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"
Sep 11 14:49:32.304188 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:32.304162    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"
Sep 11 14:49:32.591168 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:32.591144    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"]
Sep 11 14:49:33.210202 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:33.210168    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr" event={"ID":"48dfa24e-7710-4f70-8228-cb4f80b86a38","Type":"ContainerStarted","Data":"d264d30b3168fced01eee2e59ec700abb6a34f1099dae9e13712e49411a84c43"}
Sep 11 14:49:33.210554 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:33.210215    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr" event={"ID":"48dfa24e-7710-4f70-8228-cb4f80b86a38","Type":"ContainerStarted","Data":"8336891c644cf1bde49d6a3c3b45d976ded2989f827e4756fa31cb37605eeef1"}
Sep 11 14:49:33.232337 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:33.232283    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr" podStartSLOduration=2.232267875 podStartE2EDuration="2.232267875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:49:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:49:33.229694501 +0000 UTC m=+2066.028329280" watchObservedRunningTime="2026-09-11 14:49:33.232267875 +0000 UTC m=+2066.030902647"
Sep 11 14:49:34.908206 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:34.908173    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:49:42.304470 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:42.304427    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"
Sep 11 14:49:42.304470 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:42.304477    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"
Sep 11 14:49:42.317209 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:42.317178    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"
Sep 11 14:49:43.269117 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:43.269082    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"
Sep 11 14:49:44.049332 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:49:44.049281    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:50:02.322649 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:02.322598    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:50:03.254959 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:03.254926    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"]
Sep 11 14:50:03.271354 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:03.271323    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:50:05.198284 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:05.198242    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:50:08.162625 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:08.162584    2584 scope.go:117] "RemoveContainer" containerID="d7656593369302fc3aa2dc647dff4974ce384f54880775eac912e87b8748fa63"
Sep 11 14:50:12.601218 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:12.601188    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:50:18.274128 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:18.274071    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr" podUID="48dfa24e-7710-4f70-8228-cb4f80b86a38" containerName="main" containerID="cri-o://d264d30b3168fced01eee2e59ec700abb6a34f1099dae9e13712e49411a84c43" gracePeriod=45
Sep 11 14:50:18.440191 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:18.440155    2584 generic.go:356] "Generic (PLEG): container finished" podID="48dfa24e-7710-4f70-8228-cb4f80b86a38" containerID="d264d30b3168fced01eee2e59ec700abb6a34f1099dae9e13712e49411a84c43" exitCode=0
Sep 11 14:50:18.440342 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:18.440240    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr" event={"ID":"48dfa24e-7710-4f70-8228-cb4f80b86a38","Type":"ContainerDied","Data":"d264d30b3168fced01eee2e59ec700abb6a34f1099dae9e13712e49411a84c43"}
Sep 11 14:50:18.535468 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:18.535409    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"
Sep 11 14:50:18.639639 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:18.639613    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48dfa24e-7710-4f70-8228-cb4f80b86a38-tmp-dir\") pod \"48dfa24e-7710-4f70-8228-cb4f80b86a38\" (UID: \"48dfa24e-7710-4f70-8228-cb4f80b86a38\") "
Sep 11 14:50:18.639771 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:18.639648    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48dfa24e-7710-4f70-8228-cb4f80b86a38-home\") pod \"48dfa24e-7710-4f70-8228-cb4f80b86a38\" (UID: \"48dfa24e-7710-4f70-8228-cb4f80b86a38\") "
Sep 11 14:50:18.639771 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:18.639710    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9vv8\" (UniqueName: \"kubernetes.io/projected/48dfa24e-7710-4f70-8228-cb4f80b86a38-kube-api-access-f9vv8\") pod \"48dfa24e-7710-4f70-8228-cb4f80b86a38\" (UID: \"48dfa24e-7710-4f70-8228-cb4f80b86a38\") "
Sep 11 14:50:18.639771 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:18.639731    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48dfa24e-7710-4f70-8228-cb4f80b86a38-dshm\") pod \"48dfa24e-7710-4f70-8228-cb4f80b86a38\" (UID: \"48dfa24e-7710-4f70-8228-cb4f80b86a38\") "
Sep 11 14:50:18.639771 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:18.639757    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48dfa24e-7710-4f70-8228-cb4f80b86a38-model-cache\") pod \"48dfa24e-7710-4f70-8228-cb4f80b86a38\" (UID: \"48dfa24e-7710-4f70-8228-cb4f80b86a38\") "
Sep 11 14:50:18.639919 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:18.639815    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48dfa24e-7710-4f70-8228-cb4f80b86a38-tls-certs\") pod \"48dfa24e-7710-4f70-8228-cb4f80b86a38\" (UID: \"48dfa24e-7710-4f70-8228-cb4f80b86a38\") "
Sep 11 14:50:18.639919 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:18.639885    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48dfa24e-7710-4f70-8228-cb4f80b86a38-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "48dfa24e-7710-4f70-8228-cb4f80b86a38" (UID: "48dfa24e-7710-4f70-8228-cb4f80b86a38"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:50:18.640016 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:18.639978    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48dfa24e-7710-4f70-8228-cb4f80b86a38-home" (OuterVolumeSpecName: "home") pod "48dfa24e-7710-4f70-8228-cb4f80b86a38" (UID: "48dfa24e-7710-4f70-8228-cb4f80b86a38"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:50:18.640075 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:18.640038    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48dfa24e-7710-4f70-8228-cb4f80b86a38-model-cache" (OuterVolumeSpecName: "model-cache") pod "48dfa24e-7710-4f70-8228-cb4f80b86a38" (UID: "48dfa24e-7710-4f70-8228-cb4f80b86a38"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:50:18.640131 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:18.640100    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48dfa24e-7710-4f70-8228-cb4f80b86a38-model-cache\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:50:18.640131 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:18.640114    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48dfa24e-7710-4f70-8228-cb4f80b86a38-tmp-dir\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:50:18.640131 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:18.640122    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48dfa24e-7710-4f70-8228-cb4f80b86a38-home\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:50:18.641952 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:18.641923    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48dfa24e-7710-4f70-8228-cb4f80b86a38-dshm" (OuterVolumeSpecName: "dshm") pod "48dfa24e-7710-4f70-8228-cb4f80b86a38" (UID: "48dfa24e-7710-4f70-8228-cb4f80b86a38"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:50:18.642046 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:18.641963    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48dfa24e-7710-4f70-8228-cb4f80b86a38-kube-api-access-f9vv8" (OuterVolumeSpecName: "kube-api-access-f9vv8") pod "48dfa24e-7710-4f70-8228-cb4f80b86a38" (UID: "48dfa24e-7710-4f70-8228-cb4f80b86a38"). InnerVolumeSpecName "kube-api-access-f9vv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:50:18.642046 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:18.642010    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48dfa24e-7710-4f70-8228-cb4f80b86a38-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "48dfa24e-7710-4f70-8228-cb4f80b86a38" (UID: "48dfa24e-7710-4f70-8228-cb4f80b86a38"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:50:18.741108 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:18.741084    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9vv8\" (UniqueName: \"kubernetes.io/projected/48dfa24e-7710-4f70-8228-cb4f80b86a38-kube-api-access-f9vv8\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:50:18.741204 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:18.741111    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48dfa24e-7710-4f70-8228-cb4f80b86a38-dshm\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:50:18.741204 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:18.741124    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48dfa24e-7710-4f70-8228-cb4f80b86a38-tls-certs\") on node \"ip-10-0-133-175.ec2.internal\" DevicePath \"\""
Sep 11 14:50:19.447892 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:19.447863    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"
Sep 11 14:50:19.448363 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:19.447910    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr" event={"ID":"48dfa24e-7710-4f70-8228-cb4f80b86a38","Type":"ContainerDied","Data":"8336891c644cf1bde49d6a3c3b45d976ded2989f827e4756fa31cb37605eeef1"}
Sep 11 14:50:19.448363 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:19.447974    2584 scope.go:117] "RemoveContainer" containerID="d264d30b3168fced01eee2e59ec700abb6a34f1099dae9e13712e49411a84c43"
Sep 11 14:50:19.472065 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:19.472035    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"]
Sep 11 14:50:19.478333 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:19.478307    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-d67d15eb-kserve-787f78d5ff-pdbsr"]
Sep 11 14:50:19.678892 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:19.678866    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48dfa24e-7710-4f70-8228-cb4f80b86a38" path="/var/lib/kubelet/pods/48dfa24e-7710-4f70-8228-cb4f80b86a38/volumes"
Sep 11 14:50:20.112191 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:20.112158    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:50:27.772145 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:27.772114    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5c65c6f845-8n75c"]
Sep 11 14:50:27.772496 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:27.772468    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48dfa24e-7710-4f70-8228-cb4f80b86a38" containerName="main"
Sep 11 14:50:27.772496 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:27.772478    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="48dfa24e-7710-4f70-8228-cb4f80b86a38" containerName="main"
Sep 11 14:50:27.772569 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:27.772532    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="48dfa24e-7710-4f70-8228-cb4f80b86a38" containerName="main"
Sep 11 14:50:27.776764 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:27.776746    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c65c6f845-8n75c"
Sep 11 14:50:27.780701 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:27.780664    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tvhzt\""
Sep 11 14:50:27.780796 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:27.780669    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 14:50:27.780796 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:27.780671    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 14:50:27.787870 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:27.787852    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c65c6f845-8n75c"]
Sep 11 14:50:27.917312 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:27.917288    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/815f32c7-138a-4eee-91cb-82ba8c8a1fc7-metrics-certs\") pod \"maas-api-5c65c6f845-8n75c\" (UID: \"815f32c7-138a-4eee-91cb-82ba8c8a1fc7\") " pod="odh-ai-gateway-infra/maas-api-5c65c6f845-8n75c"
Sep 11 14:50:27.917441 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:27.917316    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28cxm\" (UniqueName: \"kubernetes.io/projected/815f32c7-138a-4eee-91cb-82ba8c8a1fc7-kube-api-access-28cxm\") pod \"maas-api-5c65c6f845-8n75c\" (UID: \"815f32c7-138a-4eee-91cb-82ba8c8a1fc7\") " pod="odh-ai-gateway-infra/maas-api-5c65c6f845-8n75c"
Sep 11 14:50:27.917441 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:27.917343    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/815f32c7-138a-4eee-91cb-82ba8c8a1fc7-openshift-service-ca\") pod \"maas-api-5c65c6f845-8n75c\" (UID: \"815f32c7-138a-4eee-91cb-82ba8c8a1fc7\") " pod="odh-ai-gateway-infra/maas-api-5c65c6f845-8n75c"
Sep 11 14:50:27.917441 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:27.917387    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/815f32c7-138a-4eee-91cb-82ba8c8a1fc7-maas-api-tls\") pod \"maas-api-5c65c6f845-8n75c\" (UID: \"815f32c7-138a-4eee-91cb-82ba8c8a1fc7\") " pod="odh-ai-gateway-infra/maas-api-5c65c6f845-8n75c"
Sep 11 14:50:28.018779 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:28.018752    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/815f32c7-138a-4eee-91cb-82ba8c8a1fc7-metrics-certs\") pod \"maas-api-5c65c6f845-8n75c\" (UID: \"815f32c7-138a-4eee-91cb-82ba8c8a1fc7\") " pod="odh-ai-gateway-infra/maas-api-5c65c6f845-8n75c"
Sep 11 14:50:28.018779 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:28.018782    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28cxm\" (UniqueName: \"kubernetes.io/projected/815f32c7-138a-4eee-91cb-82ba8c8a1fc7-kube-api-access-28cxm\") pod \"maas-api-5c65c6f845-8n75c\" (UID: \"815f32c7-138a-4eee-91cb-82ba8c8a1fc7\") " pod="odh-ai-gateway-infra/maas-api-5c65c6f845-8n75c"
Sep 11 14:50:28.018941 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:28.018807    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/815f32c7-138a-4eee-91cb-82ba8c8a1fc7-openshift-service-ca\") pod \"maas-api-5c65c6f845-8n75c\" (UID: \"815f32c7-138a-4eee-91cb-82ba8c8a1fc7\") " pod="odh-ai-gateway-infra/maas-api-5c65c6f845-8n75c"
Sep 11 14:50:28.018941 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:28.018841    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/815f32c7-138a-4eee-91cb-82ba8c8a1fc7-maas-api-tls\") pod \"maas-api-5c65c6f845-8n75c\" (UID: \"815f32c7-138a-4eee-91cb-82ba8c8a1fc7\") " pod="odh-ai-gateway-infra/maas-api-5c65c6f845-8n75c"
Sep 11 14:50:28.019445 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:28.019424    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/815f32c7-138a-4eee-91cb-82ba8c8a1fc7-openshift-service-ca\") pod \"maas-api-5c65c6f845-8n75c\" (UID: \"815f32c7-138a-4eee-91cb-82ba8c8a1fc7\") " pod="odh-ai-gateway-infra/maas-api-5c65c6f845-8n75c"
Sep 11 14:50:28.021179 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:28.021150    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/815f32c7-138a-4eee-91cb-82ba8c8a1fc7-metrics-certs\") pod \"maas-api-5c65c6f845-8n75c\" (UID: \"815f32c7-138a-4eee-91cb-82ba8c8a1fc7\") " pod="odh-ai-gateway-infra/maas-api-5c65c6f845-8n75c"
Sep 11 14:50:28.021295 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:28.021183    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/815f32c7-138a-4eee-91cb-82ba8c8a1fc7-maas-api-tls\") pod \"maas-api-5c65c6f845-8n75c\" (UID: \"815f32c7-138a-4eee-91cb-82ba8c8a1fc7\") " pod="odh-ai-gateway-infra/maas-api-5c65c6f845-8n75c"
Sep 11 14:50:28.040903 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:28.040882    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:50:28.049522 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:28.049499    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28cxm\" (UniqueName: \"kubernetes.io/projected/815f32c7-138a-4eee-91cb-82ba8c8a1fc7-kube-api-access-28cxm\") pod \"maas-api-5c65c6f845-8n75c\" (UID: \"815f32c7-138a-4eee-91cb-82ba8c8a1fc7\") " pod="odh-ai-gateway-infra/maas-api-5c65c6f845-8n75c"
Sep 11 14:50:28.087482 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:28.087460    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c65c6f845-8n75c"
Sep 11 14:50:28.360518 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:28.360489    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c65c6f845-8n75c"]
Sep 11 14:50:28.363029 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:50:28.363000    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod815f32c7_138a_4eee_91cb_82ba8c8a1fc7.slice/crio-252976dcbf5d8d88445a000410f99d6390a1b8bb5767930764746aaf864d834e WatchSource:0}: Error finding container 252976dcbf5d8d88445a000410f99d6390a1b8bb5767930764746aaf864d834e: Status 404 returned error can't find the container with id 252976dcbf5d8d88445a000410f99d6390a1b8bb5767930764746aaf864d834e
Sep 11 14:50:28.493447 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:28.493419    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c65c6f845-8n75c" event={"ID":"815f32c7-138a-4eee-91cb-82ba8c8a1fc7","Type":"ContainerStarted","Data":"252976dcbf5d8d88445a000410f99d6390a1b8bb5767930764746aaf864d834e"}
Sep 11 14:50:30.504775 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:30.504741    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c65c6f845-8n75c" event={"ID":"815f32c7-138a-4eee-91cb-82ba8c8a1fc7","Type":"ContainerStarted","Data":"24185bf4e5aed70b230a5ab1cd1110e0ee4f34b2803ba90dfd62e8a58386d7b2"}
Sep 11 14:50:30.505186 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:30.504943    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5c65c6f845-8n75c"
Sep 11 14:50:30.527875 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:30.527818    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5c65c6f845-8n75c" podStartSLOduration=2.093819308 podStartE2EDuration="3.527802713s" totalImagesPullingTime="1.433983405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:50:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:50:30.527344404 +0000 UTC m=+2123.325979203" watchObservedRunningTime="2026-09-11 14:50:30.527802713 +0000 UTC m=+2123.326437487"
Sep 11 14:50:33.819582 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:33.819545    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:50:36.516252 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:36.516221    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5c65c6f845-8n75c"
Sep 11 14:50:39.410219 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:39.410167    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:50:46.110363 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:46.110327    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-kv625"]
Sep 11 14:50:55.061369 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:55.061331    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-6gwgr_506192d2-fbe0-4023-8fd0-393328fb95d4/manager/1.log"
Sep 11 14:50:55.187483 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:55.187458    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-f656b_2eca4de8-e58d-466e-a0d2-f2c615190b65/manager/1.log"
Sep 11 14:50:55.325355 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:55.325284    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-57d567598c-j982k_b4567dbc-42e8-4f19-a467-1f3599697867/manager/0.log"
Sep 11 14:50:55.970583 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:55.970551    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74798b5f56-p4zrs_025f6490-ce00-4263-8836-6782fbe82a49/copy-manifests/0.log"
Sep 11 14:50:55.978263 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:55.978236    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74798b5f56-p4zrs_025f6490-ce00-4263-8836-6782fbe82a49/manager/1.log"
Sep 11 14:50:56.346994 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:56.346964    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5c65c6f845-8n75c_815f32c7-138a-4eee-91cb-82ba8c8a1fc7/maas-api/0.log"
Sep 11 14:50:56.702774 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:56.702697    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29818965-ln2d6_f26db12b-4ba6-4551-a685-bd3e291a9d03/cleanup/0.log"
Sep 11 14:50:56.820877 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:56.820845    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-6kd2h_9323c2fc-b7c3-449b-b8c7-1c833755b163/postgres/0.log"
Sep 11 14:50:57.888390 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:57.888356    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-kxc6b_99eaa447-82dd-41b3-ac95-e2faf55d52a2/manager/1.log"
Sep 11 14:50:58.003015 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:58.002989    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-6xn9q_6e9ad6e0-51c2-47f2-939f-b8e85f2a60e1/kuadrant-console-plugin/0.log"
Sep 11 14:50:58.256530 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:58.256472    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-kv625_6435339c-1193-4524-865e-8c1441868ff7/limitador/0.log"
Sep 11 14:50:59.395075 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:59.395045    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-twqsk_f1af58b6-5525-47e0-89fe-18582bb741ac/payload-pre-processing/0.log"
Sep 11 14:50:59.527560 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:59.527530    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-7v489_6f7d76f2-d602-4dfa-a01c-67d6294ea8ac/payload-processing/0.log"
Sep 11 14:50:59.649478 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:50:59.649415    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-87d46c48b-7pb8n_a7f60369-696c-4f9c-93dc-8ff217a04fc1/router/0.log"
Sep 11 14:51:00.276334 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:00.276305    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-hm7tm_88a84744-596b-4ac8-93c0-5586fb0c4b99/main/0.log"
Sep 11 14:51:00.516299 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:00.516274    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbqpvx_0f4fcffb-1812-4de9-805a-bcdad34d16fa/main/0.log"
Sep 11 14:51:06.726595 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:06.726555    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:51:06.810055 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:06.810017    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:51:08.182974 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:08.182942    2584 scope.go:117] "RemoveContainer" containerID="ee6ed6d84a97edae5c7b43a84df5bb4960b295e12ad0abfd5bdcc8d35c4154dd"
Sep 11 14:51:08.190740 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:08.190720    2584 scope.go:117] "RemoveContainer" containerID="f2e032aa187e724709ef053a9ab552759257965cc52c5634dac0172864fc6ceb"
Sep 11 14:51:09.800083 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:09.800052    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dwq8z_1550d3f8-d568-4b3b-80c5-34a9ddfb0e10/global-pull-secret-syncer/0.log"
Sep 11 14:51:10.020046 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:10.020017    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log"
Sep 11 14:51:10.219697 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:10.219619    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-175.ec2.internal_03736b57a79149ed7e63d2686d1a25d5/haproxy/0.log"
Sep 11 14:51:14.932533 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:14.932498    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-kxc6b_99eaa447-82dd-41b3-ac95-e2faf55d52a2/manager/1.log"
Sep 11 14:51:14.932971 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:14.932606    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-kxc6b_99eaa447-82dd-41b3-ac95-e2faf55d52a2/manager/0.log"
Sep 11 14:51:14.959820 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:14.959769    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-6xn9q_6e9ad6e0-51c2-47f2-939f-b8e85f2a60e1/kuadrant-console-plugin/0.log"
Sep 11 14:51:15.046079 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:15.046056    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-kv625_6435339c-1193-4524-865e-8c1441868ff7/limitador/0.log"
Sep 11 14:51:17.006355 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:17.006259    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-g4skv_cf06917f-caf2-4af5-9f3b-c0da05de5d9c/cluster-monitoring-operator/0.log"
Sep 11 14:51:17.225350 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:17.225315    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-v2gbj_86fe579e-bbe6-4e45-ab35-06150430bd23/monitoring-plugin/0.log"
Sep 11 14:51:17.545366 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:17.545341    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sqshp_82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4/node-exporter/0.log"
Sep 11 14:51:17.568482 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:17.568442    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sqshp_82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4/kube-rbac-proxy/0.log"
Sep 11 14:51:17.594905 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:17.594886    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sqshp_82aa1feb-927d-4cfe-aa68-6cec0d7fd5a4/init-textfile/0.log"
Sep 11 14:51:17.626479 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:17.626419    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-lbm74_1b1f59c6-e587-4bf3-811e-2dad8bffca78/kube-rbac-proxy-main/0.log"
Sep 11 14:51:17.658066 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:17.658045    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-lbm74_1b1f59c6-e587-4bf3-811e-2dad8bffca78/kube-rbac-proxy-self/0.log"
Sep 11 14:51:17.685665 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:17.685647    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-lbm74_1b1f59c6-e587-4bf3-811e-2dad8bffca78/openshift-state-metrics/0.log"
Sep 11 14:51:17.737113 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:17.737090    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4159f438-d8d3-4359-b22c-61104ca1d5ba/prometheus/0.log"
Sep 11 14:51:17.762909 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:17.762884    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4159f438-d8d3-4359-b22c-61104ca1d5ba/config-reloader/0.log"
Sep 11 14:51:17.789851 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:17.789825    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4159f438-d8d3-4359-b22c-61104ca1d5ba/thanos-sidecar/0.log"
Sep 11 14:51:17.826908 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:17.826888    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4159f438-d8d3-4359-b22c-61104ca1d5ba/kube-rbac-proxy-web/0.log"
Sep 11 14:51:17.864186 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:17.864167    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4159f438-d8d3-4359-b22c-61104ca1d5ba/kube-rbac-proxy/0.log"
Sep 11 14:51:17.897609 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:17.897546    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4159f438-d8d3-4359-b22c-61104ca1d5ba/kube-rbac-proxy-thanos/0.log"
Sep 11 14:51:17.929167 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:17.929146    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4159f438-d8d3-4359-b22c-61104ca1d5ba/init-config-reloader/0.log"
Sep 11 14:51:18.027199 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:18.027169    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-p9j96_3fbcf1a4-4ab3-4f68-972c-84ef518fab8a/prometheus-operator-admission-webhook/0.log"
Sep 11 14:51:19.708513 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:19.708480    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q5bsg/perf-node-gather-daemonset-r4ml2"]
Sep 11 14:51:19.713328 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:19.713293    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-r4ml2"
Sep 11 14:51:19.717352 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:19.717325    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-q5bsg\"/\"default-dockercfg-lmmcf\""
Sep 11 14:51:19.718376 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:19.718323    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q5bsg\"/\"kube-root-ca.crt\""
Sep 11 14:51:19.718500 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:19.718391    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q5bsg\"/\"openshift-service-ca.crt\""
Sep 11 14:51:19.726558 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:19.726527    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q5bsg/perf-node-gather-daemonset-r4ml2"]
Sep 11 14:51:19.831035 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:19.831010    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/879fb5bf-8eae-49a1-9595-0c5c31e7a9d6-proc\") pod \"perf-node-gather-daemonset-r4ml2\" (UID: \"879fb5bf-8eae-49a1-9595-0c5c31e7a9d6\") " pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-r4ml2"
Sep 11 14:51:19.831168 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:19.831050    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/879fb5bf-8eae-49a1-9595-0c5c31e7a9d6-podres\") pod \"perf-node-gather-daemonset-r4ml2\" (UID: \"879fb5bf-8eae-49a1-9595-0c5c31e7a9d6\") " pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-r4ml2"
Sep 11 14:51:19.831168 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:19.831133    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/879fb5bf-8eae-49a1-9595-0c5c31e7a9d6-sys\") pod \"perf-node-gather-daemonset-r4ml2\" (UID: \"879fb5bf-8eae-49a1-9595-0c5c31e7a9d6\") " pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-r4ml2"
Sep 11 14:51:19.831284 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:19.831180    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/879fb5bf-8eae-49a1-9595-0c5c31e7a9d6-lib-modules\") pod \"perf-node-gather-daemonset-r4ml2\" (UID: \"879fb5bf-8eae-49a1-9595-0c5c31e7a9d6\") " pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-r4ml2"
Sep 11 14:51:19.831284 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:19.831205    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvhzx\" (UniqueName: \"kubernetes.io/projected/879fb5bf-8eae-49a1-9595-0c5c31e7a9d6-kube-api-access-cvhzx\") pod \"perf-node-gather-daemonset-r4ml2\" (UID: \"879fb5bf-8eae-49a1-9595-0c5c31e7a9d6\") " pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-r4ml2"
Sep 11 14:51:19.931540 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:19.931501    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/879fb5bf-8eae-49a1-9595-0c5c31e7a9d6-lib-modules\") pod \"perf-node-gather-daemonset-r4ml2\" (UID: \"879fb5bf-8eae-49a1-9595-0c5c31e7a9d6\") " pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-r4ml2"
Sep 11 14:51:19.931540 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:19.931542    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvhzx\" (UniqueName: \"kubernetes.io/projected/879fb5bf-8eae-49a1-9595-0c5c31e7a9d6-kube-api-access-cvhzx\") pod \"perf-node-gather-daemonset-r4ml2\" (UID: \"879fb5bf-8eae-49a1-9595-0c5c31e7a9d6\") " pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-r4ml2"
Sep 11 14:51:19.931749 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:19.931574    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/879fb5bf-8eae-49a1-9595-0c5c31e7a9d6-proc\") pod \"perf-node-gather-daemonset-r4ml2\" (UID: \"879fb5bf-8eae-49a1-9595-0c5c31e7a9d6\") " pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-r4ml2"
Sep 11 14:51:19.931749 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:19.931595    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/879fb5bf-8eae-49a1-9595-0c5c31e7a9d6-podres\") pod \"perf-node-gather-daemonset-r4ml2\" (UID: \"879fb5bf-8eae-49a1-9595-0c5c31e7a9d6\") " pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-r4ml2"
Sep 11 14:51:19.931749 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:19.931633    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/879fb5bf-8eae-49a1-9595-0c5c31e7a9d6-sys\") pod \"perf-node-gather-daemonset-r4ml2\" (UID: \"879fb5bf-8eae-49a1-9595-0c5c31e7a9d6\") " pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-r4ml2"
Sep 11 14:51:19.931749 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:19.931699    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/879fb5bf-8eae-49a1-9595-0c5c31e7a9d6-lib-modules\") pod \"perf-node-gather-daemonset-r4ml2\" (UID: \"879fb5bf-8eae-49a1-9595-0c5c31e7a9d6\") " pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-r4ml2"
Sep 11 14:51:19.931749 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:19.931723    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/879fb5bf-8eae-49a1-9595-0c5c31e7a9d6-sys\") pod \"perf-node-gather-daemonset-r4ml2\" (UID: \"879fb5bf-8eae-49a1-9595-0c5c31e7a9d6\") " pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-r4ml2"
Sep 11 14:51:19.931749 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:19.931727    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/879fb5bf-8eae-49a1-9595-0c5c31e7a9d6-proc\") pod \"perf-node-gather-daemonset-r4ml2\" (UID: \"879fb5bf-8eae-49a1-9595-0c5c31e7a9d6\") " pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-r4ml2"
Sep 11 14:51:19.931998 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:19.931773    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/879fb5bf-8eae-49a1-9595-0c5c31e7a9d6-podres\") pod \"perf-node-gather-daemonset-r4ml2\" (UID: \"879fb5bf-8eae-49a1-9595-0c5c31e7a9d6\") " pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-r4ml2"
Sep 11 14:51:19.943878 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:19.943859    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvhzx\" (UniqueName: \"kubernetes.io/projected/879fb5bf-8eae-49a1-9595-0c5c31e7a9d6-kube-api-access-cvhzx\") pod \"perf-node-gather-daemonset-r4ml2\" (UID: \"879fb5bf-8eae-49a1-9595-0c5c31e7a9d6\") " pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-r4ml2"
Sep 11 14:51:20.025337 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:20.025278    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-r4ml2"
Sep 11 14:51:20.333938 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:20.333909    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q5bsg/perf-node-gather-daemonset-r4ml2"]
Sep 11 14:51:20.335575 ip-10-0-133-175 kubenswrapper[2584]: W0911 14:51:20.335546    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod879fb5bf_8eae_49a1_9595_0c5c31e7a9d6.slice/crio-a116cd23f0ad4e8335f4eaa6120714ddaaa76a16ece308503f6658ea06d4ef35 WatchSource:0}: Error finding container a116cd23f0ad4e8335f4eaa6120714ddaaa76a16ece308503f6658ea06d4ef35: Status 404 returned error can't find the container with id a116cd23f0ad4e8335f4eaa6120714ddaaa76a16ece308503f6658ea06d4ef35
Sep 11 14:51:20.751336 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:20.751272    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-r4ml2" event={"ID":"879fb5bf-8eae-49a1-9595-0c5c31e7a9d6","Type":"ContainerStarted","Data":"8d0c0332e4e5103e4f70db0b6ef4f309bebd45c5fe06805a0443aa0fa30cfa9b"}
Sep 11 14:51:20.751336 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:20.751327    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-r4ml2" event={"ID":"879fb5bf-8eae-49a1-9595-0c5c31e7a9d6","Type":"ContainerStarted","Data":"a116cd23f0ad4e8335f4eaa6120714ddaaa76a16ece308503f6658ea06d4ef35"}
Sep 11 14:51:20.751667 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:20.751411    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-r4ml2"
Sep 11 14:51:20.771110 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:20.771070    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-r4ml2" podStartSLOduration=1.7710581300000001 podStartE2EDuration="1.77105813s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:51:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:51:20.768335698 +0000 UTC m=+2173.566970479" watchObservedRunningTime="2026-09-11 14:51:20.77105813 +0000 UTC m=+2173.569692912"
Sep 11 14:51:22.844989 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:22.844958    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mc48z_ffe0180e-2a90-4d97-8575-1d44acd6b790/dns/0.log"
Sep 11 14:51:22.869217 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:22.869194    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mc48z_ffe0180e-2a90-4d97-8575-1d44acd6b790/kube-rbac-proxy/0.log"
Sep 11 14:51:22.941946 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:22.941914    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-77vcp_9528abdc-9478-4485-ab39-a8c576fef301/dns-node-resolver/0.log"
Sep 11 14:51:23.578935 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:23.578910    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-85fb7687cf-b6q6v_ec01808a-ac18-4a02-9e59-d4c9bb312006/registry/0.log"
Sep 11 14:51:23.604265 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:23.604243    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2rhc2_132a3582-58a8-497f-a537-e38bde288795/node-ca/0.log"
Sep 11 14:51:25.138926 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:25.138893    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-twqsk_f1af58b6-5525-47e0-89fe-18582bb741ac/payload-pre-processing/0.log"
Sep 11 14:51:25.188758 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:25.188730    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-7v489_6f7d76f2-d602-4dfa-a01c-67d6294ea8ac/payload-processing/0.log"
Sep 11 14:51:25.220997 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:25.220978    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-87d46c48b-7pb8n_a7f60369-696c-4f9c-93dc-8ff217a04fc1/router/0.log"
Sep 11 14:51:26.197756 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:26.197726    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w4tcc_70ac1cfe-b296-49ad-925d-7b64e662395c/serve-healthcheck-canary/0.log"
Sep 11 14:51:26.766905 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:26.766871    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-r4ml2"
Sep 11 14:51:26.819505 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:26.819469    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-22p4j_c37d429a-4f32-4478-94ac-a2d84a9c0685/kube-rbac-proxy/0.log"
Sep 11 14:51:26.842478 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:26.842457    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-22p4j_c37d429a-4f32-4478-94ac-a2d84a9c0685/exporter/0.log"
Sep 11 14:51:26.866625 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:26.866602    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-22p4j_c37d429a-4f32-4478-94ac-a2d84a9c0685/extractor/0.log"
Sep 11 14:51:28.929066 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:28.929040    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gt5x_cd82c8bb-0bd0-4dfb-941c-1c3a5b727425/konnectivity-agent/0.log" limit=1024
Sep 11 14:51:29.539512 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:29.539488    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-6gwgr_506192d2-fbe0-4023-8fd0-393328fb95d4/manager/0.log"
Sep 11 14:51:29.540299 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:29.540277    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-6gwgr_506192d2-fbe0-4023-8fd0-393328fb95d4/manager/1.log"
Sep 11 14:51:29.722145 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:29.722068    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-f656b_2eca4de8-e58d-466e-a0d2-f2c615190b65/manager/1.log"
Sep 11 14:51:29.805143 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:29.805121    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-f656b_2eca4de8-e58d-466e-a0d2-f2c615190b65/manager/0.log"
Sep 11 14:51:29.935966 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:29.935935    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-57d567598c-j982k_b4567dbc-42e8-4f19-a467-1f3599697867/manager/0.log"
Sep 11 14:51:30.401257 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:30.401227    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74798b5f56-p4zrs_025f6490-ce00-4263-8836-6782fbe82a49/manager/1.log"
Sep 11 14:51:30.466623 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:30.466579    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74798b5f56-p4zrs_025f6490-ce00-4263-8836-6782fbe82a49/manager/0.log"
Sep 11 14:51:30.498278 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:30.498257    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74798b5f56-p4zrs_025f6490-ce00-4263-8836-6782fbe82a49/copy-manifests/0.log"
Sep 11 14:51:30.637374 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:30.637355    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-twqsk_f1af58b6-5525-47e0-89fe-18582bb741ac/payload-pre-processing/0.log"
Sep 11 14:51:30.674528 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:30.674472    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-7v489_6f7d76f2-d602-4dfa-a01c-67d6294ea8ac/payload-processing/0.log"
Sep 11 14:51:30.693641 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:30.693619    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-87d46c48b-7pb8n_a7f60369-696c-4f9c-93dc-8ff217a04fc1/router/0.log"
Sep 11 14:51:31.826277 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:31.826249    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7c4cd778db-4k9k6_5e0cd52e-f9a2-4ed1-b209-2fe6a702dcfe/manager/0.log"
Sep 11 14:51:32.544889 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:32.544866    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-twqsk_f1af58b6-5525-47e0-89fe-18582bb741ac/payload-pre-processing/0.log"
Sep 11 14:51:32.582735 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:32.582710    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-7v489_6f7d76f2-d602-4dfa-a01c-67d6294ea8ac/payload-processing/0.log"
Sep 11 14:51:32.600905 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:32.600883    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-87d46c48b-7pb8n_a7f60369-696c-4f9c-93dc-8ff217a04fc1/router/0.log"
Sep 11 14:51:37.103282 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:37.103229    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-ns88x_c00d0c28-e051-40d9-af53-6896bdc3e83d/migrator/0.log"
Sep 11 14:51:37.156568 ip-10-0-133-175 kubenswrapper[2584]: I0911 14:51:37.156539    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-ns88x_c00d0c28-e051-40d9-af53-6896bdc3e83d/graceful-termination/0.log"