Sep 07 16:54:44.575074 ip-10-0-136-3 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 07 16:54:44.575088 ip-10-0-136-3 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 07 16:54:44.575098 ip-10-0-136-3 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 07 16:54:44.575287 ip-10-0-136-3 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 07 16:54:54.824350 ip-10-0-136-3 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 07 16:54:54.824365 ip-10-0-136-3 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot bb1efce7a28c42f0bf7d18041010aecb --
Sep 07 16:56:45.999175 ip-10-0-136-3 systemd[1]: Starting Kubernetes Kubelet...
Sep 07 16:56:46.368708 ip-10-0-136-3 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 16:56:46.368708 ip-10-0-136-3 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 07 16:56:46.368708 ip-10-0-136-3 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 16:56:46.368708 ip-10-0-136-3 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 07 16:56:46.368708 ip-10-0-136-3 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 16:56:46.369974 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.369874    2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 07 16:56:46.373545 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373530    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 16:56:46.373545 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373545    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 16:56:46.373606 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373549    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 16:56:46.373606 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373554    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 16:56:46.373606 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373557    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 16:56:46.373606 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373560    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 16:56:46.373606 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373563    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 16:56:46.373606 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373566    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 16:56:46.373606 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373569    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 16:56:46.373606 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373573    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 16:56:46.373606 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373577    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 16:56:46.373606 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373580    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 16:56:46.373606 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373583    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 16:56:46.373606 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373586    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 16:56:46.373606 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373589    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 16:56:46.373606 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373593    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 16:56:46.373606 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373595    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 16:56:46.373606 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373599    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 16:56:46.373606 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373602    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 16:56:46.373606 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373605    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 16:56:46.373606 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373608    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 16:56:46.374129 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373617    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 16:56:46.374129 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373620    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 16:56:46.374129 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373622    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 16:56:46.374129 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373625    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 16:56:46.374129 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373628    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 16:56:46.374129 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373630    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 16:56:46.374129 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373633    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 16:56:46.374129 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373635    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 16:56:46.374129 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373638    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 16:56:46.374129 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373641    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 16:56:46.374129 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373643    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 16:56:46.374129 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373646    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 16:56:46.374129 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373650    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 16:56:46.374129 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373653    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 16:56:46.374129 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373656    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 16:56:46.374129 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373659    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 16:56:46.374129 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373662    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 16:56:46.374129 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373665    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 16:56:46.374129 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373667    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 16:56:46.374129 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373670    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 16:56:46.374865 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373672    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 16:56:46.374865 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373675    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 16:56:46.374865 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373677    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 16:56:46.374865 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373680    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 16:56:46.374865 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373682    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 16:56:46.374865 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373685    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 16:56:46.374865 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373687    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 16:56:46.374865 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373690    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 16:56:46.374865 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373692    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 16:56:46.374865 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373695    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 16:56:46.374865 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373697    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 16:56:46.374865 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373700    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 16:56:46.374865 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373702    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 16:56:46.374865 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373706    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 16:56:46.374865 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373709    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 16:56:46.374865 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373711    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 16:56:46.374865 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373714    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 16:56:46.374865 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373716    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 16:56:46.374865 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373719    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 16:56:46.374865 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373722    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 16:56:46.375387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373725    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 16:56:46.375387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373727    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 16:56:46.375387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373731    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 16:56:46.375387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373735    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 16:56:46.375387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373737    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 16:56:46.375387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373740    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 16:56:46.375387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373742    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 16:56:46.375387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373745    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 16:56:46.375387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373747    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 16:56:46.375387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373750    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 16:56:46.375387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373754    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 16:56:46.375387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373756    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 16:56:46.375387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373759    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 16:56:46.375387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373762    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 16:56:46.375387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373764    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 16:56:46.375387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373767    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 16:56:46.375387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373769    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 16:56:46.375387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373771    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 16:56:46.375387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373774    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 16:56:46.375980 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373777    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 16:56:46.375980 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373779    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 16:56:46.375980 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373782    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 16:56:46.375980 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373784    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 16:56:46.375980 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373787    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 16:56:46.375980 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373789    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 16:56:46.375980 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373793    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 16:56:46.375980 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373797    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 16:56:46.375980 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373799    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 16:56:46.375980 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373801    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 16:56:46.375980 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373805    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 16:56:46.375980 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373807    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 16:56:46.375980 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373810    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 16:56:46.375980 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373812    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 16:56:46.375980 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373815    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 16:56:46.375980 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373817    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 16:56:46.375980 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373820    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 16:56:46.375980 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373822    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 16:56:46.375980 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.373824    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 16:56:46.376791 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376736    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 16:56:46.376791 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376752    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 16:56:46.376791 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376758    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 16:56:46.376791 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376763    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 16:56:46.376791 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376767    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 16:56:46.376791 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376772    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 16:56:46.376791 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376777    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 16:56:46.376791 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376781    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 16:56:46.376791 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376786    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 16:56:46.376791 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376790    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 16:56:46.376791 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376794    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 16:56:46.376791 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376798    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 16:56:46.377349 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376803    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 16:56:46.377349 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376807    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 16:56:46.377349 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376811    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 16:56:46.377349 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376815    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 16:56:46.377349 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376819    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 16:56:46.377349 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376824    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 16:56:46.377349 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376828    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 16:56:46.377349 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376832    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 16:56:46.377349 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376836    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 16:56:46.377349 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376840    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 16:56:46.377349 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376844    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 16:56:46.377349 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376848    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 16:56:46.377349 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376852    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 16:56:46.377349 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376856    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 16:56:46.377349 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376860    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 16:56:46.377349 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376874    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 16:56:46.377349 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376879    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 16:56:46.377349 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376883    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 16:56:46.377349 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376887    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 16:56:46.378196 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376909    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 16:56:46.378196 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376914    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 16:56:46.378196 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376919    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 16:56:46.378196 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376923    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 16:56:46.378196 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376927    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 16:56:46.378196 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376931    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 16:56:46.378196 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376935    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 16:56:46.378196 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376939    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 16:56:46.378196 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376943    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 16:56:46.378196 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376947    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 16:56:46.378196 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376952    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 16:56:46.378196 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376956    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 16:56:46.378196 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376960    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 16:56:46.378196 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376967    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 16:56:46.378196 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376974    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 16:56:46.378196 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376979    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 16:56:46.378196 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376983    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 16:56:46.378196 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376987    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 16:56:46.378196 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376992    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 16:56:46.378196 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.376997    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 16:56:46.379066 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377002    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 16:56:46.379066 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377006    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 16:56:46.379066 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377011    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 16:56:46.379066 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377015    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 16:56:46.379066 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377020    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 16:56:46.379066 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377024    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 16:56:46.379066 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377029    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 16:56:46.379066 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377033    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 16:56:46.379066 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377037    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 16:56:46.379066 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377041    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 16:56:46.379066 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377046    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 16:56:46.379066 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377050    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 16:56:46.379066 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377053    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 16:56:46.379066 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377058    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 16:56:46.379066 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377062    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 16:56:46.379066 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377066    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 16:56:46.379066 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377070    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 16:56:46.379066 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377075    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 16:56:46.379066 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377079    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 16:56:46.379066 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377083    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 16:56:46.379994 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377087    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 16:56:46.379994 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377091    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 16:56:46.379994 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377095    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 16:56:46.379994 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377099    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 16:56:46.379994 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377103    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 16:56:46.379994 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377107    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 16:56:46.379994 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377112    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 16:56:46.379994 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377117    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 16:56:46.379994 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377121    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 16:56:46.379994 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377125    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 16:56:46.379994 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377132    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 16:56:46.379994 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377136    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 16:56:46.379994 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377143    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 16:56:46.379994 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377149    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 16:56:46.379994 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377155    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 16:56:46.379994 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377159    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 16:56:46.379994 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377164    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 16:56:46.379994 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377169    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 16:56:46.379994 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377173    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 16:56:46.379994 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377177    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 16:56:46.380493 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377182    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 16:56:46.380493 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377187    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 16:56:46.380493 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377191    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 16:56:46.380493 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377195    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 16:56:46.380493 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377199    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 16:56:46.380493 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377206    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 16:56:46.380493 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377212    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 16:56:46.380493 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377217    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 16:56:46.380493 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377838    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 16:56:46.380493 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377848    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 16:56:46.380493 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377853    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 16:56:46.380493 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377860    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 16:56:46.380493 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377866    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 16:56:46.380493 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377870    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 16:56:46.380493 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377874    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 16:56:46.380493 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377878    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 16:56:46.380493 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377883    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 16:56:46.380493 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377887    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 16:56:46.380493 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377911    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 16:56:46.381190 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377919    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 16:56:46.381190 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377925    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 16:56:46.381190 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377931    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 16:56:46.381190 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377935    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 16:56:46.381190 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377940    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 16:56:46.381190 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377946    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 16:56:46.381190 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377951    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 16:56:46.381190 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377955    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 16:56:46.381190 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377960    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 16:56:46.381190 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377964    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 16:56:46.381190 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377969    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 16:56:46.381190 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377973    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 16:56:46.381190 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377978    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 16:56:46.381190 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377983    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 16:56:46.381190 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377987    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 16:56:46.381190 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377992    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 16:56:46.381190 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.377996    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 16:56:46.381190 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378000    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 16:56:46.381190 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378004    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 16:56:46.381737 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378008    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 16:56:46.381737 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378012    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 16:56:46.381737 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378017    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 16:56:46.381737 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378021    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 16:56:46.381737 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378025    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 16:56:46.381737 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378029    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 16:56:46.381737 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378033    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 16:56:46.381737 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378037    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 16:56:46.381737 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378041    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 16:56:46.381737 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378045    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 16:56:46.381737 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378049    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 16:56:46.381737 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378053    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 16:56:46.381737 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378058    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 16:56:46.381737 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378063    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 16:56:46.381737 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378067    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 16:56:46.381737 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378071    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 16:56:46.381737 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378075    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 16:56:46.381737 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378081    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 16:56:46.381737 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378085    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 16:56:46.381737 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378090    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 16:56:46.382387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378095    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 16:56:46.382387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378099    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 16:56:46.382387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378103    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 16:56:46.382387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378107    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 16:56:46.382387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378111    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 16:56:46.382387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378115    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 16:56:46.382387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378119    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 16:56:46.382387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378123    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 16:56:46.382387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378127    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 16:56:46.382387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378131    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 16:56:46.382387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378135    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 16:56:46.382387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378139    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 16:56:46.382387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378143    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 16:56:46.382387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378148    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 16:56:46.382387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378152    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 16:56:46.382387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378156    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 16:56:46.382387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378160    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 16:56:46.382387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378164    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 16:56:46.382387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378168    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 16:56:46.382387 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378172    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 16:56:46.382868 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378176    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 16:56:46.382868 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378180    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 16:56:46.382868 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378184    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 16:56:46.382868 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378189    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 16:56:46.382868 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378196    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 16:56:46.382868 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378200    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 16:56:46.382868 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378204    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 16:56:46.382868 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378208    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 16:56:46.382868 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378213    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 16:56:46.382868 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378216    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 16:56:46.382868 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378222    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 16:56:46.382868 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378227    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 16:56:46.382868 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378232    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 16:56:46.382868 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378237    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 16:56:46.382868 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378241    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 16:56:46.382868 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378245    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 16:56:46.382868 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378250    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 16:56:46.382868 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378254    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 16:56:46.382868 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378258    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 16:56:46.382868 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378262    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 16:56:46.383498 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378266    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 16:56:46.383498 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378270    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 16:56:46.383498 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378274    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 16:56:46.383498 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378278    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 16:56:46.383498 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378283    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 16:56:46.383498 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378287    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 16:56:46.383498 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378291    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 16:56:46.383498 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378295    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 16:56:46.383498 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.378302    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 16:56:46.383498 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378417    2575 flags.go:64] FLAG: --address="0.0.0.0"
Sep 07 16:56:46.383498 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378465    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 07 16:56:46.383498 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378473    2575 flags.go:64] FLAG: --anonymous-auth="true"
Sep 07 16:56:46.383498 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378480    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 07 16:56:46.383498 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378486    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 07 16:56:46.383498 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378492    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 07 16:56:46.383498 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378498    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 07 16:56:46.383498 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378507    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 07 16:56:46.383498 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378513    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 07 16:56:46.383498 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378518    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 07 16:56:46.383498 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378523    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 07 16:56:46.383498 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378528    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 07 16:56:46.384035 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378533    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 07 16:56:46.384035 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378538    2575 flags.go:64] FLAG: --cgroup-root=""
Sep 07 16:56:46.384035 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378542    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 07 16:56:46.384035 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378547    2575 flags.go:64] FLAG: --client-ca-file=""
Sep 07 16:56:46.384035 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378553    2575 flags.go:64] FLAG: --cloud-provider="external"
Sep 07 16:56:46.384035 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378558    2575 flags.go:64] FLAG: --cluster-dns="[]"
Sep 07 16:56:46.384035 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378567    2575 flags.go:64] FLAG: --cluster-domain=""
Sep 07 16:56:46.384035 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378571    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 07 16:56:46.384035 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378576    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 07 16:56:46.384035 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378581    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 07 16:56:46.384035 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378587    2575 flags.go:64] FLAG: --container-log-max-files="5"
Sep 07 16:56:46.384035 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378593    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 07 16:56:46.384035 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378598    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 07 16:56:46.384035 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378603    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 07 16:56:46.384035 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378608    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 07 16:56:46.384035 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378613    2575 flags.go:64] FLAG: --contention-profiling="false"
Sep 07 16:56:46.384035 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378617    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 07 16:56:46.384035 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378622    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 07 16:56:46.384035 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378627    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 07 16:56:46.384035 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378631    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 07 16:56:46.384035 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378637    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 07 16:56:46.384035 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378642    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 07 16:56:46.384035 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378647    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 07 16:56:46.384035 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378652    2575 flags.go:64] FLAG: --enable-load-reader="false"
Sep 07 16:56:46.384035 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378656    2575 flags.go:64] FLAG: --enable-server="true"
Sep 07 16:56:46.384626 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378661    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 07 16:56:46.384626 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378667    2575 flags.go:64] FLAG: --event-burst="100"
Sep 07 16:56:46.384626 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378673    2575 flags.go:64] FLAG: --event-qps="50"
Sep 07 16:56:46.384626 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378679    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 07 16:56:46.384626 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378684    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 07 16:56:46.384626 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378688    2575 flags.go:64] FLAG: --eviction-hard=""
Sep 07 16:56:46.384626 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378694    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 07 16:56:46.384626 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378699    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 07 16:56:46.384626 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378704    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 07 16:56:46.384626 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378708    2575 flags.go:64] FLAG: --eviction-soft=""
Sep 07 16:56:46.384626 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378713    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 07 16:56:46.384626 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378717    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 07 16:56:46.384626 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378723    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 07 16:56:46.384626 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378728    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 07 16:56:46.384626 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378733    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 07 16:56:46.384626 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378737    2575 flags.go:64] FLAG: --fail-swap-on="true"
Sep 07 16:56:46.384626 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378742    2575 flags.go:64] FLAG: --feature-gates=""
Sep 07 16:56:46.384626 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378748    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 07 16:56:46.384626 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378752    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 07 16:56:46.384626 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378757    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 07 16:56:46.384626 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378762    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 07 16:56:46.384626 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378767    2575 flags.go:64] FLAG: --healthz-port="10248"
Sep 07 16:56:46.384626 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378772    2575 flags.go:64] FLAG: --help="false"
Sep 07 16:56:46.384626 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378777    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-136-3.ec2.internal"
Sep 07 16:56:46.384626 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378782    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 07 16:56:46.385294 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378787    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 07 16:56:46.385294 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378791    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 07 16:56:46.385294 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378797    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 07 16:56:46.385294 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378802    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 07 16:56:46.385294 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378807    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 07 16:56:46.385294 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378812    2575 flags.go:64] FLAG: --image-service-endpoint=""
Sep 07 16:56:46.385294 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378816    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 07 16:56:46.385294 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378820    2575 flags.go:64] FLAG: --kube-api-burst="100"
Sep 07 16:56:46.385294 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378825    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 07 16:56:46.385294 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378832    2575 flags.go:64] FLAG: --kube-api-qps="50"
Sep 07 16:56:46.385294 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378836    2575 flags.go:64] FLAG: --kube-reserved=""
Sep 07 16:56:46.385294 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378841    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 07 16:56:46.385294 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378846    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 07 16:56:46.385294 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378851    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 07 16:56:46.385294 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378856    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 07 16:56:46.385294 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378860    2575 flags.go:64] FLAG: --lock-file=""
Sep 07 16:56:46.385294 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378866    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 07 16:56:46.385294 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378870    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 07 16:56:46.385294 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378875    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 07 16:56:46.385294 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378884    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 07 16:56:46.385294 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378889    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 07 16:56:46.385294 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378910    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 07 16:56:46.385294 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378915    2575 flags.go:64] FLAG: --logging-format="text"
Sep 07 16:56:46.385984 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378919    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 07 16:56:46.385984 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378925    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 07 16:56:46.385984 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378929    2575 flags.go:64] FLAG: --manifest-url=""
Sep 07 16:56:46.385984 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378933    2575 flags.go:64] FLAG: --manifest-url-header=""
Sep 07 16:56:46.385984 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378940    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 07 16:56:46.385984 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378945    2575 flags.go:64] FLAG: --max-open-files="1000000"
Sep 07 16:56:46.385984 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378951    2575 flags.go:64] FLAG: --max-pods="110"
Sep 07 16:56:46.385984 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378956    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 07 16:56:46.385984 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378961    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 07 16:56:46.385984 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378965    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 07 16:56:46.385984 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378970    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 07 16:56:46.385984 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378975    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 07 16:56:46.385984 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378980    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 07 16:56:46.385984 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378984    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 07 16:56:46.385984 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.378996    2575 flags.go:64] FLAG: --node-status-max-images="50"
Sep 07 16:56:46.385984 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379000    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 07 16:56:46.385984 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379006    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 07 16:56:46.385984 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379011    2575 flags.go:64] FLAG: --pod-cidr=""
Sep 07 16:56:46.385984 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379017    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 07 16:56:46.385984 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379025    2575 flags.go:64] FLAG: --pod-manifest-path=""
Sep 07 16:56:46.385984 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379030    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 07 16:56:46.385984 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379034    2575 flags.go:64] FLAG: --pods-per-core="0"
Sep 07 16:56:46.385984 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379039    2575 flags.go:64] FLAG: --port="10250"
Sep 07 16:56:46.385984 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379044    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 07 16:56:46.386580 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379048    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0313c280f112c1114"
Sep 07 16:56:46.386580 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379054    2575 flags.go:64] FLAG: --qos-reserved=""
Sep 07 16:56:46.386580 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379058    2575 flags.go:64] FLAG: --read-only-port="10255"
Sep 07 16:56:46.386580 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379063    2575 flags.go:64] FLAG: --register-node="true"
Sep 07 16:56:46.386580 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379067    2575 flags.go:64] FLAG: --register-with-taints=""
Sep 07 16:56:46.386580 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379072    2575 flags.go:64] FLAG: --registry-burst="10"
Sep 07 16:56:46.386580 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379078    2575 flags.go:64] FLAG: --registry-qps="5"
Sep 07 16:56:46.386580 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379082    2575 flags.go:64] FLAG: --reserved-cpus=""
Sep 07 16:56:46.386580 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379087    2575 flags.go:64] FLAG: --reserved-memory=""
Sep 07 16:56:46.386580 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379092    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 07 16:56:46.386580 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379097    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 07 16:56:46.386580 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379102    2575 flags.go:64] FLAG: --rotate-certificates="false"
Sep 07 16:56:46.386580 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379107    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 07 16:56:46.386580 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379111    2575 flags.go:64] FLAG: --runonce="false"
Sep 07 16:56:46.386580 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379116    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 07 16:56:46.386580 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379121    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 07 16:56:46.386580 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379125    2575 flags.go:64] FLAG: --seccomp-default="false"
Sep 07 16:56:46.386580 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379130    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 07 16:56:46.386580 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379134    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 07 16:56:46.386580 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379139    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 07 16:56:46.386580 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379144    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 07 16:56:46.386580 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379148    2575 flags.go:64] FLAG: --storage-driver-password="root"
Sep 07 16:56:46.386580 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379153    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 07 16:56:46.386580 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379158    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 07 16:56:46.386580 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379162    2575 flags.go:64] FLAG: --storage-driver-user="root"
Sep 07 16:56:46.387190 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379167    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 07 16:56:46.387190 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379176    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 07 16:56:46.387190 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379180    2575 flags.go:64] FLAG: --system-cgroups=""
Sep 07 16:56:46.387190 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379185    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 07 16:56:46.387190 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379194    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 07 16:56:46.387190 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379199    2575 flags.go:64] FLAG: --tls-cert-file=""
Sep 07 16:56:46.387190 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379203    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 07 16:56:46.387190 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379210    2575 flags.go:64] FLAG: --tls-min-version=""
Sep 07 16:56:46.387190 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379214    2575 flags.go:64] FLAG: --tls-private-key-file=""
Sep 07 16:56:46.387190 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379219    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 07 16:56:46.387190 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379224    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 07 16:56:46.387190 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379229    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 07 16:56:46.387190 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379233    2575 flags.go:64] FLAG: --v="2"
Sep 07 16:56:46.387190 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379246    2575 flags.go:64] FLAG: --version="false"
Sep 07 16:56:46.387190 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379254    2575 flags.go:64] FLAG: --vmodule=""
Sep 07 16:56:46.387190 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379260    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 07 16:56:46.387190 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.379265    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 07 16:56:46.387190 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379454    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 16:56:46.387190 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379461    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 16:56:46.387190 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379466    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 16:56:46.387190 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379471    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 16:56:46.387190 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379475    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 16:56:46.387190 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379479    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 16:56:46.387190 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379483    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 16:56:46.387762 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379486    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 16:56:46.387762 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379491    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 16:56:46.387762 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379495    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 16:56:46.387762 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379499    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 16:56:46.387762 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379503    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 16:56:46.387762 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379507    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 16:56:46.387762 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379511    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 16:56:46.387762 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379516    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 16:56:46.387762 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379520    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 16:56:46.387762 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379527    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 16:56:46.387762 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379531    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 16:56:46.387762 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379535    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 16:56:46.387762 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379542    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 16:56:46.387762 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379548    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 16:56:46.387762 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379553    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 16:56:46.387762 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379558    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 16:56:46.387762 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379562    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 16:56:46.387762 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379566    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 16:56:46.387762 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379570    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 16:56:46.387762 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379574    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 16:56:46.388278 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379579    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 16:56:46.388278 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379584    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 16:56:46.388278 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379588    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 16:56:46.388278 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379593    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 16:56:46.388278 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379597    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 16:56:46.388278 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379601    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 16:56:46.388278 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379605    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 16:56:46.388278 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379609    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 16:56:46.388278 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379614    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 16:56:46.388278 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379618    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 16:56:46.388278 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379623    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 16:56:46.388278 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379627    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 16:56:46.388278 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379631    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 16:56:46.388278 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379636    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 16:56:46.388278 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379640    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 16:56:46.388278 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379644    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 16:56:46.388278 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379648    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 16:56:46.388278 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379652    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 16:56:46.388278 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379656    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 16:56:46.388278 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379660    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 16:56:46.388766 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379664    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 16:56:46.388766 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379671    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 16:56:46.388766 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379675    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 16:56:46.388766 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379680    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 16:56:46.388766 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379686    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 16:56:46.388766 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379692    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 16:56:46.388766 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379697    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 16:56:46.388766 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379701    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 16:56:46.388766 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379706    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 16:56:46.388766 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379710    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 16:56:46.388766 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379715    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 16:56:46.388766 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379719    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 16:56:46.388766 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379724    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 16:56:46.388766 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379729    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 16:56:46.388766 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379733    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 16:56:46.388766 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379740    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 16:56:46.388766 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379747    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 16:56:46.388766 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379752    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 16:56:46.388766 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379757    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 16:56:46.389250 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379762    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 16:56:46.389250 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379766    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 16:56:46.389250 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379770    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 16:56:46.389250 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379775    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 16:56:46.389250 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379779    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 16:56:46.389250 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379783    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 16:56:46.389250 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379787    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 16:56:46.389250 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379791    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 16:56:46.389250 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379795    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 16:56:46.389250 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379800    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 16:56:46.389250 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379804    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 16:56:46.389250 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379808    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 16:56:46.389250 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379812    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 16:56:46.389250 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379816    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 16:56:46.389250 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379824    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 16:56:46.389250 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379828    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 16:56:46.389250 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379832    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 16:56:46.389250 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379836    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 16:56:46.389250 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379840    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 16:56:46.389250 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379844    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 16:56:46.389800 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379849    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 16:56:46.389800 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379853    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 16:56:46.389800 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379857    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 16:56:46.389800 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379861    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 16:56:46.389800 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379865    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 16:56:46.389800 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379869    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 16:56:46.389800 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379874    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 16:56:46.389800 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379878    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 16:56:46.389800 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379882    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 16:56:46.389800 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379886    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 16:56:46.389800 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379908    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 16:56:46.389800 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379913    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 16:56:46.389800 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.379917    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 16:56:46.389800 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.380520    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 16:56:46.389800 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.387356    2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 07 16:56:46.390198 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.387371    2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 07 16:56:46.390198 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.388131    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 07 16:56:46.390198 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.388139    2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 07 16:56:46.390198 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388197    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 16:56:46.390198 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388204    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 16:56:46.390198 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388208    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 16:56:46.390198 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388212    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 16:56:46.390198 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388215    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 16:56:46.390198 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388217    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 16:56:46.390198 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388220    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 16:56:46.390198 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388223    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 16:56:46.390198 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388226    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 16:56:46.390198 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388229    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 16:56:46.390198 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388233    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 16:56:46.390198 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388237    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 16:56:46.390198 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388240    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 16:56:46.390198 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388243    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 16:56:46.390198 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388246    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 16:56:46.390640 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388249    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 16:56:46.390640 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388252    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 16:56:46.390640 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388255    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 16:56:46.390640 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388257    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 16:56:46.390640 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388260    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 16:56:46.390640 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388264    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 16:56:46.390640 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388267    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 16:56:46.390640 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388271    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 16:56:46.390640 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388274    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 16:56:46.390640 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388277    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 16:56:46.390640 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388280    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 16:56:46.390640 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388282    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 16:56:46.390640 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388285    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 16:56:46.390640 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388288    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 16:56:46.390640 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388293    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 16:56:46.390640 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388296    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 16:56:46.390640 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388298    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 16:56:46.390640 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388301    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 16:56:46.390640 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388303    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 16:56:46.390640 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388306    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 16:56:46.391159 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388308    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 16:56:46.391159 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388311    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 16:56:46.391159 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388314    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 16:56:46.391159 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388317    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 16:56:46.391159 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388320    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 16:56:46.391159 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388322    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 16:56:46.391159 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388325    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 16:56:46.391159 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388328    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 16:56:46.391159 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388330    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 16:56:46.391159 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388332    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 16:56:46.391159 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388335    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 16:56:46.391159 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388338    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 16:56:46.391159 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388340    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 16:56:46.391159 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388343    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 16:56:46.391159 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388346    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 16:56:46.391159 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388348    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 16:56:46.391159 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388351    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 16:56:46.391159 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388353    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 16:56:46.391159 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388356    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 16:56:46.391159 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388358    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 16:56:46.391651 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388361    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 16:56:46.391651 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388363    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 16:56:46.391651 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388366    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 16:56:46.391651 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388369    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 16:56:46.391651 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388371    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 16:56:46.391651 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388374    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 16:56:46.391651 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388377    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 16:56:46.391651 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388380    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 16:56:46.391651 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388383    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 16:56:46.391651 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388386    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 16:56:46.391651 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388388    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 16:56:46.391651 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388391    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 16:56:46.391651 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388393    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 16:56:46.391651 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388396    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 16:56:46.391651 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388399    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 16:56:46.391651 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388401    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 16:56:46.391651 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388404    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 16:56:46.391651 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388406    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 16:56:46.391651 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388408    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 16:56:46.391651 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388411    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 16:56:46.392166 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388414    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 16:56:46.392166 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388416    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 16:56:46.392166 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388419    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 16:56:46.392166 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388421    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 16:56:46.392166 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388423    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 16:56:46.392166 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388426    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 16:56:46.392166 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388428    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 16:56:46.392166 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388431    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 16:56:46.392166 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388433    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 16:56:46.392166 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388436    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 16:56:46.392166 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388439    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 16:56:46.392166 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388441    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 16:56:46.392166 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388444    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 16:56:46.392166 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388446    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 16:56:46.392166 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388449    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 16:56:46.392166 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388452    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 16:56:46.392166 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388454    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 16:56:46.392166 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388457    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 16:56:46.392166 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388460    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 16:56:46.392166 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388463    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 16:56:46.392659 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388466    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 16:56:46.392659 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388469    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 16:56:46.392659 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388471    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 16:56:46.392659 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388474    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 16:56:46.392659 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.388478    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 16:56:46.392659 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388589    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 16:56:46.392659 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388593    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 16:56:46.392659 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388596    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 16:56:46.392659 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388599    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 16:56:46.392659 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388602    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 16:56:46.392659 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388605    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 16:56:46.392659 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388608    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 16:56:46.392659 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388611    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 16:56:46.392659 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388613    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 16:56:46.392659 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388616    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 16:56:46.393080 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388619    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 16:56:46.393080 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388622    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 16:56:46.393080 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388624    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 16:56:46.393080 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388628    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 16:56:46.393080 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388632    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 16:56:46.393080 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388635    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 16:56:46.393080 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388638    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 16:56:46.393080 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388640    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 16:56:46.393080 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388643    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 16:56:46.393080 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388645    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 16:56:46.393080 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388648    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 16:56:46.393080 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388650    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 16:56:46.393080 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388653    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 16:56:46.393080 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388655    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 16:56:46.393080 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388658    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 16:56:46.393080 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388661    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 16:56:46.393080 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388664    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 16:56:46.393080 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388666    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 16:56:46.393080 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388669    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 16:56:46.393550 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388672    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 16:56:46.393550 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388674    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 16:56:46.393550 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388677    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 16:56:46.393550 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388679    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 16:56:46.393550 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388682    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 16:56:46.393550 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388684    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 16:56:46.393550 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388686    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 16:56:46.393550 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388689    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 16:56:46.393550 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388691    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 16:56:46.393550 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388694    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 16:56:46.393550 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388697    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 16:56:46.393550 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388699    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 16:56:46.393550 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388702    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 16:56:46.393550 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388705    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 16:56:46.393550 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388709    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 16:56:46.393550 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388711    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 16:56:46.393550 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388715    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 16:56:46.393550 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388717    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 16:56:46.393550 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388720    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 16:56:46.393550 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388723    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 16:56:46.394094 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388726    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 16:56:46.394094 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388728    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 16:56:46.394094 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388731    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 16:56:46.394094 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388734    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 16:56:46.394094 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388736    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 16:56:46.394094 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388739    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 16:56:46.394094 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388741    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 16:56:46.394094 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388744    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 16:56:46.394094 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388747    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 16:56:46.394094 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388750    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 16:56:46.394094 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388752    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 16:56:46.394094 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388755    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 16:56:46.394094 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388758    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 16:56:46.394094 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388760    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 16:56:46.394094 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388763    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 16:56:46.394094 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388766    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 16:56:46.394094 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388768    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 16:56:46.394094 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388771    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 16:56:46.394094 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388774    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 16:56:46.394094 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388776    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 16:56:46.394594 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388779    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 16:56:46.394594 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388781    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 16:56:46.394594 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388784    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 16:56:46.394594 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388786    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 16:56:46.394594 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388789    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 16:56:46.394594 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388792    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 16:56:46.394594 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388794    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 16:56:46.394594 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388796    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 16:56:46.394594 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388799    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 16:56:46.394594 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388801    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 16:56:46.394594 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388804    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 16:56:46.394594 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388806    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 16:56:46.394594 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388808    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 16:56:46.394594 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388811    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 16:56:46.394594 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388813    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 16:56:46.394594 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388816    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 16:56:46.394594 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388820    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 16:56:46.394594 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388822    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 16:56:46.394594 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388825    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 16:56:46.394594 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388828    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 16:56:46.395119 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388831    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 16:56:46.395119 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388833    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 16:56:46.395119 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388836    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 16:56:46.395119 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388838    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 16:56:46.395119 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388841    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 16:56:46.395119 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388844    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 16:56:46.395119 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388847    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 16:56:46.395119 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388849    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 16:56:46.395119 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388851    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 16:56:46.395119 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:46.388854    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 16:56:46.395119 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.388859    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 16:56:46.395119 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.388990    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 07 16:56:46.395119 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.390911    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 07 16:56:46.395119 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.391874    2575 server.go:1019] "Starting client certificate rotation"
Sep 07 16:56:46.395468 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.391924    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 07 16:56:46.395468 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.391962    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 07 16:56:46.395468 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.394616    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 07 16:56:46.396144 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.396127    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 07 16:56:46.406740 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.406713    2575 log.go:25] "Validated CRI v1 runtime API"
Sep 07 16:56:46.409398 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.409366    2575 log.go:25] "Validated CRI v1 image API"
Sep 07 16:56:46.410205 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.410187    2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 07 16:56:46.414743 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.414724    2575 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 96735961-27a1-4910-88c0-85f6f2965f1f:/dev/nvme0n1p3 d4891398-7eed-4636-9868-3501326d3434:/dev/nvme0n1p4]
Sep 07 16:56:46.414806 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.414742    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 07 16:56:46.419787 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.419675    2575 manager.go:216] Machine: {Timestamp:2026-09-07 16:56:46.418362596 +0000 UTC m=+0.315209903 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097055 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e42dab324c4f60a3b826b38358f5f SystemUUID:ec2e42da-b324-c4f6-0a3b-826b38358f5f BootID:bb1efce7-a28c-42f0-bf7d-18041010aecb Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e4:1a:79:4a:5f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e4:1a:79:4a:5f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:d1:39:ab:88:59 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 07 16:56:46.419787 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.419780    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 07 16:56:46.419934 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.419858    2575 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 07 16:56:46.422577 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.422553    2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 07 16:56:46.422743 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.422582    2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-3.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 07 16:56:46.423339 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.423327    2575 topology_manager.go:138] "Creating topology manager with none policy"
Sep 07 16:56:46.423401 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.423344    2575 container_manager_linux.go:309] "Creating device plugin manager"
Sep 07 16:56:46.423401 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.423355    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 07 16:56:46.424023 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.424011    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 07 16:56:46.424717 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.424706    2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 07 16:56:46.428340 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.428326    2575 state_mem.go:36] "Initialized new in-memory state store"
Sep 07 16:56:46.428472 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.428461    2575 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 07 16:56:46.428527 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.428509    2575 kubelet.go:486] "Attempting to sync node with API server"
Sep 07 16:56:46.428587 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.428532    2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 07 16:56:46.428587 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.428551    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 07 16:56:46.428587 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.428564    2575 kubelet.go:398] "Adding apiserver pod source"
Sep 07 16:56:46.428587 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.428576    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 07 16:56:46.428984 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.428962    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 07 16:56:46.428984 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.428985    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 07 16:56:46.433216 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.433197    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 07 16:56:46.433994 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.433973    2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 07 16:56:46.435909 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.435879    2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 07 16:56:46.435982 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.435923    2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 07 16:56:46.436915 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.436888    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 07 16:56:46.436955 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.436928    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 07 16:56:46.436955 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.436936    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 07 16:56:46.436955 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.436941    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 07 16:56:46.436955 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.436950    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 07 16:56:46.436955 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.436955    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 07 16:56:46.437096 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.436968    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 07 16:56:46.437096 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.436973    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 07 16:56:46.437096 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.436980    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 07 16:56:46.437096 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.436985    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 07 16:56:46.437096 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.436994    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 07 16:56:46.437096 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.436999    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 07 16:56:46.437758 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.437749    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 07 16:56:46.437758 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.437758    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 07 16:56:46.441689 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.441675    2575 server.go:1268] "Started kubelet"
Sep 07 16:56:46.441797 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.441735    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 07 16:56:46.441846 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.441785    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 07 16:56:46.441907 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.441876    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 07 16:56:46.442627 ip-10-0-136-3 systemd[1]: Started Kubernetes Kubelet.
Sep 07 16:56:46.443770 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.443748    2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 07 16:56:46.444210 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.444166    2575 server.go:310] "Adding debug handlers to kubelet server"
Sep 07 16:56:46.447296 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:46.447130    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-3.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 07 16:56:46.447363 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.447208    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-3.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 07 16:56:46.447618 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:46.447586    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 07 16:56:46.448223 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:46.448184    2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 07 16:56:46.451872 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.451848    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 07 16:56:46.452473 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.452453    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 07 16:56:46.452557 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:46.452541    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-3.ec2.internal\" not found"
Sep 07 16:56:46.453190 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.453168    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 07 16:56:46.453284 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.453248    2575 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 07 16:56:46.453284 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.453262    2575 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 07 16:56:46.453405 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.453392    2575 reconstruct.go:97] "Volume reconstruction finished"
Sep 07 16:56:46.453455 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.453418    2575 reconciler.go:29] "Reconciler: start to sync state"
Sep 07 16:56:46.453736 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.453711    2575 factory.go:55] Registering systemd factory
Sep 07 16:56:46.453812 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.453749    2575 factory.go:223] Registration of the systemd container factory successfully
Sep 07 16:56:46.454680 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.454662    2575 factory.go:153] Registering CRI-O factory
Sep 07 16:56:46.454680 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.454680    2575 factory.go:223] Registration of the crio container factory successfully
Sep 07 16:56:46.454822 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:46.454699    2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-3.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 07 16:56:46.454822 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.454728    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 07 16:56:46.454822 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.454748    2575 factory.go:103] Registering Raw factory
Sep 07 16:56:46.454822 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.454763    2575 manager.go:1196] Started watching for new ooms in manager
Sep 07 16:56:46.455198 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.455181    2575 manager.go:349] Starting recovery of all containers
Sep 07 16:56:46.455628 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:46.454782    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-3.ec2.internal.18d3184f6f197e1b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-3.ec2.internal,UID:ip-10-0-136-3.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-3.ec2.internal,},FirstTimestamp:2026-09-07 16:56:46.441643547 +0000 UTC m=+0.338490853,LastTimestamp:2026-09-07 16:56:46.441643547 +0000 UTC m=+0.338490853,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-3.ec2.internal,}"
Sep 07 16:56:46.459209 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:46.459176    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 07 16:56:46.466373 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.466356    2575 manager.go:354] Recovery completed
Sep 07 16:56:46.470749 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.470734    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 16:56:46.473448 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.473427    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 16:56:46.473522 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.473466    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 16:56:46.473522 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.473477    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasSufficientPID"
Sep 07 16:56:46.474100 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.474084    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 07 16:56:46.474100 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.474091    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 16:56:46.474100 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.474096    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 07 16:56:46.474267 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.474110    2575 state_mem.go:36] "Initialized new in-memory state store"
Sep 07 16:56:46.474860 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.474846    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 16:56:46.474937 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.474870    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 16:56:46.474937 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.474882    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasSufficientPID"
Sep 07 16:56:46.476949 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:46.476868    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-3.ec2.internal.18d3184f70fec9f5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-3.ec2.internal,UID:ip-10-0-136-3.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-3.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-3.ec2.internal,},FirstTimestamp:2026-09-07 16:56:46.473447925 +0000 UTC m=+0.370295230,LastTimestamp:2026-09-07 16:56:46.473447925 +0000 UTC m=+0.370295230,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-3.ec2.internal,}"
Sep 07 16:56:46.490239 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.490221    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kdlb9"
Sep 07 16:56:46.507106 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:46.507029    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-3.ec2.internal.18d3184f70ff25cb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-3.ec2.internal,UID:ip-10-0-136-3.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-3.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-3.ec2.internal,},FirstTimestamp:2026-09-07 16:56:46.473471435 +0000 UTC m=+0.370318741,LastTimestamp:2026-09-07 16:56:46.473471435 +0000 UTC m=+0.370318741,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-3.ec2.internal,}"
Sep 07 16:56:46.512705 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.512686    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kdlb9"
Sep 07 16:56:46.517186 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:46.517123    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-3.ec2.internal.18d3184f70ff4c02  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-3.ec2.internal,UID:ip-10-0-136-3.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-3.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-3.ec2.internal,},FirstTimestamp:2026-09-07 16:56:46.473481218 +0000 UTC m=+0.370328525,LastTimestamp:2026-09-07 16:56:46.473481218 +0000 UTC m=+0.370328525,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-3.ec2.internal,}"
Sep 07 16:56:46.533037 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:46.532963    2575 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-3.ec2.internal.18d3184f70fec9f5\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-3.ec2.internal.18d3184f70fec9f5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-3.ec2.internal,UID:ip-10-0-136-3.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-3.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-3.ec2.internal,},FirstTimestamp:2026-09-07 16:56:46.473447925 +0000 UTC m=+0.370295230,LastTimestamp:2026-09-07 16:56:46.474859405 +0000 UTC m=+0.371706711,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-3.ec2.internal,}"
Sep 07 16:56:46.548334 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:46.548263    2575 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-3.ec2.internal.18d3184f70ff25cb\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-3.ec2.internal.18d3184f70ff25cb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-3.ec2.internal,UID:ip-10-0-136-3.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-3.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-3.ec2.internal,},FirstTimestamp:2026-09-07 16:56:46.473471435 +0000 UTC m=+0.370318741,LastTimestamp:2026-09-07 16:56:46.474874972 +0000 UTC m=+0.371722278,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-3.ec2.internal,}"
Sep 07 16:56:46.552954 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:46.552939    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-3.ec2.internal\" not found"
Sep 07 16:56:46.571044 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:46.570980    2575 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-3.ec2.internal.18d3184f70ff4c02\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-3.ec2.internal.18d3184f70ff4c02  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-3.ec2.internal,UID:ip-10-0-136-3.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-3.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-3.ec2.internal,},FirstTimestamp:2026-09-07 16:56:46.473481218 +0000 UTC m=+0.370328525,LastTimestamp:2026-09-07 16:56:46.474886872 +0000 UTC m=+0.371734177,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-3.ec2.internal,}"
Sep 07 16:56:46.620601 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.620523    2575 policy_none.go:49] "None policy: Start"
Sep 07 16:56:46.620601 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.620555    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 07 16:56:46.620601 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.620567    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 07 16:56:46.622758 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.622739    2575 policy_none.go:47] "Start"
Sep 07 16:56:46.651069 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.651055    2575 manager.go:337] "Starting Device Plugin manager"
Sep 07 16:56:46.651177 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:46.651097    2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 07 16:56:46.651177 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.651110    2575 server.go:87] "Starting device plugin registration server"
Sep 07 16:56:46.651453 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.651440    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 07 16:56:46.651506 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.651455    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 07 16:56:46.651576 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.651564    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 07 16:56:46.651650 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.651632    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 07 16:56:46.651650 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.651646    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 07 16:56:46.652237 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:46.652219    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 07 16:56:46.652320 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:46.652270    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-3.ec2.internal\" not found"
Sep 07 16:56:46.679300 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:46.679276    2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-3.ec2.internal\" not found" node="ip-10-0-136-3.ec2.internal"
Sep 07 16:56:46.713943 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.713910    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 07 16:56:46.715187 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.715169    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 07 16:56:46.715282 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.715220    2575 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 07 16:56:46.715282 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.715243    2575 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 07 16:56:46.715361 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:46.715286    2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 07 16:56:46.717857 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.717840    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 16:56:46.751582 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.751562    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 16:56:46.753148 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.753131    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 16:56:46.753214 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.753161    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 16:56:46.753214 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.753171    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasSufficientPID"
Sep 07 16:56:46.753214 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.753193    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-3.ec2.internal"
Sep 07 16:56:46.762640 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.762624    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-3.ec2.internal"
Sep 07 16:56:46.762685 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:46.762644    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-3.ec2.internal\": node \"ip-10-0-136-3.ec2.internal\" not found"
Sep 07 16:56:46.796402 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:46.796385    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-3.ec2.internal\" not found"
Sep 07 16:56:46.815519 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.815487    2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-3.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal"]
Sep 07 16:56:46.815582 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.815557    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 16:56:46.817078 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.817063    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 16:56:46.817143 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.817090    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 16:56:46.817143 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.817099    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasSufficientPID"
Sep 07 16:56:46.819296 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.819284    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 16:56:46.819439 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.819424    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-3.ec2.internal"
Sep 07 16:56:46.819473 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.819454    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 16:56:46.820029 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.820015    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 16:56:46.820099 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.820038    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 16:56:46.820099 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.820047    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasSufficientPID"
Sep 07 16:56:46.820099 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.820076    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 16:56:46.820099 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.820093    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 16:56:46.820099 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.820101    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasSufficientPID"
Sep 07 16:56:46.822080 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.822060    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal"
Sep 07 16:56:46.822150 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.822085    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 16:56:46.824329 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.824314    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 16:56:46.824402 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.824344    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 16:56:46.824402 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.824366    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasSufficientPID"
Sep 07 16:56:46.846457 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:46.846441    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-3.ec2.internal\" not found" node="ip-10-0-136-3.ec2.internal"
Sep 07 16:56:46.850607 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:46.850591    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-3.ec2.internal\" not found" node="ip-10-0-136-3.ec2.internal"
Sep 07 16:56:46.855806 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.855789    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1f6bdbab6cf05f88305dbbed7f882a37-config\") pod \"kube-apiserver-proxy-ip-10-0-136-3.ec2.internal\" (UID: \"1f6bdbab6cf05f88305dbbed7f882a37\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-3.ec2.internal"
Sep 07 16:56:46.855868 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.855813    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9ada7fdc5275d075f26246dd3a510397-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal\" (UID: \"9ada7fdc5275d075f26246dd3a510397\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal"
Sep 07 16:56:46.855868 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.855832    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ada7fdc5275d075f26246dd3a510397-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal\" (UID: \"9ada7fdc5275d075f26246dd3a510397\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal"
Sep 07 16:56:46.897130 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:46.897069    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-3.ec2.internal\" not found"
Sep 07 16:56:46.956358 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.956330    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9ada7fdc5275d075f26246dd3a510397-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal\" (UID: \"9ada7fdc5275d075f26246dd3a510397\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal"
Sep 07 16:56:46.956488 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.956364    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ada7fdc5275d075f26246dd3a510397-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal\" (UID: \"9ada7fdc5275d075f26246dd3a510397\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal"
Sep 07 16:56:46.956488 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.956388    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1f6bdbab6cf05f88305dbbed7f882a37-config\") pod \"kube-apiserver-proxy-ip-10-0-136-3.ec2.internal\" (UID: \"1f6bdbab6cf05f88305dbbed7f882a37\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-3.ec2.internal"
Sep 07 16:56:46.956488 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.956440    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1f6bdbab6cf05f88305dbbed7f882a37-config\") pod \"kube-apiserver-proxy-ip-10-0-136-3.ec2.internal\" (UID: \"1f6bdbab6cf05f88305dbbed7f882a37\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-3.ec2.internal"
Sep 07 16:56:46.956488 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.956444    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ada7fdc5275d075f26246dd3a510397-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal\" (UID: \"9ada7fdc5275d075f26246dd3a510397\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal"
Sep 07 16:56:46.956488 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:46.956440    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9ada7fdc5275d075f26246dd3a510397-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal\" (UID: \"9ada7fdc5275d075f26246dd3a510397\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal"
Sep 07 16:56:46.997686 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:46.997663    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-3.ec2.internal\" not found"
Sep 07 16:56:47.098769 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:47.098734    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-3.ec2.internal\" not found"
Sep 07 16:56:47.148645 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:47.148588    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-3.ec2.internal"
Sep 07 16:56:47.153741 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:47.153415    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal"
Sep 07 16:56:47.198972 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:47.198940    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-3.ec2.internal\" not found"
Sep 07 16:56:47.302266 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:47.302209    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-3.ec2.internal\" not found"
Sep 07 16:56:47.393575 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:47.393545    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 07 16:56:47.394122 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:47.393735    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 07 16:56:47.402452 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:47.402379    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-3.ec2.internal\" not found"
Sep 07 16:56:47.502732 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:47.502691    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-3.ec2.internal\" not found"
Sep 07 16:56:47.554683 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:47.554651    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 16:56:47.622199 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:47.622161    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-06 16:51:47 +0000 UTC" deadline="2028-03-03 06:29:44.09737222 +0000 UTC"
Sep 07 16:56:47.622199 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:47.622190    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13021h32m56.475185202s"
Sep 07 16:56:47.644515 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:47.644483    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 16:56:47.653089 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:47.653029    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal"
Sep 07 16:56:47.676557 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:47.676528    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 07 16:56:47.678414 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:47.678398    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-3.ec2.internal"
Sep 07 16:56:47.700834 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:47.700809    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 07 16:56:47.795641 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:47.795607    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f6bdbab6cf05f88305dbbed7f882a37.slice/crio-cc8b73c940eaa39069c4f511df472b0fd28760d8b67020dc05eb6aefb31f46b4 WatchSource:0}: Error finding container cc8b73c940eaa39069c4f511df472b0fd28760d8b67020dc05eb6aefb31f46b4: Status 404 returned error can't find the container with id cc8b73c940eaa39069c4f511df472b0fd28760d8b67020dc05eb6aefb31f46b4
Sep 07 16:56:47.796283 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:47.796261    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ada7fdc5275d075f26246dd3a510397.slice/crio-6840c90e348e975705de446930995dd3b19988b178f12aad990fc2d099fa7f29 WatchSource:0}: Error finding container 6840c90e348e975705de446930995dd3b19988b178f12aad990fc2d099fa7f29: Status 404 returned error can't find the container with id 6840c90e348e975705de446930995dd3b19988b178f12aad990fc2d099fa7f29
Sep 07 16:56:47.803471 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:47.803446    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 16:56:47.846737 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:47.846705    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 16:56:48.430891 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.430859    2575 apiserver.go:52] "Watching apiserver"
Sep 07 16:56:48.439711 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.439680    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 07 16:56:48.441372 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.441333    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-rzhjh","openshift-network-diagnostics/network-check-target-g2l8w","openshift-ovn-kubernetes/ovnkube-node-nk6rv","kube-system/konnectivity-agent-6l488","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztgrq","openshift-dns/node-resolver-dpb4t","openshift-image-registry/node-ca-8ljh2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal","openshift-multus/multus-additional-cni-plugins-dsqc5","openshift-multus/network-metrics-daemon-nplbv","openshift-network-operator/iptables-alerter-ckwp5","kube-system/global-pull-secret-syncer-g54wv","kube-system/kube-apiserver-proxy-ip-10-0-136-3.ec2.internal","openshift-cluster-node-tuning-operator/tuned-xqpnt"]
Sep 07 16:56:48.444190 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.444166    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8ljh2"
Sep 07 16:56:48.447789 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.447766    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ckwp5"
Sep 07 16:56:48.447931 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.447909    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 07 16:56:48.449127 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.449106    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mgs26\""
Sep 07 16:56:48.449421 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.449402    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 07 16:56:48.449734 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.449711    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 07 16:56:48.450081 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.450058    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.452858 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.452203    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 07 16:56:48.452858 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.452277    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6l488"
Sep 07 16:56:48.455583 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.455514    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tw2bp\""
Sep 07 16:56:48.456282 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.456142    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztgrq"
Sep 07 16:56:48.459345 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.459326    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dpb4t"
Sep 07 16:56:48.461895 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.461876    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dsqc5"
Sep 07 16:56:48.462207 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.462186    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 07 16:56:48.462533 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.462514    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 07 16:56:48.462759 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.462739    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 07 16:56:48.464428 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.464065    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.465534 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.465509    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ae3e5a16-c599-4170-955b-4873224a7a20-ovn-node-metrics-cert\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.465639 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.465548    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d92ac6a3-1ea8-4de3-ac1a-45583a6139d9-agent-certs\") pod \"konnectivity-agent-6l488\" (UID: \"d92ac6a3-1ea8-4de3-ac1a-45583a6139d9\") " pod="kube-system/konnectivity-agent-6l488"
Sep 07 16:56:48.465639 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.465575    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d92ac6a3-1ea8-4de3-ac1a-45583a6139d9-konnectivity-ca\") pod \"konnectivity-agent-6l488\" (UID: \"d92ac6a3-1ea8-4de3-ac1a-45583a6139d9\") " pod="kube-system/konnectivity-agent-6l488"
Sep 07 16:56:48.465758 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.465645    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-systemd-units\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.465758 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.465677    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-host-run-netns\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.465758 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.465706    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ae3e5a16-c599-4170-955b-4873224a7a20-ovnkube-script-lib\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.465758 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.465733    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9a404e8e-ae1c-4d06-a909-da73d9c8e229-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ztgrq\" (UID: \"9a404e8e-ae1c-4d06-a909-da73d9c8e229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztgrq"
Sep 07 16:56:48.465990 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.465759    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ae3e5a16-c599-4170-955b-4873224a7a20-env-overrides\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.465990 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.465788    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9333441c-26d5-460b-b1d3-67eec0f25fd2-host-slash\") pod \"iptables-alerter-ckwp5\" (UID: \"9333441c-26d5-460b-b1d3-67eec0f25fd2\") " pod="openshift-network-operator/iptables-alerter-ckwp5"
Sep 07 16:56:48.465990 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.465812    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-run-systemd\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.465990 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.465852    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-run-ovn\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.465990 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.465880    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-host-run-ovn-kubernetes\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.465990 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.465906    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-host-cni-bin\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.465990 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.465952    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.465990 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.465987    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9a404e8e-ae1c-4d06-a909-da73d9c8e229-socket-dir\") pod \"aws-ebs-csi-driver-node-ztgrq\" (UID: \"9a404e8e-ae1c-4d06-a909-da73d9c8e229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztgrq"
Sep 07 16:56:48.466597 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.466013    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9a404e8e-ae1c-4d06-a909-da73d9c8e229-etc-selinux\") pod \"aws-ebs-csi-driver-node-ztgrq\" (UID: \"9a404e8e-ae1c-4d06-a909-da73d9c8e229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztgrq"
Sep 07 16:56:48.466597 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.466039    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9a404e8e-ae1c-4d06-a909-da73d9c8e229-registration-dir\") pod \"aws-ebs-csi-driver-node-ztgrq\" (UID: \"9a404e8e-ae1c-4d06-a909-da73d9c8e229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztgrq"
Sep 07 16:56:48.466597 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.466064    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9a404e8e-ae1c-4d06-a909-da73d9c8e229-device-dir\") pod \"aws-ebs-csi-driver-node-ztgrq\" (UID: \"9a404e8e-ae1c-4d06-a909-da73d9c8e229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztgrq"
Sep 07 16:56:48.466597 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.466088    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c5e9c92f-1d92-4194-a20a-59963361fc54-host\") pod \"node-ca-8ljh2\" (UID: \"c5e9c92f-1d92-4194-a20a-59963361fc54\") " pod="openshift-image-registry/node-ca-8ljh2"
Sep 07 16:56:48.466597 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.466110    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c5e9c92f-1d92-4194-a20a-59963361fc54-serviceca\") pod \"node-ca-8ljh2\" (UID: \"c5e9c92f-1d92-4194-a20a-59963361fc54\") " pod="openshift-image-registry/node-ca-8ljh2"
Sep 07 16:56:48.466597 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.466134    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-host-kubelet\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.466597 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.466160    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-host-slash\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.466597 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.466201    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-etc-openvswitch\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.466597 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.466227    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-var-lib-openvswitch\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.466597 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.466250    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-log-socket\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.466597 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.466276    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9a404e8e-ae1c-4d06-a909-da73d9c8e229-sys-fs\") pod \"aws-ebs-csi-driver-node-ztgrq\" (UID: \"9a404e8e-ae1c-4d06-a909-da73d9c8e229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztgrq"
Sep 07 16:56:48.466597 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.466299    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-run-openvswitch\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.466597 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.466323    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-node-log\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.466597 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.466344    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ae3e5a16-c599-4170-955b-4873224a7a20-ovnkube-config\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.466597 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.466369    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ctm8\" (UniqueName: \"kubernetes.io/projected/ae3e5a16-c599-4170-955b-4873224a7a20-kube-api-access-9ctm8\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.466597 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.466395    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjdld\" (UniqueName: \"kubernetes.io/projected/9a404e8e-ae1c-4d06-a909-da73d9c8e229-kube-api-access-gjdld\") pod \"aws-ebs-csi-driver-node-ztgrq\" (UID: \"9a404e8e-ae1c-4d06-a909-da73d9c8e229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztgrq"
Sep 07 16:56:48.467427 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.466423    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsxtm\" (UniqueName: \"kubernetes.io/projected/c5e9c92f-1d92-4194-a20a-59963361fc54-kube-api-access-tsxtm\") pod \"node-ca-8ljh2\" (UID: \"c5e9c92f-1d92-4194-a20a-59963361fc54\") " pod="openshift-image-registry/node-ca-8ljh2"
Sep 07 16:56:48.467427 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.466447    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9333441c-26d5-460b-b1d3-67eec0f25fd2-iptables-alerter-script\") pod \"iptables-alerter-ckwp5\" (UID: \"9333441c-26d5-460b-b1d3-67eec0f25fd2\") " pod="openshift-network-operator/iptables-alerter-ckwp5"
Sep 07 16:56:48.467427 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.466478    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttxvk\" (UniqueName: \"kubernetes.io/projected/9333441c-26d5-460b-b1d3-67eec0f25fd2-kube-api-access-ttxvk\") pod \"iptables-alerter-ckwp5\" (UID: \"9333441c-26d5-460b-b1d3-67eec0f25fd2\") " pod="openshift-network-operator/iptables-alerter-ckwp5"
Sep 07 16:56:48.467427 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.466517    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-host-cni-netd\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.468693 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.468366    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:56:48.468693 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:48.468446    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2l8w" podUID="363e1dc1-6917-4e79-a2ea-024497e43a3a"
Sep 07 16:56:48.470900 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.470874    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:56:48.471021 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:48.470947    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nplbv" podUID="ba783056-dec5-4200-8726-97d3b462d24d"
Sep 07 16:56:48.473717 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.473693    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.475951 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.475833    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:56:48.475951 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:48.475891    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g54wv" podUID="f6ab0a94-0f1c-496c-9072-1c50fcbcfadc"
Sep 07 16:56:48.504715 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.504689    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 07 16:56:48.504815 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.504768    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 07 16:56:48.504880 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.504859    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 07 16:56:48.504921 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.504912    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 07 16:56:48.505000 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.504959    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 07 16:56:48.506679 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.506655    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 07 16:56:48.507094 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.507075    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7cjcl\""
Sep 07 16:56:48.507188 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.507107    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 07 16:56:48.507314 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.507297    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 07 16:56:48.507422 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.507382    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 07 16:56:48.507597 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.507544    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 07 16:56:48.507597 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.507579    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 07 16:56:48.507806 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.507779    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 07 16:56:48.507806 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.507788    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 07 16:56:48.508043 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.508026    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 07 16:56:48.508273 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.508259    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 07 16:56:48.508561 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.508543    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-svt29\""
Sep 07 16:56:48.508561 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.508555    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 07 16:56:48.508722 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.508705    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 07 16:56:48.509923 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.509901    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 07 16:56:48.510169 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.510152    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 07 16:56:48.510293 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.510270    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6jtzt\""
Sep 07 16:56:48.510293 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.510285    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8ftzg\""
Sep 07 16:56:48.510418 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.510367    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 07 16:56:48.510576 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.510555    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cfxjz\""
Sep 07 16:56:48.510576 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.510570    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 07 16:56:48.510704 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.510620    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sm5qw\""
Sep 07 16:56:48.510704 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.510633    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4ntwt\""
Sep 07 16:56:48.547038 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.547006    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 07 16:56:48.555074 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.555049    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 07 16:56:48.567249 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567218    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ht47\" (UniqueName: \"kubernetes.io/projected/ba783056-dec5-4200-8726-97d3b462d24d-kube-api-access-7ht47\") pod \"network-metrics-daemon-nplbv\" (UID: \"ba783056-dec5-4200-8726-97d3b462d24d\") " pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:56:48.567387 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567265    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p497x\" (UniqueName: \"kubernetes.io/projected/9cfc15e5-2d9e-4cae-8db0-90217597de62-kube-api-access-p497x\") pod \"multus-additional-cni-plugins-dsqc5\" (UID: \"9cfc15e5-2d9e-4cae-8db0-90217597de62\") " pod="openshift-multus/multus-additional-cni-plugins-dsqc5"
Sep 07 16:56:48.567387 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567296    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-etc-modprobe-d\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.567387 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567323    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-host-run-multus-certs\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.567387 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567353    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9333441c-26d5-460b-b1d3-67eec0f25fd2-host-slash\") pod \"iptables-alerter-ckwp5\" (UID: \"9333441c-26d5-460b-b1d3-67eec0f25fd2\") " pod="openshift-network-operator/iptables-alerter-ckwp5"
Sep 07 16:56:48.567387 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567380    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-run-systemd\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.567654 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567404    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-run-ovn\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.567654 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567427    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-host-run-ovn-kubernetes\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.567654 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567441    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9333441c-26d5-460b-b1d3-67eec0f25fd2-host-slash\") pod \"iptables-alerter-ckwp5\" (UID: \"9333441c-26d5-460b-b1d3-67eec0f25fd2\") " pod="openshift-network-operator/iptables-alerter-ckwp5"
Sep 07 16:56:48.567654 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567453    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.567654 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567480    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9a404e8e-ae1c-4d06-a909-da73d9c8e229-socket-dir\") pod \"aws-ebs-csi-driver-node-ztgrq\" (UID: \"9a404e8e-ae1c-4d06-a909-da73d9c8e229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztgrq"
Sep 07 16:56:48.567654 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567497    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-run-ovn\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.567654 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567505    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9a404e8e-ae1c-4d06-a909-da73d9c8e229-etc-selinux\") pod \"aws-ebs-csi-driver-node-ztgrq\" (UID: \"9a404e8e-ae1c-4d06-a909-da73d9c8e229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztgrq"
Sep 07 16:56:48.567654 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567532    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-var-lib-kubelet\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.567654 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567551    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-run-systemd\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.567654 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9a404e8e-ae1c-4d06-a909-da73d9c8e229-device-dir\") pod \"aws-ebs-csi-driver-node-ztgrq\" (UID: \"9a404e8e-ae1c-4d06-a909-da73d9c8e229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztgrq"
Sep 07 16:56:48.567654 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567589    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-etc-kubernetes\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.567654 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567610    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dba09c25-46b0-41d1-a3e1-5c3a5f890073-tmp\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.567654 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567630    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78vd8\" (UniqueName: \"kubernetes.io/projected/dba09c25-46b0-41d1-a3e1-5c3a5f890073-kube-api-access-78vd8\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.567654 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567652    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/31e4fa90-9ec4-44e9-96bd-fe0af3224338-multus-daemon-config\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.568285 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567676    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k82f4\" (UniqueName: \"kubernetes.io/projected/31e4fa90-9ec4-44e9-96bd-fe0af3224338-kube-api-access-k82f4\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.568285 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567691    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9a404e8e-ae1c-4d06-a909-da73d9c8e229-socket-dir\") pod \"aws-ebs-csi-driver-node-ztgrq\" (UID: \"9a404e8e-ae1c-4d06-a909-da73d9c8e229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztgrq"
Sep 07 16:56:48.568285 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567702    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c5e9c92f-1d92-4194-a20a-59963361fc54-host\") pod \"node-ca-8ljh2\" (UID: \"c5e9c92f-1d92-4194-a20a-59963361fc54\") " pod="openshift-image-registry/node-ca-8ljh2"
Sep 07 16:56:48.568285 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567725    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-host-kubelet\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.568285 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567741    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-host-run-ovn-kubernetes\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.568285 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567752    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-host-slash\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.568285 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567777    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-etc-openvswitch\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.568285 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567786    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.568285 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567801    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/490233b3-f4ff-4a5c-818b-6f1f6069f818-hosts-file\") pod \"node-resolver-dpb4t\" (UID: \"490233b3-f4ff-4a5c-818b-6f1f6069f818\") " pod="openshift-dns/node-resolver-dpb4t"
Sep 07 16:56:48.568285 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567827    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9cfc15e5-2d9e-4cae-8db0-90217597de62-system-cni-dir\") pod \"multus-additional-cni-plugins-dsqc5\" (UID: \"9cfc15e5-2d9e-4cae-8db0-90217597de62\") " pod="openshift-multus/multus-additional-cni-plugins-dsqc5"
Sep 07 16:56:48.568285 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567851    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-log-socket\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.568285 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567871    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9a404e8e-ae1c-4d06-a909-da73d9c8e229-sys-fs\") pod \"aws-ebs-csi-driver-node-ztgrq\" (UID: \"9a404e8e-ae1c-4d06-a909-da73d9c8e229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztgrq"
Sep 07 16:56:48.568285 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567896    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxd6h\" (UniqueName: \"kubernetes.io/projected/490233b3-f4ff-4a5c-818b-6f1f6069f818-kube-api-access-sxd6h\") pod \"node-resolver-dpb4t\" (UID: \"490233b3-f4ff-4a5c-818b-6f1f6069f818\") " pod="openshift-dns/node-resolver-dpb4t"
Sep 07 16:56:48.568285 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567913    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9a404e8e-ae1c-4d06-a909-da73d9c8e229-etc-selinux\") pod \"aws-ebs-csi-driver-node-ztgrq\" (UID: \"9a404e8e-ae1c-4d06-a909-da73d9c8e229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztgrq"
Sep 07 16:56:48.568285 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567920    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-host\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.568285 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567944    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-node-log\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.568285 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567995    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjdld\" (UniqueName: \"kubernetes.io/projected/9a404e8e-ae1c-4d06-a909-da73d9c8e229-kube-api-access-gjdld\") pod \"aws-ebs-csi-driver-node-ztgrq\" (UID: \"9a404e8e-ae1c-4d06-a909-da73d9c8e229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztgrq"
Sep 07 16:56:48.569148 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568022    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba783056-dec5-4200-8726-97d3b462d24d-metrics-certs\") pod \"network-metrics-daemon-nplbv\" (UID: \"ba783056-dec5-4200-8726-97d3b462d24d\") " pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:56:48.569148 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568049    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f6ab0a94-0f1c-496c-9072-1c50fcbcfadc-kubelet-config\") pod \"global-pull-secret-syncer-g54wv\" (UID: \"f6ab0a94-0f1c-496c-9072-1c50fcbcfadc\") " pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:56:48.569148 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.567997    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9a404e8e-ae1c-4d06-a909-da73d9c8e229-device-dir\") pod \"aws-ebs-csi-driver-node-ztgrq\" (UID: \"9a404e8e-ae1c-4d06-a909-da73d9c8e229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztgrq"
Sep 07 16:56:48.569148 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568110    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-log-socket\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.569148 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568116    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c5e9c92f-1d92-4194-a20a-59963361fc54-host\") pod \"node-ca-8ljh2\" (UID: \"c5e9c92f-1d92-4194-a20a-59963361fc54\") " pod="openshift-image-registry/node-ca-8ljh2"
Sep 07 16:56:48.569148 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568103    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9cfc15e5-2d9e-4cae-8db0-90217597de62-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dsqc5\" (UID: \"9cfc15e5-2d9e-4cae-8db0-90217597de62\") " pod="openshift-multus/multus-additional-cni-plugins-dsqc5"
Sep 07 16:56:48.569148 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568153    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-node-log\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.569148 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568167    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dba09c25-46b0-41d1-a3e1-5c3a5f890073-etc-tuned\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.569148 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568156    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-host-slash\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.569148 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568195    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9cfc15e5-2d9e-4cae-8db0-90217597de62-cni-binary-copy\") pod \"multus-additional-cni-plugins-dsqc5\" (UID: \"9cfc15e5-2d9e-4cae-8db0-90217597de62\") " pod="openshift-multus/multus-additional-cni-plugins-dsqc5"
Sep 07 16:56:48.569148 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568255    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-host-cni-netd\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.569148 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568265    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9a404e8e-ae1c-4d06-a909-da73d9c8e229-sys-fs\") pod \"aws-ebs-csi-driver-node-ztgrq\" (UID: \"9a404e8e-ae1c-4d06-a909-da73d9c8e229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztgrq"
Sep 07 16:56:48.569148 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568309    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-host-kubelet\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.569148 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568312    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ae3e5a16-c599-4170-955b-4873224a7a20-ovn-node-metrics-cert\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.569148 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568311    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-host-cni-netd\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.569148 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568347    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d92ac6a3-1ea8-4de3-ac1a-45583a6139d9-agent-certs\") pod \"konnectivity-agent-6l488\" (UID: \"d92ac6a3-1ea8-4de3-ac1a-45583a6139d9\") " pod="kube-system/konnectivity-agent-6l488"
Sep 07 16:56:48.569148 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568347    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-etc-openvswitch\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.569991 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568388    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-systemd-units\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.569991 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568417    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9a404e8e-ae1c-4d06-a909-da73d9c8e229-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ztgrq\" (UID: \"9a404e8e-ae1c-4d06-a909-da73d9c8e229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztgrq"
Sep 07 16:56:48.569991 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568442    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f6ab0a94-0f1c-496c-9072-1c50fcbcfadc-dbus\") pod \"global-pull-secret-syncer-g54wv\" (UID: \"f6ab0a94-0f1c-496c-9072-1c50fcbcfadc\") " pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:56:48.569991 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568464    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-etc-sysctl-d\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.569991 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568454    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-systemd-units\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.569991 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568485    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-sys\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.569991 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568510    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-host-run-k8s-cni-cncf-io\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.569991 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568551    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ae3e5a16-c599-4170-955b-4873224a7a20-env-overrides\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.569991 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568527    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9a404e8e-ae1c-4d06-a909-da73d9c8e229-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ztgrq\" (UID: \"9a404e8e-ae1c-4d06-a909-da73d9c8e229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztgrq"
Sep 07 16:56:48.569991 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568573    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/490233b3-f4ff-4a5c-818b-6f1f6069f818-tmp-dir\") pod \"node-resolver-dpb4t\" (UID: \"490233b3-f4ff-4a5c-818b-6f1f6069f818\") " pod="openshift-dns/node-resolver-dpb4t"
Sep 07 16:56:48.569991 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568594    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-host-cni-bin\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.569991 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568610    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9cfc15e5-2d9e-4cae-8db0-90217597de62-cnibin\") pod \"multus-additional-cni-plugins-dsqc5\" (UID: \"9cfc15e5-2d9e-4cae-8db0-90217597de62\") " pod="openshift-multus/multus-additional-cni-plugins-dsqc5"
Sep 07 16:56:48.569991 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568626    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-etc-systemd\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.569991 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568641    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/31e4fa90-9ec4-44e9-96bd-fe0af3224338-cni-binary-copy\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.569991 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568660    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-host-run-netns\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.569991 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568662    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-host-cni-bin\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.569991 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568683    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9a404e8e-ae1c-4d06-a909-da73d9c8e229-registration-dir\") pod \"aws-ebs-csi-driver-node-ztgrq\" (UID: \"9a404e8e-ae1c-4d06-a909-da73d9c8e229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztgrq"
Sep 07 16:56:48.570757 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568739    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9a404e8e-ae1c-4d06-a909-da73d9c8e229-registration-dir\") pod \"aws-ebs-csi-driver-node-ztgrq\" (UID: \"9a404e8e-ae1c-4d06-a909-da73d9c8e229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztgrq"
Sep 07 16:56:48.570757 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568738    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6ab0a94-0f1c-496c-9072-1c50fcbcfadc-original-pull-secret\") pod \"global-pull-secret-syncer-g54wv\" (UID: \"f6ab0a94-0f1c-496c-9072-1c50fcbcfadc\") " pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:56:48.570757 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568773    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-etc-sysconfig\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.570757 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568797    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-etc-kubernetes\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.570757 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568820    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c5e9c92f-1d92-4194-a20a-59963361fc54-serviceca\") pod \"node-ca-8ljh2\" (UID: \"c5e9c92f-1d92-4194-a20a-59963361fc54\") " pod="openshift-image-registry/node-ca-8ljh2"
Sep 07 16:56:48.570757 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568845    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9cfc15e5-2d9e-4cae-8db0-90217597de62-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dsqc5\" (UID: \"9cfc15e5-2d9e-4cae-8db0-90217597de62\") " pod="openshift-multus/multus-additional-cni-plugins-dsqc5"
Sep 07 16:56:48.570757 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568868    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-system-cni-dir\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.570757 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568889    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-cnibin\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.570757 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568926    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-multus-socket-dir-parent\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.570757 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568951    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-var-lib-openvswitch\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.570757 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568973    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d4x4\" (UniqueName: \"kubernetes.io/projected/363e1dc1-6917-4e79-a2ea-024497e43a3a-kube-api-access-4d4x4\") pod \"network-check-target-g2l8w\" (UID: \"363e1dc1-6917-4e79-a2ea-024497e43a3a\") " pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:56:48.570757 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.568996    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-run-openvswitch\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.570757 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.569017    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ae3e5a16-c599-4170-955b-4873224a7a20-ovnkube-config\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.570757 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.569030    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-var-lib-openvswitch\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.570757 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.569043    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ctm8\" (UniqueName: \"kubernetes.io/projected/ae3e5a16-c599-4170-955b-4873224a7a20-kube-api-access-9ctm8\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.570757 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.569053    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-run-openvswitch\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.570757 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.569075    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-etc-sysctl-conf\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.571590 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.569103    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-run\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.571590 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.569127    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-hostroot\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.571590 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.569103    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 07 16:56:48.571590 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.569149    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9cfc15e5-2d9e-4cae-8db0-90217597de62-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dsqc5\" (UID: \"9cfc15e5-2d9e-4cae-8db0-90217597de62\") " pod="openshift-multus/multus-additional-cni-plugins-dsqc5"
Sep 07 16:56:48.571590 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.569182    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsxtm\" (UniqueName: \"kubernetes.io/projected/c5e9c92f-1d92-4194-a20a-59963361fc54-kube-api-access-tsxtm\") pod \"node-ca-8ljh2\" (UID: \"c5e9c92f-1d92-4194-a20a-59963361fc54\") " pod="openshift-image-registry/node-ca-8ljh2"
Sep 07 16:56:48.571590 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.569200    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9333441c-26d5-460b-b1d3-67eec0f25fd2-iptables-alerter-script\") pod \"iptables-alerter-ckwp5\" (UID: \"9333441c-26d5-460b-b1d3-67eec0f25fd2\") " pod="openshift-network-operator/iptables-alerter-ckwp5"
Sep 07 16:56:48.571590 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.569215    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttxvk\" (UniqueName: \"kubernetes.io/projected/9333441c-26d5-460b-b1d3-67eec0f25fd2-kube-api-access-ttxvk\") pod \"iptables-alerter-ckwp5\" (UID: \"9333441c-26d5-460b-b1d3-67eec0f25fd2\") " pod="openshift-network-operator/iptables-alerter-ckwp5"
Sep 07 16:56:48.571590 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.569250    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d92ac6a3-1ea8-4de3-ac1a-45583a6139d9-konnectivity-ca\") pod \"konnectivity-agent-6l488\" (UID: \"d92ac6a3-1ea8-4de3-ac1a-45583a6139d9\") " pod="kube-system/konnectivity-agent-6l488"
Sep 07 16:56:48.571590 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.569278    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-multus-cni-dir\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.571590 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.569312    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-host-var-lib-cni-bin\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.571590 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.569361    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-host-run-netns\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.571590 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.569386    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ae3e5a16-c599-4170-955b-4873224a7a20-ovnkube-script-lib\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.571590 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.569412    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-lib-modules\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.571590 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.569439    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-host-var-lib-cni-multus\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.571590 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.569464    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-host-var-lib-kubelet\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.571590 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.569466    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ae3e5a16-c599-4170-955b-4873224a7a20-env-overrides\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.571590 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.569487    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-multus-conf-dir\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.572501 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.569496    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c5e9c92f-1d92-4194-a20a-59963361fc54-serviceca\") pod \"node-ca-8ljh2\" (UID: \"c5e9c92f-1d92-4194-a20a-59963361fc54\") " pod="openshift-image-registry/node-ca-8ljh2"
Sep 07 16:56:48.572501 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.569592    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ae3e5a16-c599-4170-955b-4873224a7a20-host-run-netns\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.572501 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.569639    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ae3e5a16-c599-4170-955b-4873224a7a20-ovnkube-config\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.572501 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.569841    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9333441c-26d5-460b-b1d3-67eec0f25fd2-iptables-alerter-script\") pod \"iptables-alerter-ckwp5\" (UID: \"9333441c-26d5-460b-b1d3-67eec0f25fd2\") " pod="openshift-network-operator/iptables-alerter-ckwp5"
Sep 07 16:56:48.572501 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.569847    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d92ac6a3-1ea8-4de3-ac1a-45583a6139d9-konnectivity-ca\") pod \"konnectivity-agent-6l488\" (UID: \"d92ac6a3-1ea8-4de3-ac1a-45583a6139d9\") " pod="kube-system/konnectivity-agent-6l488"
Sep 07 16:56:48.572501 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.570105    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ae3e5a16-c599-4170-955b-4873224a7a20-ovnkube-script-lib\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.574385 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.574221    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ae3e5a16-c599-4170-955b-4873224a7a20-ovn-node-metrics-cert\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.574499 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.574242    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d92ac6a3-1ea8-4de3-ac1a-45583a6139d9-agent-certs\") pod \"konnectivity-agent-6l488\" (UID: \"d92ac6a3-1ea8-4de3-ac1a-45583a6139d9\") " pod="kube-system/konnectivity-agent-6l488"
Sep 07 16:56:48.582648 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.582622    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjdld\" (UniqueName: \"kubernetes.io/projected/9a404e8e-ae1c-4d06-a909-da73d9c8e229-kube-api-access-gjdld\") pod \"aws-ebs-csi-driver-node-ztgrq\" (UID: \"9a404e8e-ae1c-4d06-a909-da73d9c8e229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztgrq"
Sep 07 16:56:48.583929 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.583906    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ctm8\" (UniqueName: \"kubernetes.io/projected/ae3e5a16-c599-4170-955b-4873224a7a20-kube-api-access-9ctm8\") pod \"ovnkube-node-nk6rv\" (UID: \"ae3e5a16-c599-4170-955b-4873224a7a20\") " pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.586299 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.586275    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsxtm\" (UniqueName: \"kubernetes.io/projected/c5e9c92f-1d92-4194-a20a-59963361fc54-kube-api-access-tsxtm\") pod \"node-ca-8ljh2\" (UID: \"c5e9c92f-1d92-4194-a20a-59963361fc54\") " pod="openshift-image-registry/node-ca-8ljh2"
Sep 07 16:56:48.587529 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.587505    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttxvk\" (UniqueName: \"kubernetes.io/projected/9333441c-26d5-460b-b1d3-67eec0f25fd2-kube-api-access-ttxvk\") pod \"iptables-alerter-ckwp5\" (UID: \"9333441c-26d5-460b-b1d3-67eec0f25fd2\") " pod="openshift-network-operator/iptables-alerter-ckwp5"
Sep 07 16:56:48.652333 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.652285    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4pk9w"
Sep 07 16:56:48.669832 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.669800    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-multus-conf-dir\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.670033 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.669847    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ht47\" (UniqueName: \"kubernetes.io/projected/ba783056-dec5-4200-8726-97d3b462d24d-kube-api-access-7ht47\") pod \"network-metrics-daemon-nplbv\" (UID: \"ba783056-dec5-4200-8726-97d3b462d24d\") " pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:56:48.670033 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.669875    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p497x\" (UniqueName: \"kubernetes.io/projected/9cfc15e5-2d9e-4cae-8db0-90217597de62-kube-api-access-p497x\") pod \"multus-additional-cni-plugins-dsqc5\" (UID: \"9cfc15e5-2d9e-4cae-8db0-90217597de62\") " pod="openshift-multus/multus-additional-cni-plugins-dsqc5"
Sep 07 16:56:48.670033 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.669895    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-multus-conf-dir\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.670033 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.669941    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-etc-modprobe-d\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.670033 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.669969    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-host-run-multus-certs\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.670033 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670008    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-var-lib-kubelet\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.670033 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670034    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-etc-kubernetes\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.670413 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670056    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dba09c25-46b0-41d1-a3e1-5c3a5f890073-tmp\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.670413 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670080    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78vd8\" (UniqueName: \"kubernetes.io/projected/dba09c25-46b0-41d1-a3e1-5c3a5f890073-kube-api-access-78vd8\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.670413 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670101    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-etc-modprobe-d\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.670413 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670154    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-var-lib-kubelet\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.670413 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670206    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-host-run-multus-certs\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.670413 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670209    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-etc-kubernetes\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.670413 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670282    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/31e4fa90-9ec4-44e9-96bd-fe0af3224338-multus-daemon-config\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.670413 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670314    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k82f4\" (UniqueName: \"kubernetes.io/projected/31e4fa90-9ec4-44e9-96bd-fe0af3224338-kube-api-access-k82f4\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.670413 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670345    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/490233b3-f4ff-4a5c-818b-6f1f6069f818-hosts-file\") pod \"node-resolver-dpb4t\" (UID: \"490233b3-f4ff-4a5c-818b-6f1f6069f818\") " pod="openshift-dns/node-resolver-dpb4t"
Sep 07 16:56:48.670413 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670395    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4pk9w"
Sep 07 16:56:48.670413 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670386    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9cfc15e5-2d9e-4cae-8db0-90217597de62-system-cni-dir\") pod \"multus-additional-cni-plugins-dsqc5\" (UID: \"9cfc15e5-2d9e-4cae-8db0-90217597de62\") " pod="openshift-multus/multus-additional-cni-plugins-dsqc5"
Sep 07 16:56:48.670941 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670450    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxd6h\" (UniqueName: \"kubernetes.io/projected/490233b3-f4ff-4a5c-818b-6f1f6069f818-kube-api-access-sxd6h\") pod \"node-resolver-dpb4t\" (UID: \"490233b3-f4ff-4a5c-818b-6f1f6069f818\") " pod="openshift-dns/node-resolver-dpb4t"
Sep 07 16:56:48.670941 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670479    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-host\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.670941 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670508    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba783056-dec5-4200-8726-97d3b462d24d-metrics-certs\") pod \"network-metrics-daemon-nplbv\" (UID: \"ba783056-dec5-4200-8726-97d3b462d24d\") " pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:56:48.670941 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670537    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f6ab0a94-0f1c-496c-9072-1c50fcbcfadc-kubelet-config\") pod \"global-pull-secret-syncer-g54wv\" (UID: \"f6ab0a94-0f1c-496c-9072-1c50fcbcfadc\") " pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:56:48.670941 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670573    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9cfc15e5-2d9e-4cae-8db0-90217597de62-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dsqc5\" (UID: \"9cfc15e5-2d9e-4cae-8db0-90217597de62\") " pod="openshift-multus/multus-additional-cni-plugins-dsqc5"
Sep 07 16:56:48.670941 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670602    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dba09c25-46b0-41d1-a3e1-5c3a5f890073-etc-tuned\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.670941 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670630    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9cfc15e5-2d9e-4cae-8db0-90217597de62-cni-binary-copy\") pod \"multus-additional-cni-plugins-dsqc5\" (UID: \"9cfc15e5-2d9e-4cae-8db0-90217597de62\") " pod="openshift-multus/multus-additional-cni-plugins-dsqc5"
Sep 07 16:56:48.670941 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670661    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f6ab0a94-0f1c-496c-9072-1c50fcbcfadc-dbus\") pod \"global-pull-secret-syncer-g54wv\" (UID: \"f6ab0a94-0f1c-496c-9072-1c50fcbcfadc\") " pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:56:48.670941 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670688    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-etc-sysctl-d\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.670941 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670703    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-host\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.670941 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670712    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-sys\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.670941 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670751    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-host-run-k8s-cni-cncf-io\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.670941 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670775    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-sys\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.670941 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670782    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/490233b3-f4ff-4a5c-818b-6f1f6069f818-tmp-dir\") pod \"node-resolver-dpb4t\" (UID: \"490233b3-f4ff-4a5c-818b-6f1f6069f818\") " pod="openshift-dns/node-resolver-dpb4t"
Sep 07 16:56:48.670941 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670808    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9cfc15e5-2d9e-4cae-8db0-90217597de62-cnibin\") pod \"multus-additional-cni-plugins-dsqc5\" (UID: \"9cfc15e5-2d9e-4cae-8db0-90217597de62\") " pod="openshift-multus/multus-additional-cni-plugins-dsqc5"
Sep 07 16:56:48.670941 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670832    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-etc-systemd\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.670941 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670855    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/31e4fa90-9ec4-44e9-96bd-fe0af3224338-cni-binary-copy\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.670941 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:48.670870    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:48.671710 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670883    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-host-run-netns\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.671710 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670912    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6ab0a94-0f1c-496c-9072-1c50fcbcfadc-original-pull-secret\") pod \"global-pull-secret-syncer-g54wv\" (UID: \"f6ab0a94-0f1c-496c-9072-1c50fcbcfadc\") " pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:56:48.671710 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:48.670967    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba783056-dec5-4200-8726-97d3b462d24d-metrics-certs podName:ba783056-dec5-4200-8726-97d3b462d24d nodeName:}" failed. No retries permitted until 2026-09-07 16:56:49.170914418 +0000 UTC m=+3.067761728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba783056-dec5-4200-8726-97d3b462d24d-metrics-certs") pod "network-metrics-daemon-nplbv" (UID: "ba783056-dec5-4200-8726-97d3b462d24d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:48.671710 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670992    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-etc-sysconfig\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.671710 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.671011    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-etc-kubernetes\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.671710 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:48.671018    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:48.671710 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.671029    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9cfc15e5-2d9e-4cae-8db0-90217597de62-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dsqc5\" (UID: \"9cfc15e5-2d9e-4cae-8db0-90217597de62\") " pod="openshift-multus/multus-additional-cni-plugins-dsqc5"
Sep 07 16:56:48.671710 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.671048    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-system-cni-dir\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.671710 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.671063    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-cnibin\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.671710 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:48.671089    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6ab0a94-0f1c-496c-9072-1c50fcbcfadc-original-pull-secret podName:f6ab0a94-0f1c-496c-9072-1c50fcbcfadc nodeName:}" failed. No retries permitted until 2026-09-07 16:56:49.171071073 +0000 UTC m=+3.067918376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6ab0a94-0f1c-496c-9072-1c50fcbcfadc-original-pull-secret") pod "global-pull-secret-syncer-g54wv" (UID: "f6ab0a94-0f1c-496c-9072-1c50fcbcfadc") : object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:48.671710 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.671106    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-cnibin\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.671710 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.671111    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-multus-socket-dir-parent\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.671710 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.671144    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d4x4\" (UniqueName: \"kubernetes.io/projected/363e1dc1-6917-4e79-a2ea-024497e43a3a-kube-api-access-4d4x4\") pod \"network-check-target-g2l8w\" (UID: \"363e1dc1-6917-4e79-a2ea-024497e43a3a\") " pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:56:48.671710 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.671176    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-etc-sysctl-conf\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.671710 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.671194    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/490233b3-f4ff-4a5c-818b-6f1f6069f818-tmp-dir\") pod \"node-resolver-dpb4t\" (UID: \"490233b3-f4ff-4a5c-818b-6f1f6069f818\") " pod="openshift-dns/node-resolver-dpb4t"
Sep 07 16:56:48.671710 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.671202    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-run\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.672568 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.671234    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-hostroot\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.672568 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.671263    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9cfc15e5-2d9e-4cae-8db0-90217597de62-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dsqc5\" (UID: \"9cfc15e5-2d9e-4cae-8db0-90217597de62\") " pod="openshift-multus/multus-additional-cni-plugins-dsqc5"
Sep 07 16:56:48.672568 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.671297    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-multus-cni-dir\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.672568 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.671295    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/490233b3-f4ff-4a5c-818b-6f1f6069f818-hosts-file\") pod \"node-resolver-dpb4t\" (UID: \"490233b3-f4ff-4a5c-818b-6f1f6069f818\") " pod="openshift-dns/node-resolver-dpb4t"
Sep 07 16:56:48.672568 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.671330    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-host-var-lib-cni-bin\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.672568 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.671361    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-lib-modules\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.672568 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.671373    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9cfc15e5-2d9e-4cae-8db0-90217597de62-cnibin\") pod \"multus-additional-cni-plugins-dsqc5\" (UID: \"9cfc15e5-2d9e-4cae-8db0-90217597de62\") " pod="openshift-multus/multus-additional-cni-plugins-dsqc5"
Sep 07 16:56:48.672568 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.671386    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-host-var-lib-cni-multus\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.672568 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.671411    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-host-var-lib-kubelet\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.672568 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.671425    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-etc-systemd\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.672568 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.671460    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9cfc15e5-2d9e-4cae-8db0-90217597de62-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dsqc5\" (UID: \"9cfc15e5-2d9e-4cae-8db0-90217597de62\") " pod="openshift-multus/multus-additional-cni-plugins-dsqc5"
Sep 07 16:56:48.672568 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.671500    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-host-run-netns\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.672568 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.670885    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/31e4fa90-9ec4-44e9-96bd-fe0af3224338-multus-daemon-config\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.672568 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.671551    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-etc-sysconfig\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.672568 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.671598    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9cfc15e5-2d9e-4cae-8db0-90217597de62-cni-binary-copy\") pod \"multus-additional-cni-plugins-dsqc5\" (UID: \"9cfc15e5-2d9e-4cae-8db0-90217597de62\") " pod="openshift-multus/multus-additional-cni-plugins-dsqc5"
Sep 07 16:56:48.672568 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.671643    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-etc-kubernetes\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.672568 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.671746    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f6ab0a94-0f1c-496c-9072-1c50fcbcfadc-dbus\") pod \"global-pull-secret-syncer-g54wv\" (UID: \"f6ab0a94-0f1c-496c-9072-1c50fcbcfadc\") " pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:56:48.672568 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.671830    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-etc-sysctl-d\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.673469 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.671968    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9cfc15e5-2d9e-4cae-8db0-90217597de62-system-cni-dir\") pod \"multus-additional-cni-plugins-dsqc5\" (UID: \"9cfc15e5-2d9e-4cae-8db0-90217597de62\") " pod="openshift-multus/multus-additional-cni-plugins-dsqc5"
Sep 07 16:56:48.673469 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.672058    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-host-var-lib-cni-bin\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.673469 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.672069    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-host-var-lib-cni-multus\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.673469 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.672130    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-multus-cni-dir\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.673469 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.672158    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9cfc15e5-2d9e-4cae-8db0-90217597de62-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dsqc5\" (UID: \"9cfc15e5-2d9e-4cae-8db0-90217597de62\") " pod="openshift-multus/multus-additional-cni-plugins-dsqc5"
Sep 07 16:56:48.673469 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.672181    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-lib-modules\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.673469 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.672204    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9cfc15e5-2d9e-4cae-8db0-90217597de62-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dsqc5\" (UID: \"9cfc15e5-2d9e-4cae-8db0-90217597de62\") " pod="openshift-multus/multus-additional-cni-plugins-dsqc5"
Sep 07 16:56:48.673469 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.672211    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-run\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.673469 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.672232    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/31e4fa90-9ec4-44e9-96bd-fe0af3224338-cni-binary-copy\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.673469 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.672239    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-multus-socket-dir-parent\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.673469 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.672243    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-hostroot\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.673469 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.672265    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dba09c25-46b0-41d1-a3e1-5c3a5f890073-etc-sysctl-conf\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.673469 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.672302    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-system-cni-dir\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.673469 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.672307    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-host-var-lib-kubelet\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.673469 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.672334    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/31e4fa90-9ec4-44e9-96bd-fe0af3224338-host-run-k8s-cni-cncf-io\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.673469 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.672385    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f6ab0a94-0f1c-496c-9072-1c50fcbcfadc-kubelet-config\") pod \"global-pull-secret-syncer-g54wv\" (UID: \"f6ab0a94-0f1c-496c-9072-1c50fcbcfadc\") " pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:56:48.673469 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.673388    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dba09c25-46b0-41d1-a3e1-5c3a5f890073-tmp\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.674829 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.674806    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dba09c25-46b0-41d1-a3e1-5c3a5f890073-etc-tuned\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.698418 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:48.698132    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 16:56:48.698418 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:48.698160    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 16:56:48.698418 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:48.698176    2575 projected.go:196] Error preparing data for projected volume kube-api-access-4d4x4 for pod openshift-network-diagnostics/network-check-target-g2l8w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:48.698418 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:48.698260    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/363e1dc1-6917-4e79-a2ea-024497e43a3a-kube-api-access-4d4x4 podName:363e1dc1-6917-4e79-a2ea-024497e43a3a nodeName:}" failed. No retries permitted until 2026-09-07 16:56:49.198237013 +0000 UTC m=+3.095084328 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4d4x4" (UniqueName: "kubernetes.io/projected/363e1dc1-6917-4e79-a2ea-024497e43a3a-kube-api-access-4d4x4") pod "network-check-target-g2l8w" (UID: "363e1dc1-6917-4e79-a2ea-024497e43a3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:48.699335 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.699271    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ht47\" (UniqueName: \"kubernetes.io/projected/ba783056-dec5-4200-8726-97d3b462d24d-kube-api-access-7ht47\") pod \"network-metrics-daemon-nplbv\" (UID: \"ba783056-dec5-4200-8726-97d3b462d24d\") " pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:56:48.699559 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.699537    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxd6h\" (UniqueName: \"kubernetes.io/projected/490233b3-f4ff-4a5c-818b-6f1f6069f818-kube-api-access-sxd6h\") pod \"node-resolver-dpb4t\" (UID: \"490233b3-f4ff-4a5c-818b-6f1f6069f818\") " pod="openshift-dns/node-resolver-dpb4t"
Sep 07 16:56:48.700807 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.700780    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78vd8\" (UniqueName: \"kubernetes.io/projected/dba09c25-46b0-41d1-a3e1-5c3a5f890073-kube-api-access-78vd8\") pod \"tuned-xqpnt\" (UID: \"dba09c25-46b0-41d1-a3e1-5c3a5f890073\") " pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.702298 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.702275    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p497x\" (UniqueName: \"kubernetes.io/projected/9cfc15e5-2d9e-4cae-8db0-90217597de62-kube-api-access-p497x\") pod \"multus-additional-cni-plugins-dsqc5\" (UID: \"9cfc15e5-2d9e-4cae-8db0-90217597de62\") " pod="openshift-multus/multus-additional-cni-plugins-dsqc5"
Sep 07 16:56:48.703340 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.703320    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k82f4\" (UniqueName: \"kubernetes.io/projected/31e4fa90-9ec4-44e9-96bd-fe0af3224338-kube-api-access-k82f4\") pod \"multus-rzhjh\" (UID: \"31e4fa90-9ec4-44e9-96bd-fe0af3224338\") " pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.720992 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.720931    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal" event={"ID":"9ada7fdc5275d075f26246dd3a510397","Type":"ContainerStarted","Data":"6840c90e348e975705de446930995dd3b19988b178f12aad990fc2d099fa7f29"}
Sep 07 16:56:48.722346 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.722319    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-3.ec2.internal" event={"ID":"1f6bdbab6cf05f88305dbbed7f882a37","Type":"ContainerStarted","Data":"cc8b73c940eaa39069c4f511df472b0fd28760d8b67020dc05eb6aefb31f46b4"}
Sep 07 16:56:48.760233 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.760205    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8ljh2"
Sep 07 16:56:48.770301 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.770276    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ckwp5"
Sep 07 16:56:48.782418 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.782396    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:56:48.789391 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.789371    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6l488"
Sep 07 16:56:48.799176 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.799157    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztgrq"
Sep 07 16:56:48.809904 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.809869    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dpb4t"
Sep 07 16:56:48.821683 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.821653    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dsqc5"
Sep 07 16:56:48.835960 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.835939    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xqpnt"
Sep 07 16:56:48.842785 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.842760    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rzhjh"
Sep 07 16:56:48.868274 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:48.868242    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 16:56:49.174821 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:49.174718    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6ab0a94-0f1c-496c-9072-1c50fcbcfadc-original-pull-secret\") pod \"global-pull-secret-syncer-g54wv\" (UID: \"f6ab0a94-0f1c-496c-9072-1c50fcbcfadc\") " pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:56:49.174990 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:49.174822    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba783056-dec5-4200-8726-97d3b462d24d-metrics-certs\") pod \"network-metrics-daemon-nplbv\" (UID: \"ba783056-dec5-4200-8726-97d3b462d24d\") " pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:56:49.174990 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:49.174915    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:49.174990 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:49.174962    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:49.175126 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:49.174996    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6ab0a94-0f1c-496c-9072-1c50fcbcfadc-original-pull-secret podName:f6ab0a94-0f1c-496c-9072-1c50fcbcfadc nodeName:}" failed. No retries permitted until 2026-09-07 16:56:50.174979577 +0000 UTC m=+4.071826871 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6ab0a94-0f1c-496c-9072-1c50fcbcfadc-original-pull-secret") pod "global-pull-secret-syncer-g54wv" (UID: "f6ab0a94-0f1c-496c-9072-1c50fcbcfadc") : object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:49.175126 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:49.175021    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba783056-dec5-4200-8726-97d3b462d24d-metrics-certs podName:ba783056-dec5-4200-8726-97d3b462d24d nodeName:}" failed. No retries permitted until 2026-09-07 16:56:50.17500394 +0000 UTC m=+4.071851237 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba783056-dec5-4200-8726-97d3b462d24d-metrics-certs") pod "network-metrics-daemon-nplbv" (UID: "ba783056-dec5-4200-8726-97d3b462d24d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:49.275539 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:49.275502    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d4x4\" (UniqueName: \"kubernetes.io/projected/363e1dc1-6917-4e79-a2ea-024497e43a3a-kube-api-access-4d4x4\") pod \"network-check-target-g2l8w\" (UID: \"363e1dc1-6917-4e79-a2ea-024497e43a3a\") " pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:56:49.275744 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:49.275667    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 16:56:49.275744 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:49.275687    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 16:56:49.275744 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:49.275701    2575 projected.go:196] Error preparing data for projected volume kube-api-access-4d4x4 for pod openshift-network-diagnostics/network-check-target-g2l8w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:49.275875 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:49.275765    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/363e1dc1-6917-4e79-a2ea-024497e43a3a-kube-api-access-4d4x4 podName:363e1dc1-6917-4e79-a2ea-024497e43a3a nodeName:}" failed. No retries permitted until 2026-09-07 16:56:50.275745706 +0000 UTC m=+4.172593017 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4d4x4" (UniqueName: "kubernetes.io/projected/363e1dc1-6917-4e79-a2ea-024497e43a3a-kube-api-access-4d4x4") pod "network-check-target-g2l8w" (UID: "363e1dc1-6917-4e79-a2ea-024497e43a3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:49.675027 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:49.674984    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 16:51:49 +0000 UTC" deadline="2028-02-27 12:16:50.87042314 +0000 UTC"
Sep 07 16:56:49.675027 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:49.675026    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12907h20m1.195401448s"
Sep 07 16:56:49.716588 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:49.716554    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:56:49.716734 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:49.716554    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:56:49.716734 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:49.716692    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nplbv" podUID="ba783056-dec5-4200-8726-97d3b462d24d"
Sep 07 16:56:49.716804 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:49.716730    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2l8w" podUID="363e1dc1-6917-4e79-a2ea-024497e43a3a"
Sep 07 16:56:49.773992 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:49.773949    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31e4fa90_9ec4_44e9_96bd_fe0af3224338.slice/crio-cd1e7a0dd8781517fce1658e84dd6a0ff36640a316d38821fc9bbc122dda569b WatchSource:0}: Error finding container cd1e7a0dd8781517fce1658e84dd6a0ff36640a316d38821fc9bbc122dda569b: Status 404 returned error can't find the container with id cd1e7a0dd8781517fce1658e84dd6a0ff36640a316d38821fc9bbc122dda569b
Sep 07 16:56:49.774454 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:49.774402    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd92ac6a3_1ea8_4de3_ac1a_45583a6139d9.slice/crio-5287d7607cbb27ef43bf2389d922da52a919e6ab2407e27757c3f2670e54c6b2 WatchSource:0}: Error finding container 5287d7607cbb27ef43bf2389d922da52a919e6ab2407e27757c3f2670e54c6b2: Status 404 returned error can't find the container with id 5287d7607cbb27ef43bf2389d922da52a919e6ab2407e27757c3f2670e54c6b2
Sep 07 16:56:49.776687 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:49.776597    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod490233b3_f4ff_4a5c_818b_6f1f6069f818.slice/crio-215b3f33bb795934efaf3f12c19c21ec652940dfa6a4d139e95644ee578547a2 WatchSource:0}: Error finding container 215b3f33bb795934efaf3f12c19c21ec652940dfa6a4d139e95644ee578547a2: Status 404 returned error can't find the container with id 215b3f33bb795934efaf3f12c19c21ec652940dfa6a4d139e95644ee578547a2
Sep 07 16:56:49.778712 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:49.778688    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae3e5a16_c599_4170_955b_4873224a7a20.slice/crio-fdfde2748dc86b7bf0ba121e0cb8af4b26d860682cda9c5f30d16805e6fa9afb WatchSource:0}: Error finding container fdfde2748dc86b7bf0ba121e0cb8af4b26d860682cda9c5f30d16805e6fa9afb: Status 404 returned error can't find the container with id fdfde2748dc86b7bf0ba121e0cb8af4b26d860682cda9c5f30d16805e6fa9afb
Sep 07 16:56:49.784929 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:49.784904    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5e9c92f_1d92_4194_a20a_59963361fc54.slice/crio-80c6722f464a3e23c53ef5491c1ab18cbd2107fc4f1e2b17ff5aaaa642ff5e79 WatchSource:0}: Error finding container 80c6722f464a3e23c53ef5491c1ab18cbd2107fc4f1e2b17ff5aaaa642ff5e79: Status 404 returned error can't find the container with id 80c6722f464a3e23c53ef5491c1ab18cbd2107fc4f1e2b17ff5aaaa642ff5e79
Sep 07 16:56:49.785507 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:49.785480    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cfc15e5_2d9e_4cae_8db0_90217597de62.slice/crio-364a8f62d4b40c990a1d6ae7fb42768e4c52be88b042ec89bde1f8ad77868bc8 WatchSource:0}: Error finding container 364a8f62d4b40c990a1d6ae7fb42768e4c52be88b042ec89bde1f8ad77868bc8: Status 404 returned error can't find the container with id 364a8f62d4b40c990a1d6ae7fb42768e4c52be88b042ec89bde1f8ad77868bc8
Sep 07 16:56:49.785755 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:49.785731    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddba09c25_46b0_41d1_a3e1_5c3a5f890073.slice/crio-a436274b929d7b5fa88655d4211552db527d3ca992948b400091c1326f3029b7 WatchSource:0}: Error finding container a436274b929d7b5fa88655d4211552db527d3ca992948b400091c1326f3029b7: Status 404 returned error can't find the container with id a436274b929d7b5fa88655d4211552db527d3ca992948b400091c1326f3029b7
Sep 07 16:56:49.787712 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:49.787322    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a404e8e_ae1c_4d06_a909_da73d9c8e229.slice/crio-9c80a19abc009bc9c06c56be0f12f89e58ed2c1130e453809c12ffd4dcf48c11 WatchSource:0}: Error finding container 9c80a19abc009bc9c06c56be0f12f89e58ed2c1130e453809c12ffd4dcf48c11: Status 404 returned error can't find the container with id 9c80a19abc009bc9c06c56be0f12f89e58ed2c1130e453809c12ffd4dcf48c11
Sep 07 16:56:49.788887 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:56:49.788859    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9333441c_26d5_460b_b1d3_67eec0f25fd2.slice/crio-e1656444b8866ee6f57e8129a2d5e96ca2909ff0eb514866c3345f398bd4e3a4 WatchSource:0}: Error finding container e1656444b8866ee6f57e8129a2d5e96ca2909ff0eb514866c3345f398bd4e3a4: Status 404 returned error can't find the container with id e1656444b8866ee6f57e8129a2d5e96ca2909ff0eb514866c3345f398bd4e3a4
Sep 07 16:56:50.183275 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:50.183230    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6ab0a94-0f1c-496c-9072-1c50fcbcfadc-original-pull-secret\") pod \"global-pull-secret-syncer-g54wv\" (UID: \"f6ab0a94-0f1c-496c-9072-1c50fcbcfadc\") " pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:56:50.183465 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:50.183344    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba783056-dec5-4200-8726-97d3b462d24d-metrics-certs\") pod \"network-metrics-daemon-nplbv\" (UID: \"ba783056-dec5-4200-8726-97d3b462d24d\") " pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:56:50.183552 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:50.183486    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:50.183616 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:50.183577    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba783056-dec5-4200-8726-97d3b462d24d-metrics-certs podName:ba783056-dec5-4200-8726-97d3b462d24d nodeName:}" failed. No retries permitted until 2026-09-07 16:56:52.183534969 +0000 UTC m=+6.080382284 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba783056-dec5-4200-8726-97d3b462d24d-metrics-certs") pod "network-metrics-daemon-nplbv" (UID: "ba783056-dec5-4200-8726-97d3b462d24d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:50.183887 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:50.183857    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:50.183992 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:50.183953    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6ab0a94-0f1c-496c-9072-1c50fcbcfadc-original-pull-secret podName:f6ab0a94-0f1c-496c-9072-1c50fcbcfadc nodeName:}" failed. No retries permitted until 2026-09-07 16:56:52.183914012 +0000 UTC m=+6.080761311 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6ab0a94-0f1c-496c-9072-1c50fcbcfadc-original-pull-secret") pod "global-pull-secret-syncer-g54wv" (UID: "f6ab0a94-0f1c-496c-9072-1c50fcbcfadc") : object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:50.285048 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:50.284335    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d4x4\" (UniqueName: \"kubernetes.io/projected/363e1dc1-6917-4e79-a2ea-024497e43a3a-kube-api-access-4d4x4\") pod \"network-check-target-g2l8w\" (UID: \"363e1dc1-6917-4e79-a2ea-024497e43a3a\") " pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:56:50.285048 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:50.284526    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 16:56:50.285048 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:50.284546    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 16:56:50.285048 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:50.284559    2575 projected.go:196] Error preparing data for projected volume kube-api-access-4d4x4 for pod openshift-network-diagnostics/network-check-target-g2l8w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:50.285048 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:50.284615    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/363e1dc1-6917-4e79-a2ea-024497e43a3a-kube-api-access-4d4x4 podName:363e1dc1-6917-4e79-a2ea-024497e43a3a nodeName:}" failed. No retries permitted until 2026-09-07 16:56:52.284597433 +0000 UTC m=+6.181444752 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4d4x4" (UniqueName: "kubernetes.io/projected/363e1dc1-6917-4e79-a2ea-024497e43a3a-kube-api-access-4d4x4") pod "network-check-target-g2l8w" (UID: "363e1dc1-6917-4e79-a2ea-024497e43a3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:50.676615 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:50.676526    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 16:51:49 +0000 UTC" deadline="2028-05-11 08:57:53.964060697 +0000 UTC"
Sep 07 16:56:50.676615 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:50.676571    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14680h1m3.287494738s"
Sep 07 16:56:50.719543 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:50.719002    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:56:50.719543 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:50.719154    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g54wv" podUID="f6ab0a94-0f1c-496c-9072-1c50fcbcfadc"
Sep 07 16:56:50.739321 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:50.739233    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztgrq" event={"ID":"9a404e8e-ae1c-4d06-a909-da73d9c8e229","Type":"ContainerStarted","Data":"9c80a19abc009bc9c06c56be0f12f89e58ed2c1130e453809c12ffd4dcf48c11"}
Sep 07 16:56:50.741484 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:50.741402    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ckwp5" event={"ID":"9333441c-26d5-460b-b1d3-67eec0f25fd2","Type":"ContainerStarted","Data":"e1656444b8866ee6f57e8129a2d5e96ca2909ff0eb514866c3345f398bd4e3a4"}
Sep 07 16:56:50.751039 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:50.750979    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dsqc5" event={"ID":"9cfc15e5-2d9e-4cae-8db0-90217597de62","Type":"ContainerStarted","Data":"364a8f62d4b40c990a1d6ae7fb42768e4c52be88b042ec89bde1f8ad77868bc8"}
Sep 07 16:56:50.760320 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:50.760283    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv" event={"ID":"ae3e5a16-c599-4170-955b-4873224a7a20","Type":"ContainerStarted","Data":"fdfde2748dc86b7bf0ba121e0cb8af4b26d860682cda9c5f30d16805e6fa9afb"}
Sep 07 16:56:50.768319 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:50.768219    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dpb4t" event={"ID":"490233b3-f4ff-4a5c-818b-6f1f6069f818","Type":"ContainerStarted","Data":"215b3f33bb795934efaf3f12c19c21ec652940dfa6a4d139e95644ee578547a2"}
Sep 07 16:56:50.785218 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:50.785178    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rzhjh" event={"ID":"31e4fa90-9ec4-44e9-96bd-fe0af3224338","Type":"ContainerStarted","Data":"cd1e7a0dd8781517fce1658e84dd6a0ff36640a316d38821fc9bbc122dda569b"}
Sep 07 16:56:50.796540 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:50.796430    2575 generic.go:356] "Generic (PLEG): container finished" podID="9ada7fdc5275d075f26246dd3a510397" containerID="fc59ced49ce712aa06b6e4f94349e182b91cd60cd391d62f5ea9f48e13459a8d" exitCode=0
Sep 07 16:56:50.796712 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:50.796540    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal" event={"ID":"9ada7fdc5275d075f26246dd3a510397","Type":"ContainerDied","Data":"fc59ced49ce712aa06b6e4f94349e182b91cd60cd391d62f5ea9f48e13459a8d"}
Sep 07 16:56:50.819561 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:50.819528    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-3.ec2.internal" event={"ID":"1f6bdbab6cf05f88305dbbed7f882a37","Type":"ContainerStarted","Data":"5ea8ade90368f2ac46641bd7c0587f33e831c261220a31e4cb9a0e15df0d5bde"}
Sep 07 16:56:50.844466 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:50.844372    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xqpnt" event={"ID":"dba09c25-46b0-41d1-a3e1-5c3a5f890073","Type":"ContainerStarted","Data":"a436274b929d7b5fa88655d4211552db527d3ca992948b400091c1326f3029b7"}
Sep 07 16:56:50.861392 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:50.861295    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8ljh2" event={"ID":"c5e9c92f-1d92-4194-a20a-59963361fc54","Type":"ContainerStarted","Data":"80c6722f464a3e23c53ef5491c1ab18cbd2107fc4f1e2b17ff5aaaa642ff5e79"}
Sep 07 16:56:50.871174 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:50.871139    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6l488" event={"ID":"d92ac6a3-1ea8-4de3-ac1a-45583a6139d9","Type":"ContainerStarted","Data":"5287d7607cbb27ef43bf2389d922da52a919e6ab2407e27757c3f2670e54c6b2"}
Sep 07 16:56:51.716041 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:51.715943    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:56:51.716523 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:51.716116    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nplbv" podUID="ba783056-dec5-4200-8726-97d3b462d24d"
Sep 07 16:56:51.716586 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:51.716534    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:56:51.716643 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:51.716628    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2l8w" podUID="363e1dc1-6917-4e79-a2ea-024497e43a3a"
Sep 07 16:56:51.883794 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:51.883718    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal" event={"ID":"9ada7fdc5275d075f26246dd3a510397","Type":"ContainerStarted","Data":"601cf49e083be3e8e9111227308e665c38c805bd19846b91e4745fc7f68ca42f"}
Sep 07 16:56:51.923348 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:51.923043    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal" podStartSLOduration=3.9230211710000003 podStartE2EDuration="3.923021171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:56:51.918774897 +0000 UTC m=+5.815622216" watchObservedRunningTime="2026-09-07 16:56:51.923021171 +0000 UTC m=+5.819868490"
Sep 07 16:56:51.923711 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:51.923674    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-3.ec2.internal" podStartSLOduration=3.923662128 podStartE2EDuration="3.923662128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:56:50.876212639 +0000 UTC m=+4.773059959" watchObservedRunningTime="2026-09-07 16:56:51.923662128 +0000 UTC m=+5.820509448"
Sep 07 16:56:52.201483 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:52.201343    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6ab0a94-0f1c-496c-9072-1c50fcbcfadc-original-pull-secret\") pod \"global-pull-secret-syncer-g54wv\" (UID: \"f6ab0a94-0f1c-496c-9072-1c50fcbcfadc\") " pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:56:52.201483 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:52.201448    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba783056-dec5-4200-8726-97d3b462d24d-metrics-certs\") pod \"network-metrics-daemon-nplbv\" (UID: \"ba783056-dec5-4200-8726-97d3b462d24d\") " pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:56:52.201727 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:52.201587    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:52.201727 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:52.201653    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba783056-dec5-4200-8726-97d3b462d24d-metrics-certs podName:ba783056-dec5-4200-8726-97d3b462d24d nodeName:}" failed. No retries permitted until 2026-09-07 16:56:56.201633196 +0000 UTC m=+10.098480505 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba783056-dec5-4200-8726-97d3b462d24d-metrics-certs") pod "network-metrics-daemon-nplbv" (UID: "ba783056-dec5-4200-8726-97d3b462d24d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:52.202088 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:52.202069    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:52.202169 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:52.202127    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6ab0a94-0f1c-496c-9072-1c50fcbcfadc-original-pull-secret podName:f6ab0a94-0f1c-496c-9072-1c50fcbcfadc nodeName:}" failed. No retries permitted until 2026-09-07 16:56:56.202111447 +0000 UTC m=+10.098958761 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6ab0a94-0f1c-496c-9072-1c50fcbcfadc-original-pull-secret") pod "global-pull-secret-syncer-g54wv" (UID: "f6ab0a94-0f1c-496c-9072-1c50fcbcfadc") : object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:52.302788 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:52.302745    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d4x4\" (UniqueName: \"kubernetes.io/projected/363e1dc1-6917-4e79-a2ea-024497e43a3a-kube-api-access-4d4x4\") pod \"network-check-target-g2l8w\" (UID: \"363e1dc1-6917-4e79-a2ea-024497e43a3a\") " pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:56:52.302988 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:52.302968    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 16:56:52.303075 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:52.302990    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 16:56:52.303075 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:52.303004    2575 projected.go:196] Error preparing data for projected volume kube-api-access-4d4x4 for pod openshift-network-diagnostics/network-check-target-g2l8w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:52.303075 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:52.303067    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/363e1dc1-6917-4e79-a2ea-024497e43a3a-kube-api-access-4d4x4 podName:363e1dc1-6917-4e79-a2ea-024497e43a3a nodeName:}" failed. No retries permitted until 2026-09-07 16:56:56.303047117 +0000 UTC m=+10.199894414 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4d4x4" (UniqueName: "kubernetes.io/projected/363e1dc1-6917-4e79-a2ea-024497e43a3a-kube-api-access-4d4x4") pod "network-check-target-g2l8w" (UID: "363e1dc1-6917-4e79-a2ea-024497e43a3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:52.717120 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:52.717089    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:56:52.717616 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:52.717238    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g54wv" podUID="f6ab0a94-0f1c-496c-9072-1c50fcbcfadc"
Sep 07 16:56:53.715736 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:53.715698    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:56:53.715946 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:53.715836    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2l8w" podUID="363e1dc1-6917-4e79-a2ea-024497e43a3a"
Sep 07 16:56:53.716418 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:53.716252    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:56:53.716418 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:53.716368    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nplbv" podUID="ba783056-dec5-4200-8726-97d3b462d24d"
Sep 07 16:56:54.718890 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:54.718851    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:56:54.719400 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:54.719030    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g54wv" podUID="f6ab0a94-0f1c-496c-9072-1c50fcbcfadc"
Sep 07 16:56:55.715931 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:55.715861    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:56:55.715931 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:55.715881    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:56:55.716174 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:55.716012    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nplbv" podUID="ba783056-dec5-4200-8726-97d3b462d24d"
Sep 07 16:56:55.716395 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:55.716369    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2l8w" podUID="363e1dc1-6917-4e79-a2ea-024497e43a3a"
Sep 07 16:56:56.235823 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:56.235782    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba783056-dec5-4200-8726-97d3b462d24d-metrics-certs\") pod \"network-metrics-daemon-nplbv\" (UID: \"ba783056-dec5-4200-8726-97d3b462d24d\") " pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:56:56.236300 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:56.235856    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6ab0a94-0f1c-496c-9072-1c50fcbcfadc-original-pull-secret\") pod \"global-pull-secret-syncer-g54wv\" (UID: \"f6ab0a94-0f1c-496c-9072-1c50fcbcfadc\") " pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:56:56.236300 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:56.236052    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:56.236300 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:56.236122    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6ab0a94-0f1c-496c-9072-1c50fcbcfadc-original-pull-secret podName:f6ab0a94-0f1c-496c-9072-1c50fcbcfadc nodeName:}" failed. No retries permitted until 2026-09-07 16:57:04.236101456 +0000 UTC m=+18.132948753 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6ab0a94-0f1c-496c-9072-1c50fcbcfadc-original-pull-secret") pod "global-pull-secret-syncer-g54wv" (UID: "f6ab0a94-0f1c-496c-9072-1c50fcbcfadc") : object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:56.236535 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:56.236504    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:56.236636 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:56.236619    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba783056-dec5-4200-8726-97d3b462d24d-metrics-certs podName:ba783056-dec5-4200-8726-97d3b462d24d nodeName:}" failed. No retries permitted until 2026-09-07 16:57:04.236603404 +0000 UTC m=+18.133450701 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba783056-dec5-4200-8726-97d3b462d24d-metrics-certs") pod "network-metrics-daemon-nplbv" (UID: "ba783056-dec5-4200-8726-97d3b462d24d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:56.336403 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:56.336322    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d4x4\" (UniqueName: \"kubernetes.io/projected/363e1dc1-6917-4e79-a2ea-024497e43a3a-kube-api-access-4d4x4\") pod \"network-check-target-g2l8w\" (UID: \"363e1dc1-6917-4e79-a2ea-024497e43a3a\") " pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:56:56.336614 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:56.336477    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 16:56:56.336614 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:56.336499    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 16:56:56.336614 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:56.336510    2575 projected.go:196] Error preparing data for projected volume kube-api-access-4d4x4 for pod openshift-network-diagnostics/network-check-target-g2l8w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:56.336614 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:56.336567    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/363e1dc1-6917-4e79-a2ea-024497e43a3a-kube-api-access-4d4x4 podName:363e1dc1-6917-4e79-a2ea-024497e43a3a nodeName:}" failed. No retries permitted until 2026-09-07 16:57:04.336548819 +0000 UTC m=+18.233396130 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4d4x4" (UniqueName: "kubernetes.io/projected/363e1dc1-6917-4e79-a2ea-024497e43a3a-kube-api-access-4d4x4") pod "network-check-target-g2l8w" (UID: "363e1dc1-6917-4e79-a2ea-024497e43a3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:56.716858 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:56.716391    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:56:56.716858 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:56.716503    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g54wv" podUID="f6ab0a94-0f1c-496c-9072-1c50fcbcfadc"
Sep 07 16:56:57.716245 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:57.715877    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:56:57.716245 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:57.715882    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:56:57.716245 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:57.716019    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2l8w" podUID="363e1dc1-6917-4e79-a2ea-024497e43a3a"
Sep 07 16:56:57.716245 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:57.716137    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nplbv" podUID="ba783056-dec5-4200-8726-97d3b462d24d"
Sep 07 16:56:58.715718 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:58.715688    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:56:58.715889 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:58.715819    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g54wv" podUID="f6ab0a94-0f1c-496c-9072-1c50fcbcfadc"
Sep 07 16:56:59.715850 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:59.715815    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:56:59.715850 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:56:59.715851    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:56:59.716329 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:59.715947    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2l8w" podUID="363e1dc1-6917-4e79-a2ea-024497e43a3a"
Sep 07 16:56:59.716329 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:56:59.716086    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nplbv" podUID="ba783056-dec5-4200-8726-97d3b462d24d"
Sep 07 16:57:00.716495 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:00.716406    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:57:00.716951 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:00.716523    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g54wv" podUID="f6ab0a94-0f1c-496c-9072-1c50fcbcfadc"
Sep 07 16:57:01.715523 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:01.715482    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:57:01.715692 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:01.715530    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:57:01.715692 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:01.715614    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nplbv" podUID="ba783056-dec5-4200-8726-97d3b462d24d"
Sep 07 16:57:01.715781 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:01.715747    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2l8w" podUID="363e1dc1-6917-4e79-a2ea-024497e43a3a"
Sep 07 16:57:02.716524 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:02.716492    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:57:02.717007 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:02.716625    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g54wv" podUID="f6ab0a94-0f1c-496c-9072-1c50fcbcfadc"
Sep 07 16:57:03.715975 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:03.715946    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:57:03.715975 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:03.715961    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:57:03.716223 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:03.716063    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2l8w" podUID="363e1dc1-6917-4e79-a2ea-024497e43a3a"
Sep 07 16:57:03.716223 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:03.716153    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nplbv" podUID="ba783056-dec5-4200-8726-97d3b462d24d"
Sep 07 16:57:04.296443 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:04.296406    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6ab0a94-0f1c-496c-9072-1c50fcbcfadc-original-pull-secret\") pod \"global-pull-secret-syncer-g54wv\" (UID: \"f6ab0a94-0f1c-496c-9072-1c50fcbcfadc\") " pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:57:04.296915 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:04.296496    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba783056-dec5-4200-8726-97d3b462d24d-metrics-certs\") pod \"network-metrics-daemon-nplbv\" (UID: \"ba783056-dec5-4200-8726-97d3b462d24d\") " pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:57:04.296915 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:04.296558    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 16:57:04.296915 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:04.296601    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:57:04.296915 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:04.296633    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6ab0a94-0f1c-496c-9072-1c50fcbcfadc-original-pull-secret podName:f6ab0a94-0f1c-496c-9072-1c50fcbcfadc nodeName:}" failed. No retries permitted until 2026-09-07 16:57:20.296611845 +0000 UTC m=+34.193459162 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6ab0a94-0f1c-496c-9072-1c50fcbcfadc-original-pull-secret") pod "global-pull-secret-syncer-g54wv" (UID: "f6ab0a94-0f1c-496c-9072-1c50fcbcfadc") : object "kube-system"/"original-pull-secret" not registered
Sep 07 16:57:04.296915 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:04.296653    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba783056-dec5-4200-8726-97d3b462d24d-metrics-certs podName:ba783056-dec5-4200-8726-97d3b462d24d nodeName:}" failed. No retries permitted until 2026-09-07 16:57:20.296643737 +0000 UTC m=+34.193491031 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba783056-dec5-4200-8726-97d3b462d24d-metrics-certs") pod "network-metrics-daemon-nplbv" (UID: "ba783056-dec5-4200-8726-97d3b462d24d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:57:04.397286 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:04.397239    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d4x4\" (UniqueName: \"kubernetes.io/projected/363e1dc1-6917-4e79-a2ea-024497e43a3a-kube-api-access-4d4x4\") pod \"network-check-target-g2l8w\" (UID: \"363e1dc1-6917-4e79-a2ea-024497e43a3a\") " pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:57:04.397454 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:04.397419    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 16:57:04.397454 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:04.397446    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 16:57:04.397575 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:04.397457    2575 projected.go:196] Error preparing data for projected volume kube-api-access-4d4x4 for pod openshift-network-diagnostics/network-check-target-g2l8w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:57:04.397575 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:04.397510    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/363e1dc1-6917-4e79-a2ea-024497e43a3a-kube-api-access-4d4x4 podName:363e1dc1-6917-4e79-a2ea-024497e43a3a nodeName:}" failed. No retries permitted until 2026-09-07 16:57:20.397497157 +0000 UTC m=+34.294344466 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4d4x4" (UniqueName: "kubernetes.io/projected/363e1dc1-6917-4e79-a2ea-024497e43a3a-kube-api-access-4d4x4") pod "network-check-target-g2l8w" (UID: "363e1dc1-6917-4e79-a2ea-024497e43a3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:57:04.716403 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:04.716328    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:57:04.716547 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:04.716472    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g54wv" podUID="f6ab0a94-0f1c-496c-9072-1c50fcbcfadc"
Sep 07 16:57:05.715785 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:05.715751    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:57:05.716257 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:05.715752    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:57:05.716257 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:05.715902    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2l8w" podUID="363e1dc1-6917-4e79-a2ea-024497e43a3a"
Sep 07 16:57:05.716257 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:05.716007    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nplbv" podUID="ba783056-dec5-4200-8726-97d3b462d24d"
Sep 07 16:57:06.716861 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:06.716826    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:57:06.717344 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:06.716949    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g54wv" podUID="f6ab0a94-0f1c-496c-9072-1c50fcbcfadc"
Sep 07 16:57:07.715726 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:07.715696    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:57:07.715882 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:07.715699    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:57:07.715882 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:07.715791    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2l8w" podUID="363e1dc1-6917-4e79-a2ea-024497e43a3a"
Sep 07 16:57:07.715882 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:07.715875    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nplbv" podUID="ba783056-dec5-4200-8726-97d3b462d24d"
Sep 07 16:57:07.923842 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:07.923200    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6l488" event={"ID":"d92ac6a3-1ea8-4de3-ac1a-45583a6139d9","Type":"ContainerStarted","Data":"0284688fb118e1176e4e71bbb9e30b6b11c5f096768043f9a0edf6d4c2e80844"}
Sep 07 16:57:07.932243 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:07.932171    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xqpnt" event={"ID":"dba09c25-46b0-41d1-a3e1-5c3a5f890073","Type":"ContainerStarted","Data":"8aae7e671bf4243641fe59da73ee7eb9ee7f7a4974ec402f0a543a3b8e29dd9b"}
Sep 07 16:57:07.968255 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:07.968163    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xqpnt" podStartSLOduration=2.971387479 podStartE2EDuration="20.968144674s" totalImagesPullingTime="17.996757195s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:07.96757309 +0000 UTC m=+21.864420409" watchObservedRunningTime="2026-09-07 16:57:07.968144674 +0000 UTC m=+21.864991991"
Sep 07 16:57:07.968671 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:07.968635    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6l488" podStartSLOduration=7.040077891 podStartE2EDuration="20.968625412s" totalImagesPullingTime="13.928547521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:07.944434355 +0000 UTC m=+21.841281672" watchObservedRunningTime="2026-09-07 16:57:07.968625412 +0000 UTC m=+21.865472728"
Sep 07 16:57:08.102350 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:08.102187    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6l488"
Sep 07 16:57:08.270012 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:08.269982    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:08.374020 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:08.373993    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:08.716217 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:08.716186    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:57:08.716393 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:08.716313    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g54wv" podUID="f6ab0a94-0f1c-496c-9072-1c50fcbcfadc"
Sep 07 16:57:08.841987 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:08.841944    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:08.935842 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:08.935811    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8ljh2" event={"ID":"c5e9c92f-1d92-4194-a20a-59963361fc54","Type":"ContainerStarted","Data":"432696fd74cddb4756916476cca199e7049dab4b430ce47f1d42b66903b7d125"}
Sep 07 16:57:08.937409 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:08.937382    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztgrq" event={"ID":"9a404e8e-ae1c-4d06-a909-da73d9c8e229","Type":"ContainerStarted","Data":"0bdc9bfe549d4a6c1e15060c705b924b4214c75a864751003a3c035b056cd004"}
Sep 07 16:57:08.938821 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:08.938801    2575 generic.go:356] "Generic (PLEG): container finished" podID="9cfc15e5-2d9e-4cae-8db0-90217597de62" containerID="8ef585f8e2a2328fe0bd0b153596f1782ea096c2ef495f5a331ddace36e760c5" exitCode=0
Sep 07 16:57:08.938927 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:08.938873    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dsqc5" event={"ID":"9cfc15e5-2d9e-4cae-8db0-90217597de62","Type":"ContainerDied","Data":"8ef585f8e2a2328fe0bd0b153596f1782ea096c2ef495f5a331ddace36e760c5"}
Sep 07 16:57:08.942231 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:08.942206    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv" event={"ID":"ae3e5a16-c599-4170-955b-4873224a7a20","Type":"ContainerStarted","Data":"828d38dc52e237fd387d8573da03a0455ce72c07483ada9b040a54ef88550e73"}
Sep 07 16:57:08.942309 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:08.942288    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv" event={"ID":"ae3e5a16-c599-4170-955b-4873224a7a20","Type":"ContainerStarted","Data":"70f7537b260e61fe7de6dd8f9837b7d525e8a6b5cea13723a4efebdcb3249fde"}
Sep 07 16:57:08.942356 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:08.942339    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv" event={"ID":"ae3e5a16-c599-4170-955b-4873224a7a20","Type":"ContainerStarted","Data":"06abadb732daf9fa8232145f75b7d1d0c485952afc3255ca6e1c352f919177f6"}
Sep 07 16:57:08.942394 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:08.942381    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv" event={"ID":"ae3e5a16-c599-4170-955b-4873224a7a20","Type":"ContainerStarted","Data":"6846a0ce62676e2d33380e49c32dc120f6529f1b5d3bbbe2bfc50f48b1987e9d"}
Sep 07 16:57:08.942442 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:08.942411    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv" event={"ID":"ae3e5a16-c599-4170-955b-4873224a7a20","Type":"ContainerStarted","Data":"8ee90b4fc287c4c0c0747fb9e2f656084b74a18c20bbdaee3ffd7fb2f88b549a"}
Sep 07 16:57:08.942442 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:08.942439    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv" event={"ID":"ae3e5a16-c599-4170-955b-4873224a7a20","Type":"ContainerStarted","Data":"a7816aeb642c3adbe92da9fd07bb1b23884079f252c50ce4d69655a04ec5da01"}
Sep 07 16:57:08.943526 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:08.943509    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dpb4t" event={"ID":"490233b3-f4ff-4a5c-818b-6f1f6069f818","Type":"ContainerStarted","Data":"bd076ef48942c9750f46340637f7d6c41dab8909e6c6f77f6afd9ce3b96de3d5"}
Sep 07 16:57:08.944805 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:08.944783    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rzhjh" event={"ID":"31e4fa90-9ec4-44e9-96bd-fe0af3224338","Type":"ContainerStarted","Data":"eb6a32ca7776190b5463734045e6cea787dd8000406928177c3e5f8f945773a7"}
Sep 07 16:57:08.946713 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:08.946694    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:08.980825 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:08.980778    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dpb4t" podStartSLOduration=4.001963789 podStartE2EDuration="21.980764492s" totalImagesPullingTime="17.978800703s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:08.979660703 +0000 UTC m=+22.876508009" watchObservedRunningTime="2026-09-07 16:57:08.980764492 +0000 UTC m=+22.877611807"
Sep 07 16:57:08.980973 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:08.980845    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8ljh2" podStartSLOduration=4.014150071 podStartE2EDuration="21.980841366s" totalImagesPullingTime="17.966691295s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:08.958360057 +0000 UTC m=+22.855207372" watchObservedRunningTime="2026-09-07 16:57:08.980841366 +0000 UTC m=+22.877688682"
Sep 07 16:57:09.188773 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:09.188593    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rzhjh" podStartSLOduration=4.148185888 podStartE2EDuration="22.18857935s" totalImagesPullingTime="18.040393462s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:09.166474741 +0000 UTC m=+23.063322056" watchObservedRunningTime="2026-09-07 16:57:09.18857935 +0000 UTC m=+23.085426665"
Sep 07 16:57:09.205045 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:09.205022    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 07 16:57:09.226271 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:09.226241    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:09.393817 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:09.393786    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6l488"
Sep 07 16:57:09.394321 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:09.394300    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6l488"
Sep 07 16:57:09.556491 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:09.556454    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:09.662654 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:09.662452    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-07T16:57:09.205038801Z","UUID":"b14b8f0d-351d-46c4-9ded-37001de5de81","Handler":null,"Name":"","Endpoint":""}
Sep 07 16:57:09.664228 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:09.664208    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 07 16:57:09.664370 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:09.664242    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 07 16:57:09.716434 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:09.716386    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:57:09.716434 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:09.716434    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:57:09.716676 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:09.716518    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2l8w" podUID="363e1dc1-6917-4e79-a2ea-024497e43a3a"
Sep 07 16:57:09.716676 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:09.716615    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nplbv" podUID="ba783056-dec5-4200-8726-97d3b462d24d"
Sep 07 16:57:09.817374 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:09.817342    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:09.950930 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:09.950831    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztgrq" event={"ID":"9a404e8e-ae1c-4d06-a909-da73d9c8e229","Type":"ContainerStarted","Data":"a4f46048ecfde8ce1dec5de2d166ed851b27f3a57bab48dcf7bcf90dc40ce41b"}
Sep 07 16:57:09.953276 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:09.953246    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ckwp5" event={"ID":"9333441c-26d5-460b-b1d3-67eec0f25fd2","Type":"ContainerStarted","Data":"b00dc3d8e00285a08de0c68b61690440c302a6cd1bdd41508505be901f09ebb0"}
Sep 07 16:57:09.954212 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:09.954191    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6l488"
Sep 07 16:57:09.984072 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:09.984043    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:10.018452 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:10.018393    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ckwp5" podStartSLOduration=5.054062866 podStartE2EDuration="23.018373553s" totalImagesPullingTime="17.964310687s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:09.979004083 +0000 UTC m=+23.875851399" watchObservedRunningTime="2026-09-07 16:57:10.018373553 +0000 UTC m=+23.915220871"
Sep 07 16:57:10.180927 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:10.180875    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:10.302514 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:10.302478    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:10.404741 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:10.404694    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:10.715827 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:10.715799    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:57:10.716013 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:10.715932    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g54wv" podUID="f6ab0a94-0f1c-496c-9072-1c50fcbcfadc"
Sep 07 16:57:10.958395 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:10.958360    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztgrq" event={"ID":"9a404e8e-ae1c-4d06-a909-da73d9c8e229","Type":"ContainerStarted","Data":"867b9a967f9060f8eecdb57d771bec0807836a0ae7f366244749ed32394db298"}
Sep 07 16:57:10.962500 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:10.962473    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv" event={"ID":"ae3e5a16-c599-4170-955b-4873224a7a20","Type":"ContainerStarted","Data":"b2871d9daaff6b85737f7541a1d7f0a19656580d92d36ffc1755e4b8ef3568f4"}
Sep 07 16:57:10.981514 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:10.981453    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztgrq" podStartSLOduration=3.831062189 podStartE2EDuration="23.981432545s" totalImagesPullingTime="20.150370356s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:10.981250958 +0000 UTC m=+24.878098274" watchObservedRunningTime="2026-09-07 16:57:10.981432545 +0000 UTC m=+24.878279860"
Sep 07 16:57:11.084385 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:11.084349    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:11.207475 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:11.207445    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:11.321512 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:11.321479    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:11.716216 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:11.716138    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:57:11.716382 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:11.716272    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nplbv" podUID="ba783056-dec5-4200-8726-97d3b462d24d"
Sep 07 16:57:11.716382 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:11.716312    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:57:11.716477 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:11.716385    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2l8w" podUID="363e1dc1-6917-4e79-a2ea-024497e43a3a"
Sep 07 16:57:11.980402 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:11.980329    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dpb4t_490233b3-f4ff-4a5c-818b-6f1f6069f818/dns-node-resolver/0.log"
Sep 07 16:57:12.241434 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:12.241360    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:12.715882 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:12.715851    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:57:12.716048 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:12.716001    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g54wv" podUID="f6ab0a94-0f1c-496c-9072-1c50fcbcfadc"
Sep 07 16:57:12.777351 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:12.777323    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8ljh2_c5e9c92f-1d92-4194-a20a-59963361fc54/node-ca/0.log"
Sep 07 16:57:13.614563 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:13.614323    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:13.716207 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:13.716176    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:57:13.716399 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:13.716290    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nplbv" podUID="ba783056-dec5-4200-8726-97d3b462d24d"
Sep 07 16:57:13.716399 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:13.716318    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:57:13.716399 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:13.716365    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2l8w" podUID="363e1dc1-6917-4e79-a2ea-024497e43a3a"
Sep 07 16:57:13.970486 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:13.970399    2575 generic.go:356] "Generic (PLEG): container finished" podID="9cfc15e5-2d9e-4cae-8db0-90217597de62" containerID="3d237c17b38022ae9d74557f6ddabd74fb7dd9fcd9c141226c17eccc5306d8a3" exitCode=0
Sep 07 16:57:13.970657 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:13.970482    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dsqc5" event={"ID":"9cfc15e5-2d9e-4cae-8db0-90217597de62","Type":"ContainerDied","Data":"3d237c17b38022ae9d74557f6ddabd74fb7dd9fcd9c141226c17eccc5306d8a3"}
Sep 07 16:57:13.974351 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:13.974324    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv" event={"ID":"ae3e5a16-c599-4170-955b-4873224a7a20","Type":"ContainerStarted","Data":"9c07b097ebd6a65c30c93f63b94de95eb220ce92bb9bbde2342b3728b57cd944"}
Sep 07 16:57:13.974560 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:13.974540    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:57:13.974648 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:13.974619    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:57:13.974708 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:13.974669    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:57:13.989710 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:13.989689    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:57:13.989841 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:13.989788    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:57:14.033344 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:14.033296    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv" podStartSLOduration=9.00533071 podStartE2EDuration="27.033281461s" totalImagesPullingTime="18.027950751s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:14.032012808 +0000 UTC m=+27.928860123" watchObservedRunningTime="2026-09-07 16:57:14.033281461 +0000 UTC m=+27.930128777"
Sep 07 16:57:14.715682 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:14.715650    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:57:14.716190 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:14.715781    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g54wv" podUID="f6ab0a94-0f1c-496c-9072-1c50fcbcfadc"
Sep 07 16:57:14.978450 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:14.978372    2575 generic.go:356] "Generic (PLEG): container finished" podID="9cfc15e5-2d9e-4cae-8db0-90217597de62" containerID="c2f74fa68401b51bd287aeeadf95e4a78c69e319b734821f95f562a0fede36de" exitCode=0
Sep 07 16:57:14.978616 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:14.978440    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dsqc5" event={"ID":"9cfc15e5-2d9e-4cae-8db0-90217597de62","Type":"ContainerDied","Data":"c2f74fa68401b51bd287aeeadf95e4a78c69e319b734821f95f562a0fede36de"}
Sep 07 16:57:15.213477 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:15.213443    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:15.715664 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:15.715640    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:57:15.715763 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:15.715675    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:57:15.716070 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:15.715758    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2l8w" podUID="363e1dc1-6917-4e79-a2ea-024497e43a3a"
Sep 07 16:57:15.716070 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:15.715868    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nplbv" podUID="ba783056-dec5-4200-8726-97d3b462d24d"
Sep 07 16:57:15.716702 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:15.716682    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:15.959885 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:15.959800    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:15.983376 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:15.983347    2575 generic.go:356] "Generic (PLEG): container finished" podID="9cfc15e5-2d9e-4cae-8db0-90217597de62" containerID="5b8bc460cc189a408374eef78b53fb8affe73321df3b7e59658374a6f60f18aa" exitCode=0
Sep 07 16:57:15.983508 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:15.983433    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dsqc5" event={"ID":"9cfc15e5-2d9e-4cae-8db0-90217597de62","Type":"ContainerDied","Data":"5b8bc460cc189a408374eef78b53fb8affe73321df3b7e59658374a6f60f18aa"}
Sep 07 16:57:16.213646 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:16.213561    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:16.351964 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:16.351933    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:16.471935 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:16.471839    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:16.719611 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:16.719394    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:57:16.720010 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:16.719684    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g54wv" podUID="f6ab0a94-0f1c-496c-9072-1c50fcbcfadc"
Sep 07 16:57:17.397619 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:17.397584    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:17.716121 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:17.716043    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:57:17.716285 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:17.716047    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:57:17.716285 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:17.716159    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2l8w" podUID="363e1dc1-6917-4e79-a2ea-024497e43a3a"
Sep 07 16:57:17.716285 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:17.716248    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nplbv" podUID="ba783056-dec5-4200-8726-97d3b462d24d"
Sep 07 16:57:17.764723 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:17.764683    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:18.003414 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:18.003327    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:18.155432 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:18.155387    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:18.376870 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:18.376817    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:18.493526 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:18.493488    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:18.696242 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:18.696130    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:18.719493 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:18.719471    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:57:18.719647 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:18.719592    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g54wv" podUID="f6ab0a94-0f1c-496c-9072-1c50fcbcfadc"
Sep 07 16:57:19.166397 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:19.166355    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:19.369875 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:19.369841    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:19.504843 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:19.504769    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:19.715695 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:19.715663    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:57:19.715874 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:19.715691    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:57:19.715874 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:19.715783    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2l8w" podUID="363e1dc1-6917-4e79-a2ea-024497e43a3a"
Sep 07 16:57:19.715998 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:19.715879    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nplbv" podUID="ba783056-dec5-4200-8726-97d3b462d24d"
Sep 07 16:57:19.750912 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:19.750870    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:19.946405 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:19.946378    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:20.317647 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:20.317621    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba783056-dec5-4200-8726-97d3b462d24d-metrics-certs\") pod \"network-metrics-daemon-nplbv\" (UID: \"ba783056-dec5-4200-8726-97d3b462d24d\") " pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:57:20.317943 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:20.317663    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6ab0a94-0f1c-496c-9072-1c50fcbcfadc-original-pull-secret\") pod \"global-pull-secret-syncer-g54wv\" (UID: \"f6ab0a94-0f1c-496c-9072-1c50fcbcfadc\") " pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:57:20.317943 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:20.317748    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 16:57:20.317943 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:20.317777    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:57:20.317943 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:20.317798    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6ab0a94-0f1c-496c-9072-1c50fcbcfadc-original-pull-secret podName:f6ab0a94-0f1c-496c-9072-1c50fcbcfadc nodeName:}" failed. No retries permitted until 2026-09-07 16:57:52.317786231 +0000 UTC m=+66.214633525 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6ab0a94-0f1c-496c-9072-1c50fcbcfadc-original-pull-secret") pod "global-pull-secret-syncer-g54wv" (UID: "f6ab0a94-0f1c-496c-9072-1c50fcbcfadc") : object "kube-system"/"original-pull-secret" not registered
Sep 07 16:57:20.317943 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:20.317840    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba783056-dec5-4200-8726-97d3b462d24d-metrics-certs podName:ba783056-dec5-4200-8726-97d3b462d24d nodeName:}" failed. No retries permitted until 2026-09-07 16:57:52.317823561 +0000 UTC m=+66.214670857 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba783056-dec5-4200-8726-97d3b462d24d-metrics-certs") pod "network-metrics-daemon-nplbv" (UID: "ba783056-dec5-4200-8726-97d3b462d24d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:57:20.355265 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:20.355233    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:20.418077 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:20.418038    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d4x4\" (UniqueName: \"kubernetes.io/projected/363e1dc1-6917-4e79-a2ea-024497e43a3a-kube-api-access-4d4x4\") pod \"network-check-target-g2l8w\" (UID: \"363e1dc1-6917-4e79-a2ea-024497e43a3a\") " pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:57:20.418255 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:20.418176    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 16:57:20.418255 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:20.418199    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 16:57:20.418255 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:20.418210    2575 projected.go:196] Error preparing data for projected volume kube-api-access-4d4x4 for pod openshift-network-diagnostics/network-check-target-g2l8w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:57:20.418407 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:20.418274    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/363e1dc1-6917-4e79-a2ea-024497e43a3a-kube-api-access-4d4x4 podName:363e1dc1-6917-4e79-a2ea-024497e43a3a nodeName:}" failed. No retries permitted until 2026-09-07 16:57:52.418256079 +0000 UTC m=+66.315103377 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4d4x4" (UniqueName: "kubernetes.io/projected/363e1dc1-6917-4e79-a2ea-024497e43a3a-kube-api-access-4d4x4") pod "network-check-target-g2l8w" (UID: "363e1dc1-6917-4e79-a2ea-024497e43a3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:57:20.462342 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:20.462304    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:20.547787 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:20.547755    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:20.719211 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:20.719176    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:57:20.719386 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:20.719289    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g54wv" podUID="f6ab0a94-0f1c-496c-9072-1c50fcbcfadc"
Sep 07 16:57:20.948532 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:20.948441    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:20.996686 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:20.996652    2575 generic.go:356] "Generic (PLEG): container finished" podID="9cfc15e5-2d9e-4cae-8db0-90217597de62" containerID="4b24a2d843978d065eacc85c8b7f11bebeec84e5100a7a149729a16ef28b3ad9" exitCode=0
Sep 07 16:57:20.996820 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:20.996707    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dsqc5" event={"ID":"9cfc15e5-2d9e-4cae-8db0-90217597de62","Type":"ContainerDied","Data":"4b24a2d843978d065eacc85c8b7f11bebeec84e5100a7a149729a16ef28b3ad9"}
Sep 07 16:57:21.078640 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:21.078616    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:21.171369 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:21.171344    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:21.579566 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:21.579533    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:21.716051 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:21.716025    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:57:21.716051 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:21.716041    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:57:21.716243 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:21.716129    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2l8w" podUID="363e1dc1-6917-4e79-a2ea-024497e43a3a"
Sep 07 16:57:21.716280 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:21.716258    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nplbv" podUID="ba783056-dec5-4200-8726-97d3b462d24d"
Sep 07 16:57:21.781440 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:21.781410    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:22.002337 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:22.002251    2575 generic.go:356] "Generic (PLEG): container finished" podID="9cfc15e5-2d9e-4cae-8db0-90217597de62" containerID="0d5bbc379c0fc59106b434dcd0e008f67203aadf73f303d0b6fabdb4f26fb2cc" exitCode=0
Sep 07 16:57:22.002337 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:22.002313    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dsqc5" event={"ID":"9cfc15e5-2d9e-4cae-8db0-90217597de62","Type":"ContainerDied","Data":"0d5bbc379c0fc59106b434dcd0e008f67203aadf73f303d0b6fabdb4f26fb2cc"}
Sep 07 16:57:22.369548 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:22.369517    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:22.473519 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:22.473483    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:22.572765 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:22.572735    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:22.715880 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:22.715800    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:57:22.716251 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:22.715928    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g54wv" podUID="f6ab0a94-0f1c-496c-9072-1c50fcbcfadc"
Sep 07 16:57:22.763477 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:22.763448    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:22.950087 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:22.950051    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:23.008045 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:23.007970    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dsqc5" event={"ID":"9cfc15e5-2d9e-4cae-8db0-90217597de62","Type":"ContainerStarted","Data":"c092b1f7be37a4ac5d82deb0d7d9dbfb328e350b1c8049a633248277ed2d635c"}
Sep 07 16:57:23.032814 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:23.032769    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dsqc5" podStartSLOduration=8.232451733 podStartE2EDuration="36.032755693s" totalImagesPullingTime="27.80030396s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:23.031146228 +0000 UTC m=+36.927993544" watchObservedRunningTime="2026-09-07 16:57:23.032755693 +0000 UTC m=+36.929603005"
Sep 07 16:57:23.375520 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:23.375488    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:23.716092 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:23.716008    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:57:23.716448 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:23.716008    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:57:23.716448 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:23.716120    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nplbv" podUID="ba783056-dec5-4200-8726-97d3b462d24d"
Sep 07 16:57:23.716448 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:23.716189    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2l8w" podUID="363e1dc1-6917-4e79-a2ea-024497e43a3a"
Sep 07 16:57:23.978102 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:23.978020    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:24.348360 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:24.348323    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:24.538426 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:24.538392    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:24.716332 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:24.716239    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:57:24.716776 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:24.716343    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g54wv" podUID="f6ab0a94-0f1c-496c-9072-1c50fcbcfadc"
Sep 07 16:57:24.936710 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:24.936683    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:25.716001 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:25.715968    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:57:25.716196 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:25.715973    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:57:25.716196 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:25.716058    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2l8w" podUID="363e1dc1-6917-4e79-a2ea-024497e43a3a"
Sep 07 16:57:25.716196 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:25.716167    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nplbv" podUID="ba783056-dec5-4200-8726-97d3b462d24d"
Sep 07 16:57:25.742709 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:25.742679    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:25.940643 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:25.940607    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:26.148533 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:26.148496    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:26.341281 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:26.341252    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:26.717315 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:26.717281    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:57:26.717452 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:26.717372    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g54wv" podUID="f6ab0a94-0f1c-496c-9072-1c50fcbcfadc"
Sep 07 16:57:27.716114 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:27.716083    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:57:27.716479 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:27.716181    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nplbv" podUID="ba783056-dec5-4200-8726-97d3b462d24d"
Sep 07 16:57:27.716479 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:27.716238    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:57:27.716479 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:27.716318    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2l8w" podUID="363e1dc1-6917-4e79-a2ea-024497e43a3a"
Sep 07 16:57:28.715825 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:28.715794    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:57:28.716060 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:28.715928    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g54wv" podUID="f6ab0a94-0f1c-496c-9072-1c50fcbcfadc"
Sep 07 16:57:29.715583 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:29.715543    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:57:29.716043 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:29.715650    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2l8w" podUID="363e1dc1-6917-4e79-a2ea-024497e43a3a"
Sep 07 16:57:29.716043 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:29.715699    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:57:29.716043 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:29.715787    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nplbv" podUID="ba783056-dec5-4200-8726-97d3b462d24d"
Sep 07 16:57:30.519807 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:30.519772    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:30.716095 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:30.716061    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:57:30.716425 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:30.716152    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g54wv" podUID="f6ab0a94-0f1c-496c-9072-1c50fcbcfadc"
Sep 07 16:57:30.718589 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:30.718562    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:30.810543 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:30.810513    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:30.921538 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:30.921504    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:31.396211 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:31.396177    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:31.716473 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:31.716401    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:57:31.716473 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:31.716434    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:57:31.716869 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:31.716501    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2l8w" podUID="363e1dc1-6917-4e79-a2ea-024497e43a3a"
Sep 07 16:57:31.716869 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:31.716613    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nplbv" podUID="ba783056-dec5-4200-8726-97d3b462d24d"
Sep 07 16:57:31.763515 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:31.763481    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:31.863866 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:31.863840    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:32.035097 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:32.035021    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-g2l8w"]
Sep 07 16:57:32.035254 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:32.035115    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:57:32.035254 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:32.035201    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2l8w" podUID="363e1dc1-6917-4e79-a2ea-024497e43a3a"
Sep 07 16:57:32.039876 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:32.039845    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g54wv"]
Sep 07 16:57:32.040077 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:32.039961    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:57:32.040077 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:32.040063    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g54wv" podUID="f6ab0a94-0f1c-496c-9072-1c50fcbcfadc"
Sep 07 16:57:32.045501 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:32.045478    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nplbv"]
Sep 07 16:57:32.045625 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:32.045558    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:57:32.045683 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:32.045642    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nplbv" podUID="ba783056-dec5-4200-8726-97d3b462d24d"
Sep 07 16:57:33.715771 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:33.715588    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:57:33.716145 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:33.715647    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:57:33.716145 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:33.715831    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2l8w" podUID="363e1dc1-6917-4e79-a2ea-024497e43a3a"
Sep 07 16:57:33.716145 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:33.715647    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:57:33.716145 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:33.715928    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nplbv" podUID="ba783056-dec5-4200-8726-97d3b462d24d"
Sep 07 16:57:33.716145 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:33.715976    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g54wv" podUID="f6ab0a94-0f1c-496c-9072-1c50fcbcfadc"
Sep 07 16:57:35.716063 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:35.716023    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:57:35.716456 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:35.716069    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:57:35.716456 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:35.716117    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:57:35.716456 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:35.716128    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g54wv" podUID="f6ab0a94-0f1c-496c-9072-1c50fcbcfadc"
Sep 07 16:57:35.716456 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:35.716199    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nplbv" podUID="ba783056-dec5-4200-8726-97d3b462d24d"
Sep 07 16:57:35.716456 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:57:35.716265    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2l8w" podUID="363e1dc1-6917-4e79-a2ea-024497e43a3a"
Sep 07 16:57:36.431788 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.431759    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeReady"
Sep 07 16:57:36.431980 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.431883    2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 07 16:57:36.491225 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.491193    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-w6xqw"]
Sep 07 16:57:36.513567 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.513541    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-shggg"]
Sep 07 16:57:36.513717 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.513663    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w6xqw"
Sep 07 16:57:36.518537 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.518518    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 07 16:57:36.518988 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.518971    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 07 16:57:36.519055 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.519042    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kv5rt\""
Sep 07 16:57:36.519163 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.519150    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 07 16:57:36.519854 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.519838    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 07 16:57:36.535676 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.535626    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w6xqw"]
Sep 07 16:57:36.535676 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.535659    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-shggg"]
Sep 07 16:57:36.535812 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.535727    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-shggg"
Sep 07 16:57:36.538383 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.538360    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 07 16:57:36.538474 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.538365    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 07 16:57:36.538601 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.538589    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g7mrx\""
Sep 07 16:57:36.538740 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.538723    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 07 16:57:36.592516 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.592489    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-g6dvf"]
Sep 07 16:57:36.613981 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.613953    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g6dvf"
Sep 07 16:57:36.614326 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.614300    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g6dvf"]
Sep 07 16:57:36.617036 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.617012    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 07 16:57:36.617171 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.617153    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-96tzd\""
Sep 07 16:57:36.617309 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.617294    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 07 16:57:36.632458 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.632433    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1a345a05-e4aa-4e97-b085-b5c333e2e731-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w6xqw\" (UID: \"1a345a05-e4aa-4e97-b085-b5c333e2e731\") " pod="openshift-insights/insights-runtime-extractor-w6xqw"
Sep 07 16:57:36.632458 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.632459    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1a345a05-e4aa-4e97-b085-b5c333e2e731-crio-socket\") pod \"insights-runtime-extractor-w6xqw\" (UID: \"1a345a05-e4aa-4e97-b085-b5c333e2e731\") " pod="openshift-insights/insights-runtime-extractor-w6xqw"
Sep 07 16:57:36.632583 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.632488    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdhnl\" (UniqueName: \"kubernetes.io/projected/0fc4edc2-3945-42e0-90f7-87b0688f7e6f-kube-api-access-xdhnl\") pod \"ingress-canary-shggg\" (UID: \"0fc4edc2-3945-42e0-90f7-87b0688f7e6f\") " pod="openshift-ingress-canary/ingress-canary-shggg"
Sep 07 16:57:36.632583 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.632534    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kglgd\" (UniqueName: \"kubernetes.io/projected/1a345a05-e4aa-4e97-b085-b5c333e2e731-kube-api-access-kglgd\") pod \"insights-runtime-extractor-w6xqw\" (UID: \"1a345a05-e4aa-4e97-b085-b5c333e2e731\") " pod="openshift-insights/insights-runtime-extractor-w6xqw"
Sep 07 16:57:36.632649 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.632587    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a345a05-e4aa-4e97-b085-b5c333e2e731-data-volume\") pod \"insights-runtime-extractor-w6xqw\" (UID: \"1a345a05-e4aa-4e97-b085-b5c333e2e731\") " pod="openshift-insights/insights-runtime-extractor-w6xqw"
Sep 07 16:57:36.632649 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.632605    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1a345a05-e4aa-4e97-b085-b5c333e2e731-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w6xqw\" (UID: \"1a345a05-e4aa-4e97-b085-b5c333e2e731\") " pod="openshift-insights/insights-runtime-extractor-w6xqw"
Sep 07 16:57:36.632649 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.632622    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0fc4edc2-3945-42e0-90f7-87b0688f7e6f-cert\") pod \"ingress-canary-shggg\" (UID: \"0fc4edc2-3945-42e0-90f7-87b0688f7e6f\") " pod="openshift-ingress-canary/ingress-canary-shggg"
Sep 07 16:57:36.732570 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.732528    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:36.733875 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.733852    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1a345a05-e4aa-4e97-b085-b5c333e2e731-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w6xqw\" (UID: \"1a345a05-e4aa-4e97-b085-b5c333e2e731\") " pod="openshift-insights/insights-runtime-extractor-w6xqw"
Sep 07 16:57:36.733954 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.733883    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/529d1b0f-2d6d-440e-8e89-6c6cd5c0178c-config-volume\") pod \"dns-default-g6dvf\" (UID: \"529d1b0f-2d6d-440e-8e89-6c6cd5c0178c\") " pod="openshift-dns/dns-default-g6dvf"
Sep 07 16:57:36.733954 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.733923    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1a345a05-e4aa-4e97-b085-b5c333e2e731-crio-socket\") pod \"insights-runtime-extractor-w6xqw\" (UID: \"1a345a05-e4aa-4e97-b085-b5c333e2e731\") " pod="openshift-insights/insights-runtime-extractor-w6xqw"
Sep 07 16:57:36.733954 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.733940    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns8r7\" (UniqueName: \"kubernetes.io/projected/529d1b0f-2d6d-440e-8e89-6c6cd5c0178c-kube-api-access-ns8r7\") pod \"dns-default-g6dvf\" (UID: \"529d1b0f-2d6d-440e-8e89-6c6cd5c0178c\") " pod="openshift-dns/dns-default-g6dvf"
Sep 07 16:57:36.734049 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.733971    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdhnl\" (UniqueName: \"kubernetes.io/projected/0fc4edc2-3945-42e0-90f7-87b0688f7e6f-kube-api-access-xdhnl\") pod \"ingress-canary-shggg\" (UID: \"0fc4edc2-3945-42e0-90f7-87b0688f7e6f\") " pod="openshift-ingress-canary/ingress-canary-shggg"
Sep 07 16:57:36.734049 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.733986    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kglgd\" (UniqueName: \"kubernetes.io/projected/1a345a05-e4aa-4e97-b085-b5c333e2e731-kube-api-access-kglgd\") pod \"insights-runtime-extractor-w6xqw\" (UID: \"1a345a05-e4aa-4e97-b085-b5c333e2e731\") " pod="openshift-insights/insights-runtime-extractor-w6xqw"
Sep 07 16:57:36.734049 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.734003    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/529d1b0f-2d6d-440e-8e89-6c6cd5c0178c-tmp-dir\") pod \"dns-default-g6dvf\" (UID: \"529d1b0f-2d6d-440e-8e89-6c6cd5c0178c\") " pod="openshift-dns/dns-default-g6dvf"
Sep 07 16:57:36.734049 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.734027    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a345a05-e4aa-4e97-b085-b5c333e2e731-data-volume\") pod \"insights-runtime-extractor-w6xqw\" (UID: \"1a345a05-e4aa-4e97-b085-b5c333e2e731\") " pod="openshift-insights/insights-runtime-extractor-w6xqw"
Sep 07 16:57:36.734049 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.734043    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1a345a05-e4aa-4e97-b085-b5c333e2e731-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w6xqw\" (UID: \"1a345a05-e4aa-4e97-b085-b5c333e2e731\") " pod="openshift-insights/insights-runtime-extractor-w6xqw"
Sep 07 16:57:36.734258 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.734070    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0fc4edc2-3945-42e0-90f7-87b0688f7e6f-cert\") pod \"ingress-canary-shggg\" (UID: \"0fc4edc2-3945-42e0-90f7-87b0688f7e6f\") " pod="openshift-ingress-canary/ingress-canary-shggg"
Sep 07 16:57:36.734258 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.734201    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/529d1b0f-2d6d-440e-8e89-6c6cd5c0178c-metrics-tls\") pod \"dns-default-g6dvf\" (UID: \"529d1b0f-2d6d-440e-8e89-6c6cd5c0178c\") " pod="openshift-dns/dns-default-g6dvf"
Sep 07 16:57:36.734388 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.734366    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1a345a05-e4aa-4e97-b085-b5c333e2e731-crio-socket\") pod \"insights-runtime-extractor-w6xqw\" (UID: \"1a345a05-e4aa-4e97-b085-b5c333e2e731\") " pod="openshift-insights/insights-runtime-extractor-w6xqw"
Sep 07 16:57:36.734493 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.734475    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a345a05-e4aa-4e97-b085-b5c333e2e731-data-volume\") pod \"insights-runtime-extractor-w6xqw\" (UID: \"1a345a05-e4aa-4e97-b085-b5c333e2e731\") " pod="openshift-insights/insights-runtime-extractor-w6xqw"
Sep 07 16:57:36.734811 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.734788    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1a345a05-e4aa-4e97-b085-b5c333e2e731-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w6xqw\" (UID: \"1a345a05-e4aa-4e97-b085-b5c333e2e731\") " pod="openshift-insights/insights-runtime-extractor-w6xqw"
Sep 07 16:57:36.737786 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.737765    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1a345a05-e4aa-4e97-b085-b5c333e2e731-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w6xqw\" (UID: \"1a345a05-e4aa-4e97-b085-b5c333e2e731\") " pod="openshift-insights/insights-runtime-extractor-w6xqw"
Sep 07 16:57:36.738011 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.737992    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0fc4edc2-3945-42e0-90f7-87b0688f7e6f-cert\") pod \"ingress-canary-shggg\" (UID: \"0fc4edc2-3945-42e0-90f7-87b0688f7e6f\") " pod="openshift-ingress-canary/ingress-canary-shggg"
Sep 07 16:57:36.743056 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.743029    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdhnl\" (UniqueName: \"kubernetes.io/projected/0fc4edc2-3945-42e0-90f7-87b0688f7e6f-kube-api-access-xdhnl\") pod \"ingress-canary-shggg\" (UID: \"0fc4edc2-3945-42e0-90f7-87b0688f7e6f\") " pod="openshift-ingress-canary/ingress-canary-shggg"
Sep 07 16:57:36.743144 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.743096    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kglgd\" (UniqueName: \"kubernetes.io/projected/1a345a05-e4aa-4e97-b085-b5c333e2e731-kube-api-access-kglgd\") pod \"insights-runtime-extractor-w6xqw\" (UID: \"1a345a05-e4aa-4e97-b085-b5c333e2e731\") " pod="openshift-insights/insights-runtime-extractor-w6xqw"
Sep 07 16:57:36.823219 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.823191    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w6xqw"
Sep 07 16:57:36.832430 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.832402    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:36.835329 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.835310    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/529d1b0f-2d6d-440e-8e89-6c6cd5c0178c-tmp-dir\") pod \"dns-default-g6dvf\" (UID: \"529d1b0f-2d6d-440e-8e89-6c6cd5c0178c\") " pod="openshift-dns/dns-default-g6dvf"
Sep 07 16:57:36.835395 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.835354    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/529d1b0f-2d6d-440e-8e89-6c6cd5c0178c-metrics-tls\") pod \"dns-default-g6dvf\" (UID: \"529d1b0f-2d6d-440e-8e89-6c6cd5c0178c\") " pod="openshift-dns/dns-default-g6dvf"
Sep 07 16:57:36.835431 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.835408    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/529d1b0f-2d6d-440e-8e89-6c6cd5c0178c-config-volume\") pod \"dns-default-g6dvf\" (UID: \"529d1b0f-2d6d-440e-8e89-6c6cd5c0178c\") " pod="openshift-dns/dns-default-g6dvf"
Sep 07 16:57:36.835465 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.835437    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns8r7\" (UniqueName: \"kubernetes.io/projected/529d1b0f-2d6d-440e-8e89-6c6cd5c0178c-kube-api-access-ns8r7\") pod \"dns-default-g6dvf\" (UID: \"529d1b0f-2d6d-440e-8e89-6c6cd5c0178c\") " pod="openshift-dns/dns-default-g6dvf"
Sep 07 16:57:36.835682 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.835664    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/529d1b0f-2d6d-440e-8e89-6c6cd5c0178c-tmp-dir\") pod \"dns-default-g6dvf\" (UID: \"529d1b0f-2d6d-440e-8e89-6c6cd5c0178c\") " pod="openshift-dns/dns-default-g6dvf"
Sep 07 16:57:36.835923 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.835885    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/529d1b0f-2d6d-440e-8e89-6c6cd5c0178c-config-volume\") pod \"dns-default-g6dvf\" (UID: \"529d1b0f-2d6d-440e-8e89-6c6cd5c0178c\") " pod="openshift-dns/dns-default-g6dvf"
Sep 07 16:57:36.837592 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.837575    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/529d1b0f-2d6d-440e-8e89-6c6cd5c0178c-metrics-tls\") pod \"dns-default-g6dvf\" (UID: \"529d1b0f-2d6d-440e-8e89-6c6cd5c0178c\") " pod="openshift-dns/dns-default-g6dvf"
Sep 07 16:57:36.843200 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.843181    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns8r7\" (UniqueName: \"kubernetes.io/projected/529d1b0f-2d6d-440e-8e89-6c6cd5c0178c-kube-api-access-ns8r7\") pod \"dns-default-g6dvf\" (UID: \"529d1b0f-2d6d-440e-8e89-6c6cd5c0178c\") " pod="openshift-dns/dns-default-g6dvf"
Sep 07 16:57:36.844069 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.844052    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-shggg"
Sep 07 16:57:36.923229 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:36.923187    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g6dvf"
Sep 07 16:57:37.150119 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:37.149873    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-shggg"]
Sep 07 16:57:37.153370 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:57:37.153341    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fc4edc2_3945_42e0_90f7_87b0688f7e6f.slice/crio-628dca170c5100decef6c5d38cc83353e3e2fd70914c4bd60e70df4a3a3adf85 WatchSource:0}: Error finding container 628dca170c5100decef6c5d38cc83353e3e2fd70914c4bd60e70df4a3a3adf85: Status 404 returned error can't find the container with id 628dca170c5100decef6c5d38cc83353e3e2fd70914c4bd60e70df4a3a3adf85
Sep 07 16:57:37.155178 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:37.155155    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w6xqw"]
Sep 07 16:57:37.157688 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:57:37.157667    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a345a05_e4aa_4e97_b085_b5c333e2e731.slice/crio-0e75308e4cb6deb0ed688fce29881502c06af803402772c78a3fb85f6357742a WatchSource:0}: Error finding container 0e75308e4cb6deb0ed688fce29881502c06af803402772c78a3fb85f6357742a: Status 404 returned error can't find the container with id 0e75308e4cb6deb0ed688fce29881502c06af803402772c78a3fb85f6357742a
Sep 07 16:57:37.220784 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:37.220761    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g6dvf"]
Sep 07 16:57:37.223988 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:57:37.223961    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod529d1b0f_2d6d_440e_8e89_6c6cd5c0178c.slice/crio-5a5c2f4574d2e36401fa9254bd5391eecee59123abe55aeb57a215ed4582a836 WatchSource:0}: Error finding container 5a5c2f4574d2e36401fa9254bd5391eecee59123abe55aeb57a215ed4582a836: Status 404 returned error can't find the container with id 5a5c2f4574d2e36401fa9254bd5391eecee59123abe55aeb57a215ed4582a836
Sep 07 16:57:37.339097 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:37.339062    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:37.440679 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:37.440577    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:37.672015 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:37.671980    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:37.715676 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:37.715598    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:57:37.715676 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:37.715648    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:57:37.715676 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:37.715598    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:57:37.718857 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:37.718837    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bvnj8\""
Sep 07 16:57:37.720596 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:37.719918    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 07 16:57:37.720596 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:37.720027    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 07 16:57:37.720596 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:37.720198    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lxz8c\""
Sep 07 16:57:37.720596 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:37.720243    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 07 16:57:37.720596 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:37.720266    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 07 16:57:37.765969 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:37.765923    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:37.838267 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:37.838238    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rpb2w"]
Sep 07 16:57:37.840194 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:37.840175    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rpb2w"
Sep 07 16:57:37.843272 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:37.843249    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-82466\""
Sep 07 16:57:37.843495 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:37.843481    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 07 16:57:37.850765 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:37.850741    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:37.854360 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:37.854335    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rpb2w"]
Sep 07 16:57:37.942099 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:37.942053    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a5202dd8-27cf-466b-a27f-f222cbba7676-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-rpb2w\" (UID: \"a5202dd8-27cf-466b-a27f-f222cbba7676\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rpb2w"
Sep 07 16:57:37.964976 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:37.964879    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:38.042452 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:38.042374    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a5202dd8-27cf-466b-a27f-f222cbba7676-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-rpb2w\" (UID: \"a5202dd8-27cf-466b-a27f-f222cbba7676\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rpb2w"
Sep 07 16:57:38.043181 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:38.043113    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g6dvf" event={"ID":"529d1b0f-2d6d-440e-8e89-6c6cd5c0178c","Type":"ContainerStarted","Data":"5a5c2f4574d2e36401fa9254bd5391eecee59123abe55aeb57a215ed4582a836"}
Sep 07 16:57:38.045064 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:38.045010    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-shggg" event={"ID":"0fc4edc2-3945-42e0-90f7-87b0688f7e6f","Type":"ContainerStarted","Data":"628dca170c5100decef6c5d38cc83353e3e2fd70914c4bd60e70df4a3a3adf85"}
Sep 07 16:57:38.047165 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:38.047037    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w6xqw" event={"ID":"1a345a05-e4aa-4e97-b085-b5c333e2e731","Type":"ContainerStarted","Data":"2ff6549fbcf1cd51ea7e54eda4219db406d7f0af52e501942ccf5159031f1275"}
Sep 07 16:57:38.047165 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:38.047092    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w6xqw" event={"ID":"1a345a05-e4aa-4e97-b085-b5c333e2e731","Type":"ContainerStarted","Data":"7172006e99e0eb1829e731dd485a6497bafc17ce6bce721469d0bba3d3d31a75"}
Sep 07 16:57:38.047165 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:38.047120    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w6xqw" event={"ID":"1a345a05-e4aa-4e97-b085-b5c333e2e731","Type":"ContainerStarted","Data":"0e75308e4cb6deb0ed688fce29881502c06af803402772c78a3fb85f6357742a"}
Sep 07 16:57:38.047926 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:38.047861    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a5202dd8-27cf-466b-a27f-f222cbba7676-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-rpb2w\" (UID: \"a5202dd8-27cf-466b-a27f-f222cbba7676\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rpb2w"
Sep 07 16:57:38.154254 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:38.154218    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rpb2w"
Sep 07 16:57:38.243782 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:38.243696    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-2jwgt"]
Sep 07 16:57:38.246484 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:38.246464    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-2jwgt"
Sep 07 16:57:38.250437 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:38.250414    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 07 16:57:38.250763 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:38.250743    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-hg6cj\""
Sep 07 16:57:38.250823 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:38.250770    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 07 16:57:38.277366 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:38.277334    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-2jwgt"]
Sep 07 16:57:38.303494 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:38.303443    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:38.344599 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:38.344564    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skkz2\" (UniqueName: \"kubernetes.io/projected/22fa9fc6-fec4-4134-8bfe-e3550ce544e4-kube-api-access-skkz2\") pod \"downloads-85d98c998f-2jwgt\" (UID: \"22fa9fc6-fec4-4134-8bfe-e3550ce544e4\") " pod="openshift-console/downloads-85d98c998f-2jwgt"
Sep 07 16:57:38.404913 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:38.404867    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:38.446035 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:38.445911    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skkz2\" (UniqueName: \"kubernetes.io/projected/22fa9fc6-fec4-4134-8bfe-e3550ce544e4-kube-api-access-skkz2\") pod \"downloads-85d98c998f-2jwgt\" (UID: \"22fa9fc6-fec4-4134-8bfe-e3550ce544e4\") " pod="openshift-console/downloads-85d98c998f-2jwgt"
Sep 07 16:57:38.450944 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:38.450847    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rpb2w"]
Sep 07 16:57:38.457619 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:57:38.457588    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5202dd8_27cf_466b_a27f_f222cbba7676.slice/crio-981bba78883bde9daa81c4a93fd07bc3db2a0b79b4e0243447dd101ffb3160d6 WatchSource:0}: Error finding container 981bba78883bde9daa81c4a93fd07bc3db2a0b79b4e0243447dd101ffb3160d6: Status 404 returned error can't find the container with id 981bba78883bde9daa81c4a93fd07bc3db2a0b79b4e0243447dd101ffb3160d6
Sep 07 16:57:38.462081 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:38.462037    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skkz2\" (UniqueName: \"kubernetes.io/projected/22fa9fc6-fec4-4134-8bfe-e3550ce544e4-kube-api-access-skkz2\") pod \"downloads-85d98c998f-2jwgt\" (UID: \"22fa9fc6-fec4-4134-8bfe-e3550ce544e4\") " pod="openshift-console/downloads-85d98c998f-2jwgt"
Sep 07 16:57:38.496731 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:38.496595    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:38.556881 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:38.556641    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-2jwgt"
Sep 07 16:57:38.590196 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:38.589994    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:38.717518 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:38.717462    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:38.818741 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:38.818694    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:38.938440 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:38.938375    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:39.039542 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:39.039319    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:39.052113 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:39.052080    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rpb2w" event={"ID":"a5202dd8-27cf-466b-a27f-f222cbba7676","Type":"ContainerStarted","Data":"981bba78883bde9daa81c4a93fd07bc3db2a0b79b4e0243447dd101ffb3160d6"}
Sep 07 16:57:39.134875 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:39.134806    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:39.210263 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:39.210231    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:39.947036 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:39.947001    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:40.109415 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:40.109370    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:40.238198 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:40.238161    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:40.639279 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:40.639223    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:40.697720 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:40.697599    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-2jwgt"]
Sep 07 16:57:40.701347 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:57:40.701319    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22fa9fc6_fec4_4134_8bfe_e3550ce544e4.slice/crio-ac2c4caf510e21b86ec04c630f90925a9c831094bf658a629c6379c8eb29c3ec WatchSource:0}: Error finding container ac2c4caf510e21b86ec04c630f90925a9c831094bf658a629c6379c8eb29c3ec: Status 404 returned error can't find the container with id ac2c4caf510e21b86ec04c630f90925a9c831094bf658a629c6379c8eb29c3ec
Sep 07 16:57:40.734417 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:40.734381    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:40.854419 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:40.854384    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:40.953796 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:40.953711    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:41.059514 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:41.059477    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rpb2w" event={"ID":"a5202dd8-27cf-466b-a27f-f222cbba7676","Type":"ContainerStarted","Data":"9b91770ade0699e9c538474e3612b571418c51b44789c64443883fdb15035509"}
Sep 07 16:57:41.059734 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:41.059707    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rpb2w"
Sep 07 16:57:41.061337 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:41.061308    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-shggg" event={"ID":"0fc4edc2-3945-42e0-90f7-87b0688f7e6f","Type":"ContainerStarted","Data":"b1a7c340b78ecdfb2c6db4bbd683f8be7e1057614098f34244a645351bb843ea"}
Sep 07 16:57:41.062635 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:41.062610    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-2jwgt" event={"ID":"22fa9fc6-fec4-4134-8bfe-e3550ce544e4","Type":"ContainerStarted","Data":"ac2c4caf510e21b86ec04c630f90925a9c831094bf658a629c6379c8eb29c3ec"}
Sep 07 16:57:41.064445 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:41.064422    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g6dvf" event={"ID":"529d1b0f-2d6d-440e-8e89-6c6cd5c0178c","Type":"ContainerStarted","Data":"48d5b9763ad42376fae581d995077764ebfcfee068d8bb123c8cf3639b332d04"}
Sep 07 16:57:41.064533 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:41.064460    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g6dvf" event={"ID":"529d1b0f-2d6d-440e-8e89-6c6cd5c0178c","Type":"ContainerStarted","Data":"3ed19962c75a5daf783e7d811ffd423ad951e0a64e74b4a0a99f3d43a0ce00f5"}
Sep 07 16:57:41.064533 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:41.064481    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-g6dvf"
Sep 07 16:57:41.064958 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:41.064941    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rpb2w"
Sep 07 16:57:41.066524 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:41.066505    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w6xqw" event={"ID":"1a345a05-e4aa-4e97-b085-b5c333e2e731","Type":"ContainerStarted","Data":"ebadaffa70bce5e6b47347e39d7b0472b6f5b2682c62a5178724dd3a1b552533"}
Sep 07 16:57:41.131218 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:41.131168    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rpb2w" podStartSLOduration=2.122124991 podStartE2EDuration="4.131154118s" totalImagesPullingTime="2.009029127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:41.098728931 +0000 UTC m=+54.995576275" watchObservedRunningTime="2026-09-07 16:57:41.131154118 +0000 UTC m=+55.028001494"
Sep 07 16:57:41.171834 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:41.171788    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-w6xqw" podStartSLOduration=2.103301726 podStartE2EDuration="5.171772773s" totalImagesPullingTime="3.068471047s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:57:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:41.171597095 +0000 UTC m=+55.068444411" watchObservedRunningTime="2026-09-07 16:57:41.171772773 +0000 UTC m=+55.068620088"
Sep 07 16:57:41.177911 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:41.177865    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:41.204538 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:41.204450    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-shggg" podStartSLOduration=1.9366566459999999 podStartE2EDuration="5.204435391s" totalImagesPullingTime="3.267778745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:57:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:41.20403599 +0000 UTC m=+55.100883305" watchObservedRunningTime="2026-09-07 16:57:41.204435391 +0000 UTC m=+55.101282738"
Sep 07 16:57:41.229293 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:41.229234    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-g6dvf" podStartSLOduration=2.033733368 podStartE2EDuration="5.22920895s" totalImagesPullingTime="3.195475582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:57:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:41.228239361 +0000 UTC m=+55.125086677" watchObservedRunningTime="2026-09-07 16:57:41.22920895 +0000 UTC m=+55.126056267"
Sep 07 16:57:41.282036 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:41.281995    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:41.906930 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:41.906823    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:41.955746 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:41.955715    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-m928w"]
Sep 07 16:57:41.957668 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:41.957649    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-m928w"
Sep 07 16:57:41.963473 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:41.963450    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 07 16:57:41.964724 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:41.964522    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 07 16:57:41.964724 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:41.964535    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 07 16:57:41.964724 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:41.964597    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-nvqdt\""
Sep 07 16:57:41.964724 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:41.964612    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 07 16:57:41.964724 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:41.964525    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 07 16:57:41.975624 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:41.975598    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-m928w"]
Sep 07 16:57:42.009715 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:42.009676    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:42.075927 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:42.075877    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/efdb8c9b-af4f-44fe-a2c6-fa66e7e7bc42-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-m928w\" (UID: \"efdb8c9b-af4f-44fe-a2c6-fa66e7e7bc42\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-m928w"
Sep 07 16:57:42.076093 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:42.075984    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/efdb8c9b-af4f-44fe-a2c6-fa66e7e7bc42-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-m928w\" (UID: \"efdb8c9b-af4f-44fe-a2c6-fa66e7e7bc42\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-m928w"
Sep 07 16:57:42.076093 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:42.076011    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efdb8c9b-af4f-44fe-a2c6-fa66e7e7bc42-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-m928w\" (UID: \"efdb8c9b-af4f-44fe-a2c6-fa66e7e7bc42\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-m928w"
Sep 07 16:57:42.076093 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:42.076028    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xb2x\" (UniqueName: \"kubernetes.io/projected/efdb8c9b-af4f-44fe-a2c6-fa66e7e7bc42-kube-api-access-7xb2x\") pod \"prometheus-operator-6f4946db56-m928w\" (UID: \"efdb8c9b-af4f-44fe-a2c6-fa66e7e7bc42\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-m928w"
Sep 07 16:57:42.149519 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:42.149476    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:42.176508 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:42.176408    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/efdb8c9b-af4f-44fe-a2c6-fa66e7e7bc42-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-m928w\" (UID: \"efdb8c9b-af4f-44fe-a2c6-fa66e7e7bc42\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-m928w"
Sep 07 16:57:42.176681 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:42.176628    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/efdb8c9b-af4f-44fe-a2c6-fa66e7e7bc42-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-m928w\" (UID: \"efdb8c9b-af4f-44fe-a2c6-fa66e7e7bc42\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-m928w"
Sep 07 16:57:42.176681 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:42.176656    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efdb8c9b-af4f-44fe-a2c6-fa66e7e7bc42-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-m928w\" (UID: \"efdb8c9b-af4f-44fe-a2c6-fa66e7e7bc42\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-m928w"
Sep 07 16:57:42.176794 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:42.176680    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xb2x\" (UniqueName: \"kubernetes.io/projected/efdb8c9b-af4f-44fe-a2c6-fa66e7e7bc42-kube-api-access-7xb2x\") pod \"prometheus-operator-6f4946db56-m928w\" (UID: \"efdb8c9b-af4f-44fe-a2c6-fa66e7e7bc42\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-m928w"
Sep 07 16:57:42.177534 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:42.177505    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efdb8c9b-af4f-44fe-a2c6-fa66e7e7bc42-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-m928w\" (UID: \"efdb8c9b-af4f-44fe-a2c6-fa66e7e7bc42\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-m928w"
Sep 07 16:57:42.179763 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:42.179702    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/efdb8c9b-af4f-44fe-a2c6-fa66e7e7bc42-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-m928w\" (UID: \"efdb8c9b-af4f-44fe-a2c6-fa66e7e7bc42\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-m928w"
Sep 07 16:57:42.179916 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:42.179829    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/efdb8c9b-af4f-44fe-a2c6-fa66e7e7bc42-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-m928w\" (UID: \"efdb8c9b-af4f-44fe-a2c6-fa66e7e7bc42\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-m928w"
Sep 07 16:57:42.186954 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:42.186928    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xb2x\" (UniqueName: \"kubernetes.io/projected/efdb8c9b-af4f-44fe-a2c6-fa66e7e7bc42-kube-api-access-7xb2x\") pod \"prometheus-operator-6f4946db56-m928w\" (UID: \"efdb8c9b-af4f-44fe-a2c6-fa66e7e7bc42\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-m928w"
Sep 07 16:57:42.267962 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:42.267927    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-m928w"
Sep 07 16:57:42.375387 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:42.375349    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:42.479616 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:42.479531    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:42.558647 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:42.558614    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-m928w"]
Sep 07 16:57:42.562071 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:57:42.562043    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefdb8c9b_af4f_44fe_a2c6_fa66e7e7bc42.slice/crio-ff9c16a0e582cb5f505882708d0f8ac2aa645ca30cfd8dfe97309127d9622c05 WatchSource:0}: Error finding container ff9c16a0e582cb5f505882708d0f8ac2aa645ca30cfd8dfe97309127d9622c05: Status 404 returned error can't find the container with id ff9c16a0e582cb5f505882708d0f8ac2aa645ca30cfd8dfe97309127d9622c05
Sep 07 16:57:43.075823 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:43.075781    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-m928w" event={"ID":"efdb8c9b-af4f-44fe-a2c6-fa66e7e7bc42","Type":"ContainerStarted","Data":"ff9c16a0e582cb5f505882708d0f8ac2aa645ca30cfd8dfe97309127d9622c05"}
Sep 07 16:57:44.528236 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:44.528200    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:44.628384 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:44.628347    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:44.901754 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:44.901707    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:45.085306 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.085118    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-m928w" event={"ID":"efdb8c9b-af4f-44fe-a2c6-fa66e7e7bc42","Type":"ContainerStarted","Data":"194b42a613c746ca4ddf387bf77456fcf32e6873ea0ea534f66e92a20be777e5"}
Sep 07 16:57:45.085306 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.085267    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-m928w" event={"ID":"efdb8c9b-af4f-44fe-a2c6-fa66e7e7bc42","Type":"ContainerStarted","Data":"70376da256ecc7c71673c7399b8ec994da63dbc1472d6f7649ae01e45240753e"}
Sep 07 16:57:45.106198 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.106147    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-m928w" podStartSLOduration=2.177897598 podStartE2EDuration="4.106132472s" totalImagesPullingTime="1.928234874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:57:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:45.106030658 +0000 UTC m=+59.002877973" watchObservedRunningTime="2026-09-07 16:57:45.106132472 +0000 UTC m=+59.002979786"
Sep 07 16:57:45.129575 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.129541    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8558d584b-z4vwb"]
Sep 07 16:57:45.131670 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.131648    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8558d584b-z4vwb"
Sep 07 16:57:45.134553 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.134485    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 07 16:57:45.135138 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.134956    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 07 16:57:45.135138 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.134986    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 07 16:57:45.135138 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.135047    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 07 16:57:45.135355 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.135267    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pzx8d\""
Sep 07 16:57:45.135461 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.135446    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 07 16:57:45.145076 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.145023    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8558d584b-z4vwb"]
Sep 07 16:57:45.201564 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.201476    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/926f8354-d3db-420b-9f29-07c076e12bee-console-oauth-config\") pod \"console-8558d584b-z4vwb\" (UID: \"926f8354-d3db-420b-9f29-07c076e12bee\") " pod="openshift-console/console-8558d584b-z4vwb"
Sep 07 16:57:45.201564 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.201533    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/926f8354-d3db-420b-9f29-07c076e12bee-console-config\") pod \"console-8558d584b-z4vwb\" (UID: \"926f8354-d3db-420b-9f29-07c076e12bee\") " pod="openshift-console/console-8558d584b-z4vwb"
Sep 07 16:57:45.201797 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.201581    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/926f8354-d3db-420b-9f29-07c076e12bee-console-serving-cert\") pod \"console-8558d584b-z4vwb\" (UID: \"926f8354-d3db-420b-9f29-07c076e12bee\") " pod="openshift-console/console-8558d584b-z4vwb"
Sep 07 16:57:45.201797 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.201602    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/926f8354-d3db-420b-9f29-07c076e12bee-oauth-serving-cert\") pod \"console-8558d584b-z4vwb\" (UID: \"926f8354-d3db-420b-9f29-07c076e12bee\") " pod="openshift-console/console-8558d584b-z4vwb"
Sep 07 16:57:45.201797 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.201627    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7t2t\" (UniqueName: \"kubernetes.io/projected/926f8354-d3db-420b-9f29-07c076e12bee-kube-api-access-g7t2t\") pod \"console-8558d584b-z4vwb\" (UID: \"926f8354-d3db-420b-9f29-07c076e12bee\") " pod="openshift-console/console-8558d584b-z4vwb"
Sep 07 16:57:45.201797 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.201656    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/926f8354-d3db-420b-9f29-07c076e12bee-service-ca\") pod \"console-8558d584b-z4vwb\" (UID: \"926f8354-d3db-420b-9f29-07c076e12bee\") " pod="openshift-console/console-8558d584b-z4vwb"
Sep 07 16:57:45.302293 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.302258    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/926f8354-d3db-420b-9f29-07c076e12bee-console-oauth-config\") pod \"console-8558d584b-z4vwb\" (UID: \"926f8354-d3db-420b-9f29-07c076e12bee\") " pod="openshift-console/console-8558d584b-z4vwb"
Sep 07 16:57:45.302476 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.302327    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/926f8354-d3db-420b-9f29-07c076e12bee-console-config\") pod \"console-8558d584b-z4vwb\" (UID: \"926f8354-d3db-420b-9f29-07c076e12bee\") " pod="openshift-console/console-8558d584b-z4vwb"
Sep 07 16:57:45.302476 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.302358    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/926f8354-d3db-420b-9f29-07c076e12bee-console-serving-cert\") pod \"console-8558d584b-z4vwb\" (UID: \"926f8354-d3db-420b-9f29-07c076e12bee\") " pod="openshift-console/console-8558d584b-z4vwb"
Sep 07 16:57:45.302476 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.302387    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/926f8354-d3db-420b-9f29-07c076e12bee-oauth-serving-cert\") pod \"console-8558d584b-z4vwb\" (UID: \"926f8354-d3db-420b-9f29-07c076e12bee\") " pod="openshift-console/console-8558d584b-z4vwb"
Sep 07 16:57:45.302476 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.302411    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7t2t\" (UniqueName: \"kubernetes.io/projected/926f8354-d3db-420b-9f29-07c076e12bee-kube-api-access-g7t2t\") pod \"console-8558d584b-z4vwb\" (UID: \"926f8354-d3db-420b-9f29-07c076e12bee\") " pod="openshift-console/console-8558d584b-z4vwb"
Sep 07 16:57:45.302476 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.302458    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/926f8354-d3db-420b-9f29-07c076e12bee-service-ca\") pod \"console-8558d584b-z4vwb\" (UID: \"926f8354-d3db-420b-9f29-07c076e12bee\") " pod="openshift-console/console-8558d584b-z4vwb"
Sep 07 16:57:45.303210 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.303180    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/926f8354-d3db-420b-9f29-07c076e12bee-service-ca\") pod \"console-8558d584b-z4vwb\" (UID: \"926f8354-d3db-420b-9f29-07c076e12bee\") " pod="openshift-console/console-8558d584b-z4vwb"
Sep 07 16:57:45.303334 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.303214    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/926f8354-d3db-420b-9f29-07c076e12bee-console-config\") pod \"console-8558d584b-z4vwb\" (UID: \"926f8354-d3db-420b-9f29-07c076e12bee\") " pod="openshift-console/console-8558d584b-z4vwb"
Sep 07 16:57:45.303571 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.303523    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/926f8354-d3db-420b-9f29-07c076e12bee-oauth-serving-cert\") pod \"console-8558d584b-z4vwb\" (UID: \"926f8354-d3db-420b-9f29-07c076e12bee\") " pod="openshift-console/console-8558d584b-z4vwb"
Sep 07 16:57:45.305124 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.305103    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/926f8354-d3db-420b-9f29-07c076e12bee-console-oauth-config\") pod \"console-8558d584b-z4vwb\" (UID: \"926f8354-d3db-420b-9f29-07c076e12bee\") " pod="openshift-console/console-8558d584b-z4vwb"
Sep 07 16:57:45.305533 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.305514    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/926f8354-d3db-420b-9f29-07c076e12bee-console-serving-cert\") pod \"console-8558d584b-z4vwb\" (UID: \"926f8354-d3db-420b-9f29-07c076e12bee\") " pod="openshift-console/console-8558d584b-z4vwb"
Sep 07 16:57:45.319966 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.319939    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7t2t\" (UniqueName: \"kubernetes.io/projected/926f8354-d3db-420b-9f29-07c076e12bee-kube-api-access-g7t2t\") pod \"console-8558d584b-z4vwb\" (UID: \"926f8354-d3db-420b-9f29-07c076e12bee\") " pod="openshift-console/console-8558d584b-z4vwb"
Sep 07 16:57:45.442996 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.442957    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8558d584b-z4vwb"
Sep 07 16:57:45.720609 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.720523    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8558d584b-z4vwb"]
Sep 07 16:57:45.723571 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:57:45.723535    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod926f8354_d3db_420b_9f29_07c076e12bee.slice/crio-875f1010cd9f383288915f4a54e0edf2ee80ad0ad81f96a26e11dc3619216740 WatchSource:0}: Error finding container 875f1010cd9f383288915f4a54e0edf2ee80ad0ad81f96a26e11dc3619216740: Status 404 returned error can't find the container with id 875f1010cd9f383288915f4a54e0edf2ee80ad0ad81f96a26e11dc3619216740
Sep 07 16:57:45.996135 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:45.996064    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nk6rv"
Sep 07 16:57:46.089759 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:46.089715    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8558d584b-z4vwb" event={"ID":"926f8354-d3db-420b-9f29-07c076e12bee","Type":"ContainerStarted","Data":"875f1010cd9f383288915f4a54e0edf2ee80ad0ad81f96a26e11dc3619216740"}
Sep 07 16:57:46.138800 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:46.138758    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:46.243693 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:46.243660    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:46.344763 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:46.344729    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:47.275039 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.274965    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:47.404946 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.404883    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:47.665585 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.665538    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:47.712432 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.712396    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-hmmgj"]
Sep 07 16:57:47.714710 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.714686    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hmmgj"
Sep 07 16:57:47.720532 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.720471    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-chwrh\""
Sep 07 16:57:47.720874 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.720853    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 07 16:57:47.721229 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.721211    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 07 16:57:47.723632 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.723601    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fqx2\" (UniqueName: \"kubernetes.io/projected/27653d59-ca6e-4a9f-a3ca-660a338bad78-kube-api-access-5fqx2\") pod \"openshift-state-metrics-657fd6c54-hmmgj\" (UID: \"27653d59-ca6e-4a9f-a3ca-660a338bad78\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hmmgj"
Sep 07 16:57:47.723739 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.723720    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27653d59-ca6e-4a9f-a3ca-660a338bad78-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-hmmgj\" (UID: \"27653d59-ca6e-4a9f-a3ca-660a338bad78\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hmmgj"
Sep 07 16:57:47.723816 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.723758    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27653d59-ca6e-4a9f-a3ca-660a338bad78-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-hmmgj\" (UID: \"27653d59-ca6e-4a9f-a3ca-660a338bad78\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hmmgj"
Sep 07 16:57:47.723816 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.723793    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27653d59-ca6e-4a9f-a3ca-660a338bad78-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-hmmgj\" (UID: \"27653d59-ca6e-4a9f-a3ca-660a338bad78\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hmmgj"
Sep 07 16:57:47.740508 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.740481    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-hmmgj"]
Sep 07 16:57:47.770625 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.770590    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-f8tld"]
Sep 07 16:57:47.772819 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.772794    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-f8tld"
Sep 07 16:57:47.775619 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.775553    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 07 16:57:47.776184 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.775992    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 07 16:57:47.776819 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.776633    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 07 16:57:47.778387 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.778223    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-lt4g7\""
Sep 07 16:57:47.799619 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.799586    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-f8tld"]
Sep 07 16:57:47.817609 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.817551    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hqmt2"]
Sep 07 16:57:47.820008 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.819986    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hqmt2"
Sep 07 16:57:47.824096 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.824073    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/768b449d-d44e-4a85-8b5f-7e8b571faed3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-f8tld\" (UID: \"768b449d-d44e-4a85-8b5f-7e8b571faed3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f8tld"
Sep 07 16:57:47.824205 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.824116    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nj6l\" (UniqueName: \"kubernetes.io/projected/768b449d-d44e-4a85-8b5f-7e8b571faed3-kube-api-access-5nj6l\") pod \"kube-state-metrics-74cb57df7-f8tld\" (UID: \"768b449d-d44e-4a85-8b5f-7e8b571faed3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f8tld"
Sep 07 16:57:47.824205 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.824155    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27653d59-ca6e-4a9f-a3ca-660a338bad78-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-hmmgj\" (UID: \"27653d59-ca6e-4a9f-a3ca-660a338bad78\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hmmgj"
Sep 07 16:57:47.824310 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.824220    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/768b449d-d44e-4a85-8b5f-7e8b571faed3-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-f8tld\" (UID: \"768b449d-d44e-4a85-8b5f-7e8b571faed3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f8tld"
Sep 07 16:57:47.824310 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.824261    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/768b449d-d44e-4a85-8b5f-7e8b571faed3-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-f8tld\" (UID: \"768b449d-d44e-4a85-8b5f-7e8b571faed3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f8tld"
Sep 07 16:57:47.824417 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.824310    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/768b449d-d44e-4a85-8b5f-7e8b571faed3-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-f8tld\" (UID: \"768b449d-d44e-4a85-8b5f-7e8b571faed3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f8tld"
Sep 07 16:57:47.824417 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.824346    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fqx2\" (UniqueName: \"kubernetes.io/projected/27653d59-ca6e-4a9f-a3ca-660a338bad78-kube-api-access-5fqx2\") pod \"openshift-state-metrics-657fd6c54-hmmgj\" (UID: \"27653d59-ca6e-4a9f-a3ca-660a338bad78\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hmmgj"
Sep 07 16:57:47.824417 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.824398    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27653d59-ca6e-4a9f-a3ca-660a338bad78-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-hmmgj\" (UID: \"27653d59-ca6e-4a9f-a3ca-660a338bad78\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hmmgj"
Sep 07 16:57:47.824567 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.824483    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27653d59-ca6e-4a9f-a3ca-660a338bad78-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-hmmgj\" (UID: \"27653d59-ca6e-4a9f-a3ca-660a338bad78\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hmmgj"
Sep 07 16:57:47.824567 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.824518    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/768b449d-d44e-4a85-8b5f-7e8b571faed3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-f8tld\" (UID: \"768b449d-d44e-4a85-8b5f-7e8b571faed3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f8tld"
Sep 07 16:57:47.825376 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.825195    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27653d59-ca6e-4a9f-a3ca-660a338bad78-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-hmmgj\" (UID: \"27653d59-ca6e-4a9f-a3ca-660a338bad78\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hmmgj"
Sep 07 16:57:47.825376 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.825223    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 07 16:57:47.825542 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.825457    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ghqrn\""
Sep 07 16:57:47.825673 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.825652    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 07 16:57:47.825887 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.825868    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 07 16:57:47.828555 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.828506    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27653d59-ca6e-4a9f-a3ca-660a338bad78-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-hmmgj\" (UID: \"27653d59-ca6e-4a9f-a3ca-660a338bad78\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hmmgj"
Sep 07 16:57:47.828757 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.828730    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27653d59-ca6e-4a9f-a3ca-660a338bad78-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-hmmgj\" (UID: \"27653d59-ca6e-4a9f-a3ca-660a338bad78\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hmmgj"
Sep 07 16:57:47.858755 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.858632    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fqx2\" (UniqueName: \"kubernetes.io/projected/27653d59-ca6e-4a9f-a3ca-660a338bad78-kube-api-access-5fqx2\") pod \"openshift-state-metrics-657fd6c54-hmmgj\" (UID: \"27653d59-ca6e-4a9f-a3ca-660a338bad78\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hmmgj"
Sep 07 16:57:47.886887 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.886851    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:47.925718 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.925562    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/768b449d-d44e-4a85-8b5f-7e8b571faed3-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-f8tld\" (UID: \"768b449d-d44e-4a85-8b5f-7e8b571faed3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f8tld"
Sep 07 16:57:47.925718 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.925612    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff018cdc-ce65-469a-af7e-67b7d8ad594b-metrics-client-ca\") pod \"node-exporter-hqmt2\" (UID: \"ff018cdc-ce65-469a-af7e-67b7d8ad594b\") " pod="openshift-monitoring/node-exporter-hqmt2"
Sep 07 16:57:47.926017 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.925745    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ff018cdc-ce65-469a-af7e-67b7d8ad594b-node-exporter-textfile\") pod \"node-exporter-hqmt2\" (UID: \"ff018cdc-ce65-469a-af7e-67b7d8ad594b\") " pod="openshift-monitoring/node-exporter-hqmt2"
Sep 07 16:57:47.926017 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.925794    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/768b449d-d44e-4a85-8b5f-7e8b571faed3-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-f8tld\" (UID: \"768b449d-d44e-4a85-8b5f-7e8b571faed3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f8tld"
Sep 07 16:57:47.926017 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.925839    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xjtt\" (UniqueName: \"kubernetes.io/projected/ff018cdc-ce65-469a-af7e-67b7d8ad594b-kube-api-access-2xjtt\") pod \"node-exporter-hqmt2\" (UID: \"ff018cdc-ce65-469a-af7e-67b7d8ad594b\") " pod="openshift-monitoring/node-exporter-hqmt2"
Sep 07 16:57:47.926017 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.925946    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/768b449d-d44e-4a85-8b5f-7e8b571faed3-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-f8tld\" (UID: \"768b449d-d44e-4a85-8b5f-7e8b571faed3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f8tld"
Sep 07 16:57:47.926225 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.926007    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/768b449d-d44e-4a85-8b5f-7e8b571faed3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-f8tld\" (UID: \"768b449d-d44e-4a85-8b5f-7e8b571faed3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f8tld"
Sep 07 16:57:47.926225 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.926081    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ff018cdc-ce65-469a-af7e-67b7d8ad594b-root\") pod \"node-exporter-hqmt2\" (UID: \"ff018cdc-ce65-469a-af7e-67b7d8ad594b\") " pod="openshift-monitoring/node-exporter-hqmt2"
Sep 07 16:57:47.926225 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.926114    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ff018cdc-ce65-469a-af7e-67b7d8ad594b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hqmt2\" (UID: \"ff018cdc-ce65-469a-af7e-67b7d8ad594b\") " pod="openshift-monitoring/node-exporter-hqmt2"
Sep 07 16:57:47.926225 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.926144    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ff018cdc-ce65-469a-af7e-67b7d8ad594b-node-exporter-tls\") pod \"node-exporter-hqmt2\" (UID: \"ff018cdc-ce65-469a-af7e-67b7d8ad594b\") " pod="openshift-monitoring/node-exporter-hqmt2"
Sep 07 16:57:47.926225 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.926168    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ff018cdc-ce65-469a-af7e-67b7d8ad594b-node-exporter-accelerators-collector-config\") pod \"node-exporter-hqmt2\" (UID: \"ff018cdc-ce65-469a-af7e-67b7d8ad594b\") " pod="openshift-monitoring/node-exporter-hqmt2"
Sep 07 16:57:47.926225 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.926199    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/768b449d-d44e-4a85-8b5f-7e8b571faed3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-f8tld\" (UID: \"768b449d-d44e-4a85-8b5f-7e8b571faed3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f8tld"
Sep 07 16:57:47.926531 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.926245    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nj6l\" (UniqueName: \"kubernetes.io/projected/768b449d-d44e-4a85-8b5f-7e8b571faed3-kube-api-access-5nj6l\") pod \"kube-state-metrics-74cb57df7-f8tld\" (UID: \"768b449d-d44e-4a85-8b5f-7e8b571faed3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f8tld"
Sep 07 16:57:47.926531 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.926304    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff018cdc-ce65-469a-af7e-67b7d8ad594b-sys\") pod \"node-exporter-hqmt2\" (UID: \"ff018cdc-ce65-469a-af7e-67b7d8ad594b\") " pod="openshift-monitoring/node-exporter-hqmt2"
Sep 07 16:57:47.926531 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.926348    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/768b449d-d44e-4a85-8b5f-7e8b571faed3-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-f8tld\" (UID: \"768b449d-d44e-4a85-8b5f-7e8b571faed3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f8tld"
Sep 07 16:57:47.926531 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.926466    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ff018cdc-ce65-469a-af7e-67b7d8ad594b-node-exporter-wtmp\") pod \"node-exporter-hqmt2\" (UID: \"ff018cdc-ce65-469a-af7e-67b7d8ad594b\") " pod="openshift-monitoring/node-exporter-hqmt2"
Sep 07 16:57:47.926917 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.926851    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/768b449d-d44e-4a85-8b5f-7e8b571faed3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-f8tld\" (UID: \"768b449d-d44e-4a85-8b5f-7e8b571faed3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f8tld"
Sep 07 16:57:47.926917 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.926885    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/768b449d-d44e-4a85-8b5f-7e8b571faed3-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-f8tld\" (UID: \"768b449d-d44e-4a85-8b5f-7e8b571faed3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f8tld"
Sep 07 16:57:47.929257 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.929233    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/768b449d-d44e-4a85-8b5f-7e8b571faed3-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-f8tld\" (UID: \"768b449d-d44e-4a85-8b5f-7e8b571faed3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f8tld"
Sep 07 16:57:47.929373 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.929319    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/768b449d-d44e-4a85-8b5f-7e8b571faed3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-f8tld\" (UID: \"768b449d-d44e-4a85-8b5f-7e8b571faed3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f8tld"
Sep 07 16:57:47.942494 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:47.942467    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nj6l\" (UniqueName: \"kubernetes.io/projected/768b449d-d44e-4a85-8b5f-7e8b571faed3-kube-api-access-5nj6l\") pod \"kube-state-metrics-74cb57df7-f8tld\" (UID: \"768b449d-d44e-4a85-8b5f-7e8b571faed3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f8tld"
Sep 07 16:57:48.026400 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.026363    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hmmgj"
Sep 07 16:57:48.028048 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.027680    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ff018cdc-ce65-469a-af7e-67b7d8ad594b-root\") pod \"node-exporter-hqmt2\" (UID: \"ff018cdc-ce65-469a-af7e-67b7d8ad594b\") " pod="openshift-monitoring/node-exporter-hqmt2"
Sep 07 16:57:48.028048 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.027720    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ff018cdc-ce65-469a-af7e-67b7d8ad594b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hqmt2\" (UID: \"ff018cdc-ce65-469a-af7e-67b7d8ad594b\") " pod="openshift-monitoring/node-exporter-hqmt2"
Sep 07 16:57:48.028048 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.027740    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ff018cdc-ce65-469a-af7e-67b7d8ad594b-node-exporter-tls\") pod \"node-exporter-hqmt2\" (UID: \"ff018cdc-ce65-469a-af7e-67b7d8ad594b\") " pod="openshift-monitoring/node-exporter-hqmt2"
Sep 07 16:57:48.028048 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.027758    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ff018cdc-ce65-469a-af7e-67b7d8ad594b-node-exporter-accelerators-collector-config\") pod \"node-exporter-hqmt2\" (UID: \"ff018cdc-ce65-469a-af7e-67b7d8ad594b\") " pod="openshift-monitoring/node-exporter-hqmt2"
Sep 07 16:57:48.028048 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.027841    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff018cdc-ce65-469a-af7e-67b7d8ad594b-sys\") pod \"node-exporter-hqmt2\" (UID: \"ff018cdc-ce65-469a-af7e-67b7d8ad594b\") " pod="openshift-monitoring/node-exporter-hqmt2"
Sep 07 16:57:48.028048 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.027863    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ff018cdc-ce65-469a-af7e-67b7d8ad594b-root\") pod \"node-exporter-hqmt2\" (UID: \"ff018cdc-ce65-469a-af7e-67b7d8ad594b\") " pod="openshift-monitoring/node-exporter-hqmt2"
Sep 07 16:57:48.028048 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.027871    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ff018cdc-ce65-469a-af7e-67b7d8ad594b-node-exporter-wtmp\") pod \"node-exporter-hqmt2\" (UID: \"ff018cdc-ce65-469a-af7e-67b7d8ad594b\") " pod="openshift-monitoring/node-exporter-hqmt2"
Sep 07 16:57:48.028048 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.027953    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff018cdc-ce65-469a-af7e-67b7d8ad594b-metrics-client-ca\") pod \"node-exporter-hqmt2\" (UID: \"ff018cdc-ce65-469a-af7e-67b7d8ad594b\") " pod="openshift-monitoring/node-exporter-hqmt2"
Sep 07 16:57:48.028048 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.027986    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ff018cdc-ce65-469a-af7e-67b7d8ad594b-node-exporter-textfile\") pod \"node-exporter-hqmt2\" (UID: \"ff018cdc-ce65-469a-af7e-67b7d8ad594b\") " pod="openshift-monitoring/node-exporter-hqmt2"
Sep 07 16:57:48.028048 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.027995    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ff018cdc-ce65-469a-af7e-67b7d8ad594b-node-exporter-wtmp\") pod \"node-exporter-hqmt2\" (UID: \"ff018cdc-ce65-469a-af7e-67b7d8ad594b\") " pod="openshift-monitoring/node-exporter-hqmt2"
Sep 07 16:57:48.028048 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.028033    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xjtt\" (UniqueName: \"kubernetes.io/projected/ff018cdc-ce65-469a-af7e-67b7d8ad594b-kube-api-access-2xjtt\") pod \"node-exporter-hqmt2\" (UID: \"ff018cdc-ce65-469a-af7e-67b7d8ad594b\") " pod="openshift-monitoring/node-exporter-hqmt2"
Sep 07 16:57:48.028646 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.028308    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff018cdc-ce65-469a-af7e-67b7d8ad594b-sys\") pod \"node-exporter-hqmt2\" (UID: \"ff018cdc-ce65-469a-af7e-67b7d8ad594b\") " pod="openshift-monitoring/node-exporter-hqmt2"
Sep 07 16:57:48.028646 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.028587    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff018cdc-ce65-469a-af7e-67b7d8ad594b-metrics-client-ca\") pod \"node-exporter-hqmt2\" (UID: \"ff018cdc-ce65-469a-af7e-67b7d8ad594b\") " pod="openshift-monitoring/node-exporter-hqmt2"
Sep 07 16:57:48.028646 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.028601    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ff018cdc-ce65-469a-af7e-67b7d8ad594b-node-exporter-accelerators-collector-config\") pod \"node-exporter-hqmt2\" (UID: \"ff018cdc-ce65-469a-af7e-67b7d8ad594b\") " pod="openshift-monitoring/node-exporter-hqmt2"
Sep 07 16:57:48.028797 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.028668    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ff018cdc-ce65-469a-af7e-67b7d8ad594b-node-exporter-textfile\") pod \"node-exporter-hqmt2\" (UID: \"ff018cdc-ce65-469a-af7e-67b7d8ad594b\") " pod="openshift-monitoring/node-exporter-hqmt2"
Sep 07 16:57:48.031252 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.031226    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ff018cdc-ce65-469a-af7e-67b7d8ad594b-node-exporter-tls\") pod \"node-exporter-hqmt2\" (UID: \"ff018cdc-ce65-469a-af7e-67b7d8ad594b\") " pod="openshift-monitoring/node-exporter-hqmt2"
Sep 07 16:57:48.031252 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.031245    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ff018cdc-ce65-469a-af7e-67b7d8ad594b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hqmt2\" (UID: \"ff018cdc-ce65-469a-af7e-67b7d8ad594b\") " pod="openshift-monitoring/node-exporter-hqmt2"
Sep 07 16:57:48.042153 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.042131    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xjtt\" (UniqueName: \"kubernetes.io/projected/ff018cdc-ce65-469a-af7e-67b7d8ad594b-kube-api-access-2xjtt\") pod \"node-exporter-hqmt2\" (UID: \"ff018cdc-ce65-469a-af7e-67b7d8ad594b\") " pod="openshift-monitoring/node-exporter-hqmt2"
Sep 07 16:57:48.084281 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.084247    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-f8tld"
Sep 07 16:57:48.119089 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.118597    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:48.140816 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.140607    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hqmt2"
Sep 07 16:57:48.321687 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.321625    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:48.421427 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.421235    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:48.549220 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.549186    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:48.627236 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.627162    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 16:57:48.634485 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.634457    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.638550 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.638400    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 07 16:57:48.638550 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.638405    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 07 16:57:48.638807 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.638768    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 07 16:57:48.638930 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.638809    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 07 16:57:48.639040 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.639024    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 07 16:57:48.639485 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.639325    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 07 16:57:48.640024 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.639611    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 07 16:57:48.640024 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.639665    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 07 16:57:48.640024 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.639797    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 07 16:57:48.640024 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.639922    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7qmw6\""
Sep 07 16:57:48.665855 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.665827    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 16:57:48.732667 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.732483    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7dfbd559-299c-489d-94d3-925ab300a2d4-config-out\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.732667 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.732522    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.732667 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.732558    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.732667 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.732594    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dfbd559-299c-489d-94d3-925ab300a2d4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.732667 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.732626    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-config-volume\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.732667 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.732649    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dfbd559-299c-489d-94d3-925ab300a2d4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.733169 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.732686    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-web-config\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.733169 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.732758    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t7z2\" (UniqueName: \"kubernetes.io/projected/7dfbd559-299c-489d-94d3-925ab300a2d4-kube-api-access-7t7z2\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.733169 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.732817    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.733169 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.732924    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.733169 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.732953    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.733169 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.733014    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7dfbd559-299c-489d-94d3-925ab300a2d4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.733169 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.733092    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7dfbd559-299c-489d-94d3-925ab300a2d4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.749005 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.748916    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:48.833995 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.833960    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.834157 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.834005    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.834157 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.834032    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7dfbd559-299c-489d-94d3-925ab300a2d4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.834157 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.834096    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7dfbd559-299c-489d-94d3-925ab300a2d4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.834157 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.834139    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7dfbd559-299c-489d-94d3-925ab300a2d4-config-out\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.834377 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.834164    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.834377 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.834203    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.834377 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.834241    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dfbd559-299c-489d-94d3-925ab300a2d4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.834377 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.834283    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-config-volume\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.834377 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.834305    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dfbd559-299c-489d-94d3-925ab300a2d4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.834377 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.834334    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-web-config\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.834377 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.834359    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t7z2\" (UniqueName: \"kubernetes.io/projected/7dfbd559-299c-489d-94d3-925ab300a2d4-kube-api-access-7t7z2\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.834696 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.834397    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.834696 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.834550    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7dfbd559-299c-489d-94d3-925ab300a2d4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.837776 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.837685    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7dfbd559-299c-489d-94d3-925ab300a2d4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.837776 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.837769    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-web-config\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.838011 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.837986    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dfbd559-299c-489d-94d3-925ab300a2d4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.838218 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.838198    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dfbd559-299c-489d-94d3-925ab300a2d4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.840414 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.840230    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.841984 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.841958    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-config-volume\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.842083 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.842019    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.843008 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.842379    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7dfbd559-299c-489d-94d3-925ab300a2d4-config-out\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.843008 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.842536    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.843008 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.842973    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.843992 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.843964    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.847607 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.847566    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t7z2\" (UniqueName: \"kubernetes.io/projected/7dfbd559-299c-489d-94d3-925ab300a2d4-kube-api-access-7t7z2\") pod \"alertmanager-main-0\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.945731 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.945641    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:48.948461 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:48.948432    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:57:48.962497 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:57:48.962458    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff018cdc_ce65_469a_af7e_67b7d8ad594b.slice/crio-76e5c433de2498131274a365cd1f6f9aea22a9736ce3af1198c67fa1eee1bc2d WatchSource:0}: Error finding container 76e5c433de2498131274a365cd1f6f9aea22a9736ce3af1198c67fa1eee1bc2d: Status 404 returned error can't find the container with id 76e5c433de2498131274a365cd1f6f9aea22a9736ce3af1198c67fa1eee1bc2d
Sep 07 16:57:49.103935 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:49.103883    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8558d584b-z4vwb" event={"ID":"926f8354-d3db-420b-9f29-07c076e12bee","Type":"ContainerStarted","Data":"f9258b18b3b663496403c1526b14f51c16edb3c2bb250a37a1cf554a79d6df86"}
Sep 07 16:57:49.106079 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:49.106027    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hqmt2" event={"ID":"ff018cdc-ce65-469a-af7e-67b7d8ad594b","Type":"ContainerStarted","Data":"76e5c433de2498131274a365cd1f6f9aea22a9736ce3af1198c67fa1eee1bc2d"}
Sep 07 16:57:49.135579 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:49.135517    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8558d584b-z4vwb" podStartSLOduration=0.894279247 podStartE2EDuration="4.135498745s" totalImagesPullingTime="3.241219498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:57:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:49.134630812 +0000 UTC m=+63.031478127" watchObservedRunningTime="2026-09-07 16:57:49.135498745 +0000 UTC m=+63.032346060"
Sep 07 16:57:49.239211 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:49.239066    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-hmmgj"]
Sep 07 16:57:49.244798 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:57:49.244764    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27653d59_ca6e_4a9f_a3ca_660a338bad78.slice/crio-670e79891a3781e99f0f70fc9c520671a1e01d618b648850a85e0f737df0c56d WatchSource:0}: Error finding container 670e79891a3781e99f0f70fc9c520671a1e01d618b648850a85e0f737df0c56d: Status 404 returned error can't find the container with id 670e79891a3781e99f0f70fc9c520671a1e01d618b648850a85e0f737df0c56d
Sep 07 16:57:49.258324 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:49.258298    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-f8tld"]
Sep 07 16:57:49.261557 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:57:49.261525    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod768b449d_d44e_4a85_8b5f_7e8b571faed3.slice/crio-92ec9de27ca09cfcceb68bce93f61676bcb28e986512f16544f7d96d906cc91f WatchSource:0}: Error finding container 92ec9de27ca09cfcceb68bce93f61676bcb28e986512f16544f7d96d906cc91f: Status 404 returned error can't find the container with id 92ec9de27ca09cfcceb68bce93f61676bcb28e986512f16544f7d96d906cc91f
Sep 07 16:57:49.282241 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:49.282189    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 16:57:49.290886 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:57:49.290854    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dfbd559_299c_489d_94d3_925ab300a2d4.slice/crio-ec877babb5cbacd013d653e207bc29544816ba6e9446046cfb21f9e614d70c90 WatchSource:0}: Error finding container ec877babb5cbacd013d653e207bc29544816ba6e9446046cfb21f9e614d70c90: Status 404 returned error can't find the container with id ec877babb5cbacd013d653e207bc29544816ba6e9446046cfb21f9e614d70c90
Sep 07 16:57:49.982819 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:49.982787    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:50.093561 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.093518    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:50.114320 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.114214    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dfbd559-299c-489d-94d3-925ab300a2d4","Type":"ContainerStarted","Data":"ec877babb5cbacd013d653e207bc29544816ba6e9446046cfb21f9e614d70c90"}
Sep 07 16:57:50.116640 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.116561    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-f8tld" event={"ID":"768b449d-d44e-4a85-8b5f-7e8b571faed3","Type":"ContainerStarted","Data":"92ec9de27ca09cfcceb68bce93f61676bcb28e986512f16544f7d96d906cc91f"}
Sep 07 16:57:50.119589 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.119482    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hmmgj" event={"ID":"27653d59-ca6e-4a9f-a3ca-660a338bad78","Type":"ContainerStarted","Data":"c38133ee905a21d6f55c906fec4bb59771da50fcc204a7c2a710dc7ace949efb"}
Sep 07 16:57:50.119589 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.119535    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hmmgj" event={"ID":"27653d59-ca6e-4a9f-a3ca-660a338bad78","Type":"ContainerStarted","Data":"65bbc69fb0e3a00f35c1f67a6baf04b5e83ad7c0caf8a92b91e8bfc7d6e49001"}
Sep 07 16:57:50.119589 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.119562    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hmmgj" event={"ID":"27653d59-ca6e-4a9f-a3ca-660a338bad78","Type":"ContainerStarted","Data":"670e79891a3781e99f0f70fc9c520671a1e01d618b648850a85e0f737df0c56d"}
Sep 07 16:57:50.121720 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.121639    2575 generic.go:356] "Generic (PLEG): container finished" podID="ff018cdc-ce65-469a-af7e-67b7d8ad594b" containerID="58e4d2056e5f98c6e69a2bf2e244f717b66d37ea979ff07d74eae4f8e49160bb" exitCode=0
Sep 07 16:57:50.122476 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.122388    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hqmt2" event={"ID":"ff018cdc-ce65-469a-af7e-67b7d8ad594b","Type":"ContainerDied","Data":"58e4d2056e5f98c6e69a2bf2e244f717b66d37ea979ff07d74eae4f8e49160bb"}
Sep 07 16:57:50.625343 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.625305    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-97975b55c-p8s7b"]
Sep 07 16:57:50.639437 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.639413    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b"
Sep 07 16:57:50.642096 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.642074    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 07 16:57:50.645578 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.645521    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 07 16:57:50.645778 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.645756    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 07 16:57:50.645868 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.645850    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 07 16:57:50.646050 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.646020    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-32brq9q7rfhhe\""
Sep 07 16:57:50.646195 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.646173    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-2xpcn\""
Sep 07 16:57:50.646428 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.646270    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 07 16:57:50.663973 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.663868    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-97975b55c-p8s7b"]
Sep 07 16:57:50.700763 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.700728    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:50.754035 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.753995    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4fsj\" (UniqueName: \"kubernetes.io/projected/15fb9da0-89c7-459e-9c49-84110269cc31-kube-api-access-c4fsj\") pod \"thanos-querier-97975b55c-p8s7b\" (UID: \"15fb9da0-89c7-459e-9c49-84110269cc31\") " pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b"
Sep 07 16:57:50.754196 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.754099    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/15fb9da0-89c7-459e-9c49-84110269cc31-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-97975b55c-p8s7b\" (UID: \"15fb9da0-89c7-459e-9c49-84110269cc31\") " pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b"
Sep 07 16:57:50.754196 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.754144    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15fb9da0-89c7-459e-9c49-84110269cc31-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-97975b55c-p8s7b\" (UID: \"15fb9da0-89c7-459e-9c49-84110269cc31\") " pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b"
Sep 07 16:57:50.754196 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.754190    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15fb9da0-89c7-459e-9c49-84110269cc31-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-97975b55c-p8s7b\" (UID: \"15fb9da0-89c7-459e-9c49-84110269cc31\") " pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b"
Sep 07 16:57:50.754354 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.754223    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/15fb9da0-89c7-459e-9c49-84110269cc31-secret-grpc-tls\") pod \"thanos-querier-97975b55c-p8s7b\" (UID: \"15fb9da0-89c7-459e-9c49-84110269cc31\") " pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b"
Sep 07 16:57:50.754354 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.754273    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/15fb9da0-89c7-459e-9c49-84110269cc31-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-97975b55c-p8s7b\" (UID: \"15fb9da0-89c7-459e-9c49-84110269cc31\") " pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b"
Sep 07 16:57:50.754354 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.754297    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15fb9da0-89c7-459e-9c49-84110269cc31-metrics-client-ca\") pod \"thanos-querier-97975b55c-p8s7b\" (UID: \"15fb9da0-89c7-459e-9c49-84110269cc31\") " pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b"
Sep 07 16:57:50.754473 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.754376    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/15fb9da0-89c7-459e-9c49-84110269cc31-secret-thanos-querier-tls\") pod \"thanos-querier-97975b55c-p8s7b\" (UID: \"15fb9da0-89c7-459e-9c49-84110269cc31\") " pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b"
Sep 07 16:57:50.855450 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.855409    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15fb9da0-89c7-459e-9c49-84110269cc31-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-97975b55c-p8s7b\" (UID: \"15fb9da0-89c7-459e-9c49-84110269cc31\") " pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b"
Sep 07 16:57:50.855639 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.855473    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15fb9da0-89c7-459e-9c49-84110269cc31-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-97975b55c-p8s7b\" (UID: \"15fb9da0-89c7-459e-9c49-84110269cc31\") " pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b"
Sep 07 16:57:50.855639 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.855517    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/15fb9da0-89c7-459e-9c49-84110269cc31-secret-grpc-tls\") pod \"thanos-querier-97975b55c-p8s7b\" (UID: \"15fb9da0-89c7-459e-9c49-84110269cc31\") " pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b"
Sep 07 16:57:50.855639 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.855561    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/15fb9da0-89c7-459e-9c49-84110269cc31-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-97975b55c-p8s7b\" (UID: \"15fb9da0-89c7-459e-9c49-84110269cc31\") " pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b"
Sep 07 16:57:50.855639 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.855585    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15fb9da0-89c7-459e-9c49-84110269cc31-metrics-client-ca\") pod \"thanos-querier-97975b55c-p8s7b\" (UID: \"15fb9da0-89c7-459e-9c49-84110269cc31\") " pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b"
Sep 07 16:57:50.855639 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.855626    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/15fb9da0-89c7-459e-9c49-84110269cc31-secret-thanos-querier-tls\") pod \"thanos-querier-97975b55c-p8s7b\" (UID: \"15fb9da0-89c7-459e-9c49-84110269cc31\") " pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b"
Sep 07 16:57:50.855886 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.855665    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4fsj\" (UniqueName: \"kubernetes.io/projected/15fb9da0-89c7-459e-9c49-84110269cc31-kube-api-access-c4fsj\") pod \"thanos-querier-97975b55c-p8s7b\" (UID: \"15fb9da0-89c7-459e-9c49-84110269cc31\") " pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b"
Sep 07 16:57:50.855886 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.855720    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/15fb9da0-89c7-459e-9c49-84110269cc31-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-97975b55c-p8s7b\" (UID: \"15fb9da0-89c7-459e-9c49-84110269cc31\") " pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b"
Sep 07 16:57:50.856521 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.856452    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15fb9da0-89c7-459e-9c49-84110269cc31-metrics-client-ca\") pod \"thanos-querier-97975b55c-p8s7b\" (UID: \"15fb9da0-89c7-459e-9c49-84110269cc31\") " pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b"
Sep 07 16:57:50.858866 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.858840    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15fb9da0-89c7-459e-9c49-84110269cc31-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-97975b55c-p8s7b\" (UID: \"15fb9da0-89c7-459e-9c49-84110269cc31\") " pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b"
Sep 07 16:57:50.859013 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.858958    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/15fb9da0-89c7-459e-9c49-84110269cc31-secret-grpc-tls\") pod \"thanos-querier-97975b55c-p8s7b\" (UID: \"15fb9da0-89c7-459e-9c49-84110269cc31\") " pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b"
Sep 07 16:57:50.859084 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.859047    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/15fb9da0-89c7-459e-9c49-84110269cc31-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-97975b55c-p8s7b\" (UID: \"15fb9da0-89c7-459e-9c49-84110269cc31\") " pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b"
Sep 07 16:57:50.859278 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.859234    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15fb9da0-89c7-459e-9c49-84110269cc31-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-97975b55c-p8s7b\" (UID: \"15fb9da0-89c7-459e-9c49-84110269cc31\") " pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b"
Sep 07 16:57:50.859639 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.859615    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/15fb9da0-89c7-459e-9c49-84110269cc31-secret-thanos-querier-tls\") pod \"thanos-querier-97975b55c-p8s7b\" (UID: \"15fb9da0-89c7-459e-9c49-84110269cc31\") " pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b"
Sep 07 16:57:50.859997 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.859977    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/15fb9da0-89c7-459e-9c49-84110269cc31-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-97975b55c-p8s7b\" (UID: \"15fb9da0-89c7-459e-9c49-84110269cc31\") " pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b"
Sep 07 16:57:50.872157 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.872133    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4fsj\" (UniqueName: \"kubernetes.io/projected/15fb9da0-89c7-459e-9c49-84110269cc31-kube-api-access-c4fsj\") pod \"thanos-querier-97975b55c-p8s7b\" (UID: \"15fb9da0-89c7-459e-9c49-84110269cc31\") " pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b"
Sep 07 16:57:50.909960 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.909859    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:50.951137 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:50.951095    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b"
Sep 07 16:57:51.030518 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:51.030487    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:51.073048 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:51.073023    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-g6dvf"
Sep 07 16:57:51.129696 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:51.129659    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hqmt2" event={"ID":"ff018cdc-ce65-469a-af7e-67b7d8ad594b","Type":"ContainerStarted","Data":"48c08a810ac3d56626bfa4746604d5e7bf7bf9795074a234a8efc90c6184efd4"}
Sep 07 16:57:52.146648 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.146611    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:52.172435 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.172402    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-jl479"]
Sep 07 16:57:52.175178 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.175154    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-jl479"
Sep 07 16:57:52.194647 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.194621    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 07 16:57:52.194805 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.194680    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4bs88\""
Sep 07 16:57:52.268905 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.268857    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/580463c2-35f7-4985-bfc6-c6d68d5d396a-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-jl479\" (UID: \"580463c2-35f7-4985-bfc6-c6d68d5d396a\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-jl479"
Sep 07 16:57:52.269087 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.269051    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqb9q\" (UniqueName: \"kubernetes.io/projected/580463c2-35f7-4985-bfc6-c6d68d5d396a-kube-api-access-qqb9q\") pod \"monitoring-plugin-85bbbbbf4-jl479\" (UID: \"580463c2-35f7-4985-bfc6-c6d68d5d396a\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-jl479"
Sep 07 16:57:52.274450 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.274416    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-jl479"]
Sep 07 16:57:52.295642 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.295606    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:52.370047 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.370009    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqb9q\" (UniqueName: \"kubernetes.io/projected/580463c2-35f7-4985-bfc6-c6d68d5d396a-kube-api-access-qqb9q\") pod \"monitoring-plugin-85bbbbbf4-jl479\" (UID: \"580463c2-35f7-4985-bfc6-c6d68d5d396a\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-jl479"
Sep 07 16:57:52.370232 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.370071    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/580463c2-35f7-4985-bfc6-c6d68d5d396a-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-jl479\" (UID: \"580463c2-35f7-4985-bfc6-c6d68d5d396a\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-jl479"
Sep 07 16:57:52.370232 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.370106    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6ab0a94-0f1c-496c-9072-1c50fcbcfadc-original-pull-secret\") pod \"global-pull-secret-syncer-g54wv\" (UID: \"f6ab0a94-0f1c-496c-9072-1c50fcbcfadc\") " pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:57:52.370232 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.370182    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba783056-dec5-4200-8726-97d3b462d24d-metrics-certs\") pod \"network-metrics-daemon-nplbv\" (UID: \"ba783056-dec5-4200-8726-97d3b462d24d\") " pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:57:52.373011 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.372951    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 07 16:57:52.373445 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.373294    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 07 16:57:52.373445 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.373383    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/580463c2-35f7-4985-bfc6-c6d68d5d396a-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-jl479\" (UID: \"580463c2-35f7-4985-bfc6-c6d68d5d396a\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-jl479"
Sep 07 16:57:52.383555 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.383525    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6ab0a94-0f1c-496c-9072-1c50fcbcfadc-original-pull-secret\") pod \"global-pull-secret-syncer-g54wv\" (UID: \"f6ab0a94-0f1c-496c-9072-1c50fcbcfadc\") " pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:57:52.383745 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.383718    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba783056-dec5-4200-8726-97d3b462d24d-metrics-certs\") pod \"network-metrics-daemon-nplbv\" (UID: \"ba783056-dec5-4200-8726-97d3b462d24d\") " pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:57:52.393758 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.393735    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqb9q\" (UniqueName: \"kubernetes.io/projected/580463c2-35f7-4985-bfc6-c6d68d5d396a-kube-api-access-qqb9q\") pod \"monitoring-plugin-85bbbbbf4-jl479\" (UID: \"580463c2-35f7-4985-bfc6-c6d68d5d396a\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-jl479"
Sep 07 16:57:52.420064 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.419993    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:52.424852 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.424828    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7c658bfc5c-jlrd9"]
Sep 07 16:57:52.429085 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.429061    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7c658bfc5c-jlrd9"
Sep 07 16:57:52.429200 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.429162    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g54wv"
Sep 07 16:57:52.435002 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.434984    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7gs240rjk02ii\""
Sep 07 16:57:52.435586 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.435562    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 07 16:57:52.435700 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.435567    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 07 16:57:52.438492 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.438471    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 07 16:57:52.438881 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.438860    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-wg9xq\""
Sep 07 16:57:52.439087 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.439071    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 07 16:57:52.440326 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.440226    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bvnj8\""
Sep 07 16:57:52.444205 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.444181    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7c658bfc5c-jlrd9"]
Sep 07 16:57:52.447971 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.447950    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nplbv"
Sep 07 16:57:52.471628 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.471595    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cdb8d674-3d7f-449c-bedc-770791095e6d-metrics-server-audit-profiles\") pod \"metrics-server-7c658bfc5c-jlrd9\" (UID: \"cdb8d674-3d7f-449c-bedc-770791095e6d\") " pod="openshift-monitoring/metrics-server-7c658bfc5c-jlrd9"
Sep 07 16:57:52.471628 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.471634    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cdb8d674-3d7f-449c-bedc-770791095e6d-client-ca-bundle\") pod \"metrics-server-7c658bfc5c-jlrd9\" (UID: \"cdb8d674-3d7f-449c-bedc-770791095e6d\") " pod="openshift-monitoring/metrics-server-7c658bfc5c-jlrd9"
Sep 07 16:57:52.471851 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.471659    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cdb8d674-3d7f-449c-bedc-770791095e6d-secret-metrics-server-tls\") pod \"metrics-server-7c658bfc5c-jlrd9\" (UID: \"cdb8d674-3d7f-449c-bedc-770791095e6d\") " pod="openshift-monitoring/metrics-server-7c658bfc5c-jlrd9"
Sep 07 16:57:52.471851 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.471765    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cdb8d674-3d7f-449c-bedc-770791095e6d-audit-log\") pod \"metrics-server-7c658bfc5c-jlrd9\" (UID: \"cdb8d674-3d7f-449c-bedc-770791095e6d\") " pod="openshift-monitoring/metrics-server-7c658bfc5c-jlrd9"
Sep 07 16:57:52.471851 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.471822    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7l7s\" (UniqueName: \"kubernetes.io/projected/cdb8d674-3d7f-449c-bedc-770791095e6d-kube-api-access-d7l7s\") pod \"metrics-server-7c658bfc5c-jlrd9\" (UID: \"cdb8d674-3d7f-449c-bedc-770791095e6d\") " pod="openshift-monitoring/metrics-server-7c658bfc5c-jlrd9"
Sep 07 16:57:52.472027 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.471849    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdb8d674-3d7f-449c-bedc-770791095e6d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c658bfc5c-jlrd9\" (UID: \"cdb8d674-3d7f-449c-bedc-770791095e6d\") " pod="openshift-monitoring/metrics-server-7c658bfc5c-jlrd9"
Sep 07 16:57:52.472027 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.471906    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cdb8d674-3d7f-449c-bedc-770791095e6d-secret-metrics-server-client-certs\") pod \"metrics-server-7c658bfc5c-jlrd9\" (UID: \"cdb8d674-3d7f-449c-bedc-770791095e6d\") " pod="openshift-monitoring/metrics-server-7c658bfc5c-jlrd9"
Sep 07 16:57:52.472027 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.471943    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d4x4\" (UniqueName: \"kubernetes.io/projected/363e1dc1-6917-4e79-a2ea-024497e43a3a-kube-api-access-4d4x4\") pod \"network-check-target-g2l8w\" (UID: \"363e1dc1-6917-4e79-a2ea-024497e43a3a\") " pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:57:52.475238 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.475215    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 07 16:57:52.486007 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.485984    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-jl479"
Sep 07 16:57:52.486678 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.486654    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 07 16:57:52.495741 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.495722    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d4x4\" (UniqueName: \"kubernetes.io/projected/363e1dc1-6917-4e79-a2ea-024497e43a3a-kube-api-access-4d4x4\") pod \"network-check-target-g2l8w\" (UID: \"363e1dc1-6917-4e79-a2ea-024497e43a3a\") " pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:57:52.572882 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.572845    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cdb8d674-3d7f-449c-bedc-770791095e6d-audit-log\") pod \"metrics-server-7c658bfc5c-jlrd9\" (UID: \"cdb8d674-3d7f-449c-bedc-770791095e6d\") " pod="openshift-monitoring/metrics-server-7c658bfc5c-jlrd9"
Sep 07 16:57:52.573065 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.572957    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7l7s\" (UniqueName: \"kubernetes.io/projected/cdb8d674-3d7f-449c-bedc-770791095e6d-kube-api-access-d7l7s\") pod \"metrics-server-7c658bfc5c-jlrd9\" (UID: \"cdb8d674-3d7f-449c-bedc-770791095e6d\") " pod="openshift-monitoring/metrics-server-7c658bfc5c-jlrd9"
Sep 07 16:57:52.573065 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.572989    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdb8d674-3d7f-449c-bedc-770791095e6d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c658bfc5c-jlrd9\" (UID: \"cdb8d674-3d7f-449c-bedc-770791095e6d\") " pod="openshift-monitoring/metrics-server-7c658bfc5c-jlrd9"
Sep 07 16:57:52.573065 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.573023    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cdb8d674-3d7f-449c-bedc-770791095e6d-secret-metrics-server-client-certs\") pod \"metrics-server-7c658bfc5c-jlrd9\" (UID: \"cdb8d674-3d7f-449c-bedc-770791095e6d\") " pod="openshift-monitoring/metrics-server-7c658bfc5c-jlrd9"
Sep 07 16:57:52.573065 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.573062    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cdb8d674-3d7f-449c-bedc-770791095e6d-metrics-server-audit-profiles\") pod \"metrics-server-7c658bfc5c-jlrd9\" (UID: \"cdb8d674-3d7f-449c-bedc-770791095e6d\") " pod="openshift-monitoring/metrics-server-7c658bfc5c-jlrd9"
Sep 07 16:57:52.573293 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.573084    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cdb8d674-3d7f-449c-bedc-770791095e6d-client-ca-bundle\") pod \"metrics-server-7c658bfc5c-jlrd9\" (UID: \"cdb8d674-3d7f-449c-bedc-770791095e6d\") " pod="openshift-monitoring/metrics-server-7c658bfc5c-jlrd9"
Sep 07 16:57:52.573293 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.573119    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cdb8d674-3d7f-449c-bedc-770791095e6d-secret-metrics-server-tls\") pod \"metrics-server-7c658bfc5c-jlrd9\" (UID: \"cdb8d674-3d7f-449c-bedc-770791095e6d\") " pod="openshift-monitoring/metrics-server-7c658bfc5c-jlrd9"
Sep 07 16:57:52.573392 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.573375    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cdb8d674-3d7f-449c-bedc-770791095e6d-audit-log\") pod \"metrics-server-7c658bfc5c-jlrd9\" (UID: \"cdb8d674-3d7f-449c-bedc-770791095e6d\") " pod="openshift-monitoring/metrics-server-7c658bfc5c-jlrd9"
Sep 07 16:57:52.573986 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.573956    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdb8d674-3d7f-449c-bedc-770791095e6d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c658bfc5c-jlrd9\" (UID: \"cdb8d674-3d7f-449c-bedc-770791095e6d\") " pod="openshift-monitoring/metrics-server-7c658bfc5c-jlrd9"
Sep 07 16:57:52.574334 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.574286    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cdb8d674-3d7f-449c-bedc-770791095e6d-metrics-server-audit-profiles\") pod \"metrics-server-7c658bfc5c-jlrd9\" (UID: \"cdb8d674-3d7f-449c-bedc-770791095e6d\") " pod="openshift-monitoring/metrics-server-7c658bfc5c-jlrd9"
Sep 07 16:57:52.576022 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.575998    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cdb8d674-3d7f-449c-bedc-770791095e6d-client-ca-bundle\") pod \"metrics-server-7c658bfc5c-jlrd9\" (UID: \"cdb8d674-3d7f-449c-bedc-770791095e6d\") " pod="openshift-monitoring/metrics-server-7c658bfc5c-jlrd9"
Sep 07 16:57:52.576162 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.576139    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cdb8d674-3d7f-449c-bedc-770791095e6d-secret-metrics-server-client-certs\") pod \"metrics-server-7c658bfc5c-jlrd9\" (UID: \"cdb8d674-3d7f-449c-bedc-770791095e6d\") " pod="openshift-monitoring/metrics-server-7c658bfc5c-jlrd9"
Sep 07 16:57:52.576228 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.576144    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cdb8d674-3d7f-449c-bedc-770791095e6d-secret-metrics-server-tls\") pod \"metrics-server-7c658bfc5c-jlrd9\" (UID: \"cdb8d674-3d7f-449c-bedc-770791095e6d\") " pod="openshift-monitoring/metrics-server-7c658bfc5c-jlrd9"
Sep 07 16:57:52.584970 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.584948    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7l7s\" (UniqueName: \"kubernetes.io/projected/cdb8d674-3d7f-449c-bedc-770791095e6d-kube-api-access-d7l7s\") pod \"metrics-server-7c658bfc5c-jlrd9\" (UID: \"cdb8d674-3d7f-449c-bedc-770791095e6d\") " pod="openshift-monitoring/metrics-server-7c658bfc5c-jlrd9"
Sep 07 16:57:52.626466 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.626424    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:52.728718 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.728610    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:52.741542 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.741450    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7c658bfc5c-jlrd9"
Sep 07 16:57:52.765449 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.765410    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lxz8c\""
Sep 07 16:57:52.772094 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.772070    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:57:52.827798 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:52.827759    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:53.006269 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.006196    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6d655bf9cf-gh59t"]
Sep 07 16:57:53.008869 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.008842    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t"
Sep 07 16:57:53.015078 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.015038    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 07 16:57:53.015221 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.015194    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 07 16:57:53.016106 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.015828    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 07 16:57:53.016106 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.015952    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 07 16:57:53.016361 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.016333    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 07 16:57:53.016702 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.016678    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-hbw6m\""
Sep 07 16:57:53.023282 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.023258    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 07 16:57:53.031472 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.031446    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6d655bf9cf-gh59t"]
Sep 07 16:57:53.077771 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.077740    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/18b09bfe-8ae6-4937-91d6-9a4536d43330-telemeter-client-tls\") pod \"telemeter-client-6d655bf9cf-gh59t\" (UID: \"18b09bfe-8ae6-4937-91d6-9a4536d43330\") " pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t"
Sep 07 16:57:53.077976 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.077782    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfn9k\" (UniqueName: \"kubernetes.io/projected/18b09bfe-8ae6-4937-91d6-9a4536d43330-kube-api-access-mfn9k\") pod \"telemeter-client-6d655bf9cf-gh59t\" (UID: \"18b09bfe-8ae6-4937-91d6-9a4536d43330\") " pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t"
Sep 07 16:57:53.077976 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.077817    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18b09bfe-8ae6-4937-91d6-9a4536d43330-serving-certs-ca-bundle\") pod \"telemeter-client-6d655bf9cf-gh59t\" (UID: \"18b09bfe-8ae6-4937-91d6-9a4536d43330\") " pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t"
Sep 07 16:57:53.077976 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.077858    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/18b09bfe-8ae6-4937-91d6-9a4536d43330-secret-telemeter-client\") pod \"telemeter-client-6d655bf9cf-gh59t\" (UID: \"18b09bfe-8ae6-4937-91d6-9a4536d43330\") " pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t"
Sep 07 16:57:53.077976 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.077908    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18b09bfe-8ae6-4937-91d6-9a4536d43330-metrics-client-ca\") pod \"telemeter-client-6d655bf9cf-gh59t\" (UID: \"18b09bfe-8ae6-4937-91d6-9a4536d43330\") " pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t"
Sep 07 16:57:53.077976 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.077924    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/18b09bfe-8ae6-4937-91d6-9a4536d43330-federate-client-tls\") pod \"telemeter-client-6d655bf9cf-gh59t\" (UID: \"18b09bfe-8ae6-4937-91d6-9a4536d43330\") " pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t"
Sep 07 16:57:53.077976 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.077940    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18b09bfe-8ae6-4937-91d6-9a4536d43330-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6d655bf9cf-gh59t\" (UID: \"18b09bfe-8ae6-4937-91d6-9a4536d43330\") " pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t"
Sep 07 16:57:53.077976 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.077973    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18b09bfe-8ae6-4937-91d6-9a4536d43330-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6d655bf9cf-gh59t\" (UID: \"18b09bfe-8ae6-4937-91d6-9a4536d43330\") " pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t"
Sep 07 16:57:53.178576 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.178539    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/18b09bfe-8ae6-4937-91d6-9a4536d43330-telemeter-client-tls\") pod \"telemeter-client-6d655bf9cf-gh59t\" (UID: \"18b09bfe-8ae6-4937-91d6-9a4536d43330\") " pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t"
Sep 07 16:57:53.178576 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.178588    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfn9k\" (UniqueName: \"kubernetes.io/projected/18b09bfe-8ae6-4937-91d6-9a4536d43330-kube-api-access-mfn9k\") pod \"telemeter-client-6d655bf9cf-gh59t\" (UID: \"18b09bfe-8ae6-4937-91d6-9a4536d43330\") " pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t"
Sep 07 16:57:53.179167 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.178624    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18b09bfe-8ae6-4937-91d6-9a4536d43330-serving-certs-ca-bundle\") pod \"telemeter-client-6d655bf9cf-gh59t\" (UID: \"18b09bfe-8ae6-4937-91d6-9a4536d43330\") " pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t"
Sep 07 16:57:53.179167 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.178774    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/18b09bfe-8ae6-4937-91d6-9a4536d43330-secret-telemeter-client\") pod \"telemeter-client-6d655bf9cf-gh59t\" (UID: \"18b09bfe-8ae6-4937-91d6-9a4536d43330\") " pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t"
Sep 07 16:57:53.179167 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.178847    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18b09bfe-8ae6-4937-91d6-9a4536d43330-metrics-client-ca\") pod \"telemeter-client-6d655bf9cf-gh59t\" (UID: \"18b09bfe-8ae6-4937-91d6-9a4536d43330\") " pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t"
Sep 07 16:57:53.179167 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.179016    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/18b09bfe-8ae6-4937-91d6-9a4536d43330-federate-client-tls\") pod \"telemeter-client-6d655bf9cf-gh59t\" (UID: \"18b09bfe-8ae6-4937-91d6-9a4536d43330\") " pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t"
Sep 07 16:57:53.179167 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.179041    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18b09bfe-8ae6-4937-91d6-9a4536d43330-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6d655bf9cf-gh59t\" (UID: \"18b09bfe-8ae6-4937-91d6-9a4536d43330\") " pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t"
Sep 07 16:57:53.179167 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.179084    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18b09bfe-8ae6-4937-91d6-9a4536d43330-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6d655bf9cf-gh59t\" (UID: \"18b09bfe-8ae6-4937-91d6-9a4536d43330\") " pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t"
Sep 07 16:57:53.179649 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.179603    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18b09bfe-8ae6-4937-91d6-9a4536d43330-serving-certs-ca-bundle\") pod \"telemeter-client-6d655bf9cf-gh59t\" (UID: \"18b09bfe-8ae6-4937-91d6-9a4536d43330\") " pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t"
Sep 07 16:57:53.180029 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.179999    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18b09bfe-8ae6-4937-91d6-9a4536d43330-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6d655bf9cf-gh59t\" (UID: \"18b09bfe-8ae6-4937-91d6-9a4536d43330\") " pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t"
Sep 07 16:57:53.180146 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.180128    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18b09bfe-8ae6-4937-91d6-9a4536d43330-metrics-client-ca\") pod \"telemeter-client-6d655bf9cf-gh59t\" (UID: \"18b09bfe-8ae6-4937-91d6-9a4536d43330\") " pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t"
Sep 07 16:57:53.182279 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.182256    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/18b09bfe-8ae6-4937-91d6-9a4536d43330-secret-telemeter-client\") pod \"telemeter-client-6d655bf9cf-gh59t\" (UID: \"18b09bfe-8ae6-4937-91d6-9a4536d43330\") " pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t"
Sep 07 16:57:53.182450 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.182435    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/18b09bfe-8ae6-4937-91d6-9a4536d43330-telemeter-client-tls\") pod \"telemeter-client-6d655bf9cf-gh59t\" (UID: \"18b09bfe-8ae6-4937-91d6-9a4536d43330\") " pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t"
Sep 07 16:57:53.182492 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.182458    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18b09bfe-8ae6-4937-91d6-9a4536d43330-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6d655bf9cf-gh59t\" (UID: \"18b09bfe-8ae6-4937-91d6-9a4536d43330\") " pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t"
Sep 07 16:57:53.182492 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.182472    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/18b09bfe-8ae6-4937-91d6-9a4536d43330-federate-client-tls\") pod \"telemeter-client-6d655bf9cf-gh59t\" (UID: \"18b09bfe-8ae6-4937-91d6-9a4536d43330\") " pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t"
Sep 07 16:57:53.189517 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.189497    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfn9k\" (UniqueName: \"kubernetes.io/projected/18b09bfe-8ae6-4937-91d6-9a4536d43330-kube-api-access-mfn9k\") pod \"telemeter-client-6d655bf9cf-gh59t\" (UID: \"18b09bfe-8ae6-4937-91d6-9a4536d43330\") " pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t"
Sep 07 16:57:53.320298 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.320259    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t"
Sep 07 16:57:53.991252 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.991222    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7984fdcf8f-xfplf"]
Sep 07 16:57:53.993846 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:53.993819    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7984fdcf8f-xfplf"
Sep 07 16:57:54.008060 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.008030    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 07 16:57:54.022989 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.022956    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7984fdcf8f-xfplf"]
Sep 07 16:57:54.075338 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.075299    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:54.087774 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.087737    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d6d7d19-bf74-441e-afb9-5746b0dacca5-console-config\") pod \"console-7984fdcf8f-xfplf\" (UID: \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\") " pod="openshift-console/console-7984fdcf8f-xfplf"
Sep 07 16:57:54.087975 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.087786    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d6d7d19-bf74-441e-afb9-5746b0dacca5-service-ca\") pod \"console-7984fdcf8f-xfplf\" (UID: \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\") " pod="openshift-console/console-7984fdcf8f-xfplf"
Sep 07 16:57:54.087975 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.087923    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d6d7d19-bf74-441e-afb9-5746b0dacca5-console-serving-cert\") pod \"console-7984fdcf8f-xfplf\" (UID: \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\") " pod="openshift-console/console-7984fdcf8f-xfplf"
Sep 07 16:57:54.087975 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.087968    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29rdt\" (UniqueName: \"kubernetes.io/projected/5d6d7d19-bf74-441e-afb9-5746b0dacca5-kube-api-access-29rdt\") pod \"console-7984fdcf8f-xfplf\" (UID: \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\") " pod="openshift-console/console-7984fdcf8f-xfplf"
Sep 07 16:57:54.088096 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.087996    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d6d7d19-bf74-441e-afb9-5746b0dacca5-console-oauth-config\") pod \"console-7984fdcf8f-xfplf\" (UID: \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\") " pod="openshift-console/console-7984fdcf8f-xfplf"
Sep 07 16:57:54.088096 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.088028    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d6d7d19-bf74-441e-afb9-5746b0dacca5-oauth-serving-cert\") pod \"console-7984fdcf8f-xfplf\" (UID: \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\") " pod="openshift-console/console-7984fdcf8f-xfplf"
Sep 07 16:57:54.088159 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.088106    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d6d7d19-bf74-441e-afb9-5746b0dacca5-trusted-ca-bundle\") pod \"console-7984fdcf8f-xfplf\" (UID: \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\") " pod="openshift-console/console-7984fdcf8f-xfplf"
Sep 07 16:57:54.089530 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.089505    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 16:57:54.093069 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.093048    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.128777 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.128745    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 07 16:57:54.128777 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.128745    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 07 16:57:54.129666 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.129646    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 07 16:57:54.129773 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.129687    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 07 16:57:54.136259 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.136234    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 07 16:57:54.136259 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.136252    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 07 16:57:54.136431 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.136275    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 07 16:57:54.136431 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.136292    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 07 16:57:54.136431 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.136373    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 07 16:57:54.136946 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.136743    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 07 16:57:54.136946 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.136828    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 07 16:57:54.136946 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.136839    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bd0vjbgt9lqcl\""
Sep 07 16:57:54.136946 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.136842    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 07 16:57:54.137284 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.137269    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-42mzl\""
Sep 07 16:57:54.146502 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.146473    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 07 16:57:54.162537 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.162506    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 07 16:57:54.188866 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.188819    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29rdt\" (UniqueName: \"kubernetes.io/projected/5d6d7d19-bf74-441e-afb9-5746b0dacca5-kube-api-access-29rdt\") pod \"console-7984fdcf8f-xfplf\" (UID: \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\") " pod="openshift-console/console-7984fdcf8f-xfplf"
Sep 07 16:57:54.189328 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.188870    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.189328 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.188919    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-config\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.189328 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.188949    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zb9q\" (UniqueName: \"kubernetes.io/projected/afbddf32-2556-4467-a6d5-551d9fdfc042-kube-api-access-4zb9q\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.189328 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.188978    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d6d7d19-bf74-441e-afb9-5746b0dacca5-console-oauth-config\") pod \"console-7984fdcf8f-xfplf\" (UID: \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\") " pod="openshift-console/console-7984fdcf8f-xfplf"
Sep 07 16:57:54.189328 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.189003    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/afbddf32-2556-4467-a6d5-551d9fdfc042-config-out\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.189328 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.189033    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d6d7d19-bf74-441e-afb9-5746b0dacca5-oauth-serving-cert\") pod \"console-7984fdcf8f-xfplf\" (UID: \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\") " pod="openshift-console/console-7984fdcf8f-xfplf"
Sep 07 16:57:54.189328 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.189066    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.189328 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.189092    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.189328 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.189120    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/afbddf32-2556-4467-a6d5-551d9fdfc042-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.189328 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.189158    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.189328 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.189193    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.189328 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.189244    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d6d7d19-bf74-441e-afb9-5746b0dacca5-trusted-ca-bundle\") pod \"console-7984fdcf8f-xfplf\" (UID: \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\") " pod="openshift-console/console-7984fdcf8f-xfplf"
Sep 07 16:57:54.189328 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.189290    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.189328 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.189322    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d6d7d19-bf74-441e-afb9-5746b0dacca5-console-config\") pod \"console-7984fdcf8f-xfplf\" (UID: \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\") " pod="openshift-console/console-7984fdcf8f-xfplf"
Sep 07 16:57:54.191161 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.189346    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.191161 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.189371    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.191161 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.189402    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d6d7d19-bf74-441e-afb9-5746b0dacca5-service-ca\") pod \"console-7984fdcf8f-xfplf\" (UID: \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\") " pod="openshift-console/console-7984fdcf8f-xfplf"
Sep 07 16:57:54.191161 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.189437    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.191161 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.189462    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/afbddf32-2556-4467-a6d5-551d9fdfc042-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.191161 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.189518    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.191161 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.189548    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.191161 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.189604    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.191161 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.189631    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.191161 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.189670    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d6d7d19-bf74-441e-afb9-5746b0dacca5-console-serving-cert\") pod \"console-7984fdcf8f-xfplf\" (UID: \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\") " pod="openshift-console/console-7984fdcf8f-xfplf"
Sep 07 16:57:54.191161 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.189693    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-web-config\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.191161 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.189721    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.191161 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.189808    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d6d7d19-bf74-441e-afb9-5746b0dacca5-oauth-serving-cert\") pod \"console-7984fdcf8f-xfplf\" (UID: \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\") " pod="openshift-console/console-7984fdcf8f-xfplf"
Sep 07 16:57:54.191161 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.190297    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d6d7d19-bf74-441e-afb9-5746b0dacca5-service-ca\") pod \"console-7984fdcf8f-xfplf\" (UID: \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\") " pod="openshift-console/console-7984fdcf8f-xfplf"
Sep 07 16:57:54.191161 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.190522    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d6d7d19-bf74-441e-afb9-5746b0dacca5-console-config\") pod \"console-7984fdcf8f-xfplf\" (UID: \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\") " pod="openshift-console/console-7984fdcf8f-xfplf"
Sep 07 16:57:54.191850 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.191460    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d6d7d19-bf74-441e-afb9-5746b0dacca5-trusted-ca-bundle\") pod \"console-7984fdcf8f-xfplf\" (UID: \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\") " pod="openshift-console/console-7984fdcf8f-xfplf"
Sep 07 16:57:54.192883 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.192860    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 16:57:54.193323 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.193297    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d6d7d19-bf74-441e-afb9-5746b0dacca5-console-oauth-config\") pod \"console-7984fdcf8f-xfplf\" (UID: \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\") " pod="openshift-console/console-7984fdcf8f-xfplf"
Sep 07 16:57:54.193395 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.193303    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d6d7d19-bf74-441e-afb9-5746b0dacca5-console-serving-cert\") pod \"console-7984fdcf8f-xfplf\" (UID: \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\") " pod="openshift-console/console-7984fdcf8f-xfplf"
Sep 07 16:57:54.208555 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.208523    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29rdt\" (UniqueName: \"kubernetes.io/projected/5d6d7d19-bf74-441e-afb9-5746b0dacca5-kube-api-access-29rdt\") pod \"console-7984fdcf8f-xfplf\" (UID: \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\") " pod="openshift-console/console-7984fdcf8f-xfplf"
Sep 07 16:57:54.291140 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.291056    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-web-config\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.291140 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.291094    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.291140 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.291126    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.291405 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.291150    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-config\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.291405 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.291174    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zb9q\" (UniqueName: \"kubernetes.io/projected/afbddf32-2556-4467-a6d5-551d9fdfc042-kube-api-access-4zb9q\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.291405 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.291201    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/afbddf32-2556-4467-a6d5-551d9fdfc042-config-out\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.291405 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.291239    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.291405 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.291262    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.291405 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.291287    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/afbddf32-2556-4467-a6d5-551d9fdfc042-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.291405 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.291317    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.291745 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.291559    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.291745 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.291616    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.291745 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.291645    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.291745 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.291672    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.291745 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.291713    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.291745 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.291737    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/afbddf32-2556-4467-a6d5-551d9fdfc042-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.292070 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.291787    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.292070 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.291821    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.292070 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.291880    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.292070 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.291935    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.292070 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.291938    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.295648 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.292656    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.295648 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.292953    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.295648 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.293502    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.295648 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.294436    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-web-config\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.295648 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.294683    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/afbddf32-2556-4467-a6d5-551d9fdfc042-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.295648 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.295128    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.295648 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.295303    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.298761 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.297136    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-config\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.298761 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.297539    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.298761 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.297725    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/afbddf32-2556-4467-a6d5-551d9fdfc042-config-out\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.298761 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.298129    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.298761 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.298622    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.299192 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.299041    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.299249 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.299203    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.299412 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.299327    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.299684 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.299655    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/afbddf32-2556-4467-a6d5-551d9fdfc042-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.300680 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.300637    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.301987 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.301956    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.304846 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.304823    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7984fdcf8f-xfplf"
Sep 07 16:57:54.309306 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.309288    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zb9q\" (UniqueName: \"kubernetes.io/projected/afbddf32-2556-4467-a6d5-551d9fdfc042-kube-api-access-4zb9q\") pod \"prometheus-k8s-0\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:54.406960 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:54.406877    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:57:55.443417 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:55.443379    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8558d584b-z4vwb"
Sep 07 16:57:55.443889 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:55.443474    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8558d584b-z4vwb"
Sep 07 16:57:55.448841 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:55.448820    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8558d584b-z4vwb"
Sep 07 16:57:56.156151 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:56.156120    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8558d584b-z4vwb"
Sep 07 16:57:56.547800 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:56.547767    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:56.629124 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:56.629090    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:57.344414 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:57.344325    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:57.405941 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:57.405873    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:58.623785 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:58.623255    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-97975b55c-p8s7b"]
Sep 07 16:57:58.636207 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:58.634184    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-jl479"]
Sep 07 16:57:58.639038 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:58.638789    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7c658bfc5c-jlrd9"]
Sep 07 16:57:58.647579 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:58.647524    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g54wv"]
Sep 07 16:57:58.661948 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:58.661346    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nplbv"]
Sep 07 16:57:58.666066 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:57:58.665875    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba783056_dec5_4200_8726_97d3b462d24d.slice/crio-304ed42f3b21430a46bb56bf2c2e5b9e6aea8d63032ea1a3c48c998d37bae69c WatchSource:0}: Error finding container 304ed42f3b21430a46bb56bf2c2e5b9e6aea8d63032ea1a3c48c998d37bae69c: Status 404 returned error can't find the container with id 304ed42f3b21430a46bb56bf2c2e5b9e6aea8d63032ea1a3c48c998d37bae69c
Sep 07 16:57:58.673173 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:58.672369    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-g2l8w"]
Sep 07 16:57:58.675652 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:57:58.675616    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod363e1dc1_6917_4e79_a2ea_024497e43a3a.slice/crio-01a5bc3b33bc9df605441797ea914760be6e27d811766ee18d14598ac8658f0d WatchSource:0}: Error finding container 01a5bc3b33bc9df605441797ea914760be6e27d811766ee18d14598ac8658f0d: Status 404 returned error can't find the container with id 01a5bc3b33bc9df605441797ea914760be6e27d811766ee18d14598ac8658f0d
Sep 07 16:57:58.736943 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:58.736913    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7984fdcf8f-xfplf"]
Sep 07 16:57:58.740064 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:58.739937    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6d655bf9cf-gh59t"]
Sep 07 16:57:58.744517 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:57:58.744489    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d6d7d19_bf74_441e_afb9_5746b0dacca5.slice/crio-aa216effe7d476f04dd75e47392dc363426eeb19deedb7d35dc6467b5e83a62a WatchSource:0}: Error finding container aa216effe7d476f04dd75e47392dc363426eeb19deedb7d35dc6467b5e83a62a: Status 404 returned error can't find the container with id aa216effe7d476f04dd75e47392dc363426eeb19deedb7d35dc6467b5e83a62a
Sep 07 16:57:58.750779 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:58.750588    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 16:57:58.752940 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:57:58.752837    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafbddf32_2556_4467_a6d5_551d9fdfc042.slice/crio-b3d8534541523c889002168e578c23167936a6bf201aac5e0029425f158b143f WatchSource:0}: Error finding container b3d8534541523c889002168e578c23167936a6bf201aac5e0029425f158b143f: Status 404 returned error can't find the container with id b3d8534541523c889002168e578c23167936a6bf201aac5e0029425f158b143f
Sep 07 16:57:59.107821 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:59.107782    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:59.168833 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:59.168796    2575 generic.go:356] "Generic (PLEG): container finished" podID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerID="1b42a94e28aa1f38d8e52dea9c98864f4c4bd9f72f9e01f3586ddc086003156d" exitCode=0
Sep 07 16:57:59.169034 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:59.168888    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dfbd559-299c-489d-94d3-925ab300a2d4","Type":"ContainerDied","Data":"1b42a94e28aa1f38d8e52dea9c98864f4c4bd9f72f9e01f3586ddc086003156d"}
Sep 07 16:57:59.178230 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:59.178195    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-g2l8w" event={"ID":"363e1dc1-6917-4e79-a2ea-024497e43a3a","Type":"ContainerStarted","Data":"01a5bc3b33bc9df605441797ea914760be6e27d811766ee18d14598ac8658f0d"}
Sep 07 16:57:59.189845 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:59.189816    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hqmt2" event={"ID":"ff018cdc-ce65-469a-af7e-67b7d8ad594b","Type":"ContainerStarted","Data":"47f76da68515475f6b2c974690e40a44c2c4fb124061ffd3ce80e68eb87e7776"}
Sep 07 16:57:59.192997 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:59.192925    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7c658bfc5c-jlrd9" event={"ID":"cdb8d674-3d7f-449c-bedc-770791095e6d","Type":"ContainerStarted","Data":"3d97189e058de1e75b920f52296bc69cb4641423c997933464fd20ba7194b3c7"}
Sep 07 16:57:59.197592 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:59.197486    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b" event={"ID":"15fb9da0-89c7-459e-9c49-84110269cc31","Type":"ContainerStarted","Data":"06ce6a12a7942447366ab5f802c3c94cbde17a4ee5efc196e51b04933796afad"}
Sep 07 16:57:59.200159 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:59.200019    2575 generic.go:356] "Generic (PLEG): container finished" podID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerID="d7cd9a21ae0a3a916cc84d11173cba660ce95f63b4c097530d40e18423097219" exitCode=0
Sep 07 16:57:59.200159 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:59.200118    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afbddf32-2556-4467-a6d5-551d9fdfc042","Type":"ContainerDied","Data":"d7cd9a21ae0a3a916cc84d11173cba660ce95f63b4c097530d40e18423097219"}
Sep 07 16:57:59.200319 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:59.200177    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afbddf32-2556-4467-a6d5-551d9fdfc042","Type":"ContainerStarted","Data":"b3d8534541523c889002168e578c23167936a6bf201aac5e0029425f158b143f"}
Sep 07 16:57:59.209665 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:59.209648    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:59.211100 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:59.211077    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-f8tld" event={"ID":"768b449d-d44e-4a85-8b5f-7e8b571faed3","Type":"ContainerStarted","Data":"004619b3fffd3518b021a2de0433fa6d5f101c458c3f567660b2abca446e81bf"}
Sep 07 16:57:59.211214 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:59.211133    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-f8tld" event={"ID":"768b449d-d44e-4a85-8b5f-7e8b571faed3","Type":"ContainerStarted","Data":"85b29efd424b31bfb67a441286a5356760c2f5e1d2ad9834ae52b8109b91b492"}
Sep 07 16:57:59.211214 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:59.211164    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-f8tld" event={"ID":"768b449d-d44e-4a85-8b5f-7e8b571faed3","Type":"ContainerStarted","Data":"df489a3ea62dd5829d41ed1bf68ac39729a79f8dd2e66f1ce8f8073bb559ce27"}
Sep 07 16:57:59.214462 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:59.214404    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nplbv" event={"ID":"ba783056-dec5-4200-8726-97d3b462d24d","Type":"ContainerStarted","Data":"304ed42f3b21430a46bb56bf2c2e5b9e6aea8d63032ea1a3c48c998d37bae69c"}
Sep 07 16:57:59.219179 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:59.218651    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hmmgj" event={"ID":"27653d59-ca6e-4a9f-a3ca-660a338bad78","Type":"ContainerStarted","Data":"8229560004b4acb32dbd54a643144c7ca252edfc8b74dd78c3a81b98fae8c879"}
Sep 07 16:57:59.221437 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:59.221372    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g54wv" event={"ID":"f6ab0a94-0f1c-496c-9072-1c50fcbcfadc","Type":"ContainerStarted","Data":"49952d7e88afcc1923b0c72c95909b099367f768610aeb98038c8e2e48e30446"}
Sep 07 16:57:59.223346 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:59.223273    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t" event={"ID":"18b09bfe-8ae6-4937-91d6-9a4536d43330","Type":"ContainerStarted","Data":"58b0bc95449cc0c40baad15348dcf394dda4c215de61f125cb96d832dc3ae1c2"}
Sep 07 16:57:59.229651 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:59.225536    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-2jwgt" event={"ID":"22fa9fc6-fec4-4134-8bfe-e3550ce544e4","Type":"ContainerStarted","Data":"5f08220c3ac1a2aaa9804db195e82268056c0f0a693ceeb161902a1d313353e1"}
Sep 07 16:57:59.230198 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:59.229855    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-2jwgt"
Sep 07 16:57:59.232986 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:59.231697    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hqmt2" podStartSLOduration=11.246563943 podStartE2EDuration="12.231678739s" totalImagesPullingTime="916.263854ms" totalInitContainerRuntime="68.850942ms" isStatefulPod=true podCreationTimestamp="2026-09-07 16:57:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:59.230925082 +0000 UTC m=+73.127772398" watchObservedRunningTime="2026-09-07 16:57:59.231678739 +0000 UTC m=+73.128526055"
Sep 07 16:57:59.235515 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:59.235290    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-2jwgt"
Sep 07 16:57:59.239528 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:59.239279    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7984fdcf8f-xfplf" event={"ID":"5d6d7d19-bf74-441e-afb9-5746b0dacca5","Type":"ContainerStarted","Data":"119d86ea785936246a64afac875fcbcfdfa8b96aad93bbc830e8409f7c468c71"}
Sep 07 16:57:59.239528 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:59.239321    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7984fdcf8f-xfplf" event={"ID":"5d6d7d19-bf74-441e-afb9-5746b0dacca5","Type":"ContainerStarted","Data":"aa216effe7d476f04dd75e47392dc363426eeb19deedb7d35dc6467b5e83a62a"}
Sep 07 16:57:59.241428 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:59.241401    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-jl479" event={"ID":"580463c2-35f7-4985-bfc6-c6d68d5d396a","Type":"ContainerStarted","Data":"f4a8cfbc808e7315b47493d9e6ba292b90837ec68c18d2831e1c43edd97c3d9b"}
Sep 07 16:57:59.310613 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:59.310520    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:59.317631 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:59.316693    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-2jwgt" podStartSLOduration=3.711468563 podStartE2EDuration="21.31667308s" totalImagesPullingTime="17.605204517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:57:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:59.28605687 +0000 UTC m=+73.182904187" watchObservedRunningTime="2026-09-07 16:57:59.31667308 +0000 UTC m=+73.213520396"
Sep 07 16:57:59.344920 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:59.344162    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-f8tld" podStartSLOduration=3.314427158 podStartE2EDuration="12.344139531s" totalImagesPullingTime="9.029712373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:57:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:59.317483241 +0000 UTC m=+73.214330556" watchObservedRunningTime="2026-09-07 16:57:59.344139531 +0000 UTC m=+73.240986848"
Sep 07 16:57:59.346049 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:57:59.345720    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7984fdcf8f-xfplf" podStartSLOduration=6.345706109 podStartE2EDuration="6.345706109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:57:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:59.343140875 +0000 UTC m=+73.239988190" watchObservedRunningTime="2026-09-07 16:57:59.345706109 +0000 UTC m=+73.242553416"
Sep 07 16:58:02.152889 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:02.152831    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:58:02.237133 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:02.237076    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:58:04.305944 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:04.305910    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7984fdcf8f-xfplf"
Sep 07 16:58:04.306730 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:04.306703    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7984fdcf8f-xfplf"
Sep 07 16:58:04.313459 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:04.313017    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7984fdcf8f-xfplf"
Sep 07 16:58:04.339084 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:04.338626    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hmmgj" podStartSLOduration=8.401574275 podStartE2EDuration="17.33860344s" totalImagesPullingTime="8.937029165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:57:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:59.36547917 +0000 UTC m=+73.262326492" watchObservedRunningTime="2026-09-07 16:58:04.33860344 +0000 UTC m=+78.235450757"
Sep 07 16:58:05.301843 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:05.301811    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7984fdcf8f-xfplf"
Sep 07 16:58:05.344218 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:05.343267    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:58:05.383697 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:05.378643    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8558d584b-z4vwb"]
Sep 07 16:58:05.447271 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:05.447184    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:58:06.173165 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:06.173054    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:58:06.274506 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:06.274446    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:58:06.373409 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:06.373366    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:58:07.353082 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:07.353044    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:58:07.420020 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:07.419976    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:58:12.342153 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:12.341987    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dfbd559-299c-489d-94d3-925ab300a2d4","Type":"ContainerStarted","Data":"d2cccc76cde35a1b34dc22546e4d5c17697741afecd26dfa54384bd6d4c8d009"}
Sep 07 16:58:12.342153 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:12.342102    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dfbd559-299c-489d-94d3-925ab300a2d4","Type":"ContainerStarted","Data":"9ad9abf4f0b6b9913e42c8883ef982f5ba0bfc84964fe84cef0886c7e91b1f2e"}
Sep 07 16:58:12.344769 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:12.344741    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-g2l8w" event={"ID":"363e1dc1-6917-4e79-a2ea-024497e43a3a","Type":"ContainerStarted","Data":"1412a3d124db5077b3facee42e3580ce9a3de5c9fbe311e581bc700f49c9f2fd"}
Sep 07 16:58:12.345060 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:12.345040    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:58:12.347146 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:12.347100    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7c658bfc5c-jlrd9" event={"ID":"cdb8d674-3d7f-449c-bedc-770791095e6d","Type":"ContainerStarted","Data":"ac414f9ca39b154fdcbbc8543991707877512835c2b817caa16aace1d1e3d6d6"}
Sep 07 16:58:12.350946 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:12.350875    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b" event={"ID":"15fb9da0-89c7-459e-9c49-84110269cc31","Type":"ContainerStarted","Data":"478102a737846c1593f3f5c0031712599a6be53b39064c480f2f2254f78bb3db"}
Sep 07 16:58:12.351281 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:12.351257    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b" event={"ID":"15fb9da0-89c7-459e-9c49-84110269cc31","Type":"ContainerStarted","Data":"f15a74de22de3af61b6d4910b2ce912a94530c3ed793e15295a1af84823558d3"}
Sep 07 16:58:12.351555 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:12.351534    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b" event={"ID":"15fb9da0-89c7-459e-9c49-84110269cc31","Type":"ContainerStarted","Data":"b13699f421343ce76bf6863de6cdbf5df40407e3c29fdcc003495fcf499142b6"}
Sep 07 16:58:12.354108 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:12.354085    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afbddf32-2556-4467-a6d5-551d9fdfc042","Type":"ContainerStarted","Data":"4de5831edaa18a4f7f6a7d762cfd8eca3277a1b59966dfa5094631dd0f141cbd"}
Sep 07 16:58:12.354187 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:12.354167    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afbddf32-2556-4467-a6d5-551d9fdfc042","Type":"ContainerStarted","Data":"6ab63e12d0d5e2cf727aed501c0cec51cc073027029dac0018c29ea97cb6be19"}
Sep 07 16:58:12.356376 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:12.356351    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nplbv" event={"ID":"ba783056-dec5-4200-8726-97d3b462d24d","Type":"ContainerStarted","Data":"5850ef162ce19d8dfb64010e72c296e33f01f7387d2469ba5f9b5bc3a4a938ad"}
Sep 07 16:58:12.356474 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:12.356397    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nplbv" event={"ID":"ba783056-dec5-4200-8726-97d3b462d24d","Type":"ContainerStarted","Data":"f670f4e3bb4ccbe7ebe612fd01edba42dbcee1a57b9ed928d682e869678670c0"}
Sep 07 16:58:12.358044 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:12.358022    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g54wv" event={"ID":"f6ab0a94-0f1c-496c-9072-1c50fcbcfadc","Type":"ContainerStarted","Data":"59b7206ca79bd5084a4738d41cf9b3f3b1f436f42c557dfda4c43f02ccb35504"}
Sep 07 16:58:12.360867 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:12.360846    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t" event={"ID":"18b09bfe-8ae6-4937-91d6-9a4536d43330","Type":"ContainerStarted","Data":"8ab889c31a80c68703fb574279d6a760d54a1b487eb747e89cbfe8ca9363d391"}
Sep 07 16:58:12.361291 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:12.361268    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t" event={"ID":"18b09bfe-8ae6-4937-91d6-9a4536d43330","Type":"ContainerStarted","Data":"8d1bce8b23f4271a2c31e0a9bb4f61878d2f87eede3c5f59f5138392ddca4c72"}
Sep 07 16:58:12.361384 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:12.361306    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t" event={"ID":"18b09bfe-8ae6-4937-91d6-9a4536d43330","Type":"ContainerStarted","Data":"e3582558af4c4b0e4528a220dfbbef0a31df6394eaec6f0a341e221fd53da119"}
Sep 07 16:58:12.362580 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:12.362553    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-jl479" event={"ID":"580463c2-35f7-4985-bfc6-c6d68d5d396a","Type":"ContainerStarted","Data":"736b8d4b60330cee083c0c1b6dde704e872057ab941dac82f9223529a6717302"}
Sep 07 16:58:12.362778 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:12.362763    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-jl479"
Sep 07 16:58:12.369218 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:12.369164    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-g2l8w" podStartSLOduration=72.290765659 podStartE2EDuration="1m25.369136913s" totalImagesPullingTime="13.078371254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:58:12.366522555 +0000 UTC m=+86.263369870" watchObservedRunningTime="2026-09-07 16:58:12.369136913 +0000 UTC m=+86.265984232"
Sep 07 16:58:12.370233 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:12.370210    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-jl479"
Sep 07 16:58:12.415049 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:12.414678    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7c658bfc5c-jlrd9" podStartSLOduration=7.316736492 podStartE2EDuration="20.414656559s" totalImagesPullingTime="13.097920067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:58:12.394833866 +0000 UTC m=+86.291681183" watchObservedRunningTime="2026-09-07 16:58:12.414656559 +0000 UTC m=+86.311503876"
Sep 07 16:58:12.415915 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:12.415854    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nplbv" podStartSLOduration=72.377877309 podStartE2EDuration="1m25.415842057s" totalImagesPullingTime="13.037964748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:58:12.414760381 +0000 UTC m=+86.311607697" watchObservedRunningTime="2026-09-07 16:58:12.415842057 +0000 UTC m=+86.312689401"
Sep 07 16:58:12.469310 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:12.469237    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-g54wv" podStartSLOduration=72.371879201 podStartE2EDuration="1m25.469213589s" totalImagesPullingTime="13.097334388s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:58:12.441107324 +0000 UTC m=+86.337954639" watchObservedRunningTime="2026-09-07 16:58:12.469213589 +0000 UTC m=+86.366060905"
Sep 07 16:58:12.470430 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:12.469753    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6d655bf9cf-gh59t" podStartSLOduration=7.45951319 podStartE2EDuration="20.469740484s" totalImagesPullingTime="13.010227294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:58:12.467045277 +0000 UTC m=+86.363892638" watchObservedRunningTime="2026-09-07 16:58:12.469740484 +0000 UTC m=+86.366587799"
Sep 07 16:58:12.497912 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:12.496102    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-jl479" podStartSLOduration=7.450308354 podStartE2EDuration="20.496081092s" totalImagesPullingTime="13.045772738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:58:12.493711875 +0000 UTC m=+86.390559204" watchObservedRunningTime="2026-09-07 16:58:12.496081092 +0000 UTC m=+86.392928405"
Sep 07 16:58:12.616513 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:12.616484    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:58:12.742244 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:12.742219    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7c658bfc5c-jlrd9"
Sep 07 16:58:12.742555 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:12.742271    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7c658bfc5c-jlrd9"
Sep 07 16:58:12.745838 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:12.745814    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:58:12.844258 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:12.844212    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:58:13.370806 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:13.370767    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dfbd559-299c-489d-94d3-925ab300a2d4","Type":"ContainerStarted","Data":"02e328b5647356933ec6c4e71f1b0f1024f094597ea4da6de5f1496df2c9f5a0"}
Sep 07 16:58:13.371202 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:13.370833    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dfbd559-299c-489d-94d3-925ab300a2d4","Type":"ContainerStarted","Data":"2be55cf798f23165ba98dc7e62f2ede566b4dabdca797dbcac49d4e7eace6d7b"}
Sep 07 16:58:13.371202 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:13.370863    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dfbd559-299c-489d-94d3-925ab300a2d4","Type":"ContainerStarted","Data":"003403d5b3cc7f62ff02cab99aded24dd0d4a2c789e9fd4e1882d3e45970bd66"}
Sep 07 16:58:13.374200 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:13.374164    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afbddf32-2556-4467-a6d5-551d9fdfc042","Type":"ContainerStarted","Data":"b99123192d45f23b446c97a479fa87490a25a4cfee318511af04762314bf9e82"}
Sep 07 16:58:13.374331 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:13.374230    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afbddf32-2556-4467-a6d5-551d9fdfc042","Type":"ContainerStarted","Data":"647ca0b25d4f4fac7f29ff9fea70af57d191202afb8719d9a00eaa142f366dba"}
Sep 07 16:58:13.374331 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:13.374256    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afbddf32-2556-4467-a6d5-551d9fdfc042","Type":"ContainerStarted","Data":"a35f206a18d8ad0adebe36c38a6b419ff259b8ad647881db3e1c06cff04e94e9"}
Sep 07 16:58:13.374331 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:13.374283    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afbddf32-2556-4467-a6d5-551d9fdfc042","Type":"ContainerStarted","Data":"3b8dcf450fbc9066bb4909865d91b5f85d3340e2572d0e3db1fddcc1ce8eecbc"}
Sep 07 16:58:13.429025 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:13.428966    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.828062808 podStartE2EDuration="19.428947114s" totalImagesPullingTime="12.563032607s" totalInitContainerRuntime="37.851699ms" isStatefulPod=false podCreationTimestamp="2026-09-07 16:57:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:58:13.427300136 +0000 UTC m=+87.324147452" watchObservedRunningTime="2026-09-07 16:58:13.428947114 +0000 UTC m=+87.325794428"
Sep 07 16:58:14.381888 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:14.381853    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dfbd559-299c-489d-94d3-925ab300a2d4","Type":"ContainerStarted","Data":"1191d489f3ae6a598b48d48aa2aec5a3bacbdf4aa15ca85e7a9941eb8a3456a5"}
Sep 07 16:58:14.384931 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:14.384877    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b" event={"ID":"15fb9da0-89c7-459e-9c49-84110269cc31","Type":"ContainerStarted","Data":"47329b51e5696d93fe81a40a55b60de966def084033f7db09a56136899312d7a"}
Sep 07 16:58:14.385075 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:14.384971    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b" event={"ID":"15fb9da0-89c7-459e-9c49-84110269cc31","Type":"ContainerStarted","Data":"4e8c00ef732074a7175f6546c7d3378149d1897dbc334e4b01a9295bc5a09162"}
Sep 07 16:58:14.385075 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:14.385003    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b" event={"ID":"15fb9da0-89c7-459e-9c49-84110269cc31","Type":"ContainerStarted","Data":"46523f9cead327f0b36ee068e233c3f6af09f2d28dc818f60e447822c8d2b599"}
Sep 07 16:58:14.407992 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:14.407960    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:58:14.420361 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:14.420294    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.6253973950000002 podStartE2EDuration="26.420274398s" totalImagesPullingTime="22.765519435s" totalInitContainerRuntime="29.357568ms" isStatefulPod=false podCreationTimestamp="2026-09-07 16:57:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:58:14.417810947 +0000 UTC m=+88.314658262" watchObservedRunningTime="2026-09-07 16:58:14.420274398 +0000 UTC m=+88.317121714"
Sep 07 16:58:14.449577 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:14.449509    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b" podStartSLOduration=9.860847294 podStartE2EDuration="24.449489864s" totalImagesPullingTime="14.58864257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:57:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:58:14.44872027 +0000 UTC m=+88.345567586" watchObservedRunningTime="2026-09-07 16:58:14.449489864 +0000 UTC m=+88.346337176"
Sep 07 16:58:15.390352 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:15.390323    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b"
Sep 07 16:58:21.399539 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:21.399511    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-97975b55c-p8s7b"
Sep 07 16:58:22.338764 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:22.338729    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:58:22.435775 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:22.435735    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:58:23.533125 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:23.533090    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7984fdcf8f-xfplf"]
Sep 07 16:58:23.716651 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:23.716615    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:58:23.811859 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:23.811831    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:58:23.913034 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:23.913003    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:58:30.413755 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:30.413713    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8558d584b-z4vwb" podUID="926f8354-d3db-420b-9f29-07c076e12bee" containerName="console" containerID="cri-o://f9258b18b3b663496403c1526b14f51c16edb3c2bb250a37a1cf554a79d6df86" gracePeriod=15
Sep 07 16:58:30.683197 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:30.683136    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8558d584b-z4vwb"
Sep 07 16:58:30.767912 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:30.767872    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/926f8354-d3db-420b-9f29-07c076e12bee-console-oauth-config\") pod \"926f8354-d3db-420b-9f29-07c076e12bee\" (UID: \"926f8354-d3db-420b-9f29-07c076e12bee\") "
Sep 07 16:58:30.768069 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:30.767979    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/926f8354-d3db-420b-9f29-07c076e12bee-console-config\") pod \"926f8354-d3db-420b-9f29-07c076e12bee\" (UID: \"926f8354-d3db-420b-9f29-07c076e12bee\") "
Sep 07 16:58:30.768069 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:30.768014    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/926f8354-d3db-420b-9f29-07c076e12bee-service-ca\") pod \"926f8354-d3db-420b-9f29-07c076e12bee\" (UID: \"926f8354-d3db-420b-9f29-07c076e12bee\") "
Sep 07 16:58:30.768069 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:30.768053    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/926f8354-d3db-420b-9f29-07c076e12bee-oauth-serving-cert\") pod \"926f8354-d3db-420b-9f29-07c076e12bee\" (UID: \"926f8354-d3db-420b-9f29-07c076e12bee\") "
Sep 07 16:58:30.768245 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:30.768223    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/926f8354-d3db-420b-9f29-07c076e12bee-console-serving-cert\") pod \"926f8354-d3db-420b-9f29-07c076e12bee\" (UID: \"926f8354-d3db-420b-9f29-07c076e12bee\") "
Sep 07 16:58:30.768320 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:30.768288    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7t2t\" (UniqueName: \"kubernetes.io/projected/926f8354-d3db-420b-9f29-07c076e12bee-kube-api-access-g7t2t\") pod \"926f8354-d3db-420b-9f29-07c076e12bee\" (UID: \"926f8354-d3db-420b-9f29-07c076e12bee\") "
Sep 07 16:58:30.768378 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:30.768355    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/926f8354-d3db-420b-9f29-07c076e12bee-console-config" (OuterVolumeSpecName: "console-config") pod "926f8354-d3db-420b-9f29-07c076e12bee" (UID: "926f8354-d3db-420b-9f29-07c076e12bee"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 16:58:30.768428 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:30.768378    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/926f8354-d3db-420b-9f29-07c076e12bee-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "926f8354-d3db-420b-9f29-07c076e12bee" (UID: "926f8354-d3db-420b-9f29-07c076e12bee"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 16:58:30.768428 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:30.768366    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/926f8354-d3db-420b-9f29-07c076e12bee-service-ca" (OuterVolumeSpecName: "service-ca") pod "926f8354-d3db-420b-9f29-07c076e12bee" (UID: "926f8354-d3db-420b-9f29-07c076e12bee"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 16:58:30.768618 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:30.768601    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/926f8354-d3db-420b-9f29-07c076e12bee-console-config\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:58:30.768674 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:30.768623    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/926f8354-d3db-420b-9f29-07c076e12bee-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:58:30.768674 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:30.768636    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/926f8354-d3db-420b-9f29-07c076e12bee-oauth-serving-cert\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:58:30.770413 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:30.770382    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/926f8354-d3db-420b-9f29-07c076e12bee-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "926f8354-d3db-420b-9f29-07c076e12bee" (UID: "926f8354-d3db-420b-9f29-07c076e12bee"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 16:58:30.770530 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:30.770385    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/926f8354-d3db-420b-9f29-07c076e12bee-kube-api-access-g7t2t" (OuterVolumeSpecName: "kube-api-access-g7t2t") pod "926f8354-d3db-420b-9f29-07c076e12bee" (UID: "926f8354-d3db-420b-9f29-07c076e12bee"). InnerVolumeSpecName "kube-api-access-g7t2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 16:58:30.770530 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:30.770453    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/926f8354-d3db-420b-9f29-07c076e12bee-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "926f8354-d3db-420b-9f29-07c076e12bee" (UID: "926f8354-d3db-420b-9f29-07c076e12bee"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 16:58:30.870005 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:30.869963    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/926f8354-d3db-420b-9f29-07c076e12bee-console-serving-cert\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:58:30.870005 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:30.869998    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7t2t\" (UniqueName: \"kubernetes.io/projected/926f8354-d3db-420b-9f29-07c076e12bee-kube-api-access-g7t2t\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:58:30.870005 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:30.870011    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/926f8354-d3db-420b-9f29-07c076e12bee-console-oauth-config\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:58:31.465235 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:31.465201    2575 generic.go:356] "Generic (PLEG): container finished" podID="926f8354-d3db-420b-9f29-07c076e12bee" containerID="f9258b18b3b663496403c1526b14f51c16edb3c2bb250a37a1cf554a79d6df86" exitCode=0
Sep 07 16:58:31.465618 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:31.465247    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8558d584b-z4vwb"
Sep 07 16:58:31.465618 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:31.465286    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8558d584b-z4vwb" event={"ID":"926f8354-d3db-420b-9f29-07c076e12bee","Type":"ContainerDied","Data":"f9258b18b3b663496403c1526b14f51c16edb3c2bb250a37a1cf554a79d6df86"}
Sep 07 16:58:31.465618 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:31.465339    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8558d584b-z4vwb" event={"ID":"926f8354-d3db-420b-9f29-07c076e12bee","Type":"ContainerDied","Data":"875f1010cd9f383288915f4a54e0edf2ee80ad0ad81f96a26e11dc3619216740"}
Sep 07 16:58:31.465618 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:31.465362    2575 scope.go:117] "RemoveContainer" containerID="f9258b18b3b663496403c1526b14f51c16edb3c2bb250a37a1cf554a79d6df86"
Sep 07 16:58:31.474266 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:31.474249    2575 scope.go:117] "RemoveContainer" containerID="f9258b18b3b663496403c1526b14f51c16edb3c2bb250a37a1cf554a79d6df86"
Sep 07 16:58:31.474565 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:58:31.474540    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9258b18b3b663496403c1526b14f51c16edb3c2bb250a37a1cf554a79d6df86\": container with ID starting with f9258b18b3b663496403c1526b14f51c16edb3c2bb250a37a1cf554a79d6df86 not found: ID does not exist" containerID="f9258b18b3b663496403c1526b14f51c16edb3c2bb250a37a1cf554a79d6df86"
Sep 07 16:58:31.474629 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:31.474574    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9258b18b3b663496403c1526b14f51c16edb3c2bb250a37a1cf554a79d6df86"} err="failed to get container status \"f9258b18b3b663496403c1526b14f51c16edb3c2bb250a37a1cf554a79d6df86\": rpc error: code = NotFound desc = could not find container \"f9258b18b3b663496403c1526b14f51c16edb3c2bb250a37a1cf554a79d6df86\": container with ID starting with f9258b18b3b663496403c1526b14f51c16edb3c2bb250a37a1cf554a79d6df86 not found: ID does not exist"
Sep 07 16:58:31.486707 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:31.486684    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8558d584b-z4vwb"]
Sep 07 16:58:31.490526 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:31.490507    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8558d584b-z4vwb"]
Sep 07 16:58:32.724079 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:32.722263    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="926f8354-d3db-420b-9f29-07c076e12bee" path="/var/lib/kubelet/pods/926f8354-d3db-420b-9f29-07c076e12bee/volumes"
Sep 07 16:58:32.747343 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:32.747316    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7c658bfc5c-jlrd9"
Sep 07 16:58:32.751173 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:32.751154    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7c658bfc5c-jlrd9"
Sep 07 16:58:43.376857 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:43.376830    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-g2l8w"
Sep 07 16:58:46.112358 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:46.112303    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:58:48.552622 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:48.552559    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7984fdcf8f-xfplf" podUID="5d6d7d19-bf74-441e-afb9-5746b0dacca5" containerName="console" containerID="cri-o://119d86ea785936246a64afac875fcbcfdfa8b96aad93bbc830e8409f7c468c71" gracePeriod=15
Sep 07 16:58:48.823147 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:48.823081    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7984fdcf8f-xfplf"
Sep 07 16:58:48.935769 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:48.935731    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d6d7d19-bf74-441e-afb9-5746b0dacca5-console-config\") pod \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\" (UID: \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\") "
Sep 07 16:58:48.935964 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:48.935778    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29rdt\" (UniqueName: \"kubernetes.io/projected/5d6d7d19-bf74-441e-afb9-5746b0dacca5-kube-api-access-29rdt\") pod \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\" (UID: \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\") "
Sep 07 16:58:48.935964 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:48.935814    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d6d7d19-bf74-441e-afb9-5746b0dacca5-oauth-serving-cert\") pod \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\" (UID: \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\") "
Sep 07 16:58:48.935964 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:48.935945    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d6d7d19-bf74-441e-afb9-5746b0dacca5-service-ca\") pod \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\" (UID: \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\") "
Sep 07 16:58:48.936140 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:48.935990    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d6d7d19-bf74-441e-afb9-5746b0dacca5-console-oauth-config\") pod \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\" (UID: \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\") "
Sep 07 16:58:48.936140 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:48.936035    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d6d7d19-bf74-441e-afb9-5746b0dacca5-console-serving-cert\") pod \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\" (UID: \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\") "
Sep 07 16:58:48.936140 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:48.936083    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d6d7d19-bf74-441e-afb9-5746b0dacca5-trusted-ca-bundle\") pod \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\" (UID: \"5d6d7d19-bf74-441e-afb9-5746b0dacca5\") "
Sep 07 16:58:48.936288 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:48.936133    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d6d7d19-bf74-441e-afb9-5746b0dacca5-console-config" (OuterVolumeSpecName: "console-config") pod "5d6d7d19-bf74-441e-afb9-5746b0dacca5" (UID: "5d6d7d19-bf74-441e-afb9-5746b0dacca5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 16:58:48.936288 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:48.936218    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d6d7d19-bf74-441e-afb9-5746b0dacca5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5d6d7d19-bf74-441e-afb9-5746b0dacca5" (UID: "5d6d7d19-bf74-441e-afb9-5746b0dacca5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 16:58:48.936395 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:48.936340    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d6d7d19-bf74-441e-afb9-5746b0dacca5-service-ca" (OuterVolumeSpecName: "service-ca") pod "5d6d7d19-bf74-441e-afb9-5746b0dacca5" (UID: "5d6d7d19-bf74-441e-afb9-5746b0dacca5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 16:58:48.936467 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:48.936402    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d6d7d19-bf74-441e-afb9-5746b0dacca5-console-config\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:58:48.936519 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:48.936479    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d6d7d19-bf74-441e-afb9-5746b0dacca5-oauth-serving-cert\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:58:48.936519 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:48.936481    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d6d7d19-bf74-441e-afb9-5746b0dacca5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5d6d7d19-bf74-441e-afb9-5746b0dacca5" (UID: "5d6d7d19-bf74-441e-afb9-5746b0dacca5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 16:58:48.938091 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:48.938069    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d6d7d19-bf74-441e-afb9-5746b0dacca5-kube-api-access-29rdt" (OuterVolumeSpecName: "kube-api-access-29rdt") pod "5d6d7d19-bf74-441e-afb9-5746b0dacca5" (UID: "5d6d7d19-bf74-441e-afb9-5746b0dacca5"). InnerVolumeSpecName "kube-api-access-29rdt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 16:58:48.938528 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:48.938508    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d6d7d19-bf74-441e-afb9-5746b0dacca5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5d6d7d19-bf74-441e-afb9-5746b0dacca5" (UID: "5d6d7d19-bf74-441e-afb9-5746b0dacca5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 16:58:48.938612 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:48.938590    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d6d7d19-bf74-441e-afb9-5746b0dacca5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5d6d7d19-bf74-441e-afb9-5746b0dacca5" (UID: "5d6d7d19-bf74-441e-afb9-5746b0dacca5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 16:58:49.037596 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:49.037559    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d6d7d19-bf74-441e-afb9-5746b0dacca5-trusted-ca-bundle\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:58:49.037596 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:49.037590    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29rdt\" (UniqueName: \"kubernetes.io/projected/5d6d7d19-bf74-441e-afb9-5746b0dacca5-kube-api-access-29rdt\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:58:49.037596 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:49.037600    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d6d7d19-bf74-441e-afb9-5746b0dacca5-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:58:49.037818 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:49.037610    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d6d7d19-bf74-441e-afb9-5746b0dacca5-console-oauth-config\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:58:49.037818 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:49.037619    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d6d7d19-bf74-441e-afb9-5746b0dacca5-console-serving-cert\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:58:49.546583 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:49.546550    2575 generic.go:356] "Generic (PLEG): container finished" podID="5d6d7d19-bf74-441e-afb9-5746b0dacca5" containerID="119d86ea785936246a64afac875fcbcfdfa8b96aad93bbc830e8409f7c468c71" exitCode=0
Sep 07 16:58:49.546743 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:49.546593    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7984fdcf8f-xfplf"
Sep 07 16:58:49.546743 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:49.546619    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7984fdcf8f-xfplf" event={"ID":"5d6d7d19-bf74-441e-afb9-5746b0dacca5","Type":"ContainerDied","Data":"119d86ea785936246a64afac875fcbcfdfa8b96aad93bbc830e8409f7c468c71"}
Sep 07 16:58:49.546743 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:49.546660    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7984fdcf8f-xfplf" event={"ID":"5d6d7d19-bf74-441e-afb9-5746b0dacca5","Type":"ContainerDied","Data":"aa216effe7d476f04dd75e47392dc363426eeb19deedb7d35dc6467b5e83a62a"}
Sep 07 16:58:49.546743 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:49.546678    2575 scope.go:117] "RemoveContainer" containerID="119d86ea785936246a64afac875fcbcfdfa8b96aad93bbc830e8409f7c468c71"
Sep 07 16:58:49.555618 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:49.555442    2575 scope.go:117] "RemoveContainer" containerID="119d86ea785936246a64afac875fcbcfdfa8b96aad93bbc830e8409f7c468c71"
Sep 07 16:58:49.555849 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:58:49.555714    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"119d86ea785936246a64afac875fcbcfdfa8b96aad93bbc830e8409f7c468c71\": container with ID starting with 119d86ea785936246a64afac875fcbcfdfa8b96aad93bbc830e8409f7c468c71 not found: ID does not exist" containerID="119d86ea785936246a64afac875fcbcfdfa8b96aad93bbc830e8409f7c468c71"
Sep 07 16:58:49.555849 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:49.555739    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"119d86ea785936246a64afac875fcbcfdfa8b96aad93bbc830e8409f7c468c71"} err="failed to get container status \"119d86ea785936246a64afac875fcbcfdfa8b96aad93bbc830e8409f7c468c71\": rpc error: code = NotFound desc = could not find container \"119d86ea785936246a64afac875fcbcfdfa8b96aad93bbc830e8409f7c468c71\": container with ID starting with 119d86ea785936246a64afac875fcbcfdfa8b96aad93bbc830e8409f7c468c71 not found: ID does not exist"
Sep 07 16:58:49.568758 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:49.568731    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7984fdcf8f-xfplf"]
Sep 07 16:58:49.570268 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:49.570246    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7984fdcf8f-xfplf"]
Sep 07 16:58:50.721349 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:50.721315    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d6d7d19-bf74-441e-afb9-5746b0dacca5" path="/var/lib/kubelet/pods/5d6d7d19-bf74-441e-afb9-5746b0dacca5/volumes"
Sep 07 16:58:54.407500 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:54.407463    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:58:54.476626 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:54.476586    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:58:54.590379 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:58:54.590040    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:03.903987 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:03.903949    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:59:03.985180 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:03.985149    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:59:08.186421 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:08.186386    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 16:59:08.186803 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:08.186760    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerName="alertmanager" containerID="cri-o://9ad9abf4f0b6b9913e42c8883ef982f5ba0bfc84964fe84cef0886c7e91b1f2e" gracePeriod=120
Sep 07 16:59:08.186878 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:08.186826    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerName="kube-rbac-proxy-metric" containerID="cri-o://02e328b5647356933ec6c4e71f1b0f1024f094597ea4da6de5f1496df2c9f5a0" gracePeriod=120
Sep 07 16:59:08.187098 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:08.186850    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerName="kube-rbac-proxy-web" containerID="cri-o://003403d5b3cc7f62ff02cab99aded24dd0d4a2c789e9fd4e1882d3e45970bd66" gracePeriod=120
Sep 07 16:59:08.187216 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:08.186910    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerName="kube-rbac-proxy" containerID="cri-o://2be55cf798f23165ba98dc7e62f2ede566b4dabdca797dbcac49d4e7eace6d7b" gracePeriod=120
Sep 07 16:59:08.187216 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:08.186924    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerName="prom-label-proxy" containerID="cri-o://1191d489f3ae6a598b48d48aa2aec5a3bacbdf4aa15ca85e7a9941eb8a3456a5" gracePeriod=120
Sep 07 16:59:08.187736 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:08.186939    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerName="config-reloader" containerID="cri-o://d2cccc76cde35a1b34dc22546e4d5c17697741afecd26dfa54384bd6d4c8d009" gracePeriod=120
Sep 07 16:59:08.640371 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:08.640339    2575 generic.go:356] "Generic (PLEG): container finished" podID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerID="1191d489f3ae6a598b48d48aa2aec5a3bacbdf4aa15ca85e7a9941eb8a3456a5" exitCode=0
Sep 07 16:59:08.640371 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:08.640365    2575 generic.go:356] "Generic (PLEG): container finished" podID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerID="02e328b5647356933ec6c4e71f1b0f1024f094597ea4da6de5f1496df2c9f5a0" exitCode=0
Sep 07 16:59:08.640371 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:08.640373    2575 generic.go:356] "Generic (PLEG): container finished" podID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerID="2be55cf798f23165ba98dc7e62f2ede566b4dabdca797dbcac49d4e7eace6d7b" exitCode=0
Sep 07 16:59:08.640371 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:08.640379    2575 generic.go:356] "Generic (PLEG): container finished" podID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerID="d2cccc76cde35a1b34dc22546e4d5c17697741afecd26dfa54384bd6d4c8d009" exitCode=0
Sep 07 16:59:08.640622 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:08.640384    2575 generic.go:356] "Generic (PLEG): container finished" podID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerID="9ad9abf4f0b6b9913e42c8883ef982f5ba0bfc84964fe84cef0886c7e91b1f2e" exitCode=0
Sep 07 16:59:08.640622 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:08.640407    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dfbd559-299c-489d-94d3-925ab300a2d4","Type":"ContainerDied","Data":"1191d489f3ae6a598b48d48aa2aec5a3bacbdf4aa15ca85e7a9941eb8a3456a5"}
Sep 07 16:59:08.640622 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:08.640469    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dfbd559-299c-489d-94d3-925ab300a2d4","Type":"ContainerDied","Data":"02e328b5647356933ec6c4e71f1b0f1024f094597ea4da6de5f1496df2c9f5a0"}
Sep 07 16:59:08.640622 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:08.640498    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dfbd559-299c-489d-94d3-925ab300a2d4","Type":"ContainerDied","Data":"2be55cf798f23165ba98dc7e62f2ede566b4dabdca797dbcac49d4e7eace6d7b"}
Sep 07 16:59:08.640622 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:08.640521    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dfbd559-299c-489d-94d3-925ab300a2d4","Type":"ContainerDied","Data":"d2cccc76cde35a1b34dc22546e4d5c17697741afecd26dfa54384bd6d4c8d009"}
Sep 07 16:59:08.640622 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:08.640545    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dfbd559-299c-489d-94d3-925ab300a2d4","Type":"ContainerDied","Data":"9ad9abf4f0b6b9913e42c8883ef982f5ba0bfc84964fe84cef0886c7e91b1f2e"}
Sep 07 16:59:09.432854 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.432830    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.520307 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.520233    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-secret-alertmanager-kube-rbac-proxy-web\") pod \"7dfbd559-299c-489d-94d3-925ab300a2d4\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") "
Sep 07 16:59:09.520307 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.520273    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-secret-alertmanager-kube-rbac-proxy\") pod \"7dfbd559-299c-489d-94d3-925ab300a2d4\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") "
Sep 07 16:59:09.520526 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.520312    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-cluster-tls-config\") pod \"7dfbd559-299c-489d-94d3-925ab300a2d4\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") "
Sep 07 16:59:09.520526 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.520336    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7dfbd559-299c-489d-94d3-925ab300a2d4-config-out\") pod \"7dfbd559-299c-489d-94d3-925ab300a2d4\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") "
Sep 07 16:59:09.520526 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.520478    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"7dfbd559-299c-489d-94d3-925ab300a2d4\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") "
Sep 07 16:59:09.520695 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.520545    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-secret-alertmanager-main-tls\") pod \"7dfbd559-299c-489d-94d3-925ab300a2d4\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") "
Sep 07 16:59:09.520695 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.520580    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-config-volume\") pod \"7dfbd559-299c-489d-94d3-925ab300a2d4\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") "
Sep 07 16:59:09.520695 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.520614    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dfbd559-299c-489d-94d3-925ab300a2d4-alertmanager-trusted-ca-bundle\") pod \"7dfbd559-299c-489d-94d3-925ab300a2d4\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") "
Sep 07 16:59:09.520695 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.520650    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7dfbd559-299c-489d-94d3-925ab300a2d4-tls-assets\") pod \"7dfbd559-299c-489d-94d3-925ab300a2d4\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") "
Sep 07 16:59:09.520695 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.520688    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dfbd559-299c-489d-94d3-925ab300a2d4-metrics-client-ca\") pod \"7dfbd559-299c-489d-94d3-925ab300a2d4\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") "
Sep 07 16:59:09.520958 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.520713    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7t7z2\" (UniqueName: \"kubernetes.io/projected/7dfbd559-299c-489d-94d3-925ab300a2d4-kube-api-access-7t7z2\") pod \"7dfbd559-299c-489d-94d3-925ab300a2d4\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") "
Sep 07 16:59:09.520958 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.520743    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7dfbd559-299c-489d-94d3-925ab300a2d4-alertmanager-main-db\") pod \"7dfbd559-299c-489d-94d3-925ab300a2d4\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") "
Sep 07 16:59:09.520958 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.520799    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-web-config\") pod \"7dfbd559-299c-489d-94d3-925ab300a2d4\" (UID: \"7dfbd559-299c-489d-94d3-925ab300a2d4\") "
Sep 07 16:59:09.521176 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.521145    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dfbd559-299c-489d-94d3-925ab300a2d4-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "7dfbd559-299c-489d-94d3-925ab300a2d4" (UID: "7dfbd559-299c-489d-94d3-925ab300a2d4"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 16:59:09.522329 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.522277    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dfbd559-299c-489d-94d3-925ab300a2d4-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "7dfbd559-299c-489d-94d3-925ab300a2d4" (UID: "7dfbd559-299c-489d-94d3-925ab300a2d4"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 16:59:09.522675 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.522627    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dfbd559-299c-489d-94d3-925ab300a2d4-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "7dfbd559-299c-489d-94d3-925ab300a2d4" (UID: "7dfbd559-299c-489d-94d3-925ab300a2d4"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 16:59:09.524842 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.524816    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dfbd559-299c-489d-94d3-925ab300a2d4-config-out" (OuterVolumeSpecName: "config-out") pod "7dfbd559-299c-489d-94d3-925ab300a2d4" (UID: "7dfbd559-299c-489d-94d3-925ab300a2d4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 16:59:09.525104 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.525052    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-config-volume" (OuterVolumeSpecName: "config-volume") pod "7dfbd559-299c-489d-94d3-925ab300a2d4" (UID: "7dfbd559-299c-489d-94d3-925ab300a2d4"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 16:59:09.525186 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.525164    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dfbd559-299c-489d-94d3-925ab300a2d4-kube-api-access-7t7z2" (OuterVolumeSpecName: "kube-api-access-7t7z2") pod "7dfbd559-299c-489d-94d3-925ab300a2d4" (UID: "7dfbd559-299c-489d-94d3-925ab300a2d4"). InnerVolumeSpecName "kube-api-access-7t7z2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 16:59:09.525260 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.525208    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "7dfbd559-299c-489d-94d3-925ab300a2d4" (UID: "7dfbd559-299c-489d-94d3-925ab300a2d4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 16:59:09.525361 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.525327    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "7dfbd559-299c-489d-94d3-925ab300a2d4" (UID: "7dfbd559-299c-489d-94d3-925ab300a2d4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 16:59:09.525468 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.525403    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "7dfbd559-299c-489d-94d3-925ab300a2d4" (UID: "7dfbd559-299c-489d-94d3-925ab300a2d4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 16:59:09.525775 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.525734    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "7dfbd559-299c-489d-94d3-925ab300a2d4" (UID: "7dfbd559-299c-489d-94d3-925ab300a2d4"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 16:59:09.526369 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.526350    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dfbd559-299c-489d-94d3-925ab300a2d4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7dfbd559-299c-489d-94d3-925ab300a2d4" (UID: "7dfbd559-299c-489d-94d3-925ab300a2d4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 16:59:09.529391 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.529243    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "7dfbd559-299c-489d-94d3-925ab300a2d4" (UID: "7dfbd559-299c-489d-94d3-925ab300a2d4"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 16:59:09.536080 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.536052    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-web-config" (OuterVolumeSpecName: "web-config") pod "7dfbd559-299c-489d-94d3-925ab300a2d4" (UID: "7dfbd559-299c-489d-94d3-925ab300a2d4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 16:59:09.622374 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.622339    2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-cluster-tls-config\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:09.622374 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.622369    2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7dfbd559-299c-489d-94d3-925ab300a2d4-config-out\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:09.622374 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.622379    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:09.622597 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.622389    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-secret-alertmanager-main-tls\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:09.622597 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.622398    2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-config-volume\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:09.622597 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.622406    2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dfbd559-299c-489d-94d3-925ab300a2d4-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:09.622597 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.622415    2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7dfbd559-299c-489d-94d3-925ab300a2d4-tls-assets\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:09.622597 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.622423    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dfbd559-299c-489d-94d3-925ab300a2d4-metrics-client-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:09.622597 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.622430    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7t7z2\" (UniqueName: \"kubernetes.io/projected/7dfbd559-299c-489d-94d3-925ab300a2d4-kube-api-access-7t7z2\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:09.622597 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.622438    2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7dfbd559-299c-489d-94d3-925ab300a2d4-alertmanager-main-db\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:09.622597 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.622446    2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-web-config\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:09.622597 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.622454    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:09.622597 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.622462    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7dfbd559-299c-489d-94d3-925ab300a2d4-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:09.647435 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.647406    2575 generic.go:356] "Generic (PLEG): container finished" podID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerID="003403d5b3cc7f62ff02cab99aded24dd0d4a2c789e9fd4e1882d3e45970bd66" exitCode=0
Sep 07 16:59:09.647583 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.647488    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.647583 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.647492    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dfbd559-299c-489d-94d3-925ab300a2d4","Type":"ContainerDied","Data":"003403d5b3cc7f62ff02cab99aded24dd0d4a2c789e9fd4e1882d3e45970bd66"}
Sep 07 16:59:09.647583 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.647567    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dfbd559-299c-489d-94d3-925ab300a2d4","Type":"ContainerDied","Data":"ec877babb5cbacd013d653e207bc29544816ba6e9446046cfb21f9e614d70c90"}
Sep 07 16:59:09.647772 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.647609    2575 scope.go:117] "RemoveContainer" containerID="1191d489f3ae6a598b48d48aa2aec5a3bacbdf4aa15ca85e7a9941eb8a3456a5"
Sep 07 16:59:09.660298 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.660279    2575 scope.go:117] "RemoveContainer" containerID="02e328b5647356933ec6c4e71f1b0f1024f094597ea4da6de5f1496df2c9f5a0"
Sep 07 16:59:09.667326 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.667304    2575 scope.go:117] "RemoveContainer" containerID="2be55cf798f23165ba98dc7e62f2ede566b4dabdca797dbcac49d4e7eace6d7b"
Sep 07 16:59:09.674620 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.674586    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 16:59:09.675558 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.675539    2575 scope.go:117] "RemoveContainer" containerID="003403d5b3cc7f62ff02cab99aded24dd0d4a2c789e9fd4e1882d3e45970bd66"
Sep 07 16:59:09.676215 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.676196    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 16:59:09.682699 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.682677    2575 scope.go:117] "RemoveContainer" containerID="d2cccc76cde35a1b34dc22546e4d5c17697741afecd26dfa54384bd6d4c8d009"
Sep 07 16:59:09.689640 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.689623    2575 scope.go:117] "RemoveContainer" containerID="9ad9abf4f0b6b9913e42c8883ef982f5ba0bfc84964fe84cef0886c7e91b1f2e"
Sep 07 16:59:09.696775 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.696760    2575 scope.go:117] "RemoveContainer" containerID="1b42a94e28aa1f38d8e52dea9c98864f4c4bd9f72f9e01f3586ddc086003156d"
Sep 07 16:59:09.703881 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.703864    2575 scope.go:117] "RemoveContainer" containerID="1191d489f3ae6a598b48d48aa2aec5a3bacbdf4aa15ca85e7a9941eb8a3456a5"
Sep 07 16:59:09.704194 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:59:09.704173    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1191d489f3ae6a598b48d48aa2aec5a3bacbdf4aa15ca85e7a9941eb8a3456a5\": container with ID starting with 1191d489f3ae6a598b48d48aa2aec5a3bacbdf4aa15ca85e7a9941eb8a3456a5 not found: ID does not exist" containerID="1191d489f3ae6a598b48d48aa2aec5a3bacbdf4aa15ca85e7a9941eb8a3456a5"
Sep 07 16:59:09.704285 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.704205    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1191d489f3ae6a598b48d48aa2aec5a3bacbdf4aa15ca85e7a9941eb8a3456a5"} err="failed to get container status \"1191d489f3ae6a598b48d48aa2aec5a3bacbdf4aa15ca85e7a9941eb8a3456a5\": rpc error: code = NotFound desc = could not find container \"1191d489f3ae6a598b48d48aa2aec5a3bacbdf4aa15ca85e7a9941eb8a3456a5\": container with ID starting with 1191d489f3ae6a598b48d48aa2aec5a3bacbdf4aa15ca85e7a9941eb8a3456a5 not found: ID does not exist"
Sep 07 16:59:09.704285 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.704230    2575 scope.go:117] "RemoveContainer" containerID="02e328b5647356933ec6c4e71f1b0f1024f094597ea4da6de5f1496df2c9f5a0"
Sep 07 16:59:09.704518 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:59:09.704499    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02e328b5647356933ec6c4e71f1b0f1024f094597ea4da6de5f1496df2c9f5a0\": container with ID starting with 02e328b5647356933ec6c4e71f1b0f1024f094597ea4da6de5f1496df2c9f5a0 not found: ID does not exist" containerID="02e328b5647356933ec6c4e71f1b0f1024f094597ea4da6de5f1496df2c9f5a0"
Sep 07 16:59:09.704557 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.704525    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02e328b5647356933ec6c4e71f1b0f1024f094597ea4da6de5f1496df2c9f5a0"} err="failed to get container status \"02e328b5647356933ec6c4e71f1b0f1024f094597ea4da6de5f1496df2c9f5a0\": rpc error: code = NotFound desc = could not find container \"02e328b5647356933ec6c4e71f1b0f1024f094597ea4da6de5f1496df2c9f5a0\": container with ID starting with 02e328b5647356933ec6c4e71f1b0f1024f094597ea4da6de5f1496df2c9f5a0 not found: ID does not exist"
Sep 07 16:59:09.704557 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.704540    2575 scope.go:117] "RemoveContainer" containerID="2be55cf798f23165ba98dc7e62f2ede566b4dabdca797dbcac49d4e7eace6d7b"
Sep 07 16:59:09.704787 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:59:09.704768    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2be55cf798f23165ba98dc7e62f2ede566b4dabdca797dbcac49d4e7eace6d7b\": container with ID starting with 2be55cf798f23165ba98dc7e62f2ede566b4dabdca797dbcac49d4e7eace6d7b not found: ID does not exist" containerID="2be55cf798f23165ba98dc7e62f2ede566b4dabdca797dbcac49d4e7eace6d7b"
Sep 07 16:59:09.704844 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.704794    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2be55cf798f23165ba98dc7e62f2ede566b4dabdca797dbcac49d4e7eace6d7b"} err="failed to get container status \"2be55cf798f23165ba98dc7e62f2ede566b4dabdca797dbcac49d4e7eace6d7b\": rpc error: code = NotFound desc = could not find container \"2be55cf798f23165ba98dc7e62f2ede566b4dabdca797dbcac49d4e7eace6d7b\": container with ID starting with 2be55cf798f23165ba98dc7e62f2ede566b4dabdca797dbcac49d4e7eace6d7b not found: ID does not exist"
Sep 07 16:59:09.704844 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.704815    2575 scope.go:117] "RemoveContainer" containerID="003403d5b3cc7f62ff02cab99aded24dd0d4a2c789e9fd4e1882d3e45970bd66"
Sep 07 16:59:09.705063 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:59:09.705046    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"003403d5b3cc7f62ff02cab99aded24dd0d4a2c789e9fd4e1882d3e45970bd66\": container with ID starting with 003403d5b3cc7f62ff02cab99aded24dd0d4a2c789e9fd4e1882d3e45970bd66 not found: ID does not exist" containerID="003403d5b3cc7f62ff02cab99aded24dd0d4a2c789e9fd4e1882d3e45970bd66"
Sep 07 16:59:09.705099 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.705067    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"003403d5b3cc7f62ff02cab99aded24dd0d4a2c789e9fd4e1882d3e45970bd66"} err="failed to get container status \"003403d5b3cc7f62ff02cab99aded24dd0d4a2c789e9fd4e1882d3e45970bd66\": rpc error: code = NotFound desc = could not find container \"003403d5b3cc7f62ff02cab99aded24dd0d4a2c789e9fd4e1882d3e45970bd66\": container with ID starting with 003403d5b3cc7f62ff02cab99aded24dd0d4a2c789e9fd4e1882d3e45970bd66 not found: ID does not exist"
Sep 07 16:59:09.705099 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.705082    2575 scope.go:117] "RemoveContainer" containerID="d2cccc76cde35a1b34dc22546e4d5c17697741afecd26dfa54384bd6d4c8d009"
Sep 07 16:59:09.705349 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:59:09.705329    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2cccc76cde35a1b34dc22546e4d5c17697741afecd26dfa54384bd6d4c8d009\": container with ID starting with d2cccc76cde35a1b34dc22546e4d5c17697741afecd26dfa54384bd6d4c8d009 not found: ID does not exist" containerID="d2cccc76cde35a1b34dc22546e4d5c17697741afecd26dfa54384bd6d4c8d009"
Sep 07 16:59:09.705484 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.705451    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2cccc76cde35a1b34dc22546e4d5c17697741afecd26dfa54384bd6d4c8d009"} err="failed to get container status \"d2cccc76cde35a1b34dc22546e4d5c17697741afecd26dfa54384bd6d4c8d009\": rpc error: code = NotFound desc = could not find container \"d2cccc76cde35a1b34dc22546e4d5c17697741afecd26dfa54384bd6d4c8d009\": container with ID starting with d2cccc76cde35a1b34dc22546e4d5c17697741afecd26dfa54384bd6d4c8d009 not found: ID does not exist"
Sep 07 16:59:09.705484 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.705475    2575 scope.go:117] "RemoveContainer" containerID="9ad9abf4f0b6b9913e42c8883ef982f5ba0bfc84964fe84cef0886c7e91b1f2e"
Sep 07 16:59:09.705817 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:59:09.705775    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ad9abf4f0b6b9913e42c8883ef982f5ba0bfc84964fe84cef0886c7e91b1f2e\": container with ID starting with 9ad9abf4f0b6b9913e42c8883ef982f5ba0bfc84964fe84cef0886c7e91b1f2e not found: ID does not exist" containerID="9ad9abf4f0b6b9913e42c8883ef982f5ba0bfc84964fe84cef0886c7e91b1f2e"
Sep 07 16:59:09.705817 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.705807    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ad9abf4f0b6b9913e42c8883ef982f5ba0bfc84964fe84cef0886c7e91b1f2e"} err="failed to get container status \"9ad9abf4f0b6b9913e42c8883ef982f5ba0bfc84964fe84cef0886c7e91b1f2e\": rpc error: code = NotFound desc = could not find container \"9ad9abf4f0b6b9913e42c8883ef982f5ba0bfc84964fe84cef0886c7e91b1f2e\": container with ID starting with 9ad9abf4f0b6b9913e42c8883ef982f5ba0bfc84964fe84cef0886c7e91b1f2e not found: ID does not exist"
Sep 07 16:59:09.706032 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.705827    2575 scope.go:117] "RemoveContainer" containerID="1b42a94e28aa1f38d8e52dea9c98864f4c4bd9f72f9e01f3586ddc086003156d"
Sep 07 16:59:09.706284 ip-10-0-136-3 kubenswrapper[2575]: E0907 16:59:09.706209    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b42a94e28aa1f38d8e52dea9c98864f4c4bd9f72f9e01f3586ddc086003156d\": container with ID starting with 1b42a94e28aa1f38d8e52dea9c98864f4c4bd9f72f9e01f3586ddc086003156d not found: ID does not exist" containerID="1b42a94e28aa1f38d8e52dea9c98864f4c4bd9f72f9e01f3586ddc086003156d"
Sep 07 16:59:09.706284 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.706241    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b42a94e28aa1f38d8e52dea9c98864f4c4bd9f72f9e01f3586ddc086003156d"} err="failed to get container status \"1b42a94e28aa1f38d8e52dea9c98864f4c4bd9f72f9e01f3586ddc086003156d\": rpc error: code = NotFound desc = could not find container \"1b42a94e28aa1f38d8e52dea9c98864f4c4bd9f72f9e01f3586ddc086003156d\": container with ID starting with 1b42a94e28aa1f38d8e52dea9c98864f4c4bd9f72f9e01f3586ddc086003156d not found: ID does not exist"
Sep 07 16:59:09.707588 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.707569    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 16:59:09.707933 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.707920    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerName="kube-rbac-proxy-metric"
Sep 07 16:59:09.707987 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.707935    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerName="kube-rbac-proxy-metric"
Sep 07 16:59:09.707987 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.707944    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerName="kube-rbac-proxy-web"
Sep 07 16:59:09.707987 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.707950    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerName="kube-rbac-proxy-web"
Sep 07 16:59:09.707987 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.707958    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="926f8354-d3db-420b-9f29-07c076e12bee" containerName="console"
Sep 07 16:59:09.707987 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.707964    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="926f8354-d3db-420b-9f29-07c076e12bee" containerName="console"
Sep 07 16:59:09.707987 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.707969    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerName="alertmanager"
Sep 07 16:59:09.707987 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.707975    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerName="alertmanager"
Sep 07 16:59:09.708191 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.707992    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerName="config-reloader"
Sep 07 16:59:09.708191 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.707998    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerName="config-reloader"
Sep 07 16:59:09.708191 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.708005    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerName="init-config-reloader"
Sep 07 16:59:09.708191 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.708010    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerName="init-config-reloader"
Sep 07 16:59:09.708191 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.708017    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d6d7d19-bf74-441e-afb9-5746b0dacca5" containerName="console"
Sep 07 16:59:09.708191 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.708031    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d6d7d19-bf74-441e-afb9-5746b0dacca5" containerName="console"
Sep 07 16:59:09.708191 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.708041    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerName="prom-label-proxy"
Sep 07 16:59:09.708191 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.708046    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerName="prom-label-proxy"
Sep 07 16:59:09.708191 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.708059    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerName="kube-rbac-proxy"
Sep 07 16:59:09.708191 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.708067    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerName="kube-rbac-proxy"
Sep 07 16:59:09.708191 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.708119    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="926f8354-d3db-420b-9f29-07c076e12bee" containerName="console"
Sep 07 16:59:09.708191 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.708127    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerName="kube-rbac-proxy-web"
Sep 07 16:59:09.708191 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.708140    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerName="kube-rbac-proxy"
Sep 07 16:59:09.708191 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.708146    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerName="alertmanager"
Sep 07 16:59:09.708191 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.708151    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerName="prom-label-proxy"
Sep 07 16:59:09.708191 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.708156    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d6d7d19-bf74-441e-afb9-5746b0dacca5" containerName="console"
Sep 07 16:59:09.708191 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.708161    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerName="config-reloader"
Sep 07 16:59:09.708191 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.708167    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dfbd559-299c-489d-94d3-925ab300a2d4" containerName="kube-rbac-proxy-metric"
Sep 07 16:59:09.711664 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.711650    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.714384 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.714362    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 07 16:59:09.714557 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.714412    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 07 16:59:09.714557 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.714481    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7qmw6\""
Sep 07 16:59:09.714557 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.714542    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 07 16:59:09.714713 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.714371    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 07 16:59:09.714713 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.714705    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 07 16:59:09.714812 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.714788    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 07 16:59:09.714812 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.714798    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 07 16:59:09.715085 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.715068    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 07 16:59:09.722504 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.722484    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 07 16:59:09.730920 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.730884    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 16:59:09.823798 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.823769    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-web-config\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.823985 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.823803    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.823985 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.823833    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.823985 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.823931    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-config-volume\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.823985 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.823973    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-config-out\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.824131 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.824028    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.824131 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.824056    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.824131 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.824091    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.824131 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.824118    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.824270 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.824141    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.824270 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.824209    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjh2s\" (UniqueName: \"kubernetes.io/projected/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-kube-api-access-gjh2s\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.824270 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.824252    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.824363 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.824288    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.925074 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.925045    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-web-config\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.925190 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.925078    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.925190 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.925108    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.925190 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.925149    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-config-volume\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.925190 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.925181    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-config-out\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.925391 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.925230    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.925391 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.925258    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.925391 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.925283    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.925391 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.925308    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.925391 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.925330    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.925391 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.925359    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjh2s\" (UniqueName: \"kubernetes.io/projected/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-kube-api-access-gjh2s\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.925391 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.925386    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.925732 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.925412    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.926635 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.926035    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.926635 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.926302    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.928039 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.928013    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-config-out\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.928329 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.928155    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-config-volume\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.928329 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.928199    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.928329 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.928227    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-web-config\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.928329 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.928271    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.928591 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.928399    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.928591 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.928416    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.929012 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.928991    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.929139 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.929123    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.930028 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.930012    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:09.936254 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:09.936237    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjh2s\" (UniqueName: \"kubernetes.io/projected/8daa49bc-25cf-4cf4-8369-6db2fb1b5b11-kube-api-access-gjh2s\") pod \"alertmanager-main-0\" (UID: \"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:10.021856 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:10.021819    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 07 16:59:10.297122 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:10.296946    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 16:59:10.299947 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:59:10.299919    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8daa49bc_25cf_4cf4_8369_6db2fb1b5b11.slice/crio-4b54e4e4002e9a08163f8284bfc66e9a62eedda1aae405ddca01c82d741b8af1 WatchSource:0}: Error finding container 4b54e4e4002e9a08163f8284bfc66e9a62eedda1aae405ddca01c82d741b8af1: Status 404 returned error can't find the container with id 4b54e4e4002e9a08163f8284bfc66e9a62eedda1aae405ddca01c82d741b8af1
Sep 07 16:59:10.652444 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:10.652415    2575 generic.go:356] "Generic (PLEG): container finished" podID="8daa49bc-25cf-4cf4-8369-6db2fb1b5b11" containerID="3ce7357dcd106d9886fd982b61d6052e48ef983fea76fc5d7cf55df1918d6c74" exitCode=0
Sep 07 16:59:10.652852 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:10.652500    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11","Type":"ContainerDied","Data":"3ce7357dcd106d9886fd982b61d6052e48ef983fea76fc5d7cf55df1918d6c74"}
Sep 07 16:59:10.652852 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:10.652572    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11","Type":"ContainerStarted","Data":"4b54e4e4002e9a08163f8284bfc66e9a62eedda1aae405ddca01c82d741b8af1"}
Sep 07 16:59:10.721382 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:10.721359    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dfbd559-299c-489d-94d3-925ab300a2d4" path="/var/lib/kubelet/pods/7dfbd559-299c-489d-94d3-925ab300a2d4/volumes"
Sep 07 16:59:11.661094 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:11.661060    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11","Type":"ContainerStarted","Data":"e4b6dcd4a25ca6b4535d92a1e9913cd5c577858cd15bcb31a6a1af1b470c43bd"}
Sep 07 16:59:11.661554 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:11.661136    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11","Type":"ContainerStarted","Data":"ab1280af04d64f28025a63a3be8894e1aea519fe31f65744dc4ed9c7e287937c"}
Sep 07 16:59:11.661554 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:11.661178    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11","Type":"ContainerStarted","Data":"3375655981d95eb57fd33b1201f27a389ca0a5366b8ca1618499fb96dd0c7bb4"}
Sep 07 16:59:11.661554 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:11.661219    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11","Type":"ContainerStarted","Data":"004b473722e14b41f26a027659eb7d0366af4bfc376a697c910792482fe147d1"}
Sep 07 16:59:11.661554 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:11.661273    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11","Type":"ContainerStarted","Data":"8a6fb106ced03a90c0e0037e4b158556613cbcd7f96e0f0e732c59a89ef94c70"}
Sep 07 16:59:11.661554 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:11.661308    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8daa49bc-25cf-4cf4-8369-6db2fb1b5b11","Type":"ContainerStarted","Data":"b6a8c7bd86091a18725c6ec2a2b0c82d873a93dc7b4c239c75258d45c014820e"}
Sep 07 16:59:11.694868 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:11.694815    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.679183386 podStartE2EDuration="2.694798419s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.615033ms" isStatefulPod=false podCreationTimestamp="2026-09-07 16:59:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:59:11.692201691 +0000 UTC m=+145.589049018" watchObservedRunningTime="2026-09-07 16:59:11.694798419 +0000 UTC m=+145.591645742"
Sep 07 16:59:12.514510 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:12.514476    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 16:59:12.514833 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:12.514803    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerName="prometheus" containerID="cri-o://6ab63e12d0d5e2cf727aed501c0cec51cc073027029dac0018c29ea97cb6be19" gracePeriod=600
Sep 07 16:59:12.514970 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:12.514812    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerName="kube-rbac-proxy" containerID="cri-o://647ca0b25d4f4fac7f29ff9fea70af57d191202afb8719d9a00eaa142f366dba" gracePeriod=600
Sep 07 16:59:12.514970 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:12.514885    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerName="config-reloader" containerID="cri-o://4de5831edaa18a4f7f6a7d762cfd8eca3277a1b59966dfa5094631dd0f141cbd" gracePeriod=600
Sep 07 16:59:12.515081 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:12.514969    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerName="kube-rbac-proxy-web" containerID="cri-o://a35f206a18d8ad0adebe36c38a6b419ff259b8ad647881db3e1c06cff04e94e9" gracePeriod=600
Sep 07 16:59:12.515081 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:12.514877    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerName="kube-rbac-proxy-thanos" containerID="cri-o://b99123192d45f23b446c97a479fa87490a25a4cfee318511af04762314bf9e82" gracePeriod=600
Sep 07 16:59:12.515081 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:12.514883    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerName="thanos-sidecar" containerID="cri-o://3b8dcf450fbc9066bb4909865d91b5f85d3340e2572d0e3db1fddcc1ce8eecbc" gracePeriod=600
Sep 07 16:59:12.670279 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:12.670249    2575 generic.go:356] "Generic (PLEG): container finished" podID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerID="b99123192d45f23b446c97a479fa87490a25a4cfee318511af04762314bf9e82" exitCode=0
Sep 07 16:59:12.670279 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:12.670273    2575 generic.go:356] "Generic (PLEG): container finished" podID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerID="647ca0b25d4f4fac7f29ff9fea70af57d191202afb8719d9a00eaa142f366dba" exitCode=0
Sep 07 16:59:12.670279 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:12.670280    2575 generic.go:356] "Generic (PLEG): container finished" podID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerID="3b8dcf450fbc9066bb4909865d91b5f85d3340e2572d0e3db1fddcc1ce8eecbc" exitCode=0
Sep 07 16:59:12.670279 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:12.670285    2575 generic.go:356] "Generic (PLEG): container finished" podID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerID="4de5831edaa18a4f7f6a7d762cfd8eca3277a1b59966dfa5094631dd0f141cbd" exitCode=0
Sep 07 16:59:12.670719 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:12.670291    2575 generic.go:356] "Generic (PLEG): container finished" podID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerID="6ab63e12d0d5e2cf727aed501c0cec51cc073027029dac0018c29ea97cb6be19" exitCode=0
Sep 07 16:59:12.670719 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:12.670318    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afbddf32-2556-4467-a6d5-551d9fdfc042","Type":"ContainerDied","Data":"b99123192d45f23b446c97a479fa87490a25a4cfee318511af04762314bf9e82"}
Sep 07 16:59:12.670719 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:12.670381    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afbddf32-2556-4467-a6d5-551d9fdfc042","Type":"ContainerDied","Data":"647ca0b25d4f4fac7f29ff9fea70af57d191202afb8719d9a00eaa142f366dba"}
Sep 07 16:59:12.670719 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:12.670408    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afbddf32-2556-4467-a6d5-551d9fdfc042","Type":"ContainerDied","Data":"3b8dcf450fbc9066bb4909865d91b5f85d3340e2572d0e3db1fddcc1ce8eecbc"}
Sep 07 16:59:12.670719 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:12.670431    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afbddf32-2556-4467-a6d5-551d9fdfc042","Type":"ContainerDied","Data":"4de5831edaa18a4f7f6a7d762cfd8eca3277a1b59966dfa5094631dd0f141cbd"}
Sep 07 16:59:12.670719 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:12.670453    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afbddf32-2556-4467-a6d5-551d9fdfc042","Type":"ContainerDied","Data":"6ab63e12d0d5e2cf727aed501c0cec51cc073027029dac0018c29ea97cb6be19"}
Sep 07 16:59:13.678729 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.678700    2575 generic.go:356] "Generic (PLEG): container finished" podID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerID="a35f206a18d8ad0adebe36c38a6b419ff259b8ad647881db3e1c06cff04e94e9" exitCode=0
Sep 07 16:59:13.679161 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.678749    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afbddf32-2556-4467-a6d5-551d9fdfc042","Type":"ContainerDied","Data":"a35f206a18d8ad0adebe36c38a6b419ff259b8ad647881db3e1c06cff04e94e9"}
Sep 07 16:59:13.763326 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.763303    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:13.860549 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.860462    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-configmap-kubelet-serving-ca-bundle\") pod \"afbddf32-2556-4467-a6d5-551d9fdfc042\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") "
Sep 07 16:59:13.860549 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.860496    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/afbddf32-2556-4467-a6d5-551d9fdfc042-tls-assets\") pod \"afbddf32-2556-4467-a6d5-551d9fdfc042\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") "
Sep 07 16:59:13.860549 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.860515    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-configmap-serving-certs-ca-bundle\") pod \"afbddf32-2556-4467-a6d5-551d9fdfc042\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") "
Sep 07 16:59:13.860549 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.860533    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-prometheus-trusted-ca-bundle\") pod \"afbddf32-2556-4467-a6d5-551d9fdfc042\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") "
Sep 07 16:59:13.860852 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.860570    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zb9q\" (UniqueName: \"kubernetes.io/projected/afbddf32-2556-4467-a6d5-551d9fdfc042-kube-api-access-4zb9q\") pod \"afbddf32-2556-4467-a6d5-551d9fdfc042\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") "
Sep 07 16:59:13.860852 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.860605    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-kube-rbac-proxy\") pod \"afbddf32-2556-4467-a6d5-551d9fdfc042\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") "
Sep 07 16:59:13.860852 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.860631    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/afbddf32-2556-4467-a6d5-551d9fdfc042-prometheus-k8s-db\") pod \"afbddf32-2556-4467-a6d5-551d9fdfc042\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") "
Sep 07 16:59:13.860852 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.860659    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-prometheus-k8s-rulefiles-0\") pod \"afbddf32-2556-4467-a6d5-551d9fdfc042\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") "
Sep 07 16:59:13.860852 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.860682    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-grpc-tls\") pod \"afbddf32-2556-4467-a6d5-551d9fdfc042\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") "
Sep 07 16:59:13.860852 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.860711    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"afbddf32-2556-4467-a6d5-551d9fdfc042\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") "
Sep 07 16:59:13.860852 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.860742    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-metrics-client-certs\") pod \"afbddf32-2556-4467-a6d5-551d9fdfc042\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") "
Sep 07 16:59:13.860852 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.860772    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-prometheus-k8s-tls\") pod \"afbddf32-2556-4467-a6d5-551d9fdfc042\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") "
Sep 07 16:59:13.860852 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.860813    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"afbddf32-2556-4467-a6d5-551d9fdfc042\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") "
Sep 07 16:59:13.861381 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.860942    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "afbddf32-2556-4467-a6d5-551d9fdfc042" (UID: "afbddf32-2556-4467-a6d5-551d9fdfc042"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 16:59:13.861381 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.860976    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "afbddf32-2556-4467-a6d5-551d9fdfc042" (UID: "afbddf32-2556-4467-a6d5-551d9fdfc042"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 16:59:13.861381 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.861008    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-prometheus-k8s-rulefiles-2\") pod \"afbddf32-2556-4467-a6d5-551d9fdfc042\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") "
Sep 07 16:59:13.861381 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.861316    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "afbddf32-2556-4467-a6d5-551d9fdfc042" (UID: "afbddf32-2556-4467-a6d5-551d9fdfc042"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 16:59:13.861581 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.861530    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "afbddf32-2556-4467-a6d5-551d9fdfc042" (UID: "afbddf32-2556-4467-a6d5-551d9fdfc042"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 16:59:13.862590 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.861668    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-config\") pod \"afbddf32-2556-4467-a6d5-551d9fdfc042\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") "
Sep 07 16:59:13.862590 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.861780    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-prometheus-k8s-rulefiles-1\") pod \"afbddf32-2556-4467-a6d5-551d9fdfc042\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") "
Sep 07 16:59:13.862590 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.861808    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-configmap-metrics-client-ca\") pod \"afbddf32-2556-4467-a6d5-551d9fdfc042\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") "
Sep 07 16:59:13.862590 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.861840    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/afbddf32-2556-4467-a6d5-551d9fdfc042-config-out\") pod \"afbddf32-2556-4467-a6d5-551d9fdfc042\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") "
Sep 07 16:59:13.862590 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.861864    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-web-config\") pod \"afbddf32-2556-4467-a6d5-551d9fdfc042\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") "
Sep 07 16:59:13.862590 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.861929    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-thanos-prometheus-http-client-file\") pod \"afbddf32-2556-4467-a6d5-551d9fdfc042\" (UID: \"afbddf32-2556-4467-a6d5-551d9fdfc042\") "
Sep 07 16:59:13.862590 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.862256    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:13.862590 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.862276    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:13.862590 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.862291    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:13.862590 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.862307    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:13.862590 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.862571    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afbddf32-2556-4467-a6d5-551d9fdfc042-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "afbddf32-2556-4467-a6d5-551d9fdfc042" (UID: "afbddf32-2556-4467-a6d5-551d9fdfc042"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 16:59:13.863321 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.863025    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "afbddf32-2556-4467-a6d5-551d9fdfc042" (UID: "afbddf32-2556-4467-a6d5-551d9fdfc042"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 16:59:13.864945 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.864270    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "afbddf32-2556-4467-a6d5-551d9fdfc042" (UID: "afbddf32-2556-4467-a6d5-551d9fdfc042"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 16:59:13.864945 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.864359    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "afbddf32-2556-4467-a6d5-551d9fdfc042" (UID: "afbddf32-2556-4467-a6d5-551d9fdfc042"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 16:59:13.865241 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.865183    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "afbddf32-2556-4467-a6d5-551d9fdfc042" (UID: "afbddf32-2556-4467-a6d5-551d9fdfc042"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 16:59:13.866284 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.866260    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "afbddf32-2556-4467-a6d5-551d9fdfc042" (UID: "afbddf32-2556-4467-a6d5-551d9fdfc042"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 16:59:13.866434 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.866289    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afbddf32-2556-4467-a6d5-551d9fdfc042-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "afbddf32-2556-4467-a6d5-551d9fdfc042" (UID: "afbddf32-2556-4467-a6d5-551d9fdfc042"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 16:59:13.867102 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.867049    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afbddf32-2556-4467-a6d5-551d9fdfc042-kube-api-access-4zb9q" (OuterVolumeSpecName: "kube-api-access-4zb9q") pod "afbddf32-2556-4467-a6d5-551d9fdfc042" (UID: "afbddf32-2556-4467-a6d5-551d9fdfc042"). InnerVolumeSpecName "kube-api-access-4zb9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 16:59:13.867102 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.867093    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "afbddf32-2556-4467-a6d5-551d9fdfc042" (UID: "afbddf32-2556-4467-a6d5-551d9fdfc042"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 16:59:13.867259 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.867235    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "afbddf32-2556-4467-a6d5-551d9fdfc042" (UID: "afbddf32-2556-4467-a6d5-551d9fdfc042"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 16:59:13.867381 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.867358    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "afbddf32-2556-4467-a6d5-551d9fdfc042" (UID: "afbddf32-2556-4467-a6d5-551d9fdfc042"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 16:59:13.867493 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.867478    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "afbddf32-2556-4467-a6d5-551d9fdfc042" (UID: "afbddf32-2556-4467-a6d5-551d9fdfc042"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 16:59:13.867602 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.867585    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "afbddf32-2556-4467-a6d5-551d9fdfc042" (UID: "afbddf32-2556-4467-a6d5-551d9fdfc042"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 16:59:13.867658 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.867614    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afbddf32-2556-4467-a6d5-551d9fdfc042-config-out" (OuterVolumeSpecName: "config-out") pod "afbddf32-2556-4467-a6d5-551d9fdfc042" (UID: "afbddf32-2556-4467-a6d5-551d9fdfc042"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 16:59:13.867875 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.867849    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-config" (OuterVolumeSpecName: "config") pod "afbddf32-2556-4467-a6d5-551d9fdfc042" (UID: "afbddf32-2556-4467-a6d5-551d9fdfc042"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 16:59:13.878634 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.878610    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-web-config" (OuterVolumeSpecName: "web-config") pod "afbddf32-2556-4467-a6d5-551d9fdfc042" (UID: "afbddf32-2556-4467-a6d5-551d9fdfc042"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 16:59:13.963299 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.963259    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:13.963299 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.963294    2575 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-metrics-client-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:13.963299 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.963305    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:13.963514 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.963314    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:13.963514 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.963323    2575 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-config\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:13.963514 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.963332    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:13.963514 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.963342    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-configmap-metrics-client-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:13.963514 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.963351    2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/afbddf32-2556-4467-a6d5-551d9fdfc042-config-out\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:13.963514 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.963361    2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-web-config\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:13.963514 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.963368    2575 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:13.963514 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.963376    2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/afbddf32-2556-4467-a6d5-551d9fdfc042-tls-assets\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:13.963514 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.963384    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zb9q\" (UniqueName: \"kubernetes.io/projected/afbddf32-2556-4467-a6d5-551d9fdfc042-kube-api-access-4zb9q\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:13.963514 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.963392    2575 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-kube-rbac-proxy\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:13.963514 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.963400    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/afbddf32-2556-4467-a6d5-551d9fdfc042-prometheus-k8s-db\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:13.963514 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.963408    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/afbddf32-2556-4467-a6d5-551d9fdfc042-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:13.963514 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:13.963415    2575 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/afbddf32-2556-4467-a6d5-551d9fdfc042-secret-grpc-tls\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 16:59:14.686338 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.686310    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.686744 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.686294    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afbddf32-2556-4467-a6d5-551d9fdfc042","Type":"ContainerDied","Data":"b3d8534541523c889002168e578c23167936a6bf201aac5e0029425f158b143f"}
Sep 07 16:59:14.686744 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.686473    2575 scope.go:117] "RemoveContainer" containerID="b99123192d45f23b446c97a479fa87490a25a4cfee318511af04762314bf9e82"
Sep 07 16:59:14.694878 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.694859    2575 scope.go:117] "RemoveContainer" containerID="647ca0b25d4f4fac7f29ff9fea70af57d191202afb8719d9a00eaa142f366dba"
Sep 07 16:59:14.702725 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.702703    2575 scope.go:117] "RemoveContainer" containerID="a35f206a18d8ad0adebe36c38a6b419ff259b8ad647881db3e1c06cff04e94e9"
Sep 07 16:59:14.709841 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.709822    2575 scope.go:117] "RemoveContainer" containerID="3b8dcf450fbc9066bb4909865d91b5f85d3340e2572d0e3db1fddcc1ce8eecbc"
Sep 07 16:59:14.717252 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.717230    2575 scope.go:117] "RemoveContainer" containerID="4de5831edaa18a4f7f6a7d762cfd8eca3277a1b59966dfa5094631dd0f141cbd"
Sep 07 16:59:14.720670 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.720648    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 16:59:14.724948 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.724927    2575 scope.go:117] "RemoveContainer" containerID="6ab63e12d0d5e2cf727aed501c0cec51cc073027029dac0018c29ea97cb6be19"
Sep 07 16:59:14.726236 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.726217    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 16:59:14.732022 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.732006    2575 scope.go:117] "RemoveContainer" containerID="d7cd9a21ae0a3a916cc84d11173cba660ce95f63b4c097530d40e18423097219"
Sep 07 16:59:14.770189 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.770158    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 16:59:14.770473 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.770462    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerName="config-reloader"
Sep 07 16:59:14.770516 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.770475    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerName="config-reloader"
Sep 07 16:59:14.770516 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.770485    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerName="kube-rbac-proxy-thanos"
Sep 07 16:59:14.770516 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.770490    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerName="kube-rbac-proxy-thanos"
Sep 07 16:59:14.770516 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.770500    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerName="init-config-reloader"
Sep 07 16:59:14.770516 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.770505    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerName="init-config-reloader"
Sep 07 16:59:14.770516 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.770515    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerName="kube-rbac-proxy-web"
Sep 07 16:59:14.770680 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.770520    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerName="kube-rbac-proxy-web"
Sep 07 16:59:14.770680 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.770530    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerName="kube-rbac-proxy"
Sep 07 16:59:14.770680 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.770535    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerName="kube-rbac-proxy"
Sep 07 16:59:14.770680 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.770543    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerName="prometheus"
Sep 07 16:59:14.770680 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.770549    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerName="prometheus"
Sep 07 16:59:14.770680 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.770558    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerName="thanos-sidecar"
Sep 07 16:59:14.770680 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.770564    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerName="thanos-sidecar"
Sep 07 16:59:14.770680 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.770625    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerName="prometheus"
Sep 07 16:59:14.770680 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.770634    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerName="kube-rbac-proxy"
Sep 07 16:59:14.770680 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.770641    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerName="config-reloader"
Sep 07 16:59:14.770680 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.770646    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerName="kube-rbac-proxy-web"
Sep 07 16:59:14.770680 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.770653    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerName="kube-rbac-proxy-thanos"
Sep 07 16:59:14.770680 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.770661    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="afbddf32-2556-4467-a6d5-551d9fdfc042" containerName="thanos-sidecar"
Sep 07 16:59:14.774354 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.774338    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.778973 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.778953    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 07 16:59:14.779075 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.778978    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bd0vjbgt9lqcl\""
Sep 07 16:59:14.779622 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.779606    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-42mzl\""
Sep 07 16:59:14.779868 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.779852    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 07 16:59:14.779945 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.779922    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 07 16:59:14.779945 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.779925    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 07 16:59:14.780235 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.780213    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 07 16:59:14.780297 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.780277    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 07 16:59:14.780589 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.780571    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 07 16:59:14.780673 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.780658    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 07 16:59:14.780730 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.780597    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 07 16:59:14.780787 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.780597    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 07 16:59:14.780787 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.780617    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 07 16:59:14.780787 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.780576    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 07 16:59:14.783206 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.783187    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 07 16:59:14.788639 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.788622    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 07 16:59:14.806066 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.806037    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 16:59:14.871372 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.871293    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.871372 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.871327    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.871372 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.871346    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.871372 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.871363    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.871602 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.871388    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.871602 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.871429    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.871602 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.871450    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.871602 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.871470    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.871602 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.871489    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-config\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.871602 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.871516    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.871602 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.871545    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.871602 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.871563    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.871832 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.871611    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.871832 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.871641    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.871832 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.871661    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.871832 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.871682    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds4jj\" (UniqueName: \"kubernetes.io/projected/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-kube-api-access-ds4jj\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.871832 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.871698    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.871832 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.871769    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.871832 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.871799    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-config-out\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.871832 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.871826    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-web-config\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.972406 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.972366    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.972406 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.972409    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.972613 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.972433    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.972613 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.972466    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.972613 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.972492    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.972613 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.972518    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.972613 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.972548    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-config\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.972613 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.972582    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.972613 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.972604    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.972933 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.972626    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.972933 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.972654    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.972933 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.972685    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.972933 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.972715    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.972933 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.972751    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds4jj\" (UniqueName: \"kubernetes.io/projected/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-kube-api-access-ds4jj\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.972933 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.972778    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.972933 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.972819    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.972933 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.972849    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-config-out\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.972933 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.972877    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-web-config\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.973395 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.972960    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.973395 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.972993    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.973395 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.973200    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.973729 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.973699    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.976770 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.975509    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.976770 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.975553    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.976770 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.976055    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.976770 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.976152    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.976770 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.976248    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.976770 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.976314    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.976770 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.976575    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.976770 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.976708    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.976770 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.976718    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.977289 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.976800    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.977621 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.977602    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-config\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.977781 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.977764    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.977912 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.977877    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.978314 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.978295    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.978474 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.978453    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.978801 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.978781    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-web-config\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.979111 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.979092    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-config-out\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:14.989186 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:14.989161    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds4jj\" (UniqueName: \"kubernetes.io/projected/11978911-17b6-4bcd-9b8a-f5e78dd4ab79-kube-api-access-ds4jj\") pod \"prometheus-k8s-0\" (UID: \"11978911-17b6-4bcd-9b8a-f5e78dd4ab79\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:15.084601 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:15.084568    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:15.382686 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:15.382660    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 16:59:15.385028 ip-10-0-136-3 kubenswrapper[2575]: W0907 16:59:15.385002    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11978911_17b6_4bcd_9b8a_f5e78dd4ab79.slice/crio-832281175a7af3aec00928f5a293dbbce80f802a3dd25926470b7aca8317bf52 WatchSource:0}: Error finding container 832281175a7af3aec00928f5a293dbbce80f802a3dd25926470b7aca8317bf52: Status 404 returned error can't find the container with id 832281175a7af3aec00928f5a293dbbce80f802a3dd25926470b7aca8317bf52
Sep 07 16:59:15.692615 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:15.692515    2575 generic.go:356] "Generic (PLEG): container finished" podID="11978911-17b6-4bcd-9b8a-f5e78dd4ab79" containerID="dc8f36c461b2ddffcf95a2a82ea569b8c5cbf7a52018a5a4e173f3a7d905b22f" exitCode=0
Sep 07 16:59:15.692615 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:15.692599    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11978911-17b6-4bcd-9b8a-f5e78dd4ab79","Type":"ContainerDied","Data":"dc8f36c461b2ddffcf95a2a82ea569b8c5cbf7a52018a5a4e173f3a7d905b22f"}
Sep 07 16:59:15.693073 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:15.692672    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11978911-17b6-4bcd-9b8a-f5e78dd4ab79","Type":"ContainerStarted","Data":"832281175a7af3aec00928f5a293dbbce80f802a3dd25926470b7aca8317bf52"}
Sep 07 16:59:15.938685 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:15.938655    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:59:16.038500 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:16.038424    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:59:16.701232 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:16.701192    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11978911-17b6-4bcd-9b8a-f5e78dd4ab79","Type":"ContainerStarted","Data":"8ca5917b6e943352a9bc1de5163b0ce82771fe09b8e2b4b38e1db2383bc9ffee"}
Sep 07 16:59:16.701647 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:16.701293    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11978911-17b6-4bcd-9b8a-f5e78dd4ab79","Type":"ContainerStarted","Data":"ee1d4dce8b8ba99ff1e0f4e78241736444b733bdf4a25290cf2cf5c2849d6e34"}
Sep 07 16:59:16.701647 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:16.701332    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11978911-17b6-4bcd-9b8a-f5e78dd4ab79","Type":"ContainerStarted","Data":"f41254fe1836127ff988d4e43baa97358ba118062f41d0be68b99501903ade18"}
Sep 07 16:59:16.701647 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:16.701362    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11978911-17b6-4bcd-9b8a-f5e78dd4ab79","Type":"ContainerStarted","Data":"a90b348ff94a7a1f74078a093baa07ed1e1d552ea7e0a100efc724c0f56b9e80"}
Sep 07 16:59:16.701647 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:16.701386    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11978911-17b6-4bcd-9b8a-f5e78dd4ab79","Type":"ContainerStarted","Data":"e707e34c48df88b7929d3c20b97d1c48cf1f155f3598b88200e6bc7f9ab96071"}
Sep 07 16:59:16.701647 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:16.701424    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11978911-17b6-4bcd-9b8a-f5e78dd4ab79","Type":"ContainerStarted","Data":"d43b603c8f4a40e25ed143c9c16418aa5c437e9aafaccb40686ca99c351c0a2f"}
Sep 07 16:59:16.720386 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:16.720360    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afbddf32-2556-4467-a6d5-551d9fdfc042" path="/var/lib/kubelet/pods/afbddf32-2556-4467-a6d5-551d9fdfc042/volumes"
Sep 07 16:59:16.739937 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:16.739870    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.721876035 podStartE2EDuration="2.73985253s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.976495ms" isStatefulPod=false podCreationTimestamp="2026-09-07 16:59:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:59:16.738857421 +0000 UTC m=+150.635704742" watchObservedRunningTime="2026-09-07 16:59:16.73985253 +0000 UTC m=+150.636699845"
Sep 07 16:59:20.085256 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:20.085202    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 16:59:22.343102 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:22.343062    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:59:22.437009 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:22.436971    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:59:22.505580 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:22.505540    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:59:33.889151 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:33.889116    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:59:33.989159 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:33.989119    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 16:59:34.053425 ip-10-0-136-3 kubenswrapper[2575]: I0907 16:59:34.053378    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:00:10.151004 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:10.150954    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:00:10.209380 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:10.209329    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:00:10.513228 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:10.513134    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:00:10.571072 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:10.571028    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:00:15.085610 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:15.085565    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:00:15.101170 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:15.101142    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:00:15.440657 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:15.440557    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:00:15.541381 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:15.541346    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:00:15.964845 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:15.964820    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:00:37.712713 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:37.712674    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:00:39.138065 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:39.138026    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:00:41.322946 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:41.322916    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:00:41.423541 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:41.423507    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:00:42.827090 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:42.827056    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:00:42.925650 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:42.925613    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:00:43.341420 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:43.341375    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:00:43.488733 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:43.488698    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:00:44.830466 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:44.830432    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:00:45.227875 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:45.227791    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:00:45.494909 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:45.494816    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dntz2"]
Sep 07 17:00:45.497050 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:45.497033    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dntz2"
Sep 07 17:00:45.500122 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:45.500102    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 07 17:00:45.500241 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:45.500134    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 07 17:00:45.501237 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:45.501219    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-7lqvb\""
Sep 07 17:00:45.511974 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:45.511955    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dntz2"]
Sep 07 17:00:45.580520 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:45.580485    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c796q\" (UniqueName: \"kubernetes.io/projected/285e5566-ed81-4b30-861d-70e8bc5b4daf-kube-api-access-c796q\") pod \"cert-manager-cainjector-559cdd8c87-dntz2\" (UID: \"285e5566-ed81-4b30-861d-70e8bc5b4daf\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dntz2"
Sep 07 17:00:45.580701 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:45.580532    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/285e5566-ed81-4b30-861d-70e8bc5b4daf-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dntz2\" (UID: \"285e5566-ed81-4b30-861d-70e8bc5b4daf\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dntz2"
Sep 07 17:00:45.681501 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:45.681463    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c796q\" (UniqueName: \"kubernetes.io/projected/285e5566-ed81-4b30-861d-70e8bc5b4daf-kube-api-access-c796q\") pod \"cert-manager-cainjector-559cdd8c87-dntz2\" (UID: \"285e5566-ed81-4b30-861d-70e8bc5b4daf\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dntz2"
Sep 07 17:00:45.681669 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:45.681511    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/285e5566-ed81-4b30-861d-70e8bc5b4daf-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dntz2\" (UID: \"285e5566-ed81-4b30-861d-70e8bc5b4daf\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dntz2"
Sep 07 17:00:45.689914 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:45.689862    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/285e5566-ed81-4b30-861d-70e8bc5b4daf-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dntz2\" (UID: \"285e5566-ed81-4b30-861d-70e8bc5b4daf\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dntz2"
Sep 07 17:00:45.690078 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:45.690061    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c796q\" (UniqueName: \"kubernetes.io/projected/285e5566-ed81-4b30-861d-70e8bc5b4daf-kube-api-access-c796q\") pod \"cert-manager-cainjector-559cdd8c87-dntz2\" (UID: \"285e5566-ed81-4b30-861d-70e8bc5b4daf\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dntz2"
Sep 07 17:00:45.815156 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:45.815127    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dntz2"
Sep 07 17:00:46.087449 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:46.087426    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dntz2"]
Sep 07 17:00:46.089511 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:00:46.089485    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod285e5566_ed81_4b30_861d_70e8bc5b4daf.slice/crio-92bb645a0324234401fadde31e0baa3627bda73b02d84f129852dc64b3e2da58 WatchSource:0}: Error finding container 92bb645a0324234401fadde31e0baa3627bda73b02d84f129852dc64b3e2da58: Status 404 returned error can't find the container with id 92bb645a0324234401fadde31e0baa3627bda73b02d84f129852dc64b3e2da58
Sep 07 17:00:47.075336 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:47.075276    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dntz2" event={"ID":"285e5566-ed81-4b30-861d-70e8bc5b4daf","Type":"ContainerStarted","Data":"92bb645a0324234401fadde31e0baa3627bda73b02d84f129852dc64b3e2da58"}
Sep 07 17:00:48.312426 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:48.312384    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:00:48.413180 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:48.413145    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:00:50.089519 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:50.089488    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dntz2" event={"ID":"285e5566-ed81-4b30-861d-70e8bc5b4daf","Type":"ContainerStarted","Data":"77eb2700b924cd46aeae1c84bbd3b09e16cc801c14c6332b1a5b564a458151d8"}
Sep 07 17:00:50.119485 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:50.119423    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dntz2" podStartSLOduration=2.067029204 podStartE2EDuration="5.119405991s" totalImagesPullingTime="3.052376787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:00:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:00:50.118451086 +0000 UTC m=+244.015298405" watchObservedRunningTime="2026-09-07 17:00:50.119405991 +0000 UTC m=+244.016253305"
Sep 07 17:00:51.045694 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:51.045652    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rhd7l"]
Sep 07 17:00:51.048973 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:51.048957    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-rhd7l"
Sep 07 17:00:51.052130 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:51.052109    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-7zcl2\""
Sep 07 17:00:51.066549 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:51.066524    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rhd7l"]
Sep 07 17:00:51.128674 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:51.128631    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e415fa14-0b35-4c08-b1d1-43472d5da4ee-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rhd7l\" (UID: \"e415fa14-0b35-4c08-b1d1-43472d5da4ee\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rhd7l"
Sep 07 17:00:51.128674 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:51.128677    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v2s6\" (UniqueName: \"kubernetes.io/projected/e415fa14-0b35-4c08-b1d1-43472d5da4ee-kube-api-access-8v2s6\") pod \"cert-manager-webhook-6486ffd997-rhd7l\" (UID: \"e415fa14-0b35-4c08-b1d1-43472d5da4ee\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rhd7l"
Sep 07 17:00:51.229717 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:51.229675    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e415fa14-0b35-4c08-b1d1-43472d5da4ee-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rhd7l\" (UID: \"e415fa14-0b35-4c08-b1d1-43472d5da4ee\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rhd7l"
Sep 07 17:00:51.229717 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:51.229722    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v2s6\" (UniqueName: \"kubernetes.io/projected/e415fa14-0b35-4c08-b1d1-43472d5da4ee-kube-api-access-8v2s6\") pod \"cert-manager-webhook-6486ffd997-rhd7l\" (UID: \"e415fa14-0b35-4c08-b1d1-43472d5da4ee\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rhd7l"
Sep 07 17:00:51.250182 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:51.250149    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e415fa14-0b35-4c08-b1d1-43472d5da4ee-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rhd7l\" (UID: \"e415fa14-0b35-4c08-b1d1-43472d5da4ee\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rhd7l"
Sep 07 17:00:51.250302 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:51.250222    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v2s6\" (UniqueName: \"kubernetes.io/projected/e415fa14-0b35-4c08-b1d1-43472d5da4ee-kube-api-access-8v2s6\") pod \"cert-manager-webhook-6486ffd997-rhd7l\" (UID: \"e415fa14-0b35-4c08-b1d1-43472d5da4ee\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rhd7l"
Sep 07 17:00:51.357470 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:51.357381    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-rhd7l"
Sep 07 17:00:51.630963 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:51.630939    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rhd7l"]
Sep 07 17:00:51.632802 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:00:51.632776    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode415fa14_0b35_4c08_b1d1_43472d5da4ee.slice/crio-32dc77208de9cc1407e9707b095ed5da1f7d59c1e1e2ea83dde13ac74a1f2bc3 WatchSource:0}: Error finding container 32dc77208de9cc1407e9707b095ed5da1f7d59c1e1e2ea83dde13ac74a1f2bc3: Status 404 returned error can't find the container with id 32dc77208de9cc1407e9707b095ed5da1f7d59c1e1e2ea83dde13ac74a1f2bc3
Sep 07 17:00:51.900346 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:51.900241    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:00:51.971564 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:51.971533    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:00:52.099864 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:52.099824    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-rhd7l" event={"ID":"e415fa14-0b35-4c08-b1d1-43472d5da4ee","Type":"ContainerStarted","Data":"df9ef88c5fdc82fb74d862ecf8f6f12cfc790f8bc4de24191c2baef309d1a134"}
Sep 07 17:00:52.100071 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:52.099872    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-rhd7l" event={"ID":"e415fa14-0b35-4c08-b1d1-43472d5da4ee","Type":"ContainerStarted","Data":"32dc77208de9cc1407e9707b095ed5da1f7d59c1e1e2ea83dde13ac74a1f2bc3"}
Sep 07 17:00:52.100071 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:52.099933    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-rhd7l"
Sep 07 17:00:52.123820 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:52.123766    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-rhd7l" podStartSLOduration=1.12374869 podStartE2EDuration="1.12374869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:00:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:00:52.123541976 +0000 UTC m=+246.020389287" watchObservedRunningTime="2026-09-07 17:00:52.12374869 +0000 UTC m=+246.020596005"
Sep 07 17:00:53.659301 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:53.659250    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:00:54.733518 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:54.733485    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:00:54.834210 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:54.834171    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:00:58.106667 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:00:58.106638    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-rhd7l"
Sep 07 17:01:09.744787 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:09.744704    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:01:09.845253 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:09.845220    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:01:11.753922 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:11.753864    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:01:26.353426 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:26.353385    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:01:26.434926 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:26.434876    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-74c754dcfc-tt9k5"]
Sep 07 17:01:26.439272 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:26.439249    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-tt9k5"
Sep 07 17:01:26.442967 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:26.442944    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 07 17:01:26.471039 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:26.471010    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 07 17:01:26.471039 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:26.471038    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-n5bmt\""
Sep 07 17:01:26.471261 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:26.471249    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 07 17:01:26.471955 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:26.471942    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 07 17:01:26.472017 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:26.472005    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 07 17:01:26.490911 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:26.490876    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-74c754dcfc-tt9k5"]
Sep 07 17:01:26.526435 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:26.526406    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f13be0ff-dc07-40f1-87a6-2f17dffc4ed9-manager-config\") pod \"lws-controller-manager-74c754dcfc-tt9k5\" (UID: \"f13be0ff-dc07-40f1-87a6-2f17dffc4ed9\") " pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-tt9k5"
Sep 07 17:01:26.526593 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:26.526465    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppwpz\" (UniqueName: \"kubernetes.io/projected/f13be0ff-dc07-40f1-87a6-2f17dffc4ed9-kube-api-access-ppwpz\") pod \"lws-controller-manager-74c754dcfc-tt9k5\" (UID: \"f13be0ff-dc07-40f1-87a6-2f17dffc4ed9\") " pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-tt9k5"
Sep 07 17:01:26.526593 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:26.526541    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f13be0ff-dc07-40f1-87a6-2f17dffc4ed9-cert\") pod \"lws-controller-manager-74c754dcfc-tt9k5\" (UID: \"f13be0ff-dc07-40f1-87a6-2f17dffc4ed9\") " pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-tt9k5"
Sep 07 17:01:26.526593 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:26.526564    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f13be0ff-dc07-40f1-87a6-2f17dffc4ed9-metrics-cert\") pod \"lws-controller-manager-74c754dcfc-tt9k5\" (UID: \"f13be0ff-dc07-40f1-87a6-2f17dffc4ed9\") " pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-tt9k5"
Sep 07 17:01:26.627855 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:26.627761    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f13be0ff-dc07-40f1-87a6-2f17dffc4ed9-manager-config\") pod \"lws-controller-manager-74c754dcfc-tt9k5\" (UID: \"f13be0ff-dc07-40f1-87a6-2f17dffc4ed9\") " pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-tt9k5"
Sep 07 17:01:26.627855 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:26.627836    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppwpz\" (UniqueName: \"kubernetes.io/projected/f13be0ff-dc07-40f1-87a6-2f17dffc4ed9-kube-api-access-ppwpz\") pod \"lws-controller-manager-74c754dcfc-tt9k5\" (UID: \"f13be0ff-dc07-40f1-87a6-2f17dffc4ed9\") " pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-tt9k5"
Sep 07 17:01:26.628108 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:26.627886    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f13be0ff-dc07-40f1-87a6-2f17dffc4ed9-cert\") pod \"lws-controller-manager-74c754dcfc-tt9k5\" (UID: \"f13be0ff-dc07-40f1-87a6-2f17dffc4ed9\") " pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-tt9k5"
Sep 07 17:01:26.628108 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:26.628037    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f13be0ff-dc07-40f1-87a6-2f17dffc4ed9-metrics-cert\") pod \"lws-controller-manager-74c754dcfc-tt9k5\" (UID: \"f13be0ff-dc07-40f1-87a6-2f17dffc4ed9\") " pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-tt9k5"
Sep 07 17:01:26.628527 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:26.628495    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f13be0ff-dc07-40f1-87a6-2f17dffc4ed9-manager-config\") pod \"lws-controller-manager-74c754dcfc-tt9k5\" (UID: \"f13be0ff-dc07-40f1-87a6-2f17dffc4ed9\") " pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-tt9k5"
Sep 07 17:01:26.630498 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:26.630472    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f13be0ff-dc07-40f1-87a6-2f17dffc4ed9-metrics-cert\") pod \"lws-controller-manager-74c754dcfc-tt9k5\" (UID: \"f13be0ff-dc07-40f1-87a6-2f17dffc4ed9\") " pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-tt9k5"
Sep 07 17:01:26.630615 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:26.630479    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f13be0ff-dc07-40f1-87a6-2f17dffc4ed9-cert\") pod \"lws-controller-manager-74c754dcfc-tt9k5\" (UID: \"f13be0ff-dc07-40f1-87a6-2f17dffc4ed9\") " pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-tt9k5"
Sep 07 17:01:26.644913 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:26.644870    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppwpz\" (UniqueName: \"kubernetes.io/projected/f13be0ff-dc07-40f1-87a6-2f17dffc4ed9-kube-api-access-ppwpz\") pod \"lws-controller-manager-74c754dcfc-tt9k5\" (UID: \"f13be0ff-dc07-40f1-87a6-2f17dffc4ed9\") " pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-tt9k5"
Sep 07 17:01:26.749347 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:26.749318    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-tt9k5"
Sep 07 17:01:27.036540 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:27.036408    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-74c754dcfc-tt9k5"]
Sep 07 17:01:27.039258 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:01:27.039234    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf13be0ff_dc07_40f1_87a6_2f17dffc4ed9.slice/crio-a2a68cc4ea413b998919bec96ae59ac600518c556131e4c21e25ed2495f076c2 WatchSource:0}: Error finding container a2a68cc4ea413b998919bec96ae59ac600518c556131e4c21e25ed2495f076c2: Status 404 returned error can't find the container with id a2a68cc4ea413b998919bec96ae59ac600518c556131e4c21e25ed2495f076c2
Sep 07 17:01:27.248270 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:27.248235    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-tt9k5" event={"ID":"f13be0ff-dc07-40f1-87a6-2f17dffc4ed9","Type":"ContainerStarted","Data":"a2a68cc4ea413b998919bec96ae59ac600518c556131e4c21e25ed2495f076c2"}
Sep 07 17:01:27.647407 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:27.647368    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:01:27.830164 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:27.830130    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:01:27.943556 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:27.943443    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:01:28.012797 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.012747    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-49td6"]
Sep 07 17:01:28.017482 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.016876    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-49td6"
Sep 07 17:01:28.022526 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.022503    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 07 17:01:28.022744 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.022722    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 07 17:01:28.022885 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.022855    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 07 17:01:28.022990 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.022912    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lcg49\""
Sep 07 17:01:28.025115 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.025096    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 07 17:01:28.057622 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.057592    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-49td6"]
Sep 07 17:01:28.141960 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.141921    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e1a5075b-6756-47de-b470-1e12271e53da-manifests\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-49td6\" (UID: \"e1a5075b-6756-47de-b470-1e12271e53da\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-49td6"
Sep 07 17:01:28.142149 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.141979    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1a5075b-6756-47de-b470-1e12271e53da-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-49td6\" (UID: \"e1a5075b-6756-47de-b470-1e12271e53da\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-49td6"
Sep 07 17:01:28.142149 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.142018    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1a5075b-6756-47de-b470-1e12271e53da-tmp\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-49td6\" (UID: \"e1a5075b-6756-47de-b470-1e12271e53da\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-49td6"
Sep 07 17:01:28.142149 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.142045    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e1a5075b-6756-47de-b470-1e12271e53da-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-49td6\" (UID: \"e1a5075b-6756-47de-b470-1e12271e53da\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-49td6"
Sep 07 17:01:28.142321 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.142153    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fndrc\" (UniqueName: \"kubernetes.io/projected/e1a5075b-6756-47de-b470-1e12271e53da-kube-api-access-fndrc\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-49td6\" (UID: \"e1a5075b-6756-47de-b470-1e12271e53da\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-49td6"
Sep 07 17:01:28.217362 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.217237    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:01:28.243108 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.243069    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e1a5075b-6756-47de-b470-1e12271e53da-manifests\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-49td6\" (UID: \"e1a5075b-6756-47de-b470-1e12271e53da\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-49td6"
Sep 07 17:01:28.243306 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.243124    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1a5075b-6756-47de-b470-1e12271e53da-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-49td6\" (UID: \"e1a5075b-6756-47de-b470-1e12271e53da\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-49td6"
Sep 07 17:01:28.243306 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.243153    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1a5075b-6756-47de-b470-1e12271e53da-tmp\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-49td6\" (UID: \"e1a5075b-6756-47de-b470-1e12271e53da\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-49td6"
Sep 07 17:01:28.243306 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.243177    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e1a5075b-6756-47de-b470-1e12271e53da-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-49td6\" (UID: \"e1a5075b-6756-47de-b470-1e12271e53da\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-49td6"
Sep 07 17:01:28.243306 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.243242    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fndrc\" (UniqueName: \"kubernetes.io/projected/e1a5075b-6756-47de-b470-1e12271e53da-kube-api-access-fndrc\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-49td6\" (UID: \"e1a5075b-6756-47de-b470-1e12271e53da\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-49td6"
Sep 07 17:01:28.243547 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.243526    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e1a5075b-6756-47de-b470-1e12271e53da-manifests\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-49td6\" (UID: \"e1a5075b-6756-47de-b470-1e12271e53da\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-49td6"
Sep 07 17:01:28.246451 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.246425    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1a5075b-6756-47de-b470-1e12271e53da-tmp\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-49td6\" (UID: \"e1a5075b-6756-47de-b470-1e12271e53da\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-49td6"
Sep 07 17:01:28.246637 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.246613    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1a5075b-6756-47de-b470-1e12271e53da-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-49td6\" (UID: \"e1a5075b-6756-47de-b470-1e12271e53da\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-49td6"
Sep 07 17:01:28.246703 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.246665    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e1a5075b-6756-47de-b470-1e12271e53da-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-49td6\" (UID: \"e1a5075b-6756-47de-b470-1e12271e53da\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-49td6"
Sep 07 17:01:28.255169 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.255123    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fndrc\" (UniqueName: \"kubernetes.io/projected/e1a5075b-6756-47de-b470-1e12271e53da-kube-api-access-fndrc\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-49td6\" (UID: \"e1a5075b-6756-47de-b470-1e12271e53da\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-49td6"
Sep 07 17:01:28.319867 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.319789    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:01:28.332459 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.332429    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-49td6"
Sep 07 17:01:28.422145 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.421993    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:01:28.538368 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.538286    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:01:28.637797 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.637717    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-49td6"]
Sep 07 17:01:28.677533 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.677496    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:01:28.770568 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:28.770533    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:01:29.618038 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:01:29.618006    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1a5075b_6756_47de_b470_1e12271e53da.slice/crio-7d862e1b5cfc6ba5b16bf1954336ec3b2c2f278522dc362ab594b85a7497aef1 WatchSource:0}: Error finding container 7d862e1b5cfc6ba5b16bf1954336ec3b2c2f278522dc362ab594b85a7497aef1: Status 404 returned error can't find the container with id 7d862e1b5cfc6ba5b16bf1954336ec3b2c2f278522dc362ab594b85a7497aef1
Sep 07 17:01:30.267025 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:30.266984    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-tt9k5" event={"ID":"f13be0ff-dc07-40f1-87a6-2f17dffc4ed9","Type":"ContainerStarted","Data":"983ed4ec115437be75753d0467303ed08cf22e5089173f60b42ce74e9af3467b"}
Sep 07 17:01:30.267491 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:30.267129    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-tt9k5"
Sep 07 17:01:30.269165 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:30.269131    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-49td6" event={"ID":"e1a5075b-6756-47de-b470-1e12271e53da","Type":"ContainerStarted","Data":"7d862e1b5cfc6ba5b16bf1954336ec3b2c2f278522dc362ab594b85a7497aef1"}
Sep 07 17:01:30.287108 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:30.287055    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-tt9k5" podStartSLOduration=1.668238587 podStartE2EDuration="4.287034023s" totalImagesPullingTime="2.618795436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:01:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:01:30.28578817 +0000 UTC m=+284.182635486" watchObservedRunningTime="2026-09-07 17:01:30.287034023 +0000 UTC m=+284.183881340"
Sep 07 17:01:33.284170 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:33.284135    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-49td6" event={"ID":"e1a5075b-6756-47de-b470-1e12271e53da","Type":"ContainerStarted","Data":"3a0587055f185eb6ca4056743ab9ef8841f80d1b44ac1e55e081f99fcb987f1e"}
Sep 07 17:01:34.290025 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:34.289988    2575 generic.go:356] "Generic (PLEG): container finished" podID="e1a5075b-6756-47de-b470-1e12271e53da" containerID="3a0587055f185eb6ca4056743ab9ef8841f80d1b44ac1e55e081f99fcb987f1e" exitCode=0
Sep 07 17:01:34.290419 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:34.290069    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-49td6" event={"ID":"e1a5075b-6756-47de-b470-1e12271e53da","Type":"ContainerDied","Data":"3a0587055f185eb6ca4056743ab9ef8841f80d1b44ac1e55e081f99fcb987f1e"}
Sep 07 17:01:35.296447 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:35.296414    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-49td6" event={"ID":"e1a5075b-6756-47de-b470-1e12271e53da","Type":"ContainerStarted","Data":"4fd516127cbd9b203112972b5bb3b11b956a9054b63258903a8d95261169fe63"}
Sep 07 17:01:35.296792 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:35.296555    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-49td6"
Sep 07 17:01:35.352335 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:35.352284    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-49td6" podStartSLOduration=4.249242389 podStartE2EDuration="8.35226729s" totalImagesPullingTime="3.03393125s" totalInitContainerRuntime="1.069093651s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:01:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:01:35.349668648 +0000 UTC m=+289.246515963" watchObservedRunningTime="2026-09-07 17:01:35.35226729 +0000 UTC m=+289.249114605"
Sep 07 17:01:41.279172 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:41.279134    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-tt9k5"
Sep 07 17:01:46.303684 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:46.303652    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-49td6"
Sep 07 17:01:46.481730 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:46.481703    2575 kubelet.go:1648] "Image garbage collection succeeded"
Sep 07 17:01:48.026033 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:48.026000    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:01:48.194564 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:48.194526    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:01:48.505651 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:48.505613    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:01:48.681517 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:48.681481    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5b977b55fb-krqn2"]
Sep 07 17:01:48.684829 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:48.684809    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b977b55fb-krqn2"
Sep 07 17:01:48.687650 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:48.687624    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 07 17:01:48.687756 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:48.687651    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 07 17:01:48.688591 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:48.688550    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dxvzh\""
Sep 07 17:01:48.688743 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:48.688728    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 07 17:01:48.688818 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:48.688735    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 07 17:01:48.722924 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:48.722884    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b977b55fb-krqn2"]
Sep 07 17:01:48.837354 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:48.837318    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db0b8389-c068-4235-887d-a190f72b93eb-tls-certs\") pod \"kube-auth-proxy-5b977b55fb-krqn2\" (UID: \"db0b8389-c068-4235-887d-a190f72b93eb\") " pod="openshift-ingress/kube-auth-proxy-5b977b55fb-krqn2"
Sep 07 17:01:48.837354 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:48.837356    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db0b8389-c068-4235-887d-a190f72b93eb-tmp\") pod \"kube-auth-proxy-5b977b55fb-krqn2\" (UID: \"db0b8389-c068-4235-887d-a190f72b93eb\") " pod="openshift-ingress/kube-auth-proxy-5b977b55fb-krqn2"
Sep 07 17:01:48.837580 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:48.837379    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thl6k\" (UniqueName: \"kubernetes.io/projected/db0b8389-c068-4235-887d-a190f72b93eb-kube-api-access-thl6k\") pod \"kube-auth-proxy-5b977b55fb-krqn2\" (UID: \"db0b8389-c068-4235-887d-a190f72b93eb\") " pod="openshift-ingress/kube-auth-proxy-5b977b55fb-krqn2"
Sep 07 17:01:48.868726 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:48.868690    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:01:48.938255 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:48.938223    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db0b8389-c068-4235-887d-a190f72b93eb-tls-certs\") pod \"kube-auth-proxy-5b977b55fb-krqn2\" (UID: \"db0b8389-c068-4235-887d-a190f72b93eb\") " pod="openshift-ingress/kube-auth-proxy-5b977b55fb-krqn2"
Sep 07 17:01:48.938255 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:48.938256    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db0b8389-c068-4235-887d-a190f72b93eb-tmp\") pod \"kube-auth-proxy-5b977b55fb-krqn2\" (UID: \"db0b8389-c068-4235-887d-a190f72b93eb\") " pod="openshift-ingress/kube-auth-proxy-5b977b55fb-krqn2"
Sep 07 17:01:48.938494 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:48.938278    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thl6k\" (UniqueName: \"kubernetes.io/projected/db0b8389-c068-4235-887d-a190f72b93eb-kube-api-access-thl6k\") pod \"kube-auth-proxy-5b977b55fb-krqn2\" (UID: \"db0b8389-c068-4235-887d-a190f72b93eb\") " pod="openshift-ingress/kube-auth-proxy-5b977b55fb-krqn2"
Sep 07 17:01:48.940614 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:48.940590    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db0b8389-c068-4235-887d-a190f72b93eb-tmp\") pod \"kube-auth-proxy-5b977b55fb-krqn2\" (UID: \"db0b8389-c068-4235-887d-a190f72b93eb\") " pod="openshift-ingress/kube-auth-proxy-5b977b55fb-krqn2"
Sep 07 17:01:48.940748 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:48.940730    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db0b8389-c068-4235-887d-a190f72b93eb-tls-certs\") pod \"kube-auth-proxy-5b977b55fb-krqn2\" (UID: \"db0b8389-c068-4235-887d-a190f72b93eb\") " pod="openshift-ingress/kube-auth-proxy-5b977b55fb-krqn2"
Sep 07 17:01:48.959305 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:48.959277    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thl6k\" (UniqueName: \"kubernetes.io/projected/db0b8389-c068-4235-887d-a190f72b93eb-kube-api-access-thl6k\") pod \"kube-auth-proxy-5b977b55fb-krqn2\" (UID: \"db0b8389-c068-4235-887d-a190f72b93eb\") " pod="openshift-ingress/kube-auth-proxy-5b977b55fb-krqn2"
Sep 07 17:01:48.993668 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:48.993639    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b977b55fb-krqn2"
Sep 07 17:01:49.277085 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:49.277060    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b977b55fb-krqn2"]
Sep 07 17:01:49.278218 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:01:49.278171    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb0b8389_c068_4235_887d_a190f72b93eb.slice/crio-5f32df9bbe4086b1797ef042beb7fb85b2afbbb1751d034fc40b190186609fcd WatchSource:0}: Error finding container 5f32df9bbe4086b1797ef042beb7fb85b2afbbb1751d034fc40b190186609fcd: Status 404 returned error can't find the container with id 5f32df9bbe4086b1797ef042beb7fb85b2afbbb1751d034fc40b190186609fcd
Sep 07 17:01:49.280202 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:49.280187    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 17:01:49.363054 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:49.363020    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b977b55fb-krqn2" event={"ID":"db0b8389-c068-4235-887d-a190f72b93eb","Type":"ContainerStarted","Data":"5f32df9bbe4086b1797ef042beb7fb85b2afbbb1751d034fc40b190186609fcd"}
Sep 07 17:01:50.522324 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:50.522289    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:01:50.618546 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:50.618512    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:01:51.790691 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:51.790644    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:01:52.381799 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:52.381758    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b977b55fb-krqn2" event={"ID":"db0b8389-c068-4235-887d-a190f72b93eb","Type":"ContainerStarted","Data":"b530e95fcf8ba9c854fdcc6e4355d41e5fe026609434cd578713c6fac98b7e69"}
Sep 07 17:01:52.401388 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:52.401268    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5b977b55fb-krqn2" podStartSLOduration=1.7753974810000002 podStartE2EDuration="4.401246075s" totalImagesPullingTime="2.625848594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:01:52.400823681 +0000 UTC m=+306.297670999" watchObservedRunningTime="2026-09-07 17:01:52.401246075 +0000 UTC m=+306.298093391"
Sep 07 17:01:58.919982 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:58.919948    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:01:59.018656 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:59.018615    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:01:59.118545 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:59.118507    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:01:59.220330 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:59.220252    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:01:59.449199 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:59.449163    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:01:59.769014 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:01:59.768982    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:02:03.685609 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:03.685578    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:02:03.800164 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:03.800129    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:02:04.041155 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:04.041080    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:02:04.134519 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:04.134486    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:02:04.444826 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:04.444792    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:02:10.575244 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:10.575209    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:02:10.702291 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:10.702257    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:02:11.101875 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:11.101834    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:02:11.218710 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:11.218676    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:02:11.937595 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:11.937559    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:02:12.057730 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:12.057693    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:02:22.408785 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:22.408743    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:02:52.282005 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:52.281971    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:02:52.342863 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:52.342831    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:02:54.375790 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.375752    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-759b7bd587-sq6cf"]
Sep 07 17:02:54.379281 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.379251    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:02:54.382021 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.381996    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 07 17:02:54.382160 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.382004    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 07 17:02:54.382160 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.382044    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 07 17:02:54.382160 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.382034    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pzx8d\""
Sep 07 17:02:54.383050 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.383034    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 07 17:02:54.383153 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.383055    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 07 17:02:54.387118 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.387097    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 07 17:02:54.391522 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.391500    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-759b7bd587-sq6cf"]
Sep 07 17:02:54.430432 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.430400    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/380bc4a5-4a82-4ea4-94c4-14314c8f06ef-console-serving-cert\") pod \"console-759b7bd587-sq6cf\" (UID: \"380bc4a5-4a82-4ea4-94c4-14314c8f06ef\") " pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:02:54.430432 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.430432    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/380bc4a5-4a82-4ea4-94c4-14314c8f06ef-console-oauth-config\") pod \"console-759b7bd587-sq6cf\" (UID: \"380bc4a5-4a82-4ea4-94c4-14314c8f06ef\") " pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:02:54.430671 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.430453    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/380bc4a5-4a82-4ea4-94c4-14314c8f06ef-oauth-serving-cert\") pod \"console-759b7bd587-sq6cf\" (UID: \"380bc4a5-4a82-4ea4-94c4-14314c8f06ef\") " pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:02:54.430671 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.430476    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/380bc4a5-4a82-4ea4-94c4-14314c8f06ef-trusted-ca-bundle\") pod \"console-759b7bd587-sq6cf\" (UID: \"380bc4a5-4a82-4ea4-94c4-14314c8f06ef\") " pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:02:54.430671 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.430553    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/380bc4a5-4a82-4ea4-94c4-14314c8f06ef-console-config\") pod \"console-759b7bd587-sq6cf\" (UID: \"380bc4a5-4a82-4ea4-94c4-14314c8f06ef\") " pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:02:54.430671 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.430599    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwhft\" (UniqueName: \"kubernetes.io/projected/380bc4a5-4a82-4ea4-94c4-14314c8f06ef-kube-api-access-nwhft\") pod \"console-759b7bd587-sq6cf\" (UID: \"380bc4a5-4a82-4ea4-94c4-14314c8f06ef\") " pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:02:54.430671 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.430661    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/380bc4a5-4a82-4ea4-94c4-14314c8f06ef-service-ca\") pod \"console-759b7bd587-sq6cf\" (UID: \"380bc4a5-4a82-4ea4-94c4-14314c8f06ef\") " pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:02:54.431632 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.431603    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:02:54.492800 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.492768    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:02:54.531859 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.531825    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/380bc4a5-4a82-4ea4-94c4-14314c8f06ef-console-config\") pod \"console-759b7bd587-sq6cf\" (UID: \"380bc4a5-4a82-4ea4-94c4-14314c8f06ef\") " pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:02:54.532073 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.531866    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwhft\" (UniqueName: \"kubernetes.io/projected/380bc4a5-4a82-4ea4-94c4-14314c8f06ef-kube-api-access-nwhft\") pod \"console-759b7bd587-sq6cf\" (UID: \"380bc4a5-4a82-4ea4-94c4-14314c8f06ef\") " pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:02:54.532073 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.531932    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/380bc4a5-4a82-4ea4-94c4-14314c8f06ef-service-ca\") pod \"console-759b7bd587-sq6cf\" (UID: \"380bc4a5-4a82-4ea4-94c4-14314c8f06ef\") " pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:02:54.532073 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.531983    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/380bc4a5-4a82-4ea4-94c4-14314c8f06ef-console-serving-cert\") pod \"console-759b7bd587-sq6cf\" (UID: \"380bc4a5-4a82-4ea4-94c4-14314c8f06ef\") " pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:02:54.532073 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.531997    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/380bc4a5-4a82-4ea4-94c4-14314c8f06ef-console-oauth-config\") pod \"console-759b7bd587-sq6cf\" (UID: \"380bc4a5-4a82-4ea4-94c4-14314c8f06ef\") " pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:02:54.532291 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.532133    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/380bc4a5-4a82-4ea4-94c4-14314c8f06ef-oauth-serving-cert\") pod \"console-759b7bd587-sq6cf\" (UID: \"380bc4a5-4a82-4ea4-94c4-14314c8f06ef\") " pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:02:54.532291 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.532169    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/380bc4a5-4a82-4ea4-94c4-14314c8f06ef-trusted-ca-bundle\") pod \"console-759b7bd587-sq6cf\" (UID: \"380bc4a5-4a82-4ea4-94c4-14314c8f06ef\") " pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:02:54.532773 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.532724    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/380bc4a5-4a82-4ea4-94c4-14314c8f06ef-console-config\") pod \"console-759b7bd587-sq6cf\" (UID: \"380bc4a5-4a82-4ea4-94c4-14314c8f06ef\") " pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:02:54.532773 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.532753    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/380bc4a5-4a82-4ea4-94c4-14314c8f06ef-service-ca\") pod \"console-759b7bd587-sq6cf\" (UID: \"380bc4a5-4a82-4ea4-94c4-14314c8f06ef\") " pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:02:54.533061 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.532798    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/380bc4a5-4a82-4ea4-94c4-14314c8f06ef-oauth-serving-cert\") pod \"console-759b7bd587-sq6cf\" (UID: \"380bc4a5-4a82-4ea4-94c4-14314c8f06ef\") " pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:02:54.533061 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.533001    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/380bc4a5-4a82-4ea4-94c4-14314c8f06ef-trusted-ca-bundle\") pod \"console-759b7bd587-sq6cf\" (UID: \"380bc4a5-4a82-4ea4-94c4-14314c8f06ef\") " pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:02:54.534575 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.534549    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/380bc4a5-4a82-4ea4-94c4-14314c8f06ef-console-serving-cert\") pod \"console-759b7bd587-sq6cf\" (UID: \"380bc4a5-4a82-4ea4-94c4-14314c8f06ef\") " pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:02:54.534648 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.534577    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/380bc4a5-4a82-4ea4-94c4-14314c8f06ef-console-oauth-config\") pod \"console-759b7bd587-sq6cf\" (UID: \"380bc4a5-4a82-4ea4-94c4-14314c8f06ef\") " pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:02:54.540185 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.540165    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwhft\" (UniqueName: \"kubernetes.io/projected/380bc4a5-4a82-4ea4-94c4-14314c8f06ef-kube-api-access-nwhft\") pod \"console-759b7bd587-sq6cf\" (UID: \"380bc4a5-4a82-4ea4-94c4-14314c8f06ef\") " pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:02:54.689880 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:54.689795    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:02:57.280072 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:02:57.280043    2575 log.go:32] "RunPodSandbox from runtime service failed" err=<
Sep 07 17:02:57.280072 ip-10-0-136-3 kubenswrapper[2575]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_console-759b7bd587-sq6cf_openshift-console_380bc4a5-4a82-4ea4-94c4-14314c8f06ef_0(34fae8225ce86973285e2eff2793765f477c7293a4ac4f0b50d3f3c4387f08b6): error adding pod openshift-console_console-759b7bd587-sq6cf to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"34fae8225ce86973285e2eff2793765f477c7293a4ac4f0b50d3f3c4387f08b6" Netns:"/var/run/netns/8b3339b6-d307-484a-9cdd-2e89726ad078" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-console;K8S_POD_NAME=console-759b7bd587-sq6cf;K8S_POD_INFRA_CONTAINER_ID=34fae8225ce86973285e2eff2793765f477c7293a4ac4f0b50d3f3c4387f08b6;K8S_POD_UID=380bc4a5-4a82-4ea4-94c4-14314c8f06ef" Path:"" ERRORED: error configuring pod [openshift-console/console-759b7bd587-sq6cf] networking: Multus: [openshift-console/console-759b7bd587-sq6cf/380bc4a5-4a82-4ea4-94c4-14314c8f06ef]: error waiting for pod: Get "https://a180ad2b90363402289452fab9920906-d170e736a64b4892.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-console/pods/console-759b7bd587-sq6cf?timeout=1m0s": context deadline exceeded
Sep 07 17:02:57.280072 ip-10-0-136-3 kubenswrapper[2575]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 07 17:02:57.280072 ip-10-0-136-3 kubenswrapper[2575]:  >
Sep 07 17:02:57.280458 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:02:57.280096    2575 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Sep 07 17:02:57.280458 ip-10-0-136-3 kubenswrapper[2575]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_console-759b7bd587-sq6cf_openshift-console_380bc4a5-4a82-4ea4-94c4-14314c8f06ef_0(34fae8225ce86973285e2eff2793765f477c7293a4ac4f0b50d3f3c4387f08b6): error adding pod openshift-console_console-759b7bd587-sq6cf to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"34fae8225ce86973285e2eff2793765f477c7293a4ac4f0b50d3f3c4387f08b6" Netns:"/var/run/netns/8b3339b6-d307-484a-9cdd-2e89726ad078" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-console;K8S_POD_NAME=console-759b7bd587-sq6cf;K8S_POD_INFRA_CONTAINER_ID=34fae8225ce86973285e2eff2793765f477c7293a4ac4f0b50d3f3c4387f08b6;K8S_POD_UID=380bc4a5-4a82-4ea4-94c4-14314c8f06ef" Path:"" ERRORED: error configuring pod [openshift-console/console-759b7bd587-sq6cf] networking: Multus: [openshift-console/console-759b7bd587-sq6cf/380bc4a5-4a82-4ea4-94c4-14314c8f06ef]: error waiting for pod: Get "https://a180ad2b90363402289452fab9920906-d170e736a64b4892.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-console/pods/console-759b7bd587-sq6cf?timeout=1m0s": context deadline exceeded
Sep 07 17:02:57.280458 ip-10-0-136-3 kubenswrapper[2575]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 07 17:02:57.280458 ip-10-0-136-3 kubenswrapper[2575]:  > pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:02:57.280458 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:02:57.280114    2575 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Sep 07 17:02:57.280458 ip-10-0-136-3 kubenswrapper[2575]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_console-759b7bd587-sq6cf_openshift-console_380bc4a5-4a82-4ea4-94c4-14314c8f06ef_0(34fae8225ce86973285e2eff2793765f477c7293a4ac4f0b50d3f3c4387f08b6): error adding pod openshift-console_console-759b7bd587-sq6cf to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"34fae8225ce86973285e2eff2793765f477c7293a4ac4f0b50d3f3c4387f08b6" Netns:"/var/run/netns/8b3339b6-d307-484a-9cdd-2e89726ad078" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-console;K8S_POD_NAME=console-759b7bd587-sq6cf;K8S_POD_INFRA_CONTAINER_ID=34fae8225ce86973285e2eff2793765f477c7293a4ac4f0b50d3f3c4387f08b6;K8S_POD_UID=380bc4a5-4a82-4ea4-94c4-14314c8f06ef" Path:"" ERRORED: error configuring pod [openshift-console/console-759b7bd587-sq6cf] networking: Multus: [openshift-console/console-759b7bd587-sq6cf/380bc4a5-4a82-4ea4-94c4-14314c8f06ef]: error waiting for pod: Get "https://a180ad2b90363402289452fab9920906-d170e736a64b4892.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-console/pods/console-759b7bd587-sq6cf?timeout=1m0s": context deadline exceeded
Sep 07 17:02:57.280458 ip-10-0-136-3 kubenswrapper[2575]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 07 17:02:57.280458 ip-10-0-136-3 kubenswrapper[2575]:  > pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:02:57.280458 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:02:57.280173    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"console-759b7bd587-sq6cf_openshift-console(380bc4a5-4a82-4ea4-94c4-14314c8f06ef)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"console-759b7bd587-sq6cf_openshift-console(380bc4a5-4a82-4ea4-94c4-14314c8f06ef)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_console-759b7bd587-sq6cf_openshift-console_380bc4a5-4a82-4ea4-94c4-14314c8f06ef_0(34fae8225ce86973285e2eff2793765f477c7293a4ac4f0b50d3f3c4387f08b6): error adding pod openshift-console_console-759b7bd587-sq6cf to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"34fae8225ce86973285e2eff2793765f477c7293a4ac4f0b50d3f3c4387f08b6\\\" Netns:\\\"/var/run/netns/8b3339b6-d307-484a-9cdd-2e89726ad078\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-console;K8S_POD_NAME=console-759b7bd587-sq6cf;K8S_POD_INFRA_CONTAINER_ID=34fae8225ce86973285e2eff2793765f477c7293a4ac4f0b50d3f3c4387f08b6;K8S_POD_UID=380bc4a5-4a82-4ea4-94c4-14314c8f06ef\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-console/console-759b7bd587-sq6cf] networking: Multus: [openshift-console/console-759b7bd587-sq6cf/380bc4a5-4a82-4ea4-94c4-14314c8f06ef]: error waiting for pod: Get \\\"https://a180ad2b90363402289452fab9920906-d170e736a64b4892.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-console/pods/console-759b7bd587-sq6cf?timeout=1m0s\\\": context deadline exceeded\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-console/console-759b7bd587-sq6cf" podUID="380bc4a5-4a82-4ea4-94c4-14314c8f06ef"
Sep 07 17:02:57.681120 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:57.681091    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:02:57.681602 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:02:57.681585    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:03:00.268969 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:03:00.268938    2575 log.go:32] "RunPodSandbox from runtime service failed" err=<
Sep 07 17:03:00.268969 ip-10-0-136-3 kubenswrapper[2575]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_console-759b7bd587-sq6cf_openshift-console_380bc4a5-4a82-4ea4-94c4-14314c8f06ef_0(84d2e91e1fa9581a3e16b5b87f2ba5f100574a0c665696ed56e0f4a0f203f8d5): error adding pod openshift-console_console-759b7bd587-sq6cf to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"84d2e91e1fa9581a3e16b5b87f2ba5f100574a0c665696ed56e0f4a0f203f8d5" Netns:"/var/run/netns/0b1185ba-4429-4789-bc5b-a57bd2b591fa" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-console;K8S_POD_NAME=console-759b7bd587-sq6cf;K8S_POD_INFRA_CONTAINER_ID=84d2e91e1fa9581a3e16b5b87f2ba5f100574a0c665696ed56e0f4a0f203f8d5;K8S_POD_UID=380bc4a5-4a82-4ea4-94c4-14314c8f06ef" Path:"" ERRORED: error configuring pod [openshift-console/console-759b7bd587-sq6cf] networking: Multus: [openshift-console/console-759b7bd587-sq6cf/380bc4a5-4a82-4ea4-94c4-14314c8f06ef]: error waiting for pod: Get "https://a180ad2b90363402289452fab9920906-d170e736a64b4892.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-console/pods/console-759b7bd587-sq6cf?timeout=1m0s": context deadline exceeded
Sep 07 17:03:00.268969 ip-10-0-136-3 kubenswrapper[2575]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 07 17:03:00.268969 ip-10-0-136-3 kubenswrapper[2575]:  >
Sep 07 17:03:00.269334 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:03:00.268997    2575 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Sep 07 17:03:00.269334 ip-10-0-136-3 kubenswrapper[2575]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_console-759b7bd587-sq6cf_openshift-console_380bc4a5-4a82-4ea4-94c4-14314c8f06ef_0(84d2e91e1fa9581a3e16b5b87f2ba5f100574a0c665696ed56e0f4a0f203f8d5): error adding pod openshift-console_console-759b7bd587-sq6cf to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"84d2e91e1fa9581a3e16b5b87f2ba5f100574a0c665696ed56e0f4a0f203f8d5" Netns:"/var/run/netns/0b1185ba-4429-4789-bc5b-a57bd2b591fa" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-console;K8S_POD_NAME=console-759b7bd587-sq6cf;K8S_POD_INFRA_CONTAINER_ID=84d2e91e1fa9581a3e16b5b87f2ba5f100574a0c665696ed56e0f4a0f203f8d5;K8S_POD_UID=380bc4a5-4a82-4ea4-94c4-14314c8f06ef" Path:"" ERRORED: error configuring pod [openshift-console/console-759b7bd587-sq6cf] networking: Multus: [openshift-console/console-759b7bd587-sq6cf/380bc4a5-4a82-4ea4-94c4-14314c8f06ef]: error waiting for pod: Get "https://a180ad2b90363402289452fab9920906-d170e736a64b4892.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-console/pods/console-759b7bd587-sq6cf?timeout=1m0s": context deadline exceeded
Sep 07 17:03:00.269334 ip-10-0-136-3 kubenswrapper[2575]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 07 17:03:00.269334 ip-10-0-136-3 kubenswrapper[2575]:  > pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:03:00.269334 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:03:00.269015    2575 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Sep 07 17:03:00.269334 ip-10-0-136-3 kubenswrapper[2575]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_console-759b7bd587-sq6cf_openshift-console_380bc4a5-4a82-4ea4-94c4-14314c8f06ef_0(84d2e91e1fa9581a3e16b5b87f2ba5f100574a0c665696ed56e0f4a0f203f8d5): error adding pod openshift-console_console-759b7bd587-sq6cf to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"84d2e91e1fa9581a3e16b5b87f2ba5f100574a0c665696ed56e0f4a0f203f8d5" Netns:"/var/run/netns/0b1185ba-4429-4789-bc5b-a57bd2b591fa" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-console;K8S_POD_NAME=console-759b7bd587-sq6cf;K8S_POD_INFRA_CONTAINER_ID=84d2e91e1fa9581a3e16b5b87f2ba5f100574a0c665696ed56e0f4a0f203f8d5;K8S_POD_UID=380bc4a5-4a82-4ea4-94c4-14314c8f06ef" Path:"" ERRORED: error configuring pod [openshift-console/console-759b7bd587-sq6cf] networking: Multus: [openshift-console/console-759b7bd587-sq6cf/380bc4a5-4a82-4ea4-94c4-14314c8f06ef]: error waiting for pod: Get "https://a180ad2b90363402289452fab9920906-d170e736a64b4892.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-console/pods/console-759b7bd587-sq6cf?timeout=1m0s": context deadline exceeded
Sep 07 17:03:00.269334 ip-10-0-136-3 kubenswrapper[2575]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 07 17:03:00.269334 ip-10-0-136-3 kubenswrapper[2575]:  > pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:03:00.269334 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:03:00.269094    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"console-759b7bd587-sq6cf_openshift-console(380bc4a5-4a82-4ea4-94c4-14314c8f06ef)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"console-759b7bd587-sq6cf_openshift-console(380bc4a5-4a82-4ea4-94c4-14314c8f06ef)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_console-759b7bd587-sq6cf_openshift-console_380bc4a5-4a82-4ea4-94c4-14314c8f06ef_0(84d2e91e1fa9581a3e16b5b87f2ba5f100574a0c665696ed56e0f4a0f203f8d5): error adding pod openshift-console_console-759b7bd587-sq6cf to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"84d2e91e1fa9581a3e16b5b87f2ba5f100574a0c665696ed56e0f4a0f203f8d5\\\" Netns:\\\"/var/run/netns/0b1185ba-4429-4789-bc5b-a57bd2b591fa\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-console;K8S_POD_NAME=console-759b7bd587-sq6cf;K8S_POD_INFRA_CONTAINER_ID=84d2e91e1fa9581a3e16b5b87f2ba5f100574a0c665696ed56e0f4a0f203f8d5;K8S_POD_UID=380bc4a5-4a82-4ea4-94c4-14314c8f06ef\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-console/console-759b7bd587-sq6cf] networking: Multus: [openshift-console/console-759b7bd587-sq6cf/380bc4a5-4a82-4ea4-94c4-14314c8f06ef]: error waiting for pod: Get \\\"https://a180ad2b90363402289452fab9920906-d170e736a64b4892.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-console/pods/console-759b7bd587-sq6cf?timeout=1m0s\\\": context deadline exceeded\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-console/console-759b7bd587-sq6cf" podUID="380bc4a5-4a82-4ea4-94c4-14314c8f06ef"
Sep 07 17:03:08.542702 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:03:08.542666    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:03:13.588922 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:03:13.588864    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:03:13.716334 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:03:13.716295    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:03:13.716654 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:03:13.716637    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:03:16.303021 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:03:16.302989    2575 log.go:32] "RunPodSandbox from runtime service failed" err=<
Sep 07 17:03:16.303021 ip-10-0-136-3 kubenswrapper[2575]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_console-759b7bd587-sq6cf_openshift-console_380bc4a5-4a82-4ea4-94c4-14314c8f06ef_0(1259c594b89ff2d8ac934ca6b993f58568f4c4ac314195e31fab2767fce16776): error adding pod openshift-console_console-759b7bd587-sq6cf to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"1259c594b89ff2d8ac934ca6b993f58568f4c4ac314195e31fab2767fce16776" Netns:"/var/run/netns/b7a29994-769d-4b1e-82bf-4f0531c2dbdc" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-console;K8S_POD_NAME=console-759b7bd587-sq6cf;K8S_POD_INFRA_CONTAINER_ID=1259c594b89ff2d8ac934ca6b993f58568f4c4ac314195e31fab2767fce16776;K8S_POD_UID=380bc4a5-4a82-4ea4-94c4-14314c8f06ef" Path:"" ERRORED: error configuring pod [openshift-console/console-759b7bd587-sq6cf] networking: Multus: [openshift-console/console-759b7bd587-sq6cf/380bc4a5-4a82-4ea4-94c4-14314c8f06ef]: error waiting for pod: Get "https://a180ad2b90363402289452fab9920906-d170e736a64b4892.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-console/pods/console-759b7bd587-sq6cf?timeout=1m0s": context deadline exceeded
Sep 07 17:03:16.303021 ip-10-0-136-3 kubenswrapper[2575]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 07 17:03:16.303021 ip-10-0-136-3 kubenswrapper[2575]:  >
Sep 07 17:03:16.303376 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:03:16.303040    2575 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Sep 07 17:03:16.303376 ip-10-0-136-3 kubenswrapper[2575]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_console-759b7bd587-sq6cf_openshift-console_380bc4a5-4a82-4ea4-94c4-14314c8f06ef_0(1259c594b89ff2d8ac934ca6b993f58568f4c4ac314195e31fab2767fce16776): error adding pod openshift-console_console-759b7bd587-sq6cf to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"1259c594b89ff2d8ac934ca6b993f58568f4c4ac314195e31fab2767fce16776" Netns:"/var/run/netns/b7a29994-769d-4b1e-82bf-4f0531c2dbdc" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-console;K8S_POD_NAME=console-759b7bd587-sq6cf;K8S_POD_INFRA_CONTAINER_ID=1259c594b89ff2d8ac934ca6b993f58568f4c4ac314195e31fab2767fce16776;K8S_POD_UID=380bc4a5-4a82-4ea4-94c4-14314c8f06ef" Path:"" ERRORED: error configuring pod [openshift-console/console-759b7bd587-sq6cf] networking: Multus: [openshift-console/console-759b7bd587-sq6cf/380bc4a5-4a82-4ea4-94c4-14314c8f06ef]: error waiting for pod: Get "https://a180ad2b90363402289452fab9920906-d170e736a64b4892.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-console/pods/console-759b7bd587-sq6cf?timeout=1m0s": context deadline exceeded
Sep 07 17:03:16.303376 ip-10-0-136-3 kubenswrapper[2575]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 07 17:03:16.303376 ip-10-0-136-3 kubenswrapper[2575]:  > pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:03:16.303376 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:03:16.303055    2575 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Sep 07 17:03:16.303376 ip-10-0-136-3 kubenswrapper[2575]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_console-759b7bd587-sq6cf_openshift-console_380bc4a5-4a82-4ea4-94c4-14314c8f06ef_0(1259c594b89ff2d8ac934ca6b993f58568f4c4ac314195e31fab2767fce16776): error adding pod openshift-console_console-759b7bd587-sq6cf to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"1259c594b89ff2d8ac934ca6b993f58568f4c4ac314195e31fab2767fce16776" Netns:"/var/run/netns/b7a29994-769d-4b1e-82bf-4f0531c2dbdc" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-console;K8S_POD_NAME=console-759b7bd587-sq6cf;K8S_POD_INFRA_CONTAINER_ID=1259c594b89ff2d8ac934ca6b993f58568f4c4ac314195e31fab2767fce16776;K8S_POD_UID=380bc4a5-4a82-4ea4-94c4-14314c8f06ef" Path:"" ERRORED: error configuring pod [openshift-console/console-759b7bd587-sq6cf] networking: Multus: [openshift-console/console-759b7bd587-sq6cf/380bc4a5-4a82-4ea4-94c4-14314c8f06ef]: error waiting for pod: Get "https://a180ad2b90363402289452fab9920906-d170e736a64b4892.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-console/pods/console-759b7bd587-sq6cf?timeout=1m0s": context deadline exceeded
Sep 07 17:03:16.303376 ip-10-0-136-3 kubenswrapper[2575]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 07 17:03:16.303376 ip-10-0-136-3 kubenswrapper[2575]:  > pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:03:16.303376 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:03:16.303118    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"console-759b7bd587-sq6cf_openshift-console(380bc4a5-4a82-4ea4-94c4-14314c8f06ef)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"console-759b7bd587-sq6cf_openshift-console(380bc4a5-4a82-4ea4-94c4-14314c8f06ef)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_console-759b7bd587-sq6cf_openshift-console_380bc4a5-4a82-4ea4-94c4-14314c8f06ef_0(1259c594b89ff2d8ac934ca6b993f58568f4c4ac314195e31fab2767fce16776): error adding pod openshift-console_console-759b7bd587-sq6cf to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"1259c594b89ff2d8ac934ca6b993f58568f4c4ac314195e31fab2767fce16776\\\" Netns:\\\"/var/run/netns/b7a29994-769d-4b1e-82bf-4f0531c2dbdc\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-console;K8S_POD_NAME=console-759b7bd587-sq6cf;K8S_POD_INFRA_CONTAINER_ID=1259c594b89ff2d8ac934ca6b993f58568f4c4ac314195e31fab2767fce16776;K8S_POD_UID=380bc4a5-4a82-4ea4-94c4-14314c8f06ef\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-console/console-759b7bd587-sq6cf] networking: Multus: [openshift-console/console-759b7bd587-sq6cf/380bc4a5-4a82-4ea4-94c4-14314c8f06ef]: error waiting for pod: Get \\\"https://a180ad2b90363402289452fab9920906-d170e736a64b4892.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-console/pods/console-759b7bd587-sq6cf?timeout=1m0s\\\": context deadline exceeded\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-console/console-759b7bd587-sq6cf" podUID="380bc4a5-4a82-4ea4-94c4-14314c8f06ef"
Sep 07 17:03:28.716296 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:03:28.716262    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:03:28.716768 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:03:28.716575    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:03:28.987495 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:03:28.987465    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-759b7bd587-sq6cf"]
Sep 07 17:03:28.989502 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:03:28.989472    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod380bc4a5_4a82_4ea4_94c4_14314c8f06ef.slice/crio-48263507560d75ccc9ba711b34f956691d1df18a8a11baa48f4c6d8c0d7fdf37 WatchSource:0}: Error finding container 48263507560d75ccc9ba711b34f956691d1df18a8a11baa48f4c6d8c0d7fdf37: Status 404 returned error can't find the container with id 48263507560d75ccc9ba711b34f956691d1df18a8a11baa48f4c6d8c0d7fdf37
Sep 07 17:03:29.824247 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:03:29.824205    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759b7bd587-sq6cf" event={"ID":"380bc4a5-4a82-4ea4-94c4-14314c8f06ef","Type":"ContainerStarted","Data":"115f9050726ebd1bfd29c7b22f853aa9418fe7262126dbf077dc00548274d00a"}
Sep 07 17:03:29.824604 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:03:29.824268    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759b7bd587-sq6cf" event={"ID":"380bc4a5-4a82-4ea4-94c4-14314c8f06ef","Type":"ContainerStarted","Data":"48263507560d75ccc9ba711b34f956691d1df18a8a11baa48f4c6d8c0d7fdf37"}
Sep 07 17:03:29.843704 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:03:29.843655    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-759b7bd587-sq6cf" podStartSLOduration=35.843638594 podStartE2EDuration="35.843638594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:02:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:03:29.841732783 +0000 UTC m=+403.738580117" watchObservedRunningTime="2026-09-07 17:03:29.843638594 +0000 UTC m=+403.740485908"
Sep 07 17:03:34.690612 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:03:34.690570    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:03:34.691018 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:03:34.690664    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:03:34.696181 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:03:34.696156    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:03:34.850566 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:03:34.850538    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-759b7bd587-sq6cf"
Sep 07 17:03:35.018001 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:03:35.017883    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:03:35.118807 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:03:35.118777    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:03:35.172053 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:03:35.172019    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:03:40.381723 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:03:40.381681    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:03:40.481005 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:03:40.480968    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:03:53.917580 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:03:53.917540    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:03:54.712588 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:03:54.712558    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:03:57.723917 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:03:57.723861    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:03:58.032828 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:03:58.032742    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:03:58.208384 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:03:58.208347    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:03:58.724586 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:03:58.724548    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:00.394450 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:00.394416    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:00.535350 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:00.535317    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:02.198277 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:02.198237    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:02.637924 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:02.637882    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:04.363725 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:04.363689    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:06.170234 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:06.170203    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:07.124615 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:07.124577    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:07.224880 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:07.224847    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:07.527862 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:07.527779    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:07.659679 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:07.659646    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:09.918504 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:09.918426    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:10.018843 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:10.018801    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:11.928052 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:11.928015    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:12.116582 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:12.116551    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:12.388242 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:12.388211    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:12.489305 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:12.489260    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:12.587861 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:12.587823    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:12.689192 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:12.689108    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:18.180942 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:18.180889    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:18.282420 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:18.282390    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:22.513254 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:22.513211    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-87dh2"]
Sep 07 17:04:22.516683 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:22.516667    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-87dh2"
Sep 07 17:04:22.519809 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:22.519786    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 07 17:04:22.520146 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:22.520128    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-clssw\""
Sep 07 17:04:22.520477 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:22.520459    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 07 17:04:22.537681 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:22.537655    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-87dh2"]
Sep 07 17:04:22.612400 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:22.612366    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mphj\" (UniqueName: \"kubernetes.io/projected/23f7abad-ab7c-42cc-a446-4c8bf166158d-kube-api-access-4mphj\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-87dh2\" (UID: \"23f7abad-ab7c-42cc-a446-4c8bf166158d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-87dh2"
Sep 07 17:04:22.612568 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:22.612467    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/23f7abad-ab7c-42cc-a446-4c8bf166158d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-87dh2\" (UID: \"23f7abad-ab7c-42cc-a446-4c8bf166158d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-87dh2"
Sep 07 17:04:22.713691 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:22.713648    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mphj\" (UniqueName: \"kubernetes.io/projected/23f7abad-ab7c-42cc-a446-4c8bf166158d-kube-api-access-4mphj\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-87dh2\" (UID: \"23f7abad-ab7c-42cc-a446-4c8bf166158d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-87dh2"
Sep 07 17:04:22.713855 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:22.713712    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/23f7abad-ab7c-42cc-a446-4c8bf166158d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-87dh2\" (UID: \"23f7abad-ab7c-42cc-a446-4c8bf166158d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-87dh2"
Sep 07 17:04:22.714086 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:22.714068    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/23f7abad-ab7c-42cc-a446-4c8bf166158d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-87dh2\" (UID: \"23f7abad-ab7c-42cc-a446-4c8bf166158d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-87dh2"
Sep 07 17:04:22.724951 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:22.724923    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mphj\" (UniqueName: \"kubernetes.io/projected/23f7abad-ab7c-42cc-a446-4c8bf166158d-kube-api-access-4mphj\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-87dh2\" (UID: \"23f7abad-ab7c-42cc-a446-4c8bf166158d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-87dh2"
Sep 07 17:04:22.827609 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:22.827573    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-87dh2"
Sep 07 17:04:22.942629 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:22.942594    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:23.053447 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:23.053409    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:23.104069 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:23.104049    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-87dh2"]
Sep 07 17:04:23.106719 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:04:23.106695    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23f7abad_ab7c_42cc_a446_4c8bf166158d.slice/crio-e1cd124b1e8b0fa2314759d7409f8067db0dd2952aafc965859fd6ecba9506a0 WatchSource:0}: Error finding container e1cd124b1e8b0fa2314759d7409f8067db0dd2952aafc965859fd6ecba9506a0: Status 404 returned error can't find the container with id e1cd124b1e8b0fa2314759d7409f8067db0dd2952aafc965859fd6ecba9506a0
Sep 07 17:04:24.072339 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:24.072286    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-87dh2" event={"ID":"23f7abad-ab7c-42cc-a446-4c8bf166158d","Type":"ContainerStarted","Data":"e1cd124b1e8b0fa2314759d7409f8067db0dd2952aafc965859fd6ecba9506a0"}
Sep 07 17:04:26.718772 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:26.718729    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:26.819453 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:26.819409    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:26.935554 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:26.935523    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:26.998542 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:26.998456    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:28.102912 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:28.102866    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-87dh2" event={"ID":"23f7abad-ab7c-42cc-a446-4c8bf166158d","Type":"ContainerStarted","Data":"baf14a3421e9df9cca2492ea43fe46a00e5a46b4120b442c6b5e93a36fa0e201"}
Sep 07 17:04:28.103294 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:28.103014    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-87dh2"
Sep 07 17:04:28.108408 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:28.108382    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:28.127416 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:28.127370    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-87dh2" podStartSLOduration=1.9434275030000001 podStartE2EDuration="6.127354013s" totalImagesPullingTime="4.18392651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:04:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:04:28.124521998 +0000 UTC m=+462.021369312" watchObservedRunningTime="2026-09-07 17:04:28.127354013 +0000 UTC m=+462.024201328"
Sep 07 17:04:28.208801 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:28.208767    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:30.693522 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:30.693477    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:30.792036 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:30.791998    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:30.861874 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:30.861838    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:37.172145 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:37.172109    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:37.242339 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:37.242304    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:38.206792 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:38.206760    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:39.111322 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:39.111286    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-87dh2"
Sep 07 17:04:41.926921 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:41.926815    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:42.028948 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:42.028882    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:44.072358 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:44.072324    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:45.720973 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:45.720939    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:45.796424 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:45.796387    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:46.319041 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:46.319010    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:46.439848 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:46.439809    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:47.716201 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:47.716166    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:47.817618 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:47.817568    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:50.725583 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:50.725551    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:50.826738 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:50.826703    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:51.122395 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:51.122350    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:51.187155 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:51.187114    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:51.527549 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:51.527460    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:51.598856 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:51.598811    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:55.633379 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:55.633342    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:56.135773 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:56.135738    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:57.093084 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:57.093052    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:57.193046 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:57.193008    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:58.138073 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:58.138034    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:58.248292 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:58.248255    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:58.347568 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:58.347531    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:59.021332 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:59.021295    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:59.124345 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:59.124313    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:04:59.159873 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:59.159842    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c548b5d7d-gf569"]
Sep 07 17:04:59.166382 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:59.166351    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-gf569"
Sep 07 17:04:59.169336 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:59.169302    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ltmns\""
Sep 07 17:04:59.171239 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:59.171217    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-gf569"]
Sep 07 17:04:59.248097 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:59.248064    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64clw\" (UniqueName: \"kubernetes.io/projected/42b0e352-48df-44ee-b78a-5948f5c548c2-kube-api-access-64clw\") pod \"authorino-c548b5d7d-gf569\" (UID: \"42b0e352-48df-44ee-b78a-5948f5c548c2\") " pod="kuadrant-system/authorino-c548b5d7d-gf569"
Sep 07 17:04:59.349083 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:59.349053    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64clw\" (UniqueName: \"kubernetes.io/projected/42b0e352-48df-44ee-b78a-5948f5c548c2-kube-api-access-64clw\") pod \"authorino-c548b5d7d-gf569\" (UID: \"42b0e352-48df-44ee-b78a-5948f5c548c2\") " pod="kuadrant-system/authorino-c548b5d7d-gf569"
Sep 07 17:04:59.357468 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:59.357435    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64clw\" (UniqueName: \"kubernetes.io/projected/42b0e352-48df-44ee-b78a-5948f5c548c2-kube-api-access-64clw\") pod \"authorino-c548b5d7d-gf569\" (UID: \"42b0e352-48df-44ee-b78a-5948f5c548c2\") " pod="kuadrant-system/authorino-c548b5d7d-gf569"
Sep 07 17:04:59.477079 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:59.477040    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-gf569"
Sep 07 17:04:59.774109 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:04:59.774030    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-gf569"]
Sep 07 17:04:59.778122 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:04:59.778097    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42b0e352_48df_44ee_b78a_5948f5c548c2.slice/crio-b25fb76f2ad8e2e6563eb49811ab6d00e255d7c1a2690a8597e41f4ac53a59e7 WatchSource:0}: Error finding container b25fb76f2ad8e2e6563eb49811ab6d00e255d7c1a2690a8597e41f4ac53a59e7: Status 404 returned error can't find the container with id b25fb76f2ad8e2e6563eb49811ab6d00e255d7c1a2690a8597e41f4ac53a59e7
Sep 07 17:05:00.253368 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:00.253331    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-gf569" event={"ID":"42b0e352-48df-44ee-b78a-5948f5c548c2","Type":"ContainerStarted","Data":"b25fb76f2ad8e2e6563eb49811ab6d00e255d7c1a2690a8597e41f4ac53a59e7"}
Sep 07 17:05:01.849105 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:01.849076    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:05:01.949500 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:01.949462    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:05:02.265269 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:02.265179    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-gf569" event={"ID":"42b0e352-48df-44ee-b78a-5948f5c548c2","Type":"ContainerStarted","Data":"aedd3b27802c2dca711086f7b25f7d3de364042d3b3bee3e017547b43a1843eb"}
Sep 07 17:05:02.279810 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:02.279754    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c548b5d7d-gf569" podStartSLOduration=1.223525155 podStartE2EDuration="3.279739658s" totalImagesPullingTime="2.056214503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:04:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:05:02.27904436 +0000 UTC m=+496.175891677" watchObservedRunningTime="2026-09-07 17:05:02.279739658 +0000 UTC m=+496.176587005"
Sep 07 17:05:14.217595 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:14.217558    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:05:14.317623 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:14.317590    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:05:14.700785 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:14.700753    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:05:27.485378 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:27.485337    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:05:27.705221 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:27.705183    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-wrkzm"]
Sep 07 17:05:27.707460 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:27.707438    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-wrkzm"
Sep 07 17:05:27.714974 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:27.714947    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-wrkzm"]
Sep 07 17:05:27.801653 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:27.801614    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhvd9\" (UniqueName: \"kubernetes.io/projected/c7b4854c-7970-4892-b606-afb39385dbde-kube-api-access-bhvd9\") pod \"authorino-5dc7ccb5f-wrkzm\" (UID: \"c7b4854c-7970-4892-b606-afb39385dbde\") " pod="kuadrant-system/authorino-5dc7ccb5f-wrkzm"
Sep 07 17:05:27.829023 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:27.828989    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:05:27.903058 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:27.903024    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhvd9\" (UniqueName: \"kubernetes.io/projected/c7b4854c-7970-4892-b606-afb39385dbde-kube-api-access-bhvd9\") pod \"authorino-5dc7ccb5f-wrkzm\" (UID: \"c7b4854c-7970-4892-b606-afb39385dbde\") " pod="kuadrant-system/authorino-5dc7ccb5f-wrkzm"
Sep 07 17:05:27.911021 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:27.910992    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhvd9\" (UniqueName: \"kubernetes.io/projected/c7b4854c-7970-4892-b606-afb39385dbde-kube-api-access-bhvd9\") pod \"authorino-5dc7ccb5f-wrkzm\" (UID: \"c7b4854c-7970-4892-b606-afb39385dbde\") " pod="kuadrant-system/authorino-5dc7ccb5f-wrkzm"
Sep 07 17:05:27.940109 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:27.940075    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-wrkzm"]
Sep 07 17:05:27.940353 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:27.940341    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-wrkzm"
Sep 07 17:05:27.969866 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:27.969835    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-798c9d758d-8m999"]
Sep 07 17:05:27.972296 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:27.972276    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-798c9d758d-8m999"
Sep 07 17:05:27.979989 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:27.979964    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-798c9d758d-8m999"]
Sep 07 17:05:28.004536 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:28.004161    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-798c9d758d-8m999"]
Sep 07 17:05:28.004536 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:05:28.004480    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-8kww8], unattached volumes=[], failed to process volumes=[kube-api-access-8kww8]: context canceled" pod="kuadrant-system/authorino-798c9d758d-8m999" podUID="54a3cacc-c00f-442f-b5bc-55d1a7c12452"
Sep 07 17:05:28.030847 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:28.030819    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5bd97cb566-gztpb"]
Sep 07 17:05:28.033155 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:28.033140    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bd97cb566-gztpb"
Sep 07 17:05:28.036009 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:28.035988    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 07 17:05:28.041492 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:28.041470    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bd97cb566-gztpb"]
Sep 07 17:05:28.104926 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:28.104808    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kww8\" (UniqueName: \"kubernetes.io/projected/54a3cacc-c00f-442f-b5bc-55d1a7c12452-kube-api-access-8kww8\") pod \"authorino-798c9d758d-8m999\" (UID: \"54a3cacc-c00f-442f-b5bc-55d1a7c12452\") " pod="kuadrant-system/authorino-798c9d758d-8m999"
Sep 07 17:05:28.205799 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:28.205762    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6lpr\" (UniqueName: \"kubernetes.io/projected/aaf03069-18ef-40e9-bef6-56afe1a51d66-kube-api-access-d6lpr\") pod \"authorino-5bd97cb566-gztpb\" (UID: \"aaf03069-18ef-40e9-bef6-56afe1a51d66\") " pod="kuadrant-system/authorino-5bd97cb566-gztpb"
Sep 07 17:05:28.205987 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:28.205807    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aaf03069-18ef-40e9-bef6-56afe1a51d66-tls-cert\") pod \"authorino-5bd97cb566-gztpb\" (UID: \"aaf03069-18ef-40e9-bef6-56afe1a51d66\") " pod="kuadrant-system/authorino-5bd97cb566-gztpb"
Sep 07 17:05:28.206038 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:28.205995    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kww8\" (UniqueName: \"kubernetes.io/projected/54a3cacc-c00f-442f-b5bc-55d1a7c12452-kube-api-access-8kww8\") pod \"authorino-798c9d758d-8m999\" (UID: \"54a3cacc-c00f-442f-b5bc-55d1a7c12452\") " pod="kuadrant-system/authorino-798c9d758d-8m999"
Sep 07 17:05:28.219847 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:28.219811    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kww8\" (UniqueName: \"kubernetes.io/projected/54a3cacc-c00f-442f-b5bc-55d1a7c12452-kube-api-access-8kww8\") pod \"authorino-798c9d758d-8m999\" (UID: \"54a3cacc-c00f-442f-b5bc-55d1a7c12452\") " pod="kuadrant-system/authorino-798c9d758d-8m999"
Sep 07 17:05:28.221846 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:28.221823    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-wrkzm"]
Sep 07 17:05:28.223401 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:05:28.223365    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7b4854c_7970_4892_b606_afb39385dbde.slice/crio-1bf3a0ccbb1ba8346c5dc4a0b7691d8b963cb41514913a5602fe3b645b4d5889 WatchSource:0}: Error finding container 1bf3a0ccbb1ba8346c5dc4a0b7691d8b963cb41514913a5602fe3b645b4d5889: Status 404 returned error can't find the container with id 1bf3a0ccbb1ba8346c5dc4a0b7691d8b963cb41514913a5602fe3b645b4d5889
Sep 07 17:05:28.307246 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:28.307204    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6lpr\" (UniqueName: \"kubernetes.io/projected/aaf03069-18ef-40e9-bef6-56afe1a51d66-kube-api-access-d6lpr\") pod \"authorino-5bd97cb566-gztpb\" (UID: \"aaf03069-18ef-40e9-bef6-56afe1a51d66\") " pod="kuadrant-system/authorino-5bd97cb566-gztpb"
Sep 07 17:05:28.307436 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:28.307258    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aaf03069-18ef-40e9-bef6-56afe1a51d66-tls-cert\") pod \"authorino-5bd97cb566-gztpb\" (UID: \"aaf03069-18ef-40e9-bef6-56afe1a51d66\") " pod="kuadrant-system/authorino-5bd97cb566-gztpb"
Sep 07 17:05:28.309704 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:28.309680    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aaf03069-18ef-40e9-bef6-56afe1a51d66-tls-cert\") pod \"authorino-5bd97cb566-gztpb\" (UID: \"aaf03069-18ef-40e9-bef6-56afe1a51d66\") " pod="kuadrant-system/authorino-5bd97cb566-gztpb"
Sep 07 17:05:28.315433 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:28.315410    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6lpr\" (UniqueName: \"kubernetes.io/projected/aaf03069-18ef-40e9-bef6-56afe1a51d66-kube-api-access-d6lpr\") pod \"authorino-5bd97cb566-gztpb\" (UID: \"aaf03069-18ef-40e9-bef6-56afe1a51d66\") " pod="kuadrant-system/authorino-5bd97cb566-gztpb"
Sep 07 17:05:28.342077 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:28.342046    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bd97cb566-gztpb"
Sep 07 17:05:28.386764 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:28.386693    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-798c9d758d-8m999"
Sep 07 17:05:28.386951 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:28.386688    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-wrkzm" event={"ID":"c7b4854c-7970-4892-b606-afb39385dbde","Type":"ContainerStarted","Data":"1bf3a0ccbb1ba8346c5dc4a0b7691d8b963cb41514913a5602fe3b645b4d5889"}
Sep 07 17:05:28.398515 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:28.398383    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-798c9d758d-8m999"
Sep 07 17:05:28.508968 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:28.508937    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kww8\" (UniqueName: \"kubernetes.io/projected/54a3cacc-c00f-442f-b5bc-55d1a7c12452-kube-api-access-8kww8\") pod \"54a3cacc-c00f-442f-b5bc-55d1a7c12452\" (UID: \"54a3cacc-c00f-442f-b5bc-55d1a7c12452\") "
Sep 07 17:05:28.511001 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:28.510978    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54a3cacc-c00f-442f-b5bc-55d1a7c12452-kube-api-access-8kww8" (OuterVolumeSpecName: "kube-api-access-8kww8") pod "54a3cacc-c00f-442f-b5bc-55d1a7c12452" (UID: "54a3cacc-c00f-442f-b5bc-55d1a7c12452"). InnerVolumeSpecName "kube-api-access-8kww8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:05:28.609821 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:28.609791    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kww8\" (UniqueName: \"kubernetes.io/projected/54a3cacc-c00f-442f-b5bc-55d1a7c12452-kube-api-access-8kww8\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:05:28.616940 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:28.616916    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bd97cb566-gztpb"]
Sep 07 17:05:28.618661 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:05:28.618638    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaaf03069_18ef_40e9_bef6_56afe1a51d66.slice/crio-368700269c2db6e277b6e7d5f2319dd17d1bc5fbed68ad0335e2c172ff2cd8db WatchSource:0}: Error finding container 368700269c2db6e277b6e7d5f2319dd17d1bc5fbed68ad0335e2c172ff2cd8db: Status 404 returned error can't find the container with id 368700269c2db6e277b6e7d5f2319dd17d1bc5fbed68ad0335e2c172ff2cd8db
Sep 07 17:05:29.392775 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:29.392732    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bd97cb566-gztpb" event={"ID":"aaf03069-18ef-40e9-bef6-56afe1a51d66","Type":"ContainerStarted","Data":"30e9a9d2b509ccf26439bfa181ec8817e98e702e9de3b8880962eac6a7b996a1"}
Sep 07 17:05:29.392971 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:29.392782    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bd97cb566-gztpb" event={"ID":"aaf03069-18ef-40e9-bef6-56afe1a51d66","Type":"ContainerStarted","Data":"368700269c2db6e277b6e7d5f2319dd17d1bc5fbed68ad0335e2c172ff2cd8db"}
Sep 07 17:05:29.394360 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:29.394336    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-wrkzm" event={"ID":"c7b4854c-7970-4892-b606-afb39385dbde","Type":"ContainerStarted","Data":"7e33a76c7e1ea0b64a30dd8e389ad36f53e6d06b92e1ca2769cf4767300778ba"}
Sep 07 17:05:29.394360 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:29.394347    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-798c9d758d-8m999"
Sep 07 17:05:29.394522 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:29.394390    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5dc7ccb5f-wrkzm" podUID="c7b4854c-7970-4892-b606-afb39385dbde" containerName="authorino" containerID="cri-o://7e33a76c7e1ea0b64a30dd8e389ad36f53e6d06b92e1ca2769cf4767300778ba" gracePeriod=30
Sep 07 17:05:29.409176 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:29.409135    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5bd97cb566-gztpb" podStartSLOduration=1.155173164 podStartE2EDuration="1.409120875s" totalImagesPullingTime="253.947711ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:05:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:05:29.407432204 +0000 UTC m=+523.304279522" watchObservedRunningTime="2026-09-07 17:05:29.409120875 +0000 UTC m=+523.305968198"
Sep 07 17:05:29.435441 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:29.435393    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5dc7ccb5f-wrkzm" podStartSLOduration=2.008715477 podStartE2EDuration="2.435376739s" totalImagesPullingTime="426.661262ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:05:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:05:29.42218875 +0000 UTC m=+523.319036078" watchObservedRunningTime="2026-09-07 17:05:29.435376739 +0000 UTC m=+523.332224053"
Sep 07 17:05:29.436064 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:29.436048    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-gf569"]
Sep 07 17:05:29.436225 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:29.436208    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c548b5d7d-gf569" podUID="42b0e352-48df-44ee-b78a-5948f5c548c2" containerName="authorino" containerID="cri-o://aedd3b27802c2dca711086f7b25f7d3de364042d3b3bee3e017547b43a1843eb" gracePeriod=30
Sep 07 17:05:29.451325 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:29.451294    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-798c9d758d-8m999"]
Sep 07 17:05:29.456178 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:29.456155    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-798c9d758d-8m999"]
Sep 07 17:05:29.674678 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:29.674653    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-wrkzm"
Sep 07 17:05:29.695607 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:29.695582    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-gf569"
Sep 07 17:05:29.819078 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:29.819037    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64clw\" (UniqueName: \"kubernetes.io/projected/42b0e352-48df-44ee-b78a-5948f5c548c2-kube-api-access-64clw\") pod \"42b0e352-48df-44ee-b78a-5948f5c548c2\" (UID: \"42b0e352-48df-44ee-b78a-5948f5c548c2\") "
Sep 07 17:05:29.819264 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:29.819090    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhvd9\" (UniqueName: \"kubernetes.io/projected/c7b4854c-7970-4892-b606-afb39385dbde-kube-api-access-bhvd9\") pod \"c7b4854c-7970-4892-b606-afb39385dbde\" (UID: \"c7b4854c-7970-4892-b606-afb39385dbde\") "
Sep 07 17:05:29.821249 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:29.821219    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7b4854c-7970-4892-b606-afb39385dbde-kube-api-access-bhvd9" (OuterVolumeSpecName: "kube-api-access-bhvd9") pod "c7b4854c-7970-4892-b606-afb39385dbde" (UID: "c7b4854c-7970-4892-b606-afb39385dbde"). InnerVolumeSpecName "kube-api-access-bhvd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:05:29.821550 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:29.821248    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42b0e352-48df-44ee-b78a-5948f5c548c2-kube-api-access-64clw" (OuterVolumeSpecName: "kube-api-access-64clw") pod "42b0e352-48df-44ee-b78a-5948f5c548c2" (UID: "42b0e352-48df-44ee-b78a-5948f5c548c2"). InnerVolumeSpecName "kube-api-access-64clw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:05:29.920799 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:29.920772    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64clw\" (UniqueName: \"kubernetes.io/projected/42b0e352-48df-44ee-b78a-5948f5c548c2-kube-api-access-64clw\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:05:29.920799 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:29.920800    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhvd9\" (UniqueName: \"kubernetes.io/projected/c7b4854c-7970-4892-b606-afb39385dbde-kube-api-access-bhvd9\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:05:30.400410 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:30.400375    2575 generic.go:356] "Generic (PLEG): container finished" podID="42b0e352-48df-44ee-b78a-5948f5c548c2" containerID="aedd3b27802c2dca711086f7b25f7d3de364042d3b3bee3e017547b43a1843eb" exitCode=0
Sep 07 17:05:30.400410 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:30.400409    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-gf569"
Sep 07 17:05:30.400635 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:30.400451    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-gf569" event={"ID":"42b0e352-48df-44ee-b78a-5948f5c548c2","Type":"ContainerDied","Data":"aedd3b27802c2dca711086f7b25f7d3de364042d3b3bee3e017547b43a1843eb"}
Sep 07 17:05:30.400635 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:30.400500    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-gf569" event={"ID":"42b0e352-48df-44ee-b78a-5948f5c548c2","Type":"ContainerDied","Data":"b25fb76f2ad8e2e6563eb49811ab6d00e255d7c1a2690a8597e41f4ac53a59e7"}
Sep 07 17:05:30.400635 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:30.400538    2575 scope.go:117] "RemoveContainer" containerID="aedd3b27802c2dca711086f7b25f7d3de364042d3b3bee3e017547b43a1843eb"
Sep 07 17:05:30.401986 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:30.401876    2575 generic.go:356] "Generic (PLEG): container finished" podID="c7b4854c-7970-4892-b606-afb39385dbde" containerID="7e33a76c7e1ea0b64a30dd8e389ad36f53e6d06b92e1ca2769cf4767300778ba" exitCode=0
Sep 07 17:05:30.401986 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:30.401944    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-wrkzm"
Sep 07 17:05:30.402110 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:30.401987    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-wrkzm" event={"ID":"c7b4854c-7970-4892-b606-afb39385dbde","Type":"ContainerDied","Data":"7e33a76c7e1ea0b64a30dd8e389ad36f53e6d06b92e1ca2769cf4767300778ba"}
Sep 07 17:05:30.402110 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:30.402026    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-wrkzm" event={"ID":"c7b4854c-7970-4892-b606-afb39385dbde","Type":"ContainerDied","Data":"1bf3a0ccbb1ba8346c5dc4a0b7691d8b963cb41514913a5602fe3b645b4d5889"}
Sep 07 17:05:30.417190 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:30.417108    2575 scope.go:117] "RemoveContainer" containerID="aedd3b27802c2dca711086f7b25f7d3de364042d3b3bee3e017547b43a1843eb"
Sep 07 17:05:30.417621 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:05:30.417593    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aedd3b27802c2dca711086f7b25f7d3de364042d3b3bee3e017547b43a1843eb\": container with ID starting with aedd3b27802c2dca711086f7b25f7d3de364042d3b3bee3e017547b43a1843eb not found: ID does not exist" containerID="aedd3b27802c2dca711086f7b25f7d3de364042d3b3bee3e017547b43a1843eb"
Sep 07 17:05:30.417781 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:30.417630    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aedd3b27802c2dca711086f7b25f7d3de364042d3b3bee3e017547b43a1843eb"} err="failed to get container status \"aedd3b27802c2dca711086f7b25f7d3de364042d3b3bee3e017547b43a1843eb\": rpc error: code = NotFound desc = could not find container \"aedd3b27802c2dca711086f7b25f7d3de364042d3b3bee3e017547b43a1843eb\": container with ID starting with aedd3b27802c2dca711086f7b25f7d3de364042d3b3bee3e017547b43a1843eb not found: ID does not exist"
Sep 07 17:05:30.417843 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:30.417793    2575 scope.go:117] "RemoveContainer" containerID="7e33a76c7e1ea0b64a30dd8e389ad36f53e6d06b92e1ca2769cf4767300778ba"
Sep 07 17:05:30.425664 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:30.425647    2575 scope.go:117] "RemoveContainer" containerID="7e33a76c7e1ea0b64a30dd8e389ad36f53e6d06b92e1ca2769cf4767300778ba"
Sep 07 17:05:30.425965 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:05:30.425946    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e33a76c7e1ea0b64a30dd8e389ad36f53e6d06b92e1ca2769cf4767300778ba\": container with ID starting with 7e33a76c7e1ea0b64a30dd8e389ad36f53e6d06b92e1ca2769cf4767300778ba not found: ID does not exist" containerID="7e33a76c7e1ea0b64a30dd8e389ad36f53e6d06b92e1ca2769cf4767300778ba"
Sep 07 17:05:30.426019 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:30.425972    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e33a76c7e1ea0b64a30dd8e389ad36f53e6d06b92e1ca2769cf4767300778ba"} err="failed to get container status \"7e33a76c7e1ea0b64a30dd8e389ad36f53e6d06b92e1ca2769cf4767300778ba\": rpc error: code = NotFound desc = could not find container \"7e33a76c7e1ea0b64a30dd8e389ad36f53e6d06b92e1ca2769cf4767300778ba\": container with ID starting with 7e33a76c7e1ea0b64a30dd8e389ad36f53e6d06b92e1ca2769cf4767300778ba not found: ID does not exist"
Sep 07 17:05:30.430746 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:30.430722    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-gf569"]
Sep 07 17:05:30.434570 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:30.434549    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-gf569"]
Sep 07 17:05:30.444753 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:30.444730    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-wrkzm"]
Sep 07 17:05:30.448808 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:30.448781    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-wrkzm"]
Sep 07 17:05:30.721644 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:30.721569    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42b0e352-48df-44ee-b78a-5948f5c548c2" path="/var/lib/kubelet/pods/42b0e352-48df-44ee-b78a-5948f5c548c2/volumes"
Sep 07 17:05:30.722014 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:30.721918    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54a3cacc-c00f-442f-b5bc-55d1a7c12452" path="/var/lib/kubelet/pods/54a3cacc-c00f-442f-b5bc-55d1a7c12452/volumes"
Sep 07 17:05:30.722120 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:30.722108    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7b4854c-7970-4892-b606-afb39385dbde" path="/var/lib/kubelet/pods/c7b4854c-7970-4892-b606-afb39385dbde/volumes"
Sep 07 17:05:34.101722 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:34.101687    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:05:34.183086 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:34.183049    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:05:34.254648 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:34.254616    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:05:34.339912 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:34.339856    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:05:37.538092 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:37.538047    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:05:37.629614 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:05:37.629567    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:06:10.383486 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:10.383443    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:06:10.480751 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:10.480714    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:06:11.867617 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:11.867572    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:06:11.969026 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:11.968995    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:06:12.151303 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:12.151215    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:06:12.412912 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:12.412801    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:06:12.507486 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:12.507443    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:06:12.520420 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:12.520354    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-kr5xx"]
Sep 07 17:06:12.521093 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:12.521067    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7b4854c-7970-4892-b606-afb39385dbde" containerName="authorino"
Sep 07 17:06:12.521093 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:12.521095    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7b4854c-7970-4892-b606-afb39385dbde" containerName="authorino"
Sep 07 17:06:12.521236 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:12.521135    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42b0e352-48df-44ee-b78a-5948f5c548c2" containerName="authorino"
Sep 07 17:06:12.521236 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:12.521145    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="42b0e352-48df-44ee-b78a-5948f5c548c2" containerName="authorino"
Sep 07 17:06:12.521369 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:12.521257    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="42b0e352-48df-44ee-b78a-5948f5c548c2" containerName="authorino"
Sep 07 17:06:12.521369 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:12.521286    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7b4854c-7970-4892-b606-afb39385dbde" containerName="authorino"
Sep 07 17:06:12.524761 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:12.524742    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kr5xx"
Sep 07 17:06:12.528511 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:12.528489    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-69dkk\""
Sep 07 17:06:12.528703 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:12.528682    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 07 17:06:12.537109 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:12.537082    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-kr5xx"]
Sep 07 17:06:12.722588 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:12.722505    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/782e4901-4c16-448e-87b9-b5de59e6e152-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-kr5xx\" (UID: \"782e4901-4c16-448e-87b9-b5de59e6e152\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kr5xx"
Sep 07 17:06:12.722588 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:12.722568    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdwcv\" (UniqueName: \"kubernetes.io/projected/782e4901-4c16-448e-87b9-b5de59e6e152-kube-api-access-sdwcv\") pod \"payload-pre-processing-59fbc47bf8-kr5xx\" (UID: \"782e4901-4c16-448e-87b9-b5de59e6e152\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kr5xx"
Sep 07 17:06:12.745976 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:12.745937    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:06:12.823740 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:12.823705    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/782e4901-4c16-448e-87b9-b5de59e6e152-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-kr5xx\" (UID: \"782e4901-4c16-448e-87b9-b5de59e6e152\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kr5xx"
Sep 07 17:06:12.823931 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:12.823766    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdwcv\" (UniqueName: \"kubernetes.io/projected/782e4901-4c16-448e-87b9-b5de59e6e152-kube-api-access-sdwcv\") pod \"payload-pre-processing-59fbc47bf8-kr5xx\" (UID: \"782e4901-4c16-448e-87b9-b5de59e6e152\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kr5xx"
Sep 07 17:06:12.824525 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:12.824505    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/782e4901-4c16-448e-87b9-b5de59e6e152-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-kr5xx\" (UID: \"782e4901-4c16-448e-87b9-b5de59e6e152\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kr5xx"
Sep 07 17:06:12.835604 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:12.835570    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdwcv\" (UniqueName: \"kubernetes.io/projected/782e4901-4c16-448e-87b9-b5de59e6e152-kube-api-access-sdwcv\") pod \"payload-pre-processing-59fbc47bf8-kr5xx\" (UID: \"782e4901-4c16-448e-87b9-b5de59e6e152\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kr5xx"
Sep 07 17:06:12.837386 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:12.837367    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kr5xx"
Sep 07 17:06:13.115615 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:13.115589    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-kr5xx"]
Sep 07 17:06:13.117833 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:06:13.117803    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod782e4901_4c16_448e_87b9_b5de59e6e152.slice/crio-1b0fe3f67ba7464d5f7d21cfd8d38563a51fc351023f504747f143ae14de7e81 WatchSource:0}: Error finding container 1b0fe3f67ba7464d5f7d21cfd8d38563a51fc351023f504747f143ae14de7e81: Status 404 returned error can't find the container with id 1b0fe3f67ba7464d5f7d21cfd8d38563a51fc351023f504747f143ae14de7e81
Sep 07 17:06:13.620915 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:13.620865    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kr5xx" event={"ID":"782e4901-4c16-448e-87b9-b5de59e6e152","Type":"ContainerStarted","Data":"1b0fe3f67ba7464d5f7d21cfd8d38563a51fc351023f504747f143ae14de7e81"}
Sep 07 17:06:15.632378 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:15.632339    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kr5xx" event={"ID":"782e4901-4c16-448e-87b9-b5de59e6e152","Type":"ContainerStarted","Data":"2e89fee991631fbe3d964054c5d4c01fb1c80f686f71fa73bf9b80eb2a52aeb0"}
Sep 07 17:06:15.632741 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:15.632487    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kr5xx"
Sep 07 17:06:15.653819 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:15.653774    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kr5xx" podStartSLOduration=1.83676168 podStartE2EDuration="3.653759335s" totalImagesPullingTime="1.816997655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:06:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:06:15.653107289 +0000 UTC m=+569.549954597" watchObservedRunningTime="2026-09-07 17:06:15.653759335 +0000 UTC m=+569.550606651"
Sep 07 17:06:24.509690 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:24.509651    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:06:24.606735 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:24.606700    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:06:26.580461 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:26.580419    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:06:26.639749 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:26.639718    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kr5xx"
Sep 07 17:06:37.359275 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:37.359235    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:06:47.111519 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:47.111482    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:06:55.304300 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:55.304264    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:06:59.081760 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:06:59.081718    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:07:01.934438 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:01.934406    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd"]
Sep 07 17:07:01.938458 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:01.938437    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd"
Sep 07 17:07:01.941287 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:01.941260    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 07 17:07:01.941454 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:01.941333    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-v5fk9\""
Sep 07 17:07:01.942422 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:01.942402    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 07 17:07:01.942507 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:01.942431    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 07 17:07:01.951844 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:01.951824    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd"]
Sep 07 17:07:01.972678 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:01.972653    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b2ab3b8-6f0c-4862-8f92-365968c679f1-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd\" (UID: \"5b2ab3b8-6f0c-4862-8f92-365968c679f1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd"
Sep 07 17:07:01.972814 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:01.972708    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b2ab3b8-6f0c-4862-8f92-365968c679f1-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd\" (UID: \"5b2ab3b8-6f0c-4862-8f92-365968c679f1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd"
Sep 07 17:07:01.972814 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:01.972752    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b2ab3b8-6f0c-4862-8f92-365968c679f1-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd\" (UID: \"5b2ab3b8-6f0c-4862-8f92-365968c679f1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd"
Sep 07 17:07:01.972814 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:01.972767    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77w72\" (UniqueName: \"kubernetes.io/projected/5b2ab3b8-6f0c-4862-8f92-365968c679f1-kube-api-access-77w72\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd\" (UID: \"5b2ab3b8-6f0c-4862-8f92-365968c679f1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd"
Sep 07 17:07:01.972968 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:01.972838    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b2ab3b8-6f0c-4862-8f92-365968c679f1-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd\" (UID: \"5b2ab3b8-6f0c-4862-8f92-365968c679f1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd"
Sep 07 17:07:01.972968 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:01.972858    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b2ab3b8-6f0c-4862-8f92-365968c679f1-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd\" (UID: \"5b2ab3b8-6f0c-4862-8f92-365968c679f1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd"
Sep 07 17:07:01.973502 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:01.973468    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:07:02.073881 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:02.073848    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b2ab3b8-6f0c-4862-8f92-365968c679f1-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd\" (UID: \"5b2ab3b8-6f0c-4862-8f92-365968c679f1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd"
Sep 07 17:07:02.074046 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:02.073922    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b2ab3b8-6f0c-4862-8f92-365968c679f1-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd\" (UID: \"5b2ab3b8-6f0c-4862-8f92-365968c679f1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd"
Sep 07 17:07:02.074046 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:02.073945    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b2ab3b8-6f0c-4862-8f92-365968c679f1-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd\" (UID: \"5b2ab3b8-6f0c-4862-8f92-365968c679f1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd"
Sep 07 17:07:02.074046 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:02.073961    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77w72\" (UniqueName: \"kubernetes.io/projected/5b2ab3b8-6f0c-4862-8f92-365968c679f1-kube-api-access-77w72\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd\" (UID: \"5b2ab3b8-6f0c-4862-8f92-365968c679f1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd"
Sep 07 17:07:02.074046 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:02.074012    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b2ab3b8-6f0c-4862-8f92-365968c679f1-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd\" (UID: \"5b2ab3b8-6f0c-4862-8f92-365968c679f1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd"
Sep 07 17:07:02.074046 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:02.074037    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b2ab3b8-6f0c-4862-8f92-365968c679f1-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd\" (UID: \"5b2ab3b8-6f0c-4862-8f92-365968c679f1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd"
Sep 07 17:07:02.074385 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:02.074362    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b2ab3b8-6f0c-4862-8f92-365968c679f1-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd\" (UID: \"5b2ab3b8-6f0c-4862-8f92-365968c679f1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd"
Sep 07 17:07:02.074460 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:02.074396    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b2ab3b8-6f0c-4862-8f92-365968c679f1-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd\" (UID: \"5b2ab3b8-6f0c-4862-8f92-365968c679f1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd"
Sep 07 17:07:02.074515 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:02.074496    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b2ab3b8-6f0c-4862-8f92-365968c679f1-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd\" (UID: \"5b2ab3b8-6f0c-4862-8f92-365968c679f1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd"
Sep 07 17:07:02.076412 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:02.076388    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b2ab3b8-6f0c-4862-8f92-365968c679f1-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd\" (UID: \"5b2ab3b8-6f0c-4862-8f92-365968c679f1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd"
Sep 07 17:07:02.076850 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:02.076829    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b2ab3b8-6f0c-4862-8f92-365968c679f1-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd\" (UID: \"5b2ab3b8-6f0c-4862-8f92-365968c679f1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd"
Sep 07 17:07:02.083383 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:02.083357    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77w72\" (UniqueName: \"kubernetes.io/projected/5b2ab3b8-6f0c-4862-8f92-365968c679f1-kube-api-access-77w72\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd\" (UID: \"5b2ab3b8-6f0c-4862-8f92-365968c679f1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd"
Sep 07 17:07:02.249763 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:02.249670    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd"
Sep 07 17:07:02.522976 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:02.522951    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd"]
Sep 07 17:07:02.525047 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:07:02.525018    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b2ab3b8_6f0c_4862_8f92_365968c679f1.slice/crio-482b7f0e226e93fe42cb090ee895d4c7ed6ce3047ca7659c3be3269fe0a76721 WatchSource:0}: Error finding container 482b7f0e226e93fe42cb090ee895d4c7ed6ce3047ca7659c3be3269fe0a76721: Status 404 returned error can't find the container with id 482b7f0e226e93fe42cb090ee895d4c7ed6ce3047ca7659c3be3269fe0a76721
Sep 07 17:07:02.526455 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:02.526438    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 17:07:02.864518 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:02.864481    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd" event={"ID":"5b2ab3b8-6f0c-4862-8f92-365968c679f1","Type":"ContainerStarted","Data":"482b7f0e226e93fe42cb090ee895d4c7ed6ce3047ca7659c3be3269fe0a76721"}
Sep 07 17:07:03.871018 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:03.870935    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd" event={"ID":"5b2ab3b8-6f0c-4862-8f92-365968c679f1","Type":"ContainerStarted","Data":"9ed2dc4137fca9ecb08706078812da58ff5f5e054363548c49da611bcd4ae39c"}
Sep 07 17:07:03.896515 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:03.896450    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd" podStartSLOduration=1.8231125320000001 podStartE2EDuration="2.896429853s" totalImagesPullingTime="1.073317321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:07:03.894480783 +0000 UTC m=+617.791328097" watchObservedRunningTime="2026-09-07 17:07:03.896429853 +0000 UTC m=+617.793277170"
Sep 07 17:07:07.442188 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:07.442151    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:07:12.250249 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:12.250162    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd"
Sep 07 17:07:12.250249 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:12.250238    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd"
Sep 07 17:07:12.262742 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:12.262718    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd"
Sep 07 17:07:12.928251 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:12.928223    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd"
Sep 07 17:07:18.298639 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:18.298608    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4"]
Sep 07 17:07:18.302171 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:18.302154    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4"
Sep 07 17:07:18.305713 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:18.305688    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 07 17:07:18.321154 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:18.321130    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4"]
Sep 07 17:07:18.364589 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:18.364556    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:07:18.430540 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:18.430508    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87c132b9-55a3-4365-a875-fcffc61cb2cc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4\" (UID: \"87c132b9-55a3-4365-a875-fcffc61cb2cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4"
Sep 07 17:07:18.430696 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:18.430592    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87c132b9-55a3-4365-a875-fcffc61cb2cc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4\" (UID: \"87c132b9-55a3-4365-a875-fcffc61cb2cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4"
Sep 07 17:07:18.430696 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:18.430616    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87c132b9-55a3-4365-a875-fcffc61cb2cc-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4\" (UID: \"87c132b9-55a3-4365-a875-fcffc61cb2cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4"
Sep 07 17:07:18.430696 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:18.430673    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf25b\" (UniqueName: \"kubernetes.io/projected/87c132b9-55a3-4365-a875-fcffc61cb2cc-kube-api-access-wf25b\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4\" (UID: \"87c132b9-55a3-4365-a875-fcffc61cb2cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4"
Sep 07 17:07:18.430817 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:18.430697    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87c132b9-55a3-4365-a875-fcffc61cb2cc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4\" (UID: \"87c132b9-55a3-4365-a875-fcffc61cb2cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4"
Sep 07 17:07:18.430817 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:18.430723    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87c132b9-55a3-4365-a875-fcffc61cb2cc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4\" (UID: \"87c132b9-55a3-4365-a875-fcffc61cb2cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4"
Sep 07 17:07:18.531347 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:18.531310    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87c132b9-55a3-4365-a875-fcffc61cb2cc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4\" (UID: \"87c132b9-55a3-4365-a875-fcffc61cb2cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4"
Sep 07 17:07:18.531347 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:18.531350    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87c132b9-55a3-4365-a875-fcffc61cb2cc-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4\" (UID: \"87c132b9-55a3-4365-a875-fcffc61cb2cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4"
Sep 07 17:07:18.531596 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:18.531415    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf25b\" (UniqueName: \"kubernetes.io/projected/87c132b9-55a3-4365-a875-fcffc61cb2cc-kube-api-access-wf25b\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4\" (UID: \"87c132b9-55a3-4365-a875-fcffc61cb2cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4"
Sep 07 17:07:18.531596 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:18.531447    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87c132b9-55a3-4365-a875-fcffc61cb2cc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4\" (UID: \"87c132b9-55a3-4365-a875-fcffc61cb2cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4"
Sep 07 17:07:18.531596 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:18.531475    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87c132b9-55a3-4365-a875-fcffc61cb2cc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4\" (UID: \"87c132b9-55a3-4365-a875-fcffc61cb2cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4"
Sep 07 17:07:18.531753 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:18.531609    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87c132b9-55a3-4365-a875-fcffc61cb2cc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4\" (UID: \"87c132b9-55a3-4365-a875-fcffc61cb2cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4"
Sep 07 17:07:18.531827 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:18.531811    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87c132b9-55a3-4365-a875-fcffc61cb2cc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4\" (UID: \"87c132b9-55a3-4365-a875-fcffc61cb2cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4"
Sep 07 17:07:18.531926 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:18.531881    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87c132b9-55a3-4365-a875-fcffc61cb2cc-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4\" (UID: \"87c132b9-55a3-4365-a875-fcffc61cb2cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4"
Sep 07 17:07:18.531986 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:18.531954    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87c132b9-55a3-4365-a875-fcffc61cb2cc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4\" (UID: \"87c132b9-55a3-4365-a875-fcffc61cb2cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4"
Sep 07 17:07:18.533650 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:18.533633    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87c132b9-55a3-4365-a875-fcffc61cb2cc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4\" (UID: \"87c132b9-55a3-4365-a875-fcffc61cb2cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4"
Sep 07 17:07:18.534141 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:18.534120    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87c132b9-55a3-4365-a875-fcffc61cb2cc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4\" (UID: \"87c132b9-55a3-4365-a875-fcffc61cb2cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4"
Sep 07 17:07:18.540803 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:18.540779    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf25b\" (UniqueName: \"kubernetes.io/projected/87c132b9-55a3-4365-a875-fcffc61cb2cc-kube-api-access-wf25b\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4\" (UID: \"87c132b9-55a3-4365-a875-fcffc61cb2cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4"
Sep 07 17:07:18.613054 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:18.612958    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4"
Sep 07 17:07:18.882920 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:18.882880    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4"]
Sep 07 17:07:18.884718 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:07:18.884688    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87c132b9_55a3_4365_a875_fcffc61cb2cc.slice/crio-c0746a69f0fc75a50a3e0b8213caed2d1aaef0757d4408c521a6b43ab3c3844e WatchSource:0}: Error finding container c0746a69f0fc75a50a3e0b8213caed2d1aaef0757d4408c521a6b43ab3c3844e: Status 404 returned error can't find the container with id c0746a69f0fc75a50a3e0b8213caed2d1aaef0757d4408c521a6b43ab3c3844e
Sep 07 17:07:18.951470 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:18.951431    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4" event={"ID":"87c132b9-55a3-4365-a875-fcffc61cb2cc","Type":"ContainerStarted","Data":"c0746a69f0fc75a50a3e0b8213caed2d1aaef0757d4408c521a6b43ab3c3844e"}
Sep 07 17:07:19.958601 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:19.958562    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4" event={"ID":"87c132b9-55a3-4365-a875-fcffc61cb2cc","Type":"ContainerStarted","Data":"26bca1db2bc0a2dd36870be3bf0dab1a5a83b352b78df501553866dee00730f9"}
Sep 07 17:07:20.757969 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:20.757929    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:07:21.314769 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:21.314731    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:07:28.614143 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:28.614104    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4"
Sep 07 17:07:28.614617 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:28.614222    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4"
Sep 07 17:07:28.626678 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:28.626638    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4"
Sep 07 17:07:28.655459 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:28.655407    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4" podStartSLOduration=10.471798879 podStartE2EDuration="10.655389949s" totalImagesPullingTime="183.59107ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:07:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:07:19.980063163 +0000 UTC m=+633.876910491" watchObservedRunningTime="2026-09-07 17:07:28.655389949 +0000 UTC m=+642.552237297"
Sep 07 17:07:29.016016 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:29.015934    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4"
Sep 07 17:07:38.209625 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:38.209585    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-mln9w"]
Sep 07 17:07:38.215823 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:38.215802    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mln9w"
Sep 07 17:07:38.218690 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:38.218667    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 07 17:07:38.225412 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:38.225388    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-mln9w"]
Sep 07 17:07:38.323795 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:38.323758    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ead-c1c3-4352-8100-1207bdcfb82e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mln9w\" (UID: \"f7c12ead-c1c3-4352-8100-1207bdcfb82e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mln9w"
Sep 07 17:07:38.323795 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:38.323797    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ead-c1c3-4352-8100-1207bdcfb82e-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mln9w\" (UID: \"f7c12ead-c1c3-4352-8100-1207bdcfb82e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mln9w"
Sep 07 17:07:38.324011 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:38.323840    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2dv9\" (UniqueName: \"kubernetes.io/projected/f7c12ead-c1c3-4352-8100-1207bdcfb82e-kube-api-access-n2dv9\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mln9w\" (UID: \"f7c12ead-c1c3-4352-8100-1207bdcfb82e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mln9w"
Sep 07 17:07:38.324011 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:38.323932    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ead-c1c3-4352-8100-1207bdcfb82e-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mln9w\" (UID: \"f7c12ead-c1c3-4352-8100-1207bdcfb82e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mln9w"
Sep 07 17:07:38.324011 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:38.323965    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ead-c1c3-4352-8100-1207bdcfb82e-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mln9w\" (UID: \"f7c12ead-c1c3-4352-8100-1207bdcfb82e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mln9w"
Sep 07 17:07:38.324011 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:38.323986    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7c12ead-c1c3-4352-8100-1207bdcfb82e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mln9w\" (UID: \"f7c12ead-c1c3-4352-8100-1207bdcfb82e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mln9w"
Sep 07 17:07:38.330000 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:38.329951    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:07:38.424536 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:38.424500    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2dv9\" (UniqueName: \"kubernetes.io/projected/f7c12ead-c1c3-4352-8100-1207bdcfb82e-kube-api-access-n2dv9\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mln9w\" (UID: \"f7c12ead-c1c3-4352-8100-1207bdcfb82e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mln9w"
Sep 07 17:07:38.424702 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:38.424566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ead-c1c3-4352-8100-1207bdcfb82e-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mln9w\" (UID: \"f7c12ead-c1c3-4352-8100-1207bdcfb82e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mln9w"
Sep 07 17:07:38.424702 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:38.424599    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ead-c1c3-4352-8100-1207bdcfb82e-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mln9w\" (UID: \"f7c12ead-c1c3-4352-8100-1207bdcfb82e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mln9w"
Sep 07 17:07:38.424702 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:38.424614    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7c12ead-c1c3-4352-8100-1207bdcfb82e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mln9w\" (UID: \"f7c12ead-c1c3-4352-8100-1207bdcfb82e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mln9w"
Sep 07 17:07:38.424702 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:38.424660    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ead-c1c3-4352-8100-1207bdcfb82e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mln9w\" (UID: \"f7c12ead-c1c3-4352-8100-1207bdcfb82e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mln9w"
Sep 07 17:07:38.424881 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:38.424857    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ead-c1c3-4352-8100-1207bdcfb82e-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mln9w\" (UID: \"f7c12ead-c1c3-4352-8100-1207bdcfb82e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mln9w"
Sep 07 17:07:38.425012 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:38.424994    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ead-c1c3-4352-8100-1207bdcfb82e-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mln9w\" (UID: \"f7c12ead-c1c3-4352-8100-1207bdcfb82e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mln9w"
Sep 07 17:07:38.425061 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:38.425042    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ead-c1c3-4352-8100-1207bdcfb82e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mln9w\" (UID: \"f7c12ead-c1c3-4352-8100-1207bdcfb82e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mln9w"
Sep 07 17:07:38.425195 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:38.425175    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ead-c1c3-4352-8100-1207bdcfb82e-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mln9w\" (UID: \"f7c12ead-c1c3-4352-8100-1207bdcfb82e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mln9w"
Sep 07 17:07:38.426955 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:38.426929    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ead-c1c3-4352-8100-1207bdcfb82e-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mln9w\" (UID: \"f7c12ead-c1c3-4352-8100-1207bdcfb82e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mln9w"
Sep 07 17:07:38.427161 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:38.427141    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7c12ead-c1c3-4352-8100-1207bdcfb82e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mln9w\" (UID: \"f7c12ead-c1c3-4352-8100-1207bdcfb82e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mln9w"
Sep 07 17:07:38.433462 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:38.433441    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2dv9\" (UniqueName: \"kubernetes.io/projected/f7c12ead-c1c3-4352-8100-1207bdcfb82e-kube-api-access-n2dv9\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mln9w\" (UID: \"f7c12ead-c1c3-4352-8100-1207bdcfb82e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mln9w"
Sep 07 17:07:38.527043 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:38.526935    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mln9w"
Sep 07 17:07:38.805890 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:38.805860    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-mln9w"]
Sep 07 17:07:38.808228 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:07:38.808202    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7c12ead_c1c3_4352_8100_1207bdcfb82e.slice/crio-128c0fab5fd9364e2fab58a779e72d09cfc7b97a306591678bce424a4bd11f2e WatchSource:0}: Error finding container 128c0fab5fd9364e2fab58a779e72d09cfc7b97a306591678bce424a4bd11f2e: Status 404 returned error can't find the container with id 128c0fab5fd9364e2fab58a779e72d09cfc7b97a306591678bce424a4bd11f2e
Sep 07 17:07:39.053297 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:39.053260    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mln9w" event={"ID":"f7c12ead-c1c3-4352-8100-1207bdcfb82e","Type":"ContainerStarted","Data":"128c0fab5fd9364e2fab58a779e72d09cfc7b97a306591678bce424a4bd11f2e"}
Sep 07 17:07:40.060165 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:40.060128    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mln9w" event={"ID":"f7c12ead-c1c3-4352-8100-1207bdcfb82e","Type":"ContainerStarted","Data":"bddb2171ee178aa211471789ed2cc60ceaa3f5ec7ff8a4718092dd299449518b"}
Sep 07 17:07:40.080954 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:40.080881    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mln9w" podStartSLOduration=1.883293839 podStartE2EDuration="2.080863425s" totalImagesPullingTime="197.569586ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:07:40.079382787 +0000 UTC m=+653.976230102" watchObservedRunningTime="2026-09-07 17:07:40.080863425 +0000 UTC m=+653.977710740"
Sep 07 17:07:48.527657 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:48.527615    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mln9w"
Sep 07 17:07:48.528096 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:48.527762    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mln9w"
Sep 07 17:07:48.540363 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:48.540340    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mln9w"
Sep 07 17:07:49.114550 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:07:49.114517    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mln9w"
Sep 07 17:08:28.369171 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:08:28.369119    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:08:40.210275 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:08:40.210183    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:08:30Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:08:30Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:08:30Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:08:30Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"}]}}\" for node \"ip-10-0-136-3.ec2.internal\": Patch \"https://a180ad2b90363402289452fab9920906-d170e736a64b4892.elb.us-east-1.amazonaws.com:6443/api/v1/nodes/ip-10-0-136-3.ec2.internal/status?timeout=10s\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 07 17:08:41.867253 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:08:41.867154    2575 controller.go:195] "Failed to update lease" err="Put \"https://a180ad2b90363402289452fab9920906-d170e736a64b4892.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-136-3.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 07 17:08:50.210524 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:08:50.210491    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-3.ec2.internal\": Get \"https://a180ad2b90363402289452fab9920906-d170e736a64b4892.elb.us-east-1.amazonaws.com:6443/api/v1/nodes/ip-10-0-136-3.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 07 17:08:51.867610 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:08:51.867561    2575 controller.go:195] "Failed to update lease" err="Put \"https://a180ad2b90363402289452fab9920906-d170e736a64b4892.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-136-3.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 07 17:08:52.618283 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:08:52.618241    2575 webhook.go:269] Failed to make webhook authorizer request: Post "https://a180ad2b90363402289452fab9920906-d170e736a64b4892.elb.us-east-1.amazonaws.com:6443/apis/authorization.k8s.io/v1/subjectaccessreviews": context canceled
Sep 07 17:08:52.618461 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:08:52.618286    2575 server.go:347] "Authorization error" err="Post \"https://a180ad2b90363402289452fab9920906-d170e736a64b4892.elb.us-east-1.amazonaws.com:6443/apis/authorization.k8s.io/v1/subjectaccessreviews\": context canceled" user="system:serviceaccount:openshift-monitoring:metrics-server" verb="get" resource="nodes" subresource="metrics"
Sep 07 17:09:00.210982 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:09:00.210945    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-3.ec2.internal\": Get \"https://a180ad2b90363402289452fab9920906-d170e736a64b4892.elb.us-east-1.amazonaws.com:6443/api/v1/nodes/ip-10-0-136-3.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 07 17:09:01.868792 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:09:01.868741    2575 controller.go:195] "Failed to update lease" err="Put \"https://a180ad2b90363402289452fab9920906-d170e736a64b4892.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-136-3.ec2.internal?timeout=10s\": context deadline exceeded"
Sep 07 17:09:07.616162 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:09:07.616123    2575 webhook.go:269] Failed to make webhook authorizer request: Post "https://a180ad2b90363402289452fab9920906-d170e736a64b4892.elb.us-east-1.amazonaws.com:6443/apis/authorization.k8s.io/v1/subjectaccessreviews": context canceled
Sep 07 17:09:07.616162 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:09:07.616161    2575 server.go:347] "Authorization error" err="Post \"https://a180ad2b90363402289452fab9920906-d170e736a64b4892.elb.us-east-1.amazonaws.com:6443/apis/authorization.k8s.io/v1/subjectaccessreviews\": context canceled" user="system:serviceaccount:openshift-monitoring:metrics-server" verb="get" resource="nodes" subresource="metrics"
Sep 07 17:09:10.211559 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:09:10.211516    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-3.ec2.internal\": Get \"https://a180ad2b90363402289452fab9920906-d170e736a64b4892.elb.us-east-1.amazonaws.com:6443/api/v1/nodes/ip-10-0-136-3.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 07 17:09:11.869979 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:09:11.869941    2575 controller.go:195] "Failed to update lease" err="Put \"https://a180ad2b90363402289452fab9920906-d170e736a64b4892.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-136-3.ec2.internal?timeout=10s\": context deadline exceeded"
Sep 07 17:09:13.998585 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.998545    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8ftzg\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.998585 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.998546    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999062 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.998572    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999062 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.998545    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999062 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.998618    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999062 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.998647    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999062 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.998663    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999062 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.998657    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999062 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.998681    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999062 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.998708    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999062 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.998718    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lcg49\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999062 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.998717    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999062 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.998734    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999062 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.998744    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999062 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.998773    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999062 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.998792    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-nvqdt\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999062 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.998815    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"default-dockercfg-4ntwt\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999062 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.998859    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sm5qw\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999062 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.998878    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999062 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.998927    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-wg9xq\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999798 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.998938    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999798 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.998942    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tw2bp\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999798 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.998946    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999798 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.998968    2575 reflector.go:571] "Warning: watch ended with error" reflector="pkg/kubelet/config/apiserver.go:66" type="*v1.Pod" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999798 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.998972    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7cjcl\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999798 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.998990    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999798 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999022    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999798 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999046    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999798 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999023    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"service-ca\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999798 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999081    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999798 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999086    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999798 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999098    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999798 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999109    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999798 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999136    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999798 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999151    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999798 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999178    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999798 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999179    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999798 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999203    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000696 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999222    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"console-oauth-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000696 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999246    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000696 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999270    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-svt29\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000696 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999286    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000696 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999286    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000696 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999311    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000696 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999325    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000696 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999328    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000696 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999352    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000696 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999370    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000696 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999376    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6jtzt\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000696 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999389    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000696 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999394    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ltmns\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000696 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999408    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000696 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999415    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000696 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999510    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000696 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999522    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000696 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:09:13.999506    2575 controller.go:195] "Failed to update lease" err="Put \"https://a180ad2b90363402289452fab9920906-d170e736a64b4892.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-136-3.ec2.internal?timeout=10s\": http2: client connection lost"
Sep 07 17:09:14.001340 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999536    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dxvzh\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001340 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999568    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7qmw6\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001340 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999573    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001340 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999607    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-dockercfg-96tzd\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001340 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999669    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001340 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999694    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001340 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999705    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001340 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999695    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-lt4g7\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001340 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999667    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-2xpcn\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001340 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999709    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-server-7gs240rjk02ii\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001340 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999745    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001340 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999748    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-7lqvb\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001340 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999772    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001340 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999792    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001340 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999790    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-clssw\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001340 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999822    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001340 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999825    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001340 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999836    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001934 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999836    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001934 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999849    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001934 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999857    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001934 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999862    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001934 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999868    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-7zcl2\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001934 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999860    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001934 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999879    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001934 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999845    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001934 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999885    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001934 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999873    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001934 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999942    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001934 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999918    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g7mrx\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001934 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999933    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ghqrn\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001934 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999940    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001934 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999941    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001934 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999850    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001934 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999950    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"original-pull-secret\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001934 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999980    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002489 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999961    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002489 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999980    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002489 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:13.999951    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002489 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000003    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002489 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000015    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002489 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000019    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002489 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000041    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"console-dockercfg-pzx8d\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002489 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000045    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002489 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000045    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002489 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000054    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002489 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000041    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002489 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000079    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002489 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000078    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4bs88\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002489 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000077    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002489 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000076    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bvnj8\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002489 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000088    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-42mzl\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002489 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000092    2575 controller.go:115] "failed to update lease using latest lease, fallback to ensure lease" err="failed 5 attempts to update lease"
Sep 07 17:09:14.002489 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000109    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002489 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000120    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lxz8c\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003069 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000124    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003069 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000141    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003069 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000151    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003069 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000163    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003069 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000178    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003069 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000177    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003069 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000197    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003069 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000208    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003069 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000211    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003069 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000223    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003069 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000235    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"console-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003069 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000240    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003069 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000251    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003069 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000257    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003069 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000256    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003069 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000273    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003069 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000272    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003069 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000296    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"default-dockercfg-hg6cj\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003601 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000296    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003601 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000310    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003601 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000319    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003601 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000310    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-n5bmt\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003601 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000328    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-82466\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003601 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000312    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003601 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000299    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003601 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000346    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003601 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000327    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003601 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000363    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003601 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000338    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003601 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000371    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003601 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000346    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-hbw6m\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003601 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000382    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003601 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000385    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bd0vjbgt9lqcl\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003601 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000364    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-chwrh\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003601 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000346    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-32brq9q7rfhhe\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003601 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000395    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.004159 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000351    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-agent\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.004159 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000298    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"console-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.004159 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000416    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.004159 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000423    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mgs26\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.004159 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000438    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.004159 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000441    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"default-dockercfg-cfxjz\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.004159 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000448    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kv5rt\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.004159 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000455    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.004159 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000384    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.004159 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000467    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.004159 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000472    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.004159 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000402    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.004159 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000385    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-69dkk\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.004159 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000413    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.004159 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000368    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.004159 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000426    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-default\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.004159 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000466    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"default-dockercfg-v5fk9\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.004159 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000441    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.004744 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000398    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.004744 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000473    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.004744 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.000513    2575 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.817761 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.817730    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 07 17:09:14.818933 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.818910    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 07 17:09:14.819023 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.818928    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 07 17:09:14.819023 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.818988    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 07 17:09:14.824862 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.824844    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 07 17:09:14.831390 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.831370    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 07 17:09:14.837410 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.837394    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 07 17:09:14.837786 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.837768    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 17:09:14.846745 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.846718    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 07 17:09:14.849119 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.849101    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 07 17:09:14.857369 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.857350    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 07 17:09:14.860077 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.860062    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ltmns\""
Sep 07 17:09:14.871672 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.871657    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 07 17:09:14.875375 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.875358    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 07 17:09:14.879741 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.879716    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 07 17:09:14.886881 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.886864    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 07 17:09:14.886978 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.886963    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 07 17:09:14.887542 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.887529    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-69dkk\""
Sep 07 17:09:14.891188 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.891173    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 07 17:09:14.912549 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.912531    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 07 17:09:14.922150 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.922130    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 07 17:09:14.924124 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.924108    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 07 17:09:14.935125 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.935109    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 07 17:09:14.946314 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.946288    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 07 17:09:14.949429 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.949411    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 07 17:09:14.958836 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.958817    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7gs240rjk02ii\""
Sep 07 17:09:14.962016 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.962000    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 07 17:09:14.974163 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.974147    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dxvzh\""
Sep 07 17:09:14.976155 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.976141    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-7zcl2\""
Sep 07 17:09:14.983354 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.983338    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 07 17:09:14.993906 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.993883    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 07 17:09:14.997914 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:14.997886    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 07 17:09:15.002189 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.002175    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 07 17:09:15.005310 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.005294    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 07 17:09:15.024901 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.024881    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 07 17:09:15.029754 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.029737    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 07 17:09:15.029823 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.029798    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 07 17:09:15.030186 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.030172    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 07 17:09:15.034163 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.034148    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 07 17:09:15.036182 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.036167    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bd0vjbgt9lqcl\""
Sep 07 17:09:15.042447 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.042432    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 07 17:09:15.045824 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.045809    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 07 17:09:15.049042 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.049028    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kv5rt\""
Sep 07 17:09:15.049801 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.049788    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 07 17:09:15.062468 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.062450    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 07 17:09:15.062535 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.062449    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ghqrn\""
Sep 07 17:09:15.071880 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.071821    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-82466\""
Sep 07 17:09:15.072078 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.072062    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 07 17:09:15.073096 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.073083    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 07 17:09:15.075711 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.075696    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 07 17:09:15.078375 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.078359    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 17:09:15.081292 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.081270    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 07 17:09:15.088928 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.088910    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 17:09:15.099486 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.099466    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 07 17:09:15.103044 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.103022    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-v5fk9\""
Sep 07 17:09:15.114647 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.114628    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 07 17:09:15.114941 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.114924    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-svt29\""
Sep 07 17:09:15.116507 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.116490    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mgs26\""
Sep 07 17:09:15.121576 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.121560    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-hg6cj\""
Sep 07 17:09:15.121641 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.121587    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 07 17:09:15.125674 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.125658    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.126996 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.126982    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-7lqvb\""
Sep 07 17:09:15.127702 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.127686    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 07 17:09:15.131120 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.131103    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.135067 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.135054    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.140478 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.140461    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.142571 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.142556    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 07 17:09:15.142837 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.142823    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.148391 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.148376    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 17:09:15.150569 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.150555    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 07 17:09:15.165418 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.165401    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.167980 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.167968    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 07 17:09:15.169587 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.169573    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 07 17:09:15.174384 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.174369    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4ntwt\""
Sep 07 17:09:15.176175 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.176161    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 07 17:09:15.182268 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.182249    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 07 17:09:15.188523 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.188509    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.192565 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.192551    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-2xpcn\""
Sep 07 17:09:15.192617 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.192570    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 07 17:09:15.194364 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.194351    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 07 17:09:15.197584 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.197568    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 07 17:09:15.201821 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.201802    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 07 17:09:15.206916 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.206887    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 07 17:09:15.208348 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.208335    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 07 17:09:15.209382 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.209367    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sm5qw\""
Sep 07 17:09:15.223568 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.223549    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 07 17:09:15.235905 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.235874    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 07 17:09:15.236977 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.236964    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8ftzg\""
Sep 07 17:09:15.242183 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.242168    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-96tzd\""
Sep 07 17:09:15.245352 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.245336    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 07 17:09:15.245437 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.245407    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 07 17:09:15.258203 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.258183    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g7mrx\""
Sep 07 17:09:15.258285 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.258220    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 07 17:09:15.266695 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.266654    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 07 17:09:15.268468 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.268453    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-n5bmt\""
Sep 07 17:09:15.271796 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.271783    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7cjcl\""
Sep 07 17:09:15.272406 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.272388    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 07 17:09:15.275415 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.275400    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 07 17:09:15.280320 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.280297    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 07 17:09:15.280421 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.280346    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-lt4g7\""
Sep 07 17:09:15.280421 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.280363    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 07 17:09:15.280841 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.280827    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-42mzl\""
Sep 07 17:09:15.286755 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.286738    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 07 17:09:15.294924 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.294906    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 07 17:09:15.295738 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.295722    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-nvqdt\""
Sep 07 17:09:15.301399 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.301381    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 07 17:09:15.305160 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.305144    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-hbw6m\""
Sep 07 17:09:15.316551 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.316529    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pzx8d\""
Sep 07 17:09:15.340614 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.340561    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 07 17:09:15.341709 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.341694    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 07 17:09:15.347206 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.347192    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tw2bp\""
Sep 07 17:09:15.347459 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.347439    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.347534 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.347442    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.347976 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.347961    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 07 17:09:15.348039 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.347990    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-32brq9q7rfhhe\""
Sep 07 17:09:15.348380 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.348366    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 07 17:09:15.355127 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.355108    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 07 17:09:15.357524 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.357509    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 07 17:09:15.359228 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.359213    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-wg9xq\""
Sep 07 17:09:15.377303 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.377281    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 07 17:09:15.379014 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.379000    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6jtzt\""
Sep 07 17:09:15.379597 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.379584    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 07 17:09:15.388925 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.388887    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 07 17:09:15.397006 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.396986    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 07 17:09:15.397999 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.397985    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 07 17:09:15.401814 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.401799    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 07 17:09:15.406802 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.406786    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 07 17:09:15.408973 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.408958    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 07 17:09:15.409512 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.409499    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.414874 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.414857    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 07 17:09:15.438184 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.438160    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 07 17:09:15.456007 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.455981    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-clssw\""
Sep 07 17:09:15.476635 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.476610    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 07 17:09:15.495248 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.495225    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 07 17:09:15.515815 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.515792    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 07 17:09:15.535270 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.535249    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 07 17:09:15.556012 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.555994    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.575929 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.575890    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 07 17:09:15.595054 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.595001    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 07 17:09:15.616263 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.616243    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 07 17:09:15.636673 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.636655    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-chwrh\""
Sep 07 17:09:15.655650 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.655626    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 07 17:09:15.675758 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.675737    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 07 17:09:15.695836 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.695815    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 07 17:09:15.729391 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.729367    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 07 17:09:15.735520 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.735502    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.755134 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.755113    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bvnj8\""
Sep 07 17:09:15.775802 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.775782    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lcg49\""
Sep 07 17:09:15.795644 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.795618    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 07 17:09:15.815811 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.815790    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 07 17:09:15.835332 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.835313    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 07 17:09:15.855867 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.855805    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cfxjz\""
Sep 07 17:09:15.882550 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.882527    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 07 17:09:15.895288 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.895266    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 07 17:09:15.915841 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.915819    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7qmw6\""
Sep 07 17:09:15.935864 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.935840    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 07 17:09:15.961975 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.961949    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 07 17:09:15.975351 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.975327    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 07 17:09:15.995632 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:15.995605    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 07 17:09:16.015071 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:16.015052    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 07 17:09:16.036467 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:16.036446    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 07 17:09:16.055973 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:16.055953    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 07 17:09:16.076004 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:16.075984    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lxz8c\""
Sep 07 17:09:16.095215 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:16.095192    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4bs88\""
Sep 07 17:09:16.116145 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:16.116090    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 07 17:09:16.135888 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:16.135864    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 07 17:09:30.459949 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:30.459886    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5bd97cb566-gztpb"]
Sep 07 17:09:30.460354 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:30.460160    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5bd97cb566-gztpb" podUID="aaf03069-18ef-40e9-bef6-56afe1a51d66" containerName="authorino" containerID="cri-o://30e9a9d2b509ccf26439bfa181ec8817e98e702e9de3b8880962eac6a7b996a1" gracePeriod=30
Sep 07 17:09:30.610374 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:30.610342    2575 generic.go:356] "Generic (PLEG): container finished" podID="aaf03069-18ef-40e9-bef6-56afe1a51d66" containerID="30e9a9d2b509ccf26439bfa181ec8817e98e702e9de3b8880962eac6a7b996a1" exitCode=0
Sep 07 17:09:30.610547 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:30.610409    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bd97cb566-gztpb" event={"ID":"aaf03069-18ef-40e9-bef6-56afe1a51d66","Type":"ContainerDied","Data":"30e9a9d2b509ccf26439bfa181ec8817e98e702e9de3b8880962eac6a7b996a1"}
Sep 07 17:09:30.719054 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:30.718989    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bd97cb566-gztpb"
Sep 07 17:09:30.866401 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:30.866366    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aaf03069-18ef-40e9-bef6-56afe1a51d66-tls-cert\") pod \"aaf03069-18ef-40e9-bef6-56afe1a51d66\" (UID: \"aaf03069-18ef-40e9-bef6-56afe1a51d66\") "
Sep 07 17:09:30.866575 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:30.866464    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6lpr\" (UniqueName: \"kubernetes.io/projected/aaf03069-18ef-40e9-bef6-56afe1a51d66-kube-api-access-d6lpr\") pod \"aaf03069-18ef-40e9-bef6-56afe1a51d66\" (UID: \"aaf03069-18ef-40e9-bef6-56afe1a51d66\") "
Sep 07 17:09:30.868433 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:30.868395    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaf03069-18ef-40e9-bef6-56afe1a51d66-kube-api-access-d6lpr" (OuterVolumeSpecName: "kube-api-access-d6lpr") pod "aaf03069-18ef-40e9-bef6-56afe1a51d66" (UID: "aaf03069-18ef-40e9-bef6-56afe1a51d66"). InnerVolumeSpecName "kube-api-access-d6lpr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:09:30.876986 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:30.876958    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaf03069-18ef-40e9-bef6-56afe1a51d66-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "aaf03069-18ef-40e9-bef6-56afe1a51d66" (UID: "aaf03069-18ef-40e9-bef6-56afe1a51d66"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:09:30.968083 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:30.968055    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6lpr\" (UniqueName: \"kubernetes.io/projected/aaf03069-18ef-40e9-bef6-56afe1a51d66-kube-api-access-d6lpr\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:09:30.968083 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:30.968080    2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aaf03069-18ef-40e9-bef6-56afe1a51d66-tls-cert\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:09:31.020930 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:31.020815    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:09:31.152575 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:31.152525    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:09:31.616710 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:31.616680    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bd97cb566-gztpb"
Sep 07 17:09:31.617142 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:31.616728    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bd97cb566-gztpb" event={"ID":"aaf03069-18ef-40e9-bef6-56afe1a51d66","Type":"ContainerDied","Data":"368700269c2db6e277b6e7d5f2319dd17d1bc5fbed68ad0335e2c172ff2cd8db"}
Sep 07 17:09:31.617142 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:31.616776    2575 scope.go:117] "RemoveContainer" containerID="30e9a9d2b509ccf26439bfa181ec8817e98e702e9de3b8880962eac6a7b996a1"
Sep 07 17:09:31.646692 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:31.643564    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5bd97cb566-gztpb"]
Sep 07 17:09:31.650794 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:31.650767    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5bd97cb566-gztpb"]
Sep 07 17:09:32.203023 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:32.202984    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:09:32.332755 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:32.332719    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:09:32.721616 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:32.721585    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aaf03069-18ef-40e9-bef6-56afe1a51d66" path="/var/lib/kubelet/pods/aaf03069-18ef-40e9-bef6-56afe1a51d66/volumes"
Sep 07 17:09:47.973735 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:47.973703    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:09:48.126197 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:48.126161    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:09:48.294514 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:48.294485    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:09:48.567977 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:48.567879    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:09:49.275537 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:49.275499    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:09:49.423299 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:49.423255    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:09:49.669712 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:49.669673    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7736-139839288110768"]
Sep 07 17:09:49.670099 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:49.670087    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaf03069-18ef-40e9-bef6-56afe1a51d66" containerName="authorino"
Sep 07 17:09:49.670150 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:49.670101    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaf03069-18ef-40e9-bef6-56afe1a51d66" containerName="authorino"
Sep 07 17:09:49.670186 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:49.670157    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaf03069-18ef-40e9-bef6-56afe1a51d66" containerName="authorino"
Sep 07 17:09:49.674373 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:49.674352    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7736-139839288110768"
Sep 07 17:09:49.677220 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:49.677198    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zsccf\""
Sep 07 17:09:49.680294 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:49.680269    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7736-139839288110768"]
Sep 07 17:09:49.697605 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:49.697572    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:09:49.755346 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:49.755315    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xl24\" (UniqueName: \"kubernetes.io/projected/78c6d9b5-0fc5-46fb-b724-e294e0d9f70f-kube-api-access-8xl24\") pod \"test-curl-7736-139839288110768\" (UID: \"78c6d9b5-0fc5-46fb-b724-e294e0d9f70f\") " pod="opendatahub/test-curl-7736-139839288110768"
Sep 07 17:09:49.856398 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:49.856364    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xl24\" (UniqueName: \"kubernetes.io/projected/78c6d9b5-0fc5-46fb-b724-e294e0d9f70f-kube-api-access-8xl24\") pod \"test-curl-7736-139839288110768\" (UID: \"78c6d9b5-0fc5-46fb-b724-e294e0d9f70f\") " pod="opendatahub/test-curl-7736-139839288110768"
Sep 07 17:09:49.865248 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:49.865221    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xl24\" (UniqueName: \"kubernetes.io/projected/78c6d9b5-0fc5-46fb-b724-e294e0d9f70f-kube-api-access-8xl24\") pod \"test-curl-7736-139839288110768\" (UID: \"78c6d9b5-0fc5-46fb-b724-e294e0d9f70f\") " pod="opendatahub/test-curl-7736-139839288110768"
Sep 07 17:09:49.986402 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:49.986314    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7736-139839288110768"
Sep 07 17:09:50.259376 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:50.259351    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7736-139839288110768"]
Sep 07 17:09:50.261424 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:09:50.261393    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod78c6d9b5_0fc5_46fb_b724_e294e0d9f70f.slice/crio-656077d164512d1fad9a6e896d9756968d10bd6ebd5288b8b06fc1403f2354f0 WatchSource:0}: Error finding container 656077d164512d1fad9a6e896d9756968d10bd6ebd5288b8b06fc1403f2354f0: Status 404 returned error can't find the container with id 656077d164512d1fad9a6e896d9756968d10bd6ebd5288b8b06fc1403f2354f0
Sep 07 17:09:50.723177 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:50.723139    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7736-139839288110768" event={"ID":"78c6d9b5-0fc5-46fb-b724-e294e0d9f70f","Type":"ContainerStarted","Data":"656077d164512d1fad9a6e896d9756968d10bd6ebd5288b8b06fc1403f2354f0"}
Sep 07 17:09:51.241225 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:51.241191    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:09:52.733096 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:52.733058    2575 generic.go:356] "Generic (PLEG): container finished" podID="78c6d9b5-0fc5-46fb-b724-e294e0d9f70f" containerID="1a13e4eff4323e8c9d120bfa183a5702dd45cdf3f9cf0f837f527cda8abe0511" exitCode=0
Sep 07 17:09:52.733538 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:52.733115    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7736-139839288110768" event={"ID":"78c6d9b5-0fc5-46fb-b724-e294e0d9f70f","Type":"ContainerDied","Data":"1a13e4eff4323e8c9d120bfa183a5702dd45cdf3f9cf0f837f527cda8abe0511"}
Sep 07 17:09:53.871611 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:53.871581    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7736-139839288110768"
Sep 07 17:09:53.891697 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:53.891654    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7736-139839288110768_78c6d9b5-0fc5-46fb-b724-e294e0d9f70f/test-curl-7736-139839288110768/0.log"
Sep 07 17:09:53.916720 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:53.916690    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7736-139839288110768"]
Sep 07 17:09:53.920334 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:53.920305    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7736-139839288110768"]
Sep 07 17:09:53.997712 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:53.997631    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xl24\" (UniqueName: \"kubernetes.io/projected/78c6d9b5-0fc5-46fb-b724-e294e0d9f70f-kube-api-access-8xl24\") pod \"78c6d9b5-0fc5-46fb-b724-e294e0d9f70f\" (UID: \"78c6d9b5-0fc5-46fb-b724-e294e0d9f70f\") "
Sep 07 17:09:53.999644 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:53.999616    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78c6d9b5-0fc5-46fb-b724-e294e0d9f70f-kube-api-access-8xl24" (OuterVolumeSpecName: "kube-api-access-8xl24") pod "78c6d9b5-0fc5-46fb-b724-e294e0d9f70f" (UID: "78c6d9b5-0fc5-46fb-b724-e294e0d9f70f"). InnerVolumeSpecName "kube-api-access-8xl24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:09:54.037252 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:54.037216    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7736-139839288110768"]
Sep 07 17:09:54.037620 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:54.037607    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78c6d9b5-0fc5-46fb-b724-e294e0d9f70f" containerName="test-curl-7736-139839288110768"
Sep 07 17:09:54.037672 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:54.037622    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="78c6d9b5-0fc5-46fb-b724-e294e0d9f70f" containerName="test-curl-7736-139839288110768"
Sep 07 17:09:54.037715 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:54.037697    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="78c6d9b5-0fc5-46fb-b724-e294e0d9f70f" containerName="test-curl-7736-139839288110768"
Sep 07 17:09:54.040781 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:54.040765    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7736-139839288110768"
Sep 07 17:09:54.048985 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:54.048959    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7736-139839288110768"]
Sep 07 17:09:54.098485 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:54.098454    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr6cs\" (UniqueName: \"kubernetes.io/projected/b521f97d-e27f-4fe8-9ad8-563d85c0b823-kube-api-access-zr6cs\") pod \"test-curl-7736-139839288110768\" (UID: \"b521f97d-e27f-4fe8-9ad8-563d85c0b823\") " pod="opendatahub/test-curl-7736-139839288110768"
Sep 07 17:09:54.098659 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:54.098567    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xl24\" (UniqueName: \"kubernetes.io/projected/78c6d9b5-0fc5-46fb-b724-e294e0d9f70f-kube-api-access-8xl24\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:09:54.199719 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:54.199684    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr6cs\" (UniqueName: \"kubernetes.io/projected/b521f97d-e27f-4fe8-9ad8-563d85c0b823-kube-api-access-zr6cs\") pod \"test-curl-7736-139839288110768\" (UID: \"b521f97d-e27f-4fe8-9ad8-563d85c0b823\") " pod="opendatahub/test-curl-7736-139839288110768"
Sep 07 17:09:54.208362 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:54.208330    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr6cs\" (UniqueName: \"kubernetes.io/projected/b521f97d-e27f-4fe8-9ad8-563d85c0b823-kube-api-access-zr6cs\") pod \"test-curl-7736-139839288110768\" (UID: \"b521f97d-e27f-4fe8-9ad8-563d85c0b823\") " pod="opendatahub/test-curl-7736-139839288110768"
Sep 07 17:09:54.351123 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:54.351091    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7736-139839288110768"
Sep 07 17:09:54.637317 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:54.637288    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7736-139839288110768"]
Sep 07 17:09:54.638324 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:09:54.638293    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb521f97d_e27f_4fe8_9ad8_563d85c0b823.slice/crio-eec7355ab6b3d085f1595310d28f7dfc54e8715729c7d899bdd72a7b2d565bbe WatchSource:0}: Error finding container eec7355ab6b3d085f1595310d28f7dfc54e8715729c7d899bdd72a7b2d565bbe: Status 404 returned error can't find the container with id eec7355ab6b3d085f1595310d28f7dfc54e8715729c7d899bdd72a7b2d565bbe
Sep 07 17:09:54.722564 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:54.722533    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78c6d9b5-0fc5-46fb-b724-e294e0d9f70f" path="/var/lib/kubelet/pods/78c6d9b5-0fc5-46fb-b724-e294e0d9f70f/volumes"
Sep 07 17:09:54.744148 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:54.744118    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7736-139839288110768" event={"ID":"b521f97d-e27f-4fe8-9ad8-563d85c0b823","Type":"ContainerStarted","Data":"eec7355ab6b3d085f1595310d28f7dfc54e8715729c7d899bdd72a7b2d565bbe"}
Sep 07 17:09:54.745212 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:54.745194    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7736-139839288110768"
Sep 07 17:09:54.745212 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:54.745209    2575 scope.go:117] "RemoveContainer" containerID="1a13e4eff4323e8c9d120bfa183a5702dd45cdf3f9cf0f837f527cda8abe0511"
Sep 07 17:09:55.753117 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:55.753035    2575 generic.go:356] "Generic (PLEG): container finished" podID="b521f97d-e27f-4fe8-9ad8-563d85c0b823" containerID="a2579f144720668697c6b0691b60876cd8a4be2e031f06f49727b7bd8c8c0c0b" exitCode=0
Sep 07 17:09:55.753117 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:55.753100    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7736-139839288110768" event={"ID":"b521f97d-e27f-4fe8-9ad8-563d85c0b823","Type":"ContainerDied","Data":"a2579f144720668697c6b0691b60876cd8a4be2e031f06f49727b7bd8c8c0c0b"}
Sep 07 17:09:55.997316 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:55.997281    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:09:56.098451 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:56.098405    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:09:56.217781 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:56.217743    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:09:56.514333 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:56.514256    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:09:56.626688 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:56.626651    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:09:56.726787 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:56.726752    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:09:56.829821 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:56.829788    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:09:56.891090 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:56.891068    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7736-139839288110768"
Sep 07 17:09:56.917278 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:56.917244    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7736-139839288110768_b521f97d-e27f-4fe8-9ad8-563d85c0b823/test-curl-7736-139839288110768/0.log"
Sep 07 17:09:56.946278 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:56.946246    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7736-139839288110768"]
Sep 07 17:09:56.952721 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:56.952696    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7736-139839288110768"]
Sep 07 17:09:57.028865 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:57.028833    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zr6cs\" (UniqueName: \"kubernetes.io/projected/b521f97d-e27f-4fe8-9ad8-563d85c0b823-kube-api-access-zr6cs\") pod \"b521f97d-e27f-4fe8-9ad8-563d85c0b823\" (UID: \"b521f97d-e27f-4fe8-9ad8-563d85c0b823\") "
Sep 07 17:09:57.030921 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:57.030888    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b521f97d-e27f-4fe8-9ad8-563d85c0b823-kube-api-access-zr6cs" (OuterVolumeSpecName: "kube-api-access-zr6cs") pod "b521f97d-e27f-4fe8-9ad8-563d85c0b823" (UID: "b521f97d-e27f-4fe8-9ad8-563d85c0b823"). InnerVolumeSpecName "kube-api-access-zr6cs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:09:57.130577 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:57.130487    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zr6cs\" (UniqueName: \"kubernetes.io/projected/b521f97d-e27f-4fe8-9ad8-563d85c0b823-kube-api-access-zr6cs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:09:57.473237 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:57.473122    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:09:57.764761 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:57.764672    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7736-139839288110768"
Sep 07 17:09:57.764922 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:57.764679    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eec7355ab6b3d085f1595310d28f7dfc54e8715729c7d899bdd72a7b2d565bbe"
Sep 07 17:09:57.777427 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:09:57.777395    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7736-139839288110768\" is forbidden: User \"system:node:ip-10-0-136-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-3.ec2.internal' and this object" podUID="b521f97d-e27f-4fe8-9ad8-563d85c0b823" pod="opendatahub/test-curl-7736-139839288110768"
Sep 07 17:09:57.800382 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:57.800347    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5"]
Sep 07 17:09:57.800817 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:57.800800    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b521f97d-e27f-4fe8-9ad8-563d85c0b823" containerName="test-curl-7736-139839288110768"
Sep 07 17:09:57.800926 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:57.800821    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b521f97d-e27f-4fe8-9ad8-563d85c0b823" containerName="test-curl-7736-139839288110768"
Sep 07 17:09:57.800998 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:57.800927    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b521f97d-e27f-4fe8-9ad8-563d85c0b823" containerName="test-curl-7736-139839288110768"
Sep 07 17:09:57.804236 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:57.804218    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5"
Sep 07 17:09:57.808248 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:09:57.808215    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7736-139839288110768\" is forbidden: User \"system:node:ip-10-0-136-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-3.ec2.internal' and this object" podUID="b521f97d-e27f-4fe8-9ad8-563d85c0b823" pod="opendatahub/test-curl-7736-139839288110768"
Sep 07 17:09:57.808346 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:57.808287    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 07 17:09:57.808595 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:57.808583    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 07 17:09:57.809246 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:57.809230    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-9fa102-serving-cert\""
Sep 07 17:09:57.809305 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:57.809244    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rggbk\""
Sep 07 17:09:57.809305 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:57.809282    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 17:09:57.839133 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:57.839101    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5"]
Sep 07 17:09:57.908191 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:57.908157    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:09:57.938863 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:57.938828    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txlqh\" (UniqueName: \"kubernetes.io/projected/b28b6087-9a39-485d-821b-1c376a1c62ad-kube-api-access-txlqh\") pod \"maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5\" (UID: \"b28b6087-9a39-485d-821b-1c376a1c62ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5"
Sep 07 17:09:57.939021 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:57.938867    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b28b6087-9a39-485d-821b-1c376a1c62ad-metrics-certs\") pod \"maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5\" (UID: \"b28b6087-9a39-485d-821b-1c376a1c62ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5"
Sep 07 17:09:57.939021 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:57.938955    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b28b6087-9a39-485d-821b-1c376a1c62ad-openshift-service-ca\") pod \"maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5\" (UID: \"b28b6087-9a39-485d-821b-1c376a1c62ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5"
Sep 07 17:09:57.939113 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:57.939036    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b28b6087-9a39-485d-821b-1c376a1c62ad-maas-api-tls\") pod \"maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5\" (UID: \"b28b6087-9a39-485d-821b-1c376a1c62ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5"
Sep 07 17:09:57.997675 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:57.997643    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:09:58.040438 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.040356    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b28b6087-9a39-485d-821b-1c376a1c62ad-maas-api-tls\") pod \"maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5\" (UID: \"b28b6087-9a39-485d-821b-1c376a1c62ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5"
Sep 07 17:09:58.040438 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.040421    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txlqh\" (UniqueName: \"kubernetes.io/projected/b28b6087-9a39-485d-821b-1c376a1c62ad-kube-api-access-txlqh\") pod \"maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5\" (UID: \"b28b6087-9a39-485d-821b-1c376a1c62ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5"
Sep 07 17:09:58.040622 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.040448    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b28b6087-9a39-485d-821b-1c376a1c62ad-metrics-certs\") pod \"maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5\" (UID: \"b28b6087-9a39-485d-821b-1c376a1c62ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5"
Sep 07 17:09:58.040622 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.040491    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b28b6087-9a39-485d-821b-1c376a1c62ad-openshift-service-ca\") pod \"maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5\" (UID: \"b28b6087-9a39-485d-821b-1c376a1c62ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5"
Sep 07 17:09:58.041219 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.041192    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b28b6087-9a39-485d-821b-1c376a1c62ad-openshift-service-ca\") pod \"maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5\" (UID: \"b28b6087-9a39-485d-821b-1c376a1c62ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5"
Sep 07 17:09:58.042854 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.042832    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b28b6087-9a39-485d-821b-1c376a1c62ad-maas-api-tls\") pod \"maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5\" (UID: \"b28b6087-9a39-485d-821b-1c376a1c62ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5"
Sep 07 17:09:58.042978 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.042863    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b28b6087-9a39-485d-821b-1c376a1c62ad-metrics-certs\") pod \"maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5\" (UID: \"b28b6087-9a39-485d-821b-1c376a1c62ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5"
Sep 07 17:09:58.048936 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.048916    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txlqh\" (UniqueName: \"kubernetes.io/projected/b28b6087-9a39-485d-821b-1c376a1c62ad-kube-api-access-txlqh\") pod \"maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5\" (UID: \"b28b6087-9a39-485d-821b-1c376a1c62ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5"
Sep 07 17:09:58.096796 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.096759    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:09:58.114140 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.114112    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5"
Sep 07 17:09:58.200785 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.200747    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:09:58.393135 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.393009    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5"]
Sep 07 17:09:58.566431 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.566392    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:09:58.668679 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.668594    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:09:58.706744 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.706711    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb"]
Sep 07 17:09:58.711445 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.711424    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb"
Sep 07 17:09:58.714028 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.714005    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-9fa102\""
Sep 07 17:09:58.714167 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.714015    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-9fa102-dockercfg-v97mf\""
Sep 07 17:09:58.723149 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.723127    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b521f97d-e27f-4fe8-9ad8-563d85c0b823" path="/var/lib/kubelet/pods/b521f97d-e27f-4fe8-9ad8-563d85c0b823/volumes"
Sep 07 17:09:58.728618 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.728591    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb"]
Sep 07 17:09:58.742514 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:09:58.742476    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7736-139839288110768\" is forbidden: User \"system:node:ip-10-0-136-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-3.ec2.internal' and this object" podUID="b521f97d-e27f-4fe8-9ad8-563d85c0b823" pod="opendatahub/test-curl-7736-139839288110768"
Sep 07 17:09:58.767198 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.767168    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4"]
Sep 07 17:09:58.771396 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.771377    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4"
Sep 07 17:09:58.771577 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.771553    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5" event={"ID":"b28b6087-9a39-485d-821b-1c376a1c62ad","Type":"ContainerStarted","Data":"44488517e37f1f5be43308d2899d51db020f7cc562a3e2023d2db584632dd6d7"}
Sep 07 17:09:58.782525 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.782501    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4"]
Sep 07 17:09:58.848830 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.848792    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkjkx\" (UniqueName: \"kubernetes.io/projected/0d2107d2-77f7-488d-9bd8-af52400ed4a2-kube-api-access-fkjkx\") pod \"payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4\" (UID: \"0d2107d2-77f7-488d-9bd8-af52400ed4a2\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4"
Sep 07 17:09:58.848830 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.848831    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7z29\" (UniqueName: \"kubernetes.io/projected/18715797-afa1-44c3-8688-4112d809e7b0-kube-api-access-d7z29\") pod \"payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb\" (UID: \"18715797-afa1-44c3-8688-4112d809e7b0\") " pod="openshift-ingress/payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb"
Sep 07 17:09:58.849258 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.848949    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/18715797-afa1-44c3-8688-4112d809e7b0-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb\" (UID: \"18715797-afa1-44c3-8688-4112d809e7b0\") " pod="openshift-ingress/payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb"
Sep 07 17:09:58.849258 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.848970    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d2107d2-77f7-488d-9bd8-af52400ed4a2-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4\" (UID: \"0d2107d2-77f7-488d-9bd8-af52400ed4a2\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4"
Sep 07 17:09:58.950559 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.950460    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/18715797-afa1-44c3-8688-4112d809e7b0-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb\" (UID: \"18715797-afa1-44c3-8688-4112d809e7b0\") " pod="openshift-ingress/payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb"
Sep 07 17:09:58.950559 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.950512    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d2107d2-77f7-488d-9bd8-af52400ed4a2-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4\" (UID: \"0d2107d2-77f7-488d-9bd8-af52400ed4a2\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4"
Sep 07 17:09:58.950744 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.950598    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkjkx\" (UniqueName: \"kubernetes.io/projected/0d2107d2-77f7-488d-9bd8-af52400ed4a2-kube-api-access-fkjkx\") pod \"payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4\" (UID: \"0d2107d2-77f7-488d-9bd8-af52400ed4a2\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4"
Sep 07 17:09:58.950744 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.950622    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7z29\" (UniqueName: \"kubernetes.io/projected/18715797-afa1-44c3-8688-4112d809e7b0-kube-api-access-d7z29\") pod \"payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb\" (UID: \"18715797-afa1-44c3-8688-4112d809e7b0\") " pod="openshift-ingress/payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb"
Sep 07 17:09:58.951445 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.951420    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d2107d2-77f7-488d-9bd8-af52400ed4a2-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4\" (UID: \"0d2107d2-77f7-488d-9bd8-af52400ed4a2\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4"
Sep 07 17:09:58.951499 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.951428    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/18715797-afa1-44c3-8688-4112d809e7b0-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb\" (UID: \"18715797-afa1-44c3-8688-4112d809e7b0\") " pod="openshift-ingress/payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb"
Sep 07 17:09:58.959735 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.959704    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkjkx\" (UniqueName: \"kubernetes.io/projected/0d2107d2-77f7-488d-9bd8-af52400ed4a2-kube-api-access-fkjkx\") pod \"payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4\" (UID: \"0d2107d2-77f7-488d-9bd8-af52400ed4a2\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4"
Sep 07 17:09:58.959735 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:58.959721    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7z29\" (UniqueName: \"kubernetes.io/projected/18715797-afa1-44c3-8688-4112d809e7b0-kube-api-access-d7z29\") pod \"payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb\" (UID: \"18715797-afa1-44c3-8688-4112d809e7b0\") " pod="openshift-ingress/payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb"
Sep 07 17:09:59.023720 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:59.023681    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb"
Sep 07 17:09:59.084141 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:59.083290    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4"
Sep 07 17:09:59.324580 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:59.324548    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb"]
Sep 07 17:09:59.324820 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:09:59.324795    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18715797_afa1_44c3_8688_4112d809e7b0.slice/crio-9809a6322502e58f56014106019bb712e526ea4f02b5fd7e1f104fbf793afa12 WatchSource:0}: Error finding container 9809a6322502e58f56014106019bb712e526ea4f02b5fd7e1f104fbf793afa12: Status 404 returned error can't find the container with id 9809a6322502e58f56014106019bb712e526ea4f02b5fd7e1f104fbf793afa12
Sep 07 17:09:59.429988 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:59.429939    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4"]
Sep 07 17:09:59.437294 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:09:59.437253    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d2107d2_77f7_488d_9bd8_af52400ed4a2.slice/crio-830480422def2c1f89b477efcc4c537f9b262220c2e480f376ac1a8ea52d07d7 WatchSource:0}: Error finding container 830480422def2c1f89b477efcc4c537f9b262220c2e480f376ac1a8ea52d07d7: Status 404 returned error can't find the container with id 830480422def2c1f89b477efcc4c537f9b262220c2e480f376ac1a8ea52d07d7
Sep 07 17:09:59.468384 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:59.468345    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:09:59.558950 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:59.558912    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:09:59.782967 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:59.781744    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb" event={"ID":"18715797-afa1-44c3-8688-4112d809e7b0","Type":"ContainerStarted","Data":"aa630382e4dde0e61adfab059de9a227b5f1c6b1ea2a692798fc72ff08dd0ee6"}
Sep 07 17:09:59.782967 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:59.781805    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb" event={"ID":"18715797-afa1-44c3-8688-4112d809e7b0","Type":"ContainerStarted","Data":"9809a6322502e58f56014106019bb712e526ea4f02b5fd7e1f104fbf793afa12"}
Sep 07 17:09:59.782967 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:59.782217    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb"
Sep 07 17:09:59.784742 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:59.784518    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4" event={"ID":"0d2107d2-77f7-488d-9bd8-af52400ed4a2","Type":"ContainerStarted","Data":"0ef719eab62d5935865ccd8378730a64df6d29313c911db993c1b5ba6755c4d3"}
Sep 07 17:09:59.784742 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:59.784571    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4" event={"ID":"0d2107d2-77f7-488d-9bd8-af52400ed4a2","Type":"ContainerStarted","Data":"830480422def2c1f89b477efcc4c537f9b262220c2e480f376ac1a8ea52d07d7"}
Sep 07 17:09:59.784742 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:59.784605    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4"
Sep 07 17:09:59.815906 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:59.815844    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb" podStartSLOduration=1.815822287 podStartE2EDuration="1.815822287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:09:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:09:59.812718091 +0000 UTC m=+793.709565417" watchObservedRunningTime="2026-09-07 17:09:59.815822287 +0000 UTC m=+793.712669609"
Sep 07 17:09:59.863225 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:09:59.863173    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4" podStartSLOduration=1.8631577419999998 podStartE2EDuration="1.863157742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:09:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:09:59.861044415 +0000 UTC m=+793.757891731" watchObservedRunningTime="2026-09-07 17:09:59.863157742 +0000 UTC m=+793.760005058"
Sep 07 17:10:00.790680 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:00.790644    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5" event={"ID":"b28b6087-9a39-485d-821b-1c376a1c62ad","Type":"ContainerStarted","Data":"02942bd18a6a6bbb86ec28d94b4c8ec8793e53d94d73a6953c36672962b008a3"}
Sep 07 17:10:00.791062 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:00.791043    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5"
Sep 07 17:10:00.818600 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:00.818540    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5" podStartSLOduration=2.117406905 podStartE2EDuration="3.818520459s" totalImagesPullingTime="1.701113554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:09:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:10:00.816651609 +0000 UTC m=+794.713498923" watchObservedRunningTime="2026-09-07 17:10:00.818520459 +0000 UTC m=+794.715367773"
Sep 07 17:10:00.859808 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:00.859774    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:00.977644 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:00.977602    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:01.079713 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:01.079677    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:01.514136 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:01.514041    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:01.609336 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:01.609297    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:01.694716 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:01.694677    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c"]
Sep 07 17:10:01.698545 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:01.698528    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c"
Sep 07 17:10:01.701498 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:01.701470    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-26ca81aa\""
Sep 07 17:10:01.720262 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:01.720218    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c"]
Sep 07 17:10:01.779949 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:01.779846    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f48s6\" (UniqueName: \"kubernetes.io/projected/6fa0cb92-2d4c-4659-91e5-16da5d297e73-kube-api-access-f48s6\") pod \"payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c\" (UID: \"6fa0cb92-2d4c-4659-91e5-16da5d297e73\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c"
Sep 07 17:10:01.779949 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:01.779944    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fa0cb92-2d4c-4659-91e5-16da5d297e73-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c\" (UID: \"6fa0cb92-2d4c-4659-91e5-16da5d297e73\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c"
Sep 07 17:10:01.805539 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:01.805506    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl"]
Sep 07 17:10:01.809169 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:01.809152    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl"
Sep 07 17:10:01.812293 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:01.812272    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-26ca81aa-dockercfg-95ptg\""
Sep 07 17:10:01.823489 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:01.823464    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl"]
Sep 07 17:10:01.881377 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:01.881341    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz9dz\" (UniqueName: \"kubernetes.io/projected/a940d33a-604c-4506-96b6-94e37d97abc7-kube-api-access-kz9dz\") pod \"payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl\" (UID: \"a940d33a-604c-4506-96b6-94e37d97abc7\") " pod="openshift-ingress/payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl"
Sep 07 17:10:01.881540 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:01.881443    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f48s6\" (UniqueName: \"kubernetes.io/projected/6fa0cb92-2d4c-4659-91e5-16da5d297e73-kube-api-access-f48s6\") pod \"payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c\" (UID: \"6fa0cb92-2d4c-4659-91e5-16da5d297e73\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c"
Sep 07 17:10:01.881540 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:01.881520    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a940d33a-604c-4506-96b6-94e37d97abc7-plugins-config-volume\") pod \"payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl\" (UID: \"a940d33a-604c-4506-96b6-94e37d97abc7\") " pod="openshift-ingress/payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl"
Sep 07 17:10:01.881648 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:01.881558    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fa0cb92-2d4c-4659-91e5-16da5d297e73-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c\" (UID: \"6fa0cb92-2d4c-4659-91e5-16da5d297e73\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c"
Sep 07 17:10:01.882266 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:01.882241    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fa0cb92-2d4c-4659-91e5-16da5d297e73-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c\" (UID: \"6fa0cb92-2d4c-4659-91e5-16da5d297e73\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c"
Sep 07 17:10:01.891080 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:01.891054    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f48s6\" (UniqueName: \"kubernetes.io/projected/6fa0cb92-2d4c-4659-91e5-16da5d297e73-kube-api-access-f48s6\") pod \"payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c\" (UID: \"6fa0cb92-2d4c-4659-91e5-16da5d297e73\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c"
Sep 07 17:10:01.982642 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:01.982604    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz9dz\" (UniqueName: \"kubernetes.io/projected/a940d33a-604c-4506-96b6-94e37d97abc7-kube-api-access-kz9dz\") pod \"payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl\" (UID: \"a940d33a-604c-4506-96b6-94e37d97abc7\") " pod="openshift-ingress/payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl"
Sep 07 17:10:01.983164 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:01.982743    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a940d33a-604c-4506-96b6-94e37d97abc7-plugins-config-volume\") pod \"payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl\" (UID: \"a940d33a-604c-4506-96b6-94e37d97abc7\") " pod="openshift-ingress/payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl"
Sep 07 17:10:01.983674 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:01.983651    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a940d33a-604c-4506-96b6-94e37d97abc7-plugins-config-volume\") pod \"payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl\" (UID: \"a940d33a-604c-4506-96b6-94e37d97abc7\") " pod="openshift-ingress/payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl"
Sep 07 17:10:01.997344 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:01.997319    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz9dz\" (UniqueName: \"kubernetes.io/projected/a940d33a-604c-4506-96b6-94e37d97abc7-kube-api-access-kz9dz\") pod \"payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl\" (UID: \"a940d33a-604c-4506-96b6-94e37d97abc7\") " pod="openshift-ingress/payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl"
Sep 07 17:10:02.009360 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:02.009337    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c"
Sep 07 17:10:02.119102 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:02.119065    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl"
Sep 07 17:10:02.287805 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:02.287779    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c"]
Sep 07 17:10:02.290112 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:10:02.290086    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fa0cb92_2d4c_4659_91e5_16da5d297e73.slice/crio-ef37bf43d822c2c3381f0d82048b634c151e4801d150278ded28da330cbe1cb8 WatchSource:0}: Error finding container ef37bf43d822c2c3381f0d82048b634c151e4801d150278ded28da330cbe1cb8: Status 404 returned error can't find the container with id ef37bf43d822c2c3381f0d82048b634c151e4801d150278ded28da330cbe1cb8
Sep 07 17:10:02.395444 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:02.395418    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl"]
Sep 07 17:10:02.396525 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:10:02.396503    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda940d33a_604c_4506_96b6_94e37d97abc7.slice/crio-a2c1c1c3bdefe3503d1f731323de547628b88ee0e2655ebb2146ccc3140d16eb WatchSource:0}: Error finding container a2c1c1c3bdefe3503d1f731323de547628b88ee0e2655ebb2146ccc3140d16eb: Status 404 returned error can't find the container with id a2c1c1c3bdefe3503d1f731323de547628b88ee0e2655ebb2146ccc3140d16eb
Sep 07 17:10:02.774949 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:02.774803    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:02.803128 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:02.803089    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl" event={"ID":"a940d33a-604c-4506-96b6-94e37d97abc7","Type":"ContainerStarted","Data":"66b7957e9121451346c359a2a073ed2a84fe60273efd2b794888aa1b54917268"}
Sep 07 17:10:02.803344 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:02.803148    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl" event={"ID":"a940d33a-604c-4506-96b6-94e37d97abc7","Type":"ContainerStarted","Data":"a2c1c1c3bdefe3503d1f731323de547628b88ee0e2655ebb2146ccc3140d16eb"}
Sep 07 17:10:02.803344 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:02.803180    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl"
Sep 07 17:10:02.804773 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:02.804745    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c" event={"ID":"6fa0cb92-2d4c-4659-91e5-16da5d297e73","Type":"ContainerStarted","Data":"483143ae9385eb4af5fb23a7cc8d8d6432e66bc0ca51fc4b067e4080688bb1b0"}
Sep 07 17:10:02.804914 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:02.804783    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c" event={"ID":"6fa0cb92-2d4c-4659-91e5-16da5d297e73","Type":"ContainerStarted","Data":"ef37bf43d822c2c3381f0d82048b634c151e4801d150278ded28da330cbe1cb8"}
Sep 07 17:10:02.804914 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:02.804890    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c"
Sep 07 17:10:02.824617 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:02.824565    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl" podStartSLOduration=1.8245489350000001 podStartE2EDuration="1.824548935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:10:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:10:02.821502526 +0000 UTC m=+796.718349844" watchObservedRunningTime="2026-09-07 17:10:02.824548935 +0000 UTC m=+796.721396249"
Sep 07 17:10:02.850167 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:02.850116    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c" podStartSLOduration=1.850100879 podStartE2EDuration="1.850100879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:10:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:10:02.849566887 +0000 UTC m=+796.746414201" watchObservedRunningTime="2026-09-07 17:10:02.850100879 +0000 UTC m=+796.746948193"
Sep 07 17:10:02.860715 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:02.860683    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:02.942779 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:02.942734    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:03.307274 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:03.307240    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:03.409764 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:03.409727    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:03.439354 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:03.439323    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj"]
Sep 07 17:10:03.442889 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:03.442873    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c"]
Sep 07 17:10:03.443017 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:03.442998    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj"
Sep 07 17:10:03.446414 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:03.446396    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c"
Sep 07 17:10:03.446593 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:03.446571    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-3f5660\""
Sep 07 17:10:03.463568 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:03.463533    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c"]
Sep 07 17:10:03.467483 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:03.467460    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj"]
Sep 07 17:10:03.596833 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:03.596734    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmp48\" (UniqueName: \"kubernetes.io/projected/1dea241d-eaa8-4a50-bf3d-a68de53ae08b-kube-api-access-dmp48\") pod \"payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj\" (UID: \"1dea241d-eaa8-4a50-bf3d-a68de53ae08b\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj"
Sep 07 17:10:03.596833 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:03.596800    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7hm7\" (UniqueName: \"kubernetes.io/projected/3879a4a0-6540-4e66-9f7c-a6d009fb24d4-kube-api-access-g7hm7\") pod \"payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c\" (UID: \"3879a4a0-6540-4e66-9f7c-a6d009fb24d4\") " pod="openshift-ingress/payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c"
Sep 07 17:10:03.597077 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:03.596938    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3879a4a0-6540-4e66-9f7c-a6d009fb24d4-plugins-config-volume\") pod \"payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c\" (UID: \"3879a4a0-6540-4e66-9f7c-a6d009fb24d4\") " pod="openshift-ingress/payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c"
Sep 07 17:10:03.597077 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:03.596974    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1dea241d-eaa8-4a50-bf3d-a68de53ae08b-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj\" (UID: \"1dea241d-eaa8-4a50-bf3d-a68de53ae08b\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj"
Sep 07 17:10:03.698140 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:03.698103    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmp48\" (UniqueName: \"kubernetes.io/projected/1dea241d-eaa8-4a50-bf3d-a68de53ae08b-kube-api-access-dmp48\") pod \"payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj\" (UID: \"1dea241d-eaa8-4a50-bf3d-a68de53ae08b\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj"
Sep 07 17:10:03.698307 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:03.698156    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7hm7\" (UniqueName: \"kubernetes.io/projected/3879a4a0-6540-4e66-9f7c-a6d009fb24d4-kube-api-access-g7hm7\") pod \"payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c\" (UID: \"3879a4a0-6540-4e66-9f7c-a6d009fb24d4\") " pod="openshift-ingress/payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c"
Sep 07 17:10:03.698307 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:03.698235    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3879a4a0-6540-4e66-9f7c-a6d009fb24d4-plugins-config-volume\") pod \"payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c\" (UID: \"3879a4a0-6540-4e66-9f7c-a6d009fb24d4\") " pod="openshift-ingress/payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c"
Sep 07 17:10:03.698307 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:03.698266    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1dea241d-eaa8-4a50-bf3d-a68de53ae08b-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj\" (UID: \"1dea241d-eaa8-4a50-bf3d-a68de53ae08b\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj"
Sep 07 17:10:03.698985 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:03.698966    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3879a4a0-6540-4e66-9f7c-a6d009fb24d4-plugins-config-volume\") pod \"payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c\" (UID: \"3879a4a0-6540-4e66-9f7c-a6d009fb24d4\") " pod="openshift-ingress/payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c"
Sep 07 17:10:03.699054 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:03.698968    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1dea241d-eaa8-4a50-bf3d-a68de53ae08b-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj\" (UID: \"1dea241d-eaa8-4a50-bf3d-a68de53ae08b\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj"
Sep 07 17:10:03.710025 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:03.709994    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7hm7\" (UniqueName: \"kubernetes.io/projected/3879a4a0-6540-4e66-9f7c-a6d009fb24d4-kube-api-access-g7hm7\") pod \"payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c\" (UID: \"3879a4a0-6540-4e66-9f7c-a6d009fb24d4\") " pod="openshift-ingress/payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c"
Sep 07 17:10:03.711484 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:03.711458    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmp48\" (UniqueName: \"kubernetes.io/projected/1dea241d-eaa8-4a50-bf3d-a68de53ae08b-kube-api-access-dmp48\") pod \"payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj\" (UID: \"1dea241d-eaa8-4a50-bf3d-a68de53ae08b\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj"
Sep 07 17:10:03.756018 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:03.755975    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj"
Sep 07 17:10:03.762113 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:03.762084    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c"
Sep 07 17:10:04.036790 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:04.036759    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj"]
Sep 07 17:10:04.038386 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:10:04.038332    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dea241d_eaa8_4a50_bf3d_a68de53ae08b.slice/crio-375cb85150d91a8958cc896b8430cb4e6387b424234884dee20c544a0ab1bbca WatchSource:0}: Error finding container 375cb85150d91a8958cc896b8430cb4e6387b424234884dee20c544a0ab1bbca: Status 404 returned error can't find the container with id 375cb85150d91a8958cc896b8430cb4e6387b424234884dee20c544a0ab1bbca
Sep 07 17:10:04.051820 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:04.051793    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c"]
Sep 07 17:10:04.054712 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:10:04.054690    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3879a4a0_6540_4e66_9f7c_a6d009fb24d4.slice/crio-43fcec8f0a4462a64499563733e1b0b531e4975e937b08a88e655d1cab9ae7ef WatchSource:0}: Error finding container 43fcec8f0a4462a64499563733e1b0b531e4975e937b08a88e655d1cab9ae7ef: Status 404 returned error can't find the container with id 43fcec8f0a4462a64499563733e1b0b531e4975e937b08a88e655d1cab9ae7ef
Sep 07 17:10:04.818777 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:04.818738    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj" event={"ID":"1dea241d-eaa8-4a50-bf3d-a68de53ae08b","Type":"ContainerStarted","Data":"ed1a46a19c0d4c224469ce7f4eab453fe723c11007ddecda24298cab6218ba55"}
Sep 07 17:10:04.819261 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:04.818804    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj" event={"ID":"1dea241d-eaa8-4a50-bf3d-a68de53ae08b","Type":"ContainerStarted","Data":"375cb85150d91a8958cc896b8430cb4e6387b424234884dee20c544a0ab1bbca"}
Sep 07 17:10:04.819261 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:04.818832    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj"
Sep 07 17:10:04.820510 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:04.820485    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c" event={"ID":"3879a4a0-6540-4e66-9f7c-a6d009fb24d4","Type":"ContainerStarted","Data":"12bcc5e5f590e0c0edf44e4b0903ba27617de47b9cc63caa2a076b8d9a0cf5d2"}
Sep 07 17:10:04.820629 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:04.820530    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c"
Sep 07 17:10:04.820629 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:04.820545    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c" event={"ID":"3879a4a0-6540-4e66-9f7c-a6d009fb24d4","Type":"ContainerStarted","Data":"43fcec8f0a4462a64499563733e1b0b531e4975e937b08a88e655d1cab9ae7ef"}
Sep 07 17:10:04.840426 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:04.840372    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj" podStartSLOduration=1.840353684 podStartE2EDuration="1.840353684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:10:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:10:04.839661364 +0000 UTC m=+798.736508682" watchObservedRunningTime="2026-09-07 17:10:04.840353684 +0000 UTC m=+798.737201000"
Sep 07 17:10:04.861626 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:04.861567    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c" podStartSLOduration=1.8615477820000002 podStartE2EDuration="1.861547782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:10:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:10:04.85942514 +0000 UTC m=+798.756272455" watchObservedRunningTime="2026-09-07 17:10:04.861547782 +0000 UTC m=+798.758395099"
Sep 07 17:10:06.553876 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:06.553838    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:06.724758 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:06.724720    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:06.801458 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:06.801424    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5"
Sep 07 17:10:06.842473 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:06.842397    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:06.936659 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:06.936633    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:09.640798 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:09.640720    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:10.793386 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:10.793358    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4"
Sep 07 17:10:10.793753 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:10.793423    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb"
Sep 07 17:10:11.870314 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:11.870279    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:13.814911 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:13.814874    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl"
Sep 07 17:10:13.815362 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:13.815284    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c"
Sep 07 17:10:15.828005 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:15.827977    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj"
Sep 07 17:10:15.828406 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:15.828054    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c"
Sep 07 17:10:19.419305 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:19.419271    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:21.436169 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:21.436127    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:21.831960 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:21.831925    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:22.432749 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:22.432713    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:22.584560 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:22.584515    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:22.684546 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:22.684448    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:23.961196 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:23.961159    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:25.179951 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:25.179913    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:25.570382 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:25.570351    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:25.760999 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:25.760961    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:25.876287 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:25.876194    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:26.303177 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:26.303120    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:27.494101 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:27.494062    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:27.588777 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:27.588739    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:28.086531 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:28.086490    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:28.199721 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:28.199688    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:28.312634 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:28.312585    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:29.105225 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:29.105189    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:29.231618 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:29.231584    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:29.383234 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:29.383148    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:36.892320 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:36.892288    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:37.044025 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:37.043993    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:37.136245 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:37.136210    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:37.276959 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:37.276849    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:40.764666 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:40.764622    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:41.510342 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:41.510310    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:41.570442 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:41.570400    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl"]
Sep 07 17:10:41.570722 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:41.570680    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl" podUID="a940d33a-604c-4506-96b6-94e37d97abc7" containerName="payload-processing" containerID="cri-o://66b7957e9121451346c359a2a073ed2a84fe60273efd2b794888aa1b54917268" gracePeriod=30
Sep 07 17:10:41.582131 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:41.582103    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c"]
Sep 07 17:10:41.582380 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:41.582356    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c" podUID="6fa0cb92-2d4c-4659-91e5-16da5d297e73" containerName="payload-pre-processing" containerID="cri-o://483143ae9385eb4af5fb23a7cc8d8d6432e66bc0ca51fc4b067e4080688bb1b0" gracePeriod=30
Sep 07 17:10:41.634113 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:41.634084    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:41.747404 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:41.747368    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:41.839949 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:41.839923    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl"
Sep 07 17:10:41.865804 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:41.865778    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c"
Sep 07 17:10:41.899258 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:41.899216    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:41.981204 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:41.981167    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a940d33a-604c-4506-96b6-94e37d97abc7-plugins-config-volume\") pod \"a940d33a-604c-4506-96b6-94e37d97abc7\" (UID: \"a940d33a-604c-4506-96b6-94e37d97abc7\") "
Sep 07 17:10:41.981417 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:41.981231    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f48s6\" (UniqueName: \"kubernetes.io/projected/6fa0cb92-2d4c-4659-91e5-16da5d297e73-kube-api-access-f48s6\") pod \"6fa0cb92-2d4c-4659-91e5-16da5d297e73\" (UID: \"6fa0cb92-2d4c-4659-91e5-16da5d297e73\") "
Sep 07 17:10:41.981417 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:41.981252    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fa0cb92-2d4c-4659-91e5-16da5d297e73-plugins-config-volume\") pod \"6fa0cb92-2d4c-4659-91e5-16da5d297e73\" (UID: \"6fa0cb92-2d4c-4659-91e5-16da5d297e73\") "
Sep 07 17:10:41.981417 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:41.981303    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kz9dz\" (UniqueName: \"kubernetes.io/projected/a940d33a-604c-4506-96b6-94e37d97abc7-kube-api-access-kz9dz\") pod \"a940d33a-604c-4506-96b6-94e37d97abc7\" (UID: \"a940d33a-604c-4506-96b6-94e37d97abc7\") "
Sep 07 17:10:41.981711 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:41.981678    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fa0cb92-2d4c-4659-91e5-16da5d297e73-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6fa0cb92-2d4c-4659-91e5-16da5d297e73" (UID: "6fa0cb92-2d4c-4659-91e5-16da5d297e73"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:10:41.981802 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:41.981740    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a940d33a-604c-4506-96b6-94e37d97abc7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a940d33a-604c-4506-96b6-94e37d97abc7" (UID: "a940d33a-604c-4506-96b6-94e37d97abc7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:10:41.983722 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:41.983690    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fa0cb92-2d4c-4659-91e5-16da5d297e73-kube-api-access-f48s6" (OuterVolumeSpecName: "kube-api-access-f48s6") pod "6fa0cb92-2d4c-4659-91e5-16da5d297e73" (UID: "6fa0cb92-2d4c-4659-91e5-16da5d297e73"). InnerVolumeSpecName "kube-api-access-f48s6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:10:41.983835 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:41.983721    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a940d33a-604c-4506-96b6-94e37d97abc7-kube-api-access-kz9dz" (OuterVolumeSpecName: "kube-api-access-kz9dz") pod "a940d33a-604c-4506-96b6-94e37d97abc7" (UID: "a940d33a-604c-4506-96b6-94e37d97abc7"). InnerVolumeSpecName "kube-api-access-kz9dz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:10:42.024744 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:42.024696    2575 generic.go:356] "Generic (PLEG): container finished" podID="a940d33a-604c-4506-96b6-94e37d97abc7" containerID="66b7957e9121451346c359a2a073ed2a84fe60273efd2b794888aa1b54917268" exitCode=0
Sep 07 17:10:42.024952 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:42.024755    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl"
Sep 07 17:10:42.024952 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:42.024864    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl" event={"ID":"a940d33a-604c-4506-96b6-94e37d97abc7","Type":"ContainerDied","Data":"66b7957e9121451346c359a2a073ed2a84fe60273efd2b794888aa1b54917268"}
Sep 07 17:10:42.025091 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:42.024974    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl" event={"ID":"a940d33a-604c-4506-96b6-94e37d97abc7","Type":"ContainerDied","Data":"a2c1c1c3bdefe3503d1f731323de547628b88ee0e2655ebb2146ccc3140d16eb"}
Sep 07 17:10:42.025091 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:42.025009    2575 scope.go:117] "RemoveContainer" containerID="66b7957e9121451346c359a2a073ed2a84fe60273efd2b794888aa1b54917268"
Sep 07 17:10:42.026825 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:42.026799    2575 generic.go:356] "Generic (PLEG): container finished" podID="6fa0cb92-2d4c-4659-91e5-16da5d297e73" containerID="483143ae9385eb4af5fb23a7cc8d8d6432e66bc0ca51fc4b067e4080688bb1b0" exitCode=0
Sep 07 17:10:42.026947 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:42.026856    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c"
Sep 07 17:10:42.026947 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:42.026887    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c" event={"ID":"6fa0cb92-2d4c-4659-91e5-16da5d297e73","Type":"ContainerDied","Data":"483143ae9385eb4af5fb23a7cc8d8d6432e66bc0ca51fc4b067e4080688bb1b0"}
Sep 07 17:10:42.027039 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:42.026962    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c" event={"ID":"6fa0cb92-2d4c-4659-91e5-16da5d297e73","Type":"ContainerDied","Data":"ef37bf43d822c2c3381f0d82048b634c151e4801d150278ded28da330cbe1cb8"}
Sep 07 17:10:42.035857 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:42.035836    2575 scope.go:117] "RemoveContainer" containerID="66b7957e9121451346c359a2a073ed2a84fe60273efd2b794888aa1b54917268"
Sep 07 17:10:42.036304 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:10:42.036283    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66b7957e9121451346c359a2a073ed2a84fe60273efd2b794888aa1b54917268\": container with ID starting with 66b7957e9121451346c359a2a073ed2a84fe60273efd2b794888aa1b54917268 not found: ID does not exist" containerID="66b7957e9121451346c359a2a073ed2a84fe60273efd2b794888aa1b54917268"
Sep 07 17:10:42.036401 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:42.036316    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66b7957e9121451346c359a2a073ed2a84fe60273efd2b794888aa1b54917268"} err="failed to get container status \"66b7957e9121451346c359a2a073ed2a84fe60273efd2b794888aa1b54917268\": rpc error: code = NotFound desc = could not find container \"66b7957e9121451346c359a2a073ed2a84fe60273efd2b794888aa1b54917268\": container with ID starting with 66b7957e9121451346c359a2a073ed2a84fe60273efd2b794888aa1b54917268 not found: ID does not exist"
Sep 07 17:10:42.036401 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:42.036340    2575 scope.go:117] "RemoveContainer" containerID="483143ae9385eb4af5fb23a7cc8d8d6432e66bc0ca51fc4b067e4080688bb1b0"
Sep 07 17:10:42.044664 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:42.044647    2575 scope.go:117] "RemoveContainer" containerID="483143ae9385eb4af5fb23a7cc8d8d6432e66bc0ca51fc4b067e4080688bb1b0"
Sep 07 17:10:42.044941 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:10:42.044919    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"483143ae9385eb4af5fb23a7cc8d8d6432e66bc0ca51fc4b067e4080688bb1b0\": container with ID starting with 483143ae9385eb4af5fb23a7cc8d8d6432e66bc0ca51fc4b067e4080688bb1b0 not found: ID does not exist" containerID="483143ae9385eb4af5fb23a7cc8d8d6432e66bc0ca51fc4b067e4080688bb1b0"
Sep 07 17:10:42.044997 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:42.044947    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"483143ae9385eb4af5fb23a7cc8d8d6432e66bc0ca51fc4b067e4080688bb1b0"} err="failed to get container status \"483143ae9385eb4af5fb23a7cc8d8d6432e66bc0ca51fc4b067e4080688bb1b0\": rpc error: code = NotFound desc = could not find container \"483143ae9385eb4af5fb23a7cc8d8d6432e66bc0ca51fc4b067e4080688bb1b0\": container with ID starting with 483143ae9385eb4af5fb23a7cc8d8d6432e66bc0ca51fc4b067e4080688bb1b0 not found: ID does not exist"
Sep 07 17:10:42.063131 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:42.063103    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c"]
Sep 07 17:10:42.071482 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:42.071457    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c"]
Sep 07 17:10:42.082272 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:42.082227    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a940d33a-604c-4506-96b6-94e37d97abc7-plugins-config-volume\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:10:42.082272 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:42.082257    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f48s6\" (UniqueName: \"kubernetes.io/projected/6fa0cb92-2d4c-4659-91e5-16da5d297e73-kube-api-access-f48s6\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:10:42.082272 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:42.082270    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fa0cb92-2d4c-4659-91e5-16da5d297e73-plugins-config-volume\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:10:42.082551 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:42.082283    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kz9dz\" (UniqueName: \"kubernetes.io/projected/a940d33a-604c-4506-96b6-94e37d97abc7-kube-api-access-kz9dz\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:10:42.085957 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:42.085927    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:42.093044 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:42.093012    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl"]
Sep 07 17:10:42.103183 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:42.103154    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl"]
Sep 07 17:10:42.544363 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:42.544329    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:42.655569 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:42.655529    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:42.722493 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:42.722459    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fa0cb92-2d4c-4659-91e5-16da5d297e73" path="/var/lib/kubelet/pods/6fa0cb92-2d4c-4659-91e5-16da5d297e73/volumes"
Sep 07 17:10:42.722841 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:42.722828    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a940d33a-604c-4506-96b6-94e37d97abc7" path="/var/lib/kubelet/pods/a940d33a-604c-4506-96b6-94e37d97abc7/volumes"
Sep 07 17:10:42.753980 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:42.753919    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:43.393462 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:43.393413    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:43.959848 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:43.959806    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:46.075790 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:46.075747    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:46.160832 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:46.160798    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:46.449706 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:46.449613    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:46.574530 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:46.574478    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:46.594252 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:46.594229    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75"]
Sep 07 17:10:46.594687 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:46.594672    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fa0cb92-2d4c-4659-91e5-16da5d297e73" containerName="payload-pre-processing"
Sep 07 17:10:46.594750 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:46.594688    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fa0cb92-2d4c-4659-91e5-16da5d297e73" containerName="payload-pre-processing"
Sep 07 17:10:46.594750 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:46.594716    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a940d33a-604c-4506-96b6-94e37d97abc7" containerName="payload-processing"
Sep 07 17:10:46.594750 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:46.594722    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a940d33a-604c-4506-96b6-94e37d97abc7" containerName="payload-processing"
Sep 07 17:10:46.594946 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:46.594783    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a940d33a-604c-4506-96b6-94e37d97abc7" containerName="payload-processing"
Sep 07 17:10:46.594946 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:46.594791    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fa0cb92-2d4c-4659-91e5-16da5d297e73" containerName="payload-pre-processing"
Sep 07 17:10:46.599295 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:46.599278    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75"
Sep 07 17:10:46.603991 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:46.603957    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-f85216b6-serving-cert\""
Sep 07 17:10:46.612926 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:46.612881    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75"]
Sep 07 17:10:46.676963 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:46.676883    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:46.731620 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:46.731535    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d9d045e-0abe-4cba-8859-c61d37af6602-openshift-service-ca\") pod \"maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75\" (UID: \"5d9d045e-0abe-4cba-8859-c61d37af6602\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75"
Sep 07 17:10:46.731620 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:46.731600    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d9d045e-0abe-4cba-8859-c61d37af6602-metrics-certs\") pod \"maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75\" (UID: \"5d9d045e-0abe-4cba-8859-c61d37af6602\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75"
Sep 07 17:10:46.731620 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:46.731618    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rq6q\" (UniqueName: \"kubernetes.io/projected/5d9d045e-0abe-4cba-8859-c61d37af6602-kube-api-access-5rq6q\") pod \"maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75\" (UID: \"5d9d045e-0abe-4cba-8859-c61d37af6602\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75"
Sep 07 17:10:46.731921 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:46.731742    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d9d045e-0abe-4cba-8859-c61d37af6602-maas-api-tls\") pod \"maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75\" (UID: \"5d9d045e-0abe-4cba-8859-c61d37af6602\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75"
Sep 07 17:10:46.832868 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:46.832830    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d9d045e-0abe-4cba-8859-c61d37af6602-metrics-certs\") pod \"maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75\" (UID: \"5d9d045e-0abe-4cba-8859-c61d37af6602\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75"
Sep 07 17:10:46.832868 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:46.832869    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rq6q\" (UniqueName: \"kubernetes.io/projected/5d9d045e-0abe-4cba-8859-c61d37af6602-kube-api-access-5rq6q\") pod \"maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75\" (UID: \"5d9d045e-0abe-4cba-8859-c61d37af6602\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75"
Sep 07 17:10:46.833126 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:46.833011    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d9d045e-0abe-4cba-8859-c61d37af6602-maas-api-tls\") pod \"maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75\" (UID: \"5d9d045e-0abe-4cba-8859-c61d37af6602\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75"
Sep 07 17:10:46.833126 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:46.833051    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d9d045e-0abe-4cba-8859-c61d37af6602-openshift-service-ca\") pod \"maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75\" (UID: \"5d9d045e-0abe-4cba-8859-c61d37af6602\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75"
Sep 07 17:10:46.833670 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:46.833645    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d9d045e-0abe-4cba-8859-c61d37af6602-openshift-service-ca\") pod \"maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75\" (UID: \"5d9d045e-0abe-4cba-8859-c61d37af6602\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75"
Sep 07 17:10:46.835245 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:46.835221    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d9d045e-0abe-4cba-8859-c61d37af6602-metrics-certs\") pod \"maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75\" (UID: \"5d9d045e-0abe-4cba-8859-c61d37af6602\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75"
Sep 07 17:10:46.835360 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:46.835274    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d9d045e-0abe-4cba-8859-c61d37af6602-maas-api-tls\") pod \"maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75\" (UID: \"5d9d045e-0abe-4cba-8859-c61d37af6602\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75"
Sep 07 17:10:46.853933 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:46.853910    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rq6q\" (UniqueName: \"kubernetes.io/projected/5d9d045e-0abe-4cba-8859-c61d37af6602-kube-api-access-5rq6q\") pod \"maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75\" (UID: \"5d9d045e-0abe-4cba-8859-c61d37af6602\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75"
Sep 07 17:10:46.894223 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:46.894190    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:46.910769 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:46.910740    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75"
Sep 07 17:10:47.260089 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:47.260052    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75"]
Sep 07 17:10:47.265341 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:10:47.265312    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d9d045e_0abe_4cba_8859_c61d37af6602.slice/crio-55db86789d28a1e46dd0e612055b65f91f60882696fa7698111e34370971c891 WatchSource:0}: Error finding container 55db86789d28a1e46dd0e612055b65f91f60882696fa7698111e34370971c891: Status 404 returned error can't find the container with id 55db86789d28a1e46dd0e612055b65f91f60882696fa7698111e34370971c891
Sep 07 17:10:47.666807 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:47.666765    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:47.802465 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:47.802427    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:47.860498 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:47.860465    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4"]
Sep 07 17:10:47.864649 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:47.864622    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4"
Sep 07 17:10:47.867662 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:47.867631    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-f85216b6\""
Sep 07 17:10:47.867800 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:47.867650    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-f85216b6-dockercfg-p2sbl\""
Sep 07 17:10:47.887228 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:47.887197    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4"]
Sep 07 17:10:48.046048 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:48.046013    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b25qf\" (UniqueName: \"kubernetes.io/projected/06c6a504-3dc2-4446-ae6e-e76de018b68d-kube-api-access-b25qf\") pod \"payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4\" (UID: \"06c6a504-3dc2-4446-ae6e-e76de018b68d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4"
Sep 07 17:10:48.046194 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:48.046135    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06c6a504-3dc2-4446-ae6e-e76de018b68d-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4\" (UID: \"06c6a504-3dc2-4446-ae6e-e76de018b68d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4"
Sep 07 17:10:48.060985 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:48.060956    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75" event={"ID":"5d9d045e-0abe-4cba-8859-c61d37af6602","Type":"ContainerStarted","Data":"3fb101783237a8e920e9f9915944ebd82fbbf2c04fa19e89cfa4dd52de980682"}
Sep 07 17:10:48.061125 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:48.061009    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75" event={"ID":"5d9d045e-0abe-4cba-8859-c61d37af6602","Type":"ContainerStarted","Data":"55db86789d28a1e46dd0e612055b65f91f60882696fa7698111e34370971c891"}
Sep 07 17:10:48.061125 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:48.061037    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75"
Sep 07 17:10:48.087133 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:48.087088    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75" podStartSLOduration=1.6399057830000001 podStartE2EDuration="2.087073408s" totalImagesPullingTime="447.167625ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:10:48.085073677 +0000 UTC m=+841.981920993" watchObservedRunningTime="2026-09-07 17:10:48.087073408 +0000 UTC m=+841.983920723"
Sep 07 17:10:48.147343 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:48.147310    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b25qf\" (UniqueName: \"kubernetes.io/projected/06c6a504-3dc2-4446-ae6e-e76de018b68d-kube-api-access-b25qf\") pod \"payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4\" (UID: \"06c6a504-3dc2-4446-ae6e-e76de018b68d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4"
Sep 07 17:10:48.147510 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:48.147381    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06c6a504-3dc2-4446-ae6e-e76de018b68d-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4\" (UID: \"06c6a504-3dc2-4446-ae6e-e76de018b68d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4"
Sep 07 17:10:48.148069 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:48.148051    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06c6a504-3dc2-4446-ae6e-e76de018b68d-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4\" (UID: \"06c6a504-3dc2-4446-ae6e-e76de018b68d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4"
Sep 07 17:10:48.157168 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:48.157141    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b25qf\" (UniqueName: \"kubernetes.io/projected/06c6a504-3dc2-4446-ae6e-e76de018b68d-kube-api-access-b25qf\") pod \"payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4\" (UID: \"06c6a504-3dc2-4446-ae6e-e76de018b68d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4"
Sep 07 17:10:48.175516 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:48.175486    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4"
Sep 07 17:10:48.458842 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:48.458811    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4"]
Sep 07 17:10:48.459435 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:10:48.459406    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06c6a504_3dc2_4446_ae6e_e76de018b68d.slice/crio-16eae7a6aeeb102c8cee53d0ce67ca8fc70f5f041d1dd0ca732730ab0806347f WatchSource:0}: Error finding container 16eae7a6aeeb102c8cee53d0ce67ca8fc70f5f041d1dd0ca732730ab0806347f: Status 404 returned error can't find the container with id 16eae7a6aeeb102c8cee53d0ce67ca8fc70f5f041d1dd0ca732730ab0806347f
Sep 07 17:10:49.068021 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:49.067976    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4" event={"ID":"06c6a504-3dc2-4446-ae6e-e76de018b68d","Type":"ContainerStarted","Data":"f2490161e3f301a46c3dd56309ea42913fc5f9e9873f3b2160877a3ebd3689a9"}
Sep 07 17:10:49.068218 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:49.068064    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4" event={"ID":"06c6a504-3dc2-4446-ae6e-e76de018b68d","Type":"ContainerStarted","Data":"16eae7a6aeeb102c8cee53d0ce67ca8fc70f5f041d1dd0ca732730ab0806347f"}
Sep 07 17:10:49.068218 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:49.068155    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4"
Sep 07 17:10:49.112410 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:49.112360    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4" podStartSLOduration=2.112345982 podStartE2EDuration="2.112345982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:10:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:10:49.109663657 +0000 UTC m=+843.006510975" watchObservedRunningTime="2026-09-07 17:10:49.112345982 +0000 UTC m=+843.009193297"
Sep 07 17:10:49.203842 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:49.203807    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:50.143684 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:50.143653    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:50.740703 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:50.740673    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:51.181288 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:51.181245    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:10:54.073589 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:10:54.073558    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75"
Sep 07 17:11:00.074979 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:00.074936    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4"
Sep 07 17:11:06.286019 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:06.285976    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:08.363040 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:08.362987    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:11.120096 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:11.120065    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"]
Sep 07 17:11:11.124517 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:11.124498    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"
Sep 07 17:11:11.127304 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:11.127280    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-3f5660\"/\"openshift-service-ca.crt\""
Sep 07 17:11:11.128433 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:11.128413    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-3f5660\"/\"autores-model-3f5660-kserve-self-signed-certs\""
Sep 07 17:11:11.128498 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:11.128439    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-3f5660\"/\"default-dockercfg-57ppj\""
Sep 07 17:11:11.130747 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:11.130729    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-3f5660\"/\"kube-root-ca.crt\""
Sep 07 17:11:11.142303 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:11.142275    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"]
Sep 07 17:11:11.162481 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:11.162447    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:11.173623 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:11.173595    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-tls-certs\") pod \"autores-model-3f5660-kserve-79fbbb4b7-dvzvn\" (UID: \"9e37aefc-fe52-44af-b5d1-838e0ecc1b34\") " pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"
Sep 07 17:11:11.173780 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:11.173654    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-dshm\") pod \"autores-model-3f5660-kserve-79fbbb4b7-dvzvn\" (UID: \"9e37aefc-fe52-44af-b5d1-838e0ecc1b34\") " pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"
Sep 07 17:11:11.173780 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:11.173724    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-tmp-dir\") pod \"autores-model-3f5660-kserve-79fbbb4b7-dvzvn\" (UID: \"9e37aefc-fe52-44af-b5d1-838e0ecc1b34\") " pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"
Sep 07 17:11:11.173880 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:11.173788    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt5kc\" (UniqueName: \"kubernetes.io/projected/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-kube-api-access-rt5kc\") pod \"autores-model-3f5660-kserve-79fbbb4b7-dvzvn\" (UID: \"9e37aefc-fe52-44af-b5d1-838e0ecc1b34\") " pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"
Sep 07 17:11:11.173880 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:11.173854    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-model-cache\") pod \"autores-model-3f5660-kserve-79fbbb4b7-dvzvn\" (UID: \"9e37aefc-fe52-44af-b5d1-838e0ecc1b34\") " pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"
Sep 07 17:11:11.173993 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:11.173888    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-home\") pod \"autores-model-3f5660-kserve-79fbbb4b7-dvzvn\" (UID: \"9e37aefc-fe52-44af-b5d1-838e0ecc1b34\") " pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"
Sep 07 17:11:11.274995 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:11.274956    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-tmp-dir\") pod \"autores-model-3f5660-kserve-79fbbb4b7-dvzvn\" (UID: \"9e37aefc-fe52-44af-b5d1-838e0ecc1b34\") " pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"
Sep 07 17:11:11.275207 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:11.275041    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt5kc\" (UniqueName: \"kubernetes.io/projected/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-kube-api-access-rt5kc\") pod \"autores-model-3f5660-kserve-79fbbb4b7-dvzvn\" (UID: \"9e37aefc-fe52-44af-b5d1-838e0ecc1b34\") " pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"
Sep 07 17:11:11.275207 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:11.275082    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-model-cache\") pod \"autores-model-3f5660-kserve-79fbbb4b7-dvzvn\" (UID: \"9e37aefc-fe52-44af-b5d1-838e0ecc1b34\") " pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"
Sep 07 17:11:11.275207 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:11.275110    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-home\") pod \"autores-model-3f5660-kserve-79fbbb4b7-dvzvn\" (UID: \"9e37aefc-fe52-44af-b5d1-838e0ecc1b34\") " pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"
Sep 07 17:11:11.275207 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:11.275172    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-tls-certs\") pod \"autores-model-3f5660-kserve-79fbbb4b7-dvzvn\" (UID: \"9e37aefc-fe52-44af-b5d1-838e0ecc1b34\") " pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"
Sep 07 17:11:11.275472 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:11.275247    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-dshm\") pod \"autores-model-3f5660-kserve-79fbbb4b7-dvzvn\" (UID: \"9e37aefc-fe52-44af-b5d1-838e0ecc1b34\") " pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"
Sep 07 17:11:11.275472 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:11.275340    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-tmp-dir\") pod \"autores-model-3f5660-kserve-79fbbb4b7-dvzvn\" (UID: \"9e37aefc-fe52-44af-b5d1-838e0ecc1b34\") " pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"
Sep 07 17:11:11.275472 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:11.275452    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-model-cache\") pod \"autores-model-3f5660-kserve-79fbbb4b7-dvzvn\" (UID: \"9e37aefc-fe52-44af-b5d1-838e0ecc1b34\") " pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"
Sep 07 17:11:11.275680 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:11.275658    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-home\") pod \"autores-model-3f5660-kserve-79fbbb4b7-dvzvn\" (UID: \"9e37aefc-fe52-44af-b5d1-838e0ecc1b34\") " pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"
Sep 07 17:11:11.277579 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:11.277558    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-dshm\") pod \"autores-model-3f5660-kserve-79fbbb4b7-dvzvn\" (UID: \"9e37aefc-fe52-44af-b5d1-838e0ecc1b34\") " pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"
Sep 07 17:11:11.277694 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:11.277675    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-tls-certs\") pod \"autores-model-3f5660-kserve-79fbbb4b7-dvzvn\" (UID: \"9e37aefc-fe52-44af-b5d1-838e0ecc1b34\") " pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"
Sep 07 17:11:11.292096 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:11.292067    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt5kc\" (UniqueName: \"kubernetes.io/projected/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-kube-api-access-rt5kc\") pod \"autores-model-3f5660-kserve-79fbbb4b7-dvzvn\" (UID: \"9e37aefc-fe52-44af-b5d1-838e0ecc1b34\") " pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"
Sep 07 17:11:11.433733 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:11.433648    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"
Sep 07 17:11:11.711541 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:11.711511    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"]
Sep 07 17:11:11.712036 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:11:11.712014    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e37aefc_fe52_44af_b5d1_838e0ecc1b34.slice/crio-565869d1c6372fded1468d58ae137ffa286d86f4f3bf88dad81503106c00672e WatchSource:0}: Error finding container 565869d1c6372fded1468d58ae137ffa286d86f4f3bf88dad81503106c00672e: Status 404 returned error can't find the container with id 565869d1c6372fded1468d58ae137ffa286d86f4f3bf88dad81503106c00672e
Sep 07 17:11:12.194963 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:12.194918    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn" event={"ID":"9e37aefc-fe52-44af-b5d1-838e0ecc1b34","Type":"ContainerStarted","Data":"5f09f9e27d849ad57b31a646f455a5db15379f65604b0ec6996432a3b0ce61b5"}
Sep 07 17:11:12.195345 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:12.194971    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn" event={"ID":"9e37aefc-fe52-44af-b5d1-838e0ecc1b34","Type":"ContainerStarted","Data":"565869d1c6372fded1468d58ae137ffa286d86f4f3bf88dad81503106c00672e"}
Sep 07 17:11:12.221620 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:12.221564    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn" podStartSLOduration=1.221548693 podStartE2EDuration="1.221548693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:11:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:11:12.219063568 +0000 UTC m=+866.115910887" watchObservedRunningTime="2026-09-07 17:11:12.221548693 +0000 UTC m=+866.118396007"
Sep 07 17:11:17.914476 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:17.914442    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:17.987949 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:17.987917    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:18.070866 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.070834    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75"]
Sep 07 17:11:18.071349 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.071319    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75" podUID="5d9d045e-0abe-4cba-8859-c61d37af6602" containerName="maas-api" containerID="cri-o://3fb101783237a8e920e9f9915944ebd82fbbf2c04fa19e89cfa4dd52de980682" gracePeriod=30
Sep 07 17:11:18.095129 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.095098    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:18.163735 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.163704    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4"]
Sep 07 17:11:18.163968 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.163915    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4" podUID="06c6a504-3dc2-4446-ae6e-e76de018b68d" containerName="payload-pre-processing" containerID="cri-o://f2490161e3f301a46c3dd56309ea42913fc5f9e9873f3b2160877a3ebd3689a9" gracePeriod=30
Sep 07 17:11:18.208489 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.208453    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:18.231349 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.231318    2575 generic.go:356] "Generic (PLEG): container finished" podID="5d9d045e-0abe-4cba-8859-c61d37af6602" containerID="3fb101783237a8e920e9f9915944ebd82fbbf2c04fa19e89cfa4dd52de980682" exitCode=0
Sep 07 17:11:18.231506 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.231388    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75" event={"ID":"5d9d045e-0abe-4cba-8859-c61d37af6602","Type":"ContainerDied","Data":"3fb101783237a8e920e9f9915944ebd82fbbf2c04fa19e89cfa4dd52de980682"}
Sep 07 17:11:18.312648 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.312611    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:18.404004 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.403974    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:18.423155 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.423105    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75"
Sep 07 17:11:18.426823 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.426802    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4"
Sep 07 17:11:18.546114 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.546079    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:18.551055 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.551034    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d9d045e-0abe-4cba-8859-c61d37af6602-metrics-certs\") pod \"5d9d045e-0abe-4cba-8859-c61d37af6602\" (UID: \"5d9d045e-0abe-4cba-8859-c61d37af6602\") "
Sep 07 17:11:18.551181 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.551088    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rq6q\" (UniqueName: \"kubernetes.io/projected/5d9d045e-0abe-4cba-8859-c61d37af6602-kube-api-access-5rq6q\") pod \"5d9d045e-0abe-4cba-8859-c61d37af6602\" (UID: \"5d9d045e-0abe-4cba-8859-c61d37af6602\") "
Sep 07 17:11:18.551181 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.551116    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b25qf\" (UniqueName: \"kubernetes.io/projected/06c6a504-3dc2-4446-ae6e-e76de018b68d-kube-api-access-b25qf\") pod \"06c6a504-3dc2-4446-ae6e-e76de018b68d\" (UID: \"06c6a504-3dc2-4446-ae6e-e76de018b68d\") "
Sep 07 17:11:18.551181 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.551152    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d9d045e-0abe-4cba-8859-c61d37af6602-maas-api-tls\") pod \"5d9d045e-0abe-4cba-8859-c61d37af6602\" (UID: \"5d9d045e-0abe-4cba-8859-c61d37af6602\") "
Sep 07 17:11:18.551353 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.551183    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d9d045e-0abe-4cba-8859-c61d37af6602-openshift-service-ca\") pod \"5d9d045e-0abe-4cba-8859-c61d37af6602\" (UID: \"5d9d045e-0abe-4cba-8859-c61d37af6602\") "
Sep 07 17:11:18.551353 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.551340    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06c6a504-3dc2-4446-ae6e-e76de018b68d-plugins-config-volume\") pod \"06c6a504-3dc2-4446-ae6e-e76de018b68d\" (UID: \"06c6a504-3dc2-4446-ae6e-e76de018b68d\") "
Sep 07 17:11:18.551808 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.551608    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d9d045e-0abe-4cba-8859-c61d37af6602-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5d9d045e-0abe-4cba-8859-c61d37af6602" (UID: "5d9d045e-0abe-4cba-8859-c61d37af6602"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:11:18.551808 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.551690    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06c6a504-3dc2-4446-ae6e-e76de018b68d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "06c6a504-3dc2-4446-ae6e-e76de018b68d" (UID: "06c6a504-3dc2-4446-ae6e-e76de018b68d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:11:18.551965 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.551851    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d9d045e-0abe-4cba-8859-c61d37af6602-openshift-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:11:18.551965 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.551871    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06c6a504-3dc2-4446-ae6e-e76de018b68d-plugins-config-volume\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:11:18.553342 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.553316    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06c6a504-3dc2-4446-ae6e-e76de018b68d-kube-api-access-b25qf" (OuterVolumeSpecName: "kube-api-access-b25qf") pod "06c6a504-3dc2-4446-ae6e-e76de018b68d" (UID: "06c6a504-3dc2-4446-ae6e-e76de018b68d"). InnerVolumeSpecName "kube-api-access-b25qf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:11:18.553441 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.553320    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d9d045e-0abe-4cba-8859-c61d37af6602-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5d9d045e-0abe-4cba-8859-c61d37af6602" (UID: "5d9d045e-0abe-4cba-8859-c61d37af6602"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:11:18.553441 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.553391    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d9d045e-0abe-4cba-8859-c61d37af6602-kube-api-access-5rq6q" (OuterVolumeSpecName: "kube-api-access-5rq6q") pod "5d9d045e-0abe-4cba-8859-c61d37af6602" (UID: "5d9d045e-0abe-4cba-8859-c61d37af6602"). InnerVolumeSpecName "kube-api-access-5rq6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:11:18.553532 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.553444    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d9d045e-0abe-4cba-8859-c61d37af6602-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5d9d045e-0abe-4cba-8859-c61d37af6602" (UID: "5d9d045e-0abe-4cba-8859-c61d37af6602"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:11:18.652382 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.652349    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d9d045e-0abe-4cba-8859-c61d37af6602-metrics-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:11:18.652382 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.652377    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rq6q\" (UniqueName: \"kubernetes.io/projected/5d9d045e-0abe-4cba-8859-c61d37af6602-kube-api-access-5rq6q\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:11:18.652382 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.652387    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b25qf\" (UniqueName: \"kubernetes.io/projected/06c6a504-3dc2-4446-ae6e-e76de018b68d-kube-api-access-b25qf\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:11:18.652616 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.652395    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d9d045e-0abe-4cba-8859-c61d37af6602-maas-api-tls\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:11:18.990551 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:18.990468    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:19.238246 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:19.238215    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75"
Sep 07 17:11:19.238246 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:19.238220    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75" event={"ID":"5d9d045e-0abe-4cba-8859-c61d37af6602","Type":"ContainerDied","Data":"55db86789d28a1e46dd0e612055b65f91f60882696fa7698111e34370971c891"}
Sep 07 17:11:19.238499 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:19.238291    2575 scope.go:117] "RemoveContainer" containerID="3fb101783237a8e920e9f9915944ebd82fbbf2c04fa19e89cfa4dd52de980682"
Sep 07 17:11:19.239721 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:19.239686    2575 generic.go:356] "Generic (PLEG): container finished" podID="06c6a504-3dc2-4446-ae6e-e76de018b68d" containerID="f2490161e3f301a46c3dd56309ea42913fc5f9e9873f3b2160877a3ebd3689a9" exitCode=0
Sep 07 17:11:19.239791 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:19.239736    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4"
Sep 07 17:11:19.239791 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:19.239766    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4" event={"ID":"06c6a504-3dc2-4446-ae6e-e76de018b68d","Type":"ContainerDied","Data":"f2490161e3f301a46c3dd56309ea42913fc5f9e9873f3b2160877a3ebd3689a9"}
Sep 07 17:11:19.239919 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:19.239807    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4" event={"ID":"06c6a504-3dc2-4446-ae6e-e76de018b68d","Type":"ContainerDied","Data":"16eae7a6aeeb102c8cee53d0ce67ca8fc70f5f041d1dd0ca732730ab0806347f"}
Sep 07 17:11:19.247644 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:19.247620    2575 scope.go:117] "RemoveContainer" containerID="f2490161e3f301a46c3dd56309ea42913fc5f9e9873f3b2160877a3ebd3689a9"
Sep 07 17:11:19.255651 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:19.255634    2575 scope.go:117] "RemoveContainer" containerID="f2490161e3f301a46c3dd56309ea42913fc5f9e9873f3b2160877a3ebd3689a9"
Sep 07 17:11:19.255942 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:11:19.255919    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2490161e3f301a46c3dd56309ea42913fc5f9e9873f3b2160877a3ebd3689a9\": container with ID starting with f2490161e3f301a46c3dd56309ea42913fc5f9e9873f3b2160877a3ebd3689a9 not found: ID does not exist" containerID="f2490161e3f301a46c3dd56309ea42913fc5f9e9873f3b2160877a3ebd3689a9"
Sep 07 17:11:19.255998 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:19.255950    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2490161e3f301a46c3dd56309ea42913fc5f9e9873f3b2160877a3ebd3689a9"} err="failed to get container status \"f2490161e3f301a46c3dd56309ea42913fc5f9e9873f3b2160877a3ebd3689a9\": rpc error: code = NotFound desc = could not find container \"f2490161e3f301a46c3dd56309ea42913fc5f9e9873f3b2160877a3ebd3689a9\": container with ID starting with f2490161e3f301a46c3dd56309ea42913fc5f9e9873f3b2160877a3ebd3689a9 not found: ID does not exist"
Sep 07 17:11:19.269059 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:19.269036    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4"]
Sep 07 17:11:19.278919 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:19.278886    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4"]
Sep 07 17:11:19.300481 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:19.300452    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75"]
Sep 07 17:11:19.314630 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:19.314599    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f85216b6-cb69f94d5-pfw75"]
Sep 07 17:11:19.356359 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:19.356316    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:19.694167 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:19.694139    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:20.723371 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:20.723334    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06c6a504-3dc2-4446-ae6e-e76de018b68d" path="/var/lib/kubelet/pods/06c6a504-3dc2-4446-ae6e-e76de018b68d/volumes"
Sep 07 17:11:20.723961 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:20.723941    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d9d045e-0abe-4cba-8859-c61d37af6602" path="/var/lib/kubelet/pods/5d9d045e-0abe-4cba-8859-c61d37af6602/volumes"
Sep 07 17:11:21.434616 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:21.434584    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"
Sep 07 17:11:21.434776 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:21.434760    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"
Sep 07 17:11:21.447718 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:21.447691    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"
Sep 07 17:11:21.595198 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:21.595161    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:21.706828 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:21.706732    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:22.268384 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:22.268355    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"
Sep 07 17:11:22.835948 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:22.835911    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx"]
Sep 07 17:11:22.836542 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:22.836519    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d9d045e-0abe-4cba-8859-c61d37af6602" containerName="maas-api"
Sep 07 17:11:22.836542 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:22.836541    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d9d045e-0abe-4cba-8859-c61d37af6602" containerName="maas-api"
Sep 07 17:11:22.836721 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:22.836551    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06c6a504-3dc2-4446-ae6e-e76de018b68d" containerName="payload-pre-processing"
Sep 07 17:11:22.836721 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:22.836560    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="06c6a504-3dc2-4446-ae6e-e76de018b68d" containerName="payload-pre-processing"
Sep 07 17:11:22.836721 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:22.836688    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d9d045e-0abe-4cba-8859-c61d37af6602" containerName="maas-api"
Sep 07 17:11:22.836721 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:22.836703    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="06c6a504-3dc2-4446-ae6e-e76de018b68d" containerName="payload-pre-processing"
Sep 07 17:11:22.841805 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:22.841777    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx"
Sep 07 17:11:22.845225 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:22.845205    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-d53e4343-serving-cert\""
Sep 07 17:11:22.862285 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:22.862258    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx"]
Sep 07 17:11:22.873135 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:22.873096    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:22.970540 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:22.970503    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:22.994645 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:22.994616    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284-metrics-certs\") pod \"maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx\" (UID: \"17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx"
Sep 07 17:11:22.994798 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:22.994693    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284-maas-api-tls\") pod \"maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx\" (UID: \"17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx"
Sep 07 17:11:22.994798 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:22.994741    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284-openshift-service-ca\") pod \"maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx\" (UID: \"17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx"
Sep 07 17:11:22.994798 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:22.994772    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfjlp\" (UniqueName: \"kubernetes.io/projected/17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284-kube-api-access-lfjlp\") pod \"maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx\" (UID: \"17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx"
Sep 07 17:11:23.073984 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:23.073952    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:23.096196 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:23.096117    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284-maas-api-tls\") pod \"maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx\" (UID: \"17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx"
Sep 07 17:11:23.096196 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:23.096174    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284-openshift-service-ca\") pod \"maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx\" (UID: \"17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx"
Sep 07 17:11:23.096378 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:23.096205    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfjlp\" (UniqueName: \"kubernetes.io/projected/17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284-kube-api-access-lfjlp\") pod \"maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx\" (UID: \"17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx"
Sep 07 17:11:23.096378 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:23.096267    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284-metrics-certs\") pod \"maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx\" (UID: \"17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx"
Sep 07 17:11:23.096961 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:23.096938    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284-openshift-service-ca\") pod \"maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx\" (UID: \"17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx"
Sep 07 17:11:23.098682 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:23.098655    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284-maas-api-tls\") pod \"maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx\" (UID: \"17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx"
Sep 07 17:11:23.098764 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:23.098704    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284-metrics-certs\") pod \"maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx\" (UID: \"17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx"
Sep 07 17:11:23.106107 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:23.106086    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfjlp\" (UniqueName: \"kubernetes.io/projected/17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284-kube-api-access-lfjlp\") pod \"maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx\" (UID: \"17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx"
Sep 07 17:11:23.152438 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:23.152398    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx"
Sep 07 17:11:23.439997 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:23.439969    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx"]
Sep 07 17:11:23.441689 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:11:23.441662    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17b31f09_ec5d_4fc2_a8e8_1f85e9bcc284.slice/crio-5820b34b7a2b7c58852aaa91a803acfff734803c06e97a46632202bc0a8da704 WatchSource:0}: Error finding container 5820b34b7a2b7c58852aaa91a803acfff734803c06e97a46632202bc0a8da704: Status 404 returned error can't find the container with id 5820b34b7a2b7c58852aaa91a803acfff734803c06e97a46632202bc0a8da704
Sep 07 17:11:23.554520 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:23.554486    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:23.679955 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:23.679915    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:24.269670 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:24.269568    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx" event={"ID":"17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284","Type":"ContainerStarted","Data":"25a07f24a86fed9c98b290840f8623710df6ccada4c06dd019b077b8af149a45"}
Sep 07 17:11:24.269670 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:24.269634    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx" event={"ID":"17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284","Type":"ContainerStarted","Data":"5820b34b7a2b7c58852aaa91a803acfff734803c06e97a46632202bc0a8da704"}
Sep 07 17:11:24.269886 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:24.269867    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx"
Sep 07 17:11:24.294876 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:24.294818    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx" podStartSLOduration=1.8414359930000002 podStartE2EDuration="2.294800875s" totalImagesPullingTime="453.364882ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:11:24.293605623 +0000 UTC m=+878.190452938" watchObservedRunningTime="2026-09-07 17:11:24.294800875 +0000 UTC m=+878.191648190"
Sep 07 17:11:30.280049 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:30.280017    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx"
Sep 07 17:11:34.263356 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:34.263317    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:42.138520 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:42.138485    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"]
Sep 07 17:11:42.142864 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:42.142844    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"
Sep 07 17:11:42.146217 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:42.146200    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-9fa102\"/\"kube-root-ca.crt\""
Sep 07 17:11:42.147627 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:42.147606    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-9fa102\"/\"default-dockercfg-bv9xx\""
Sep 07 17:11:42.147715 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:42.147638    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-9fa102\"/\"test-model-9fa102-kserve-self-signed-certs\""
Sep 07 17:11:42.147715 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:42.147606    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-9fa102\"/\"openshift-service-ca.crt\""
Sep 07 17:11:42.159310 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:42.159278    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"]
Sep 07 17:11:42.175238 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:42.175200    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-home\") pod \"test-model-9fa102-kserve-7cd78f79f9-cm6w4\" (UID: \"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f\") " pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"
Sep 07 17:11:42.175407 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:42.175309    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dfzp\" (UniqueName: \"kubernetes.io/projected/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-kube-api-access-4dfzp\") pod \"test-model-9fa102-kserve-7cd78f79f9-cm6w4\" (UID: \"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f\") " pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"
Sep 07 17:11:42.175456 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:42.175413    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-dshm\") pod \"test-model-9fa102-kserve-7cd78f79f9-cm6w4\" (UID: \"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f\") " pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"
Sep 07 17:11:42.175456 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:42.175447    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-model-cache\") pod \"test-model-9fa102-kserve-7cd78f79f9-cm6w4\" (UID: \"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f\") " pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"
Sep 07 17:11:42.175560 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:42.175544    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-tls-certs\") pod \"test-model-9fa102-kserve-7cd78f79f9-cm6w4\" (UID: \"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f\") " pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"
Sep 07 17:11:42.175622 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:42.175598    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-tmp-dir\") pod \"test-model-9fa102-kserve-7cd78f79f9-cm6w4\" (UID: \"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f\") " pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"
Sep 07 17:11:42.186270 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:42.186239    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:42.276823 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:42.276786    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dfzp\" (UniqueName: \"kubernetes.io/projected/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-kube-api-access-4dfzp\") pod \"test-model-9fa102-kserve-7cd78f79f9-cm6w4\" (UID: \"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f\") " pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"
Sep 07 17:11:42.277053 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:42.276846    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-dshm\") pod \"test-model-9fa102-kserve-7cd78f79f9-cm6w4\" (UID: \"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f\") " pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"
Sep 07 17:11:42.277053 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:42.276863    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-model-cache\") pod \"test-model-9fa102-kserve-7cd78f79f9-cm6w4\" (UID: \"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f\") " pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"
Sep 07 17:11:42.277053 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:42.276961    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-tls-certs\") pod \"test-model-9fa102-kserve-7cd78f79f9-cm6w4\" (UID: \"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f\") " pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"
Sep 07 17:11:42.277053 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:42.276984    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-tmp-dir\") pod \"test-model-9fa102-kserve-7cd78f79f9-cm6w4\" (UID: \"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f\") " pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"
Sep 07 17:11:42.277053 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:42.277017    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-home\") pod \"test-model-9fa102-kserve-7cd78f79f9-cm6w4\" (UID: \"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f\") " pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"
Sep 07 17:11:42.277378 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:42.277358    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-model-cache\") pod \"test-model-9fa102-kserve-7cd78f79f9-cm6w4\" (UID: \"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f\") " pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"
Sep 07 17:11:42.277477 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:42.277455    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-tmp-dir\") pod \"test-model-9fa102-kserve-7cd78f79f9-cm6w4\" (UID: \"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f\") " pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"
Sep 07 17:11:42.277530 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:42.277478    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-home\") pod \"test-model-9fa102-kserve-7cd78f79f9-cm6w4\" (UID: \"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f\") " pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"
Sep 07 17:11:42.279255 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:42.279229    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-dshm\") pod \"test-model-9fa102-kserve-7cd78f79f9-cm6w4\" (UID: \"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f\") " pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"
Sep 07 17:11:42.279421 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:42.279405    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-tls-certs\") pod \"test-model-9fa102-kserve-7cd78f79f9-cm6w4\" (UID: \"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f\") " pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"
Sep 07 17:11:42.289463 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:42.289442    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dfzp\" (UniqueName: \"kubernetes.io/projected/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-kube-api-access-4dfzp\") pod \"test-model-9fa102-kserve-7cd78f79f9-cm6w4\" (UID: \"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f\") " pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"
Sep 07 17:11:42.453295 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:42.453185    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"
Sep 07 17:11:42.725303 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:42.725267    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"]
Sep 07 17:11:42.726765 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:11:42.726732    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ca5b7d4_5e6e_460f_ab2a_1aaafc966e1f.slice/crio-d8364ce60d3bd61b8ff4c8a7c4a80d64f9aff6ab91e66d22df94dea098d46546 WatchSource:0}: Error finding container d8364ce60d3bd61b8ff4c8a7c4a80d64f9aff6ab91e66d22df94dea098d46546: Status 404 returned error can't find the container with id d8364ce60d3bd61b8ff4c8a7c4a80d64f9aff6ab91e66d22df94dea098d46546
Sep 07 17:11:43.372506 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:43.372471    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4" event={"ID":"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f","Type":"ContainerStarted","Data":"6b09c8598afc468647e5f477252543720870827d6c2dc73b0d19c4212c3fd538"}
Sep 07 17:11:43.372506 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:43.372512    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4" event={"ID":"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f","Type":"ContainerStarted","Data":"d8364ce60d3bd61b8ff4c8a7c4a80d64f9aff6ab91e66d22df94dea098d46546"}
Sep 07 17:11:43.398167 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:43.398109    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4" podStartSLOduration=1.398093389 podStartE2EDuration="1.398093389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:11:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:11:43.394955367 +0000 UTC m=+897.291802680" watchObservedRunningTime="2026-09-07 17:11:43.398093389 +0000 UTC m=+897.294940704"
Sep 07 17:11:43.958006 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:43.957971    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:44.045499 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:44.045454    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:44.668823 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:44.668789    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:45.009988 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:45.009912    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"]
Sep 07 17:11:45.022595 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:45.022567    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:45.461401 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:45.461361    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:46.119598 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:46.119569    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:46.365436 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:46.365400    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:50.334427 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:50.334383    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:50.438678 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:50.438639    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:52.453676 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:52.453640    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"
Sep 07 17:11:52.454096 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:52.453916    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"
Sep 07 17:11:52.466443 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:52.466418    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"
Sep 07 17:11:53.415304 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:53.415268    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx"]
Sep 07 17:11:53.415563 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:53.415472    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx" podUID="17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284" containerName="maas-api" containerID="cri-o://25a07f24a86fed9c98b290840f8623710df6ccada4c06dd019b077b8af149a45" gracePeriod=30
Sep 07 17:11:53.444164 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:53.444137    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"
Sep 07 17:11:53.458251 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:53.458212    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:53.567880 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:53.567846    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:53.645250 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:53.645211    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:53.668450 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:53.668386    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx"
Sep 07 17:11:53.749654 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:53.749618    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:53.797272 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:53.797241    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284-openshift-service-ca\") pod \"17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284\" (UID: \"17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284\") "
Sep 07 17:11:53.797272 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:53.797289    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfjlp\" (UniqueName: \"kubernetes.io/projected/17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284-kube-api-access-lfjlp\") pod \"17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284\" (UID: \"17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284\") "
Sep 07 17:11:53.797553 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:53.797375    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284-maas-api-tls\") pod \"17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284\" (UID: \"17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284\") "
Sep 07 17:11:53.797553 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:53.797435    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284-metrics-certs\") pod \"17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284\" (UID: \"17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284\") "
Sep 07 17:11:53.797694 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:53.797653    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284" (UID: "17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:11:53.798153 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:53.798122    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284-openshift-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:11:53.799758 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:53.799727    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284" (UID: "17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:11:53.799864 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:53.799780    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284" (UID: "17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:11:53.799864 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:53.799808    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284-kube-api-access-lfjlp" (OuterVolumeSpecName: "kube-api-access-lfjlp") pod "17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284" (UID: "17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284"). InnerVolumeSpecName "kube-api-access-lfjlp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:11:53.840253 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:53.840218    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:53.899100 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:53.899063    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284-maas-api-tls\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:11:53.899100 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:53.899095    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284-metrics-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:11:53.899100 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:53.899105    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfjlp\" (UniqueName: \"kubernetes.io/projected/17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284-kube-api-access-lfjlp\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:11:54.079519 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:54.079477    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:54.437994 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:54.437889    2575 generic.go:356] "Generic (PLEG): container finished" podID="17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284" containerID="25a07f24a86fed9c98b290840f8623710df6ccada4c06dd019b077b8af149a45" exitCode=0
Sep 07 17:11:54.437994 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:54.437947    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx"
Sep 07 17:11:54.438238 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:54.437993    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx" event={"ID":"17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284","Type":"ContainerDied","Data":"25a07f24a86fed9c98b290840f8623710df6ccada4c06dd019b077b8af149a45"}
Sep 07 17:11:54.438238 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:54.438060    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx" event={"ID":"17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284","Type":"ContainerDied","Data":"5820b34b7a2b7c58852aaa91a803acfff734803c06e97a46632202bc0a8da704"}
Sep 07 17:11:54.438238 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:54.438091    2575 scope.go:117] "RemoveContainer" containerID="25a07f24a86fed9c98b290840f8623710df6ccada4c06dd019b077b8af149a45"
Sep 07 17:11:54.448277 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:54.448255    2575 scope.go:117] "RemoveContainer" containerID="25a07f24a86fed9c98b290840f8623710df6ccada4c06dd019b077b8af149a45"
Sep 07 17:11:54.448605 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:11:54.448579    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25a07f24a86fed9c98b290840f8623710df6ccada4c06dd019b077b8af149a45\": container with ID starting with 25a07f24a86fed9c98b290840f8623710df6ccada4c06dd019b077b8af149a45 not found: ID does not exist" containerID="25a07f24a86fed9c98b290840f8623710df6ccada4c06dd019b077b8af149a45"
Sep 07 17:11:54.448693 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:54.448616    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25a07f24a86fed9c98b290840f8623710df6ccada4c06dd019b077b8af149a45"} err="failed to get container status \"25a07f24a86fed9c98b290840f8623710df6ccada4c06dd019b077b8af149a45\": rpc error: code = NotFound desc = could not find container \"25a07f24a86fed9c98b290840f8623710df6ccada4c06dd019b077b8af149a45\": container with ID starting with 25a07f24a86fed9c98b290840f8623710df6ccada4c06dd019b077b8af149a45 not found: ID does not exist"
Sep 07 17:11:54.462517 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:54.462488    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx"]
Sep 07 17:11:54.468246 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:54.468219    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d53e4343-74b7b9c479-r5rrx"]
Sep 07 17:11:54.725599 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:54.725517    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284" path="/var/lib/kubelet/pods/17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284/volumes"
Sep 07 17:11:54.754213 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:54.754184    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:54.798021 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:54.797990    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c"]
Sep 07 17:11:54.798258 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:54.798228    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c" podUID="3879a4a0-6540-4e66-9f7c-a6d009fb24d4" containerName="payload-processing" containerID="cri-o://12bcc5e5f590e0c0edf44e4b0903ba27617de47b9cc63caa2a076b8d9a0cf5d2" gracePeriod=30
Sep 07 17:11:54.803988 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:54.803953    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj"]
Sep 07 17:11:54.804195 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:54.804172    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj" podUID="1dea241d-eaa8-4a50-bf3d-a68de53ae08b" containerName="payload-pre-processing" containerID="cri-o://ed1a46a19c0d4c224469ce7f4eab453fe723c11007ddecda24298cab6218ba55" gracePeriod=30
Sep 07 17:11:54.861334 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:54.861300    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:54.956849 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:54.956752    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:55.033039 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.032887    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:55.051792 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.051765    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c"
Sep 07 17:11:55.090160 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.090134    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj"
Sep 07 17:11:55.213484 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.213450    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7hm7\" (UniqueName: \"kubernetes.io/projected/3879a4a0-6540-4e66-9f7c-a6d009fb24d4-kube-api-access-g7hm7\") pod \"3879a4a0-6540-4e66-9f7c-a6d009fb24d4\" (UID: \"3879a4a0-6540-4e66-9f7c-a6d009fb24d4\") "
Sep 07 17:11:55.213638 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.213527    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmp48\" (UniqueName: \"kubernetes.io/projected/1dea241d-eaa8-4a50-bf3d-a68de53ae08b-kube-api-access-dmp48\") pod \"1dea241d-eaa8-4a50-bf3d-a68de53ae08b\" (UID: \"1dea241d-eaa8-4a50-bf3d-a68de53ae08b\") "
Sep 07 17:11:55.213638 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.213580    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1dea241d-eaa8-4a50-bf3d-a68de53ae08b-plugins-config-volume\") pod \"1dea241d-eaa8-4a50-bf3d-a68de53ae08b\" (UID: \"1dea241d-eaa8-4a50-bf3d-a68de53ae08b\") "
Sep 07 17:11:55.213772 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.213645    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3879a4a0-6540-4e66-9f7c-a6d009fb24d4-plugins-config-volume\") pod \"3879a4a0-6540-4e66-9f7c-a6d009fb24d4\" (UID: \"3879a4a0-6540-4e66-9f7c-a6d009fb24d4\") "
Sep 07 17:11:55.214051 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.214022    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dea241d-eaa8-4a50-bf3d-a68de53ae08b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1dea241d-eaa8-4a50-bf3d-a68de53ae08b" (UID: "1dea241d-eaa8-4a50-bf3d-a68de53ae08b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:11:55.214178 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.214087    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3879a4a0-6540-4e66-9f7c-a6d009fb24d4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3879a4a0-6540-4e66-9f7c-a6d009fb24d4" (UID: "3879a4a0-6540-4e66-9f7c-a6d009fb24d4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:11:55.215546 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.215525    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3879a4a0-6540-4e66-9f7c-a6d009fb24d4-kube-api-access-g7hm7" (OuterVolumeSpecName: "kube-api-access-g7hm7") pod "3879a4a0-6540-4e66-9f7c-a6d009fb24d4" (UID: "3879a4a0-6540-4e66-9f7c-a6d009fb24d4"). InnerVolumeSpecName "kube-api-access-g7hm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:11:55.215647 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.215600    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dea241d-eaa8-4a50-bf3d-a68de53ae08b-kube-api-access-dmp48" (OuterVolumeSpecName: "kube-api-access-dmp48") pod "1dea241d-eaa8-4a50-bf3d-a68de53ae08b" (UID: "1dea241d-eaa8-4a50-bf3d-a68de53ae08b"). InnerVolumeSpecName "kube-api-access-dmp48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:11:55.314913 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.314802    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7hm7\" (UniqueName: \"kubernetes.io/projected/3879a4a0-6540-4e66-9f7c-a6d009fb24d4-kube-api-access-g7hm7\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:11:55.314913 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.314836    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmp48\" (UniqueName: \"kubernetes.io/projected/1dea241d-eaa8-4a50-bf3d-a68de53ae08b-kube-api-access-dmp48\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:11:55.314913 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.314846    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1dea241d-eaa8-4a50-bf3d-a68de53ae08b-plugins-config-volume\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:11:55.314913 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.314855    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3879a4a0-6540-4e66-9f7c-a6d009fb24d4-plugins-config-volume\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:11:55.396763 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.396735    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:55.444607 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.444573    2575 generic.go:356] "Generic (PLEG): container finished" podID="1dea241d-eaa8-4a50-bf3d-a68de53ae08b" containerID="ed1a46a19c0d4c224469ce7f4eab453fe723c11007ddecda24298cab6218ba55" exitCode=0
Sep 07 17:11:55.444786 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.444615    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj"
Sep 07 17:11:55.444786 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.444665    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj" event={"ID":"1dea241d-eaa8-4a50-bf3d-a68de53ae08b","Type":"ContainerDied","Data":"ed1a46a19c0d4c224469ce7f4eab453fe723c11007ddecda24298cab6218ba55"}
Sep 07 17:11:55.444786 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.444723    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj" event={"ID":"1dea241d-eaa8-4a50-bf3d-a68de53ae08b","Type":"ContainerDied","Data":"375cb85150d91a8958cc896b8430cb4e6387b424234884dee20c544a0ab1bbca"}
Sep 07 17:11:55.444786 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.444753    2575 scope.go:117] "RemoveContainer" containerID="ed1a46a19c0d4c224469ce7f4eab453fe723c11007ddecda24298cab6218ba55"
Sep 07 17:11:55.446218 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.446197    2575 generic.go:356] "Generic (PLEG): container finished" podID="3879a4a0-6540-4e66-9f7c-a6d009fb24d4" containerID="12bcc5e5f590e0c0edf44e4b0903ba27617de47b9cc63caa2a076b8d9a0cf5d2" exitCode=0
Sep 07 17:11:55.446350 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.446224    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c" event={"ID":"3879a4a0-6540-4e66-9f7c-a6d009fb24d4","Type":"ContainerDied","Data":"12bcc5e5f590e0c0edf44e4b0903ba27617de47b9cc63caa2a076b8d9a0cf5d2"}
Sep 07 17:11:55.446350 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.446254    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c"
Sep 07 17:11:55.446350 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.446276    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c" event={"ID":"3879a4a0-6540-4e66-9f7c-a6d009fb24d4","Type":"ContainerDied","Data":"43fcec8f0a4462a64499563733e1b0b531e4975e937b08a88e655d1cab9ae7ef"}
Sep 07 17:11:55.454411 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.454393    2575 scope.go:117] "RemoveContainer" containerID="ed1a46a19c0d4c224469ce7f4eab453fe723c11007ddecda24298cab6218ba55"
Sep 07 17:11:55.454710 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:11:55.454683    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed1a46a19c0d4c224469ce7f4eab453fe723c11007ddecda24298cab6218ba55\": container with ID starting with ed1a46a19c0d4c224469ce7f4eab453fe723c11007ddecda24298cab6218ba55 not found: ID does not exist" containerID="ed1a46a19c0d4c224469ce7f4eab453fe723c11007ddecda24298cab6218ba55"
Sep 07 17:11:55.454789 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.454717    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed1a46a19c0d4c224469ce7f4eab453fe723c11007ddecda24298cab6218ba55"} err="failed to get container status \"ed1a46a19c0d4c224469ce7f4eab453fe723c11007ddecda24298cab6218ba55\": rpc error: code = NotFound desc = could not find container \"ed1a46a19c0d4c224469ce7f4eab453fe723c11007ddecda24298cab6218ba55\": container with ID starting with ed1a46a19c0d4c224469ce7f4eab453fe723c11007ddecda24298cab6218ba55 not found: ID does not exist"
Sep 07 17:11:55.454789 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.454732    2575 scope.go:117] "RemoveContainer" containerID="12bcc5e5f590e0c0edf44e4b0903ba27617de47b9cc63caa2a076b8d9a0cf5d2"
Sep 07 17:11:55.462975 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.462957    2575 scope.go:117] "RemoveContainer" containerID="12bcc5e5f590e0c0edf44e4b0903ba27617de47b9cc63caa2a076b8d9a0cf5d2"
Sep 07 17:11:55.463240 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:11:55.463209    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12bcc5e5f590e0c0edf44e4b0903ba27617de47b9cc63caa2a076b8d9a0cf5d2\": container with ID starting with 12bcc5e5f590e0c0edf44e4b0903ba27617de47b9cc63caa2a076b8d9a0cf5d2 not found: ID does not exist" containerID="12bcc5e5f590e0c0edf44e4b0903ba27617de47b9cc63caa2a076b8d9a0cf5d2"
Sep 07 17:11:55.463240 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.463231    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12bcc5e5f590e0c0edf44e4b0903ba27617de47b9cc63caa2a076b8d9a0cf5d2"} err="failed to get container status \"12bcc5e5f590e0c0edf44e4b0903ba27617de47b9cc63caa2a076b8d9a0cf5d2\": rpc error: code = NotFound desc = could not find container \"12bcc5e5f590e0c0edf44e4b0903ba27617de47b9cc63caa2a076b8d9a0cf5d2\": container with ID starting with 12bcc5e5f590e0c0edf44e4b0903ba27617de47b9cc63caa2a076b8d9a0cf5d2 not found: ID does not exist"
Sep 07 17:11:55.475074 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.475053    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c"]
Sep 07 17:11:55.478054 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.478035    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c"]
Sep 07 17:11:55.486079 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.486056    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj"]
Sep 07 17:11:55.490296 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.490275    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj"]
Sep 07 17:11:55.551789 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.551760    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:55.886314 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:55.886280    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:56.076178 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:56.076098    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:56.722748 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:56.722717    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dea241d-eaa8-4a50-bf3d-a68de53ae08b" path="/var/lib/kubelet/pods/1dea241d-eaa8-4a50-bf3d-a68de53ae08b/volumes"
Sep 07 17:11:56.723138 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:56.723123    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3879a4a0-6540-4e66-9f7c-a6d009fb24d4" path="/var/lib/kubelet/pods/3879a4a0-6540-4e66-9f7c-a6d009fb24d4/volumes"
Sep 07 17:11:58.679375 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:58.679341    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:11:58.776398 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:11:58.776361    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:00.001625 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.001592    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c586c514-7d65c96788-slvhx"]
Sep 07 17:12:00.002056 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.002042    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284" containerName="maas-api"
Sep 07 17:12:00.002103 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.002057    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284" containerName="maas-api"
Sep 07 17:12:00.002103 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.002070    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dea241d-eaa8-4a50-bf3d-a68de53ae08b" containerName="payload-pre-processing"
Sep 07 17:12:00.002103 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.002076    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dea241d-eaa8-4a50-bf3d-a68de53ae08b" containerName="payload-pre-processing"
Sep 07 17:12:00.002103 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.002083    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3879a4a0-6540-4e66-9f7c-a6d009fb24d4" containerName="payload-processing"
Sep 07 17:12:00.002103 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.002089    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3879a4a0-6540-4e66-9f7c-a6d009fb24d4" containerName="payload-processing"
Sep 07 17:12:00.002266 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.002154    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="17b31f09-ec5d-4fc2-a8e8-1f85e9bcc284" containerName="maas-api"
Sep 07 17:12:00.002266 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.002161    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3879a4a0-6540-4e66-9f7c-a6d009fb24d4" containerName="payload-processing"
Sep 07 17:12:00.002266 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.002170    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dea241d-eaa8-4a50-bf3d-a68de53ae08b" containerName="payload-pre-processing"
Sep 07 17:12:00.006654 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.006632    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c586c514-7d65c96788-slvhx"
Sep 07 17:12:00.009462 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.009440    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-c586c514-serving-cert\""
Sep 07 17:12:00.018428 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.018401    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c586c514-7d65c96788-slvhx"]
Sep 07 17:12:00.030074 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.030033    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn" podUID="9e37aefc-fe52-44af-b5d1-838e0ecc1b34" containerName="main" containerID="cri-o://5f09f9e27d849ad57b31a646f455a5db15379f65604b0ec6996432a3b0ce61b5" gracePeriod=45
Sep 07 17:12:00.042641 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.042616    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:00.115352 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.115320    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:00.162848 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.162809    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40c359d9-565d-422a-864d-61a535ea9a44-metrics-certs\") pod \"maas-api-e2e-derive-c586c514-7d65c96788-slvhx\" (UID: \"40c359d9-565d-422a-864d-61a535ea9a44\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c586c514-7d65c96788-slvhx"
Sep 07 17:12:00.163007 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.162861    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40c359d9-565d-422a-864d-61a535ea9a44-maas-api-tls\") pod \"maas-api-e2e-derive-c586c514-7d65c96788-slvhx\" (UID: \"40c359d9-565d-422a-864d-61a535ea9a44\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c586c514-7d65c96788-slvhx"
Sep 07 17:12:00.163007 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.162951    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40c359d9-565d-422a-864d-61a535ea9a44-openshift-service-ca\") pod \"maas-api-e2e-derive-c586c514-7d65c96788-slvhx\" (UID: \"40c359d9-565d-422a-864d-61a535ea9a44\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c586c514-7d65c96788-slvhx"
Sep 07 17:12:00.163181 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.163158    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7z66\" (UniqueName: \"kubernetes.io/projected/40c359d9-565d-422a-864d-61a535ea9a44-kube-api-access-h7z66\") pod \"maas-api-e2e-derive-c586c514-7d65c96788-slvhx\" (UID: \"40c359d9-565d-422a-864d-61a535ea9a44\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c586c514-7d65c96788-slvhx"
Sep 07 17:12:00.264745 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.264644    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40c359d9-565d-422a-864d-61a535ea9a44-metrics-certs\") pod \"maas-api-e2e-derive-c586c514-7d65c96788-slvhx\" (UID: \"40c359d9-565d-422a-864d-61a535ea9a44\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c586c514-7d65c96788-slvhx"
Sep 07 17:12:00.264745 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.264700    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40c359d9-565d-422a-864d-61a535ea9a44-maas-api-tls\") pod \"maas-api-e2e-derive-c586c514-7d65c96788-slvhx\" (UID: \"40c359d9-565d-422a-864d-61a535ea9a44\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c586c514-7d65c96788-slvhx"
Sep 07 17:12:00.264745 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.264727    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40c359d9-565d-422a-864d-61a535ea9a44-openshift-service-ca\") pod \"maas-api-e2e-derive-c586c514-7d65c96788-slvhx\" (UID: \"40c359d9-565d-422a-864d-61a535ea9a44\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c586c514-7d65c96788-slvhx"
Sep 07 17:12:00.265050 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.264848    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7z66\" (UniqueName: \"kubernetes.io/projected/40c359d9-565d-422a-864d-61a535ea9a44-kube-api-access-h7z66\") pod \"maas-api-e2e-derive-c586c514-7d65c96788-slvhx\" (UID: \"40c359d9-565d-422a-864d-61a535ea9a44\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c586c514-7d65c96788-slvhx"
Sep 07 17:12:00.265524 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.265497    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40c359d9-565d-422a-864d-61a535ea9a44-openshift-service-ca\") pod \"maas-api-e2e-derive-c586c514-7d65c96788-slvhx\" (UID: \"40c359d9-565d-422a-864d-61a535ea9a44\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c586c514-7d65c96788-slvhx"
Sep 07 17:12:00.266779 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.266753    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:00.267410 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.267385    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40c359d9-565d-422a-864d-61a535ea9a44-maas-api-tls\") pod \"maas-api-e2e-derive-c586c514-7d65c96788-slvhx\" (UID: \"40c359d9-565d-422a-864d-61a535ea9a44\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c586c514-7d65c96788-slvhx"
Sep 07 17:12:00.267533 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.267509    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40c359d9-565d-422a-864d-61a535ea9a44-metrics-certs\") pod \"maas-api-e2e-derive-c586c514-7d65c96788-slvhx\" (UID: \"40c359d9-565d-422a-864d-61a535ea9a44\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c586c514-7d65c96788-slvhx"
Sep 07 17:12:00.273220 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.273196    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7z66\" (UniqueName: \"kubernetes.io/projected/40c359d9-565d-422a-864d-61a535ea9a44-kube-api-access-h7z66\") pod \"maas-api-e2e-derive-c586c514-7d65c96788-slvhx\" (UID: \"40c359d9-565d-422a-864d-61a535ea9a44\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c586c514-7d65c96788-slvhx"
Sep 07 17:12:00.295252 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.295233    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"
Sep 07 17:12:00.321056 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.321023    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c586c514-7d65c96788-slvhx"
Sep 07 17:12:00.467480 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.467444    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-tls-certs\") pod \"9e37aefc-fe52-44af-b5d1-838e0ecc1b34\" (UID: \"9e37aefc-fe52-44af-b5d1-838e0ecc1b34\") "
Sep 07 17:12:00.467661 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.467515    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-model-cache\") pod \"9e37aefc-fe52-44af-b5d1-838e0ecc1b34\" (UID: \"9e37aefc-fe52-44af-b5d1-838e0ecc1b34\") "
Sep 07 17:12:00.467661 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.467572    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-dshm\") pod \"9e37aefc-fe52-44af-b5d1-838e0ecc1b34\" (UID: \"9e37aefc-fe52-44af-b5d1-838e0ecc1b34\") "
Sep 07 17:12:00.467661 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.467593    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rt5kc\" (UniqueName: \"kubernetes.io/projected/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-kube-api-access-rt5kc\") pod \"9e37aefc-fe52-44af-b5d1-838e0ecc1b34\" (UID: \"9e37aefc-fe52-44af-b5d1-838e0ecc1b34\") "
Sep 07 17:12:00.467661 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.467637    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-home\") pod \"9e37aefc-fe52-44af-b5d1-838e0ecc1b34\" (UID: \"9e37aefc-fe52-44af-b5d1-838e0ecc1b34\") "
Sep 07 17:12:00.467925 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.467688    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-tmp-dir\") pod \"9e37aefc-fe52-44af-b5d1-838e0ecc1b34\" (UID: \"9e37aefc-fe52-44af-b5d1-838e0ecc1b34\") "
Sep 07 17:12:00.467925 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.467781    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-model-cache" (OuterVolumeSpecName: "model-cache") pod "9e37aefc-fe52-44af-b5d1-838e0ecc1b34" (UID: "9e37aefc-fe52-44af-b5d1-838e0ecc1b34"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:12:00.468056 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.467946    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-home" (OuterVolumeSpecName: "home") pod "9e37aefc-fe52-44af-b5d1-838e0ecc1b34" (UID: "9e37aefc-fe52-44af-b5d1-838e0ecc1b34"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:12:00.468056 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.468031    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9e37aefc-fe52-44af-b5d1-838e0ecc1b34" (UID: "9e37aefc-fe52-44af-b5d1-838e0ecc1b34"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:12:00.468220 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.468090    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-model-cache\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:12:00.468220 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.468103    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-home\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:12:00.469839 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.469816    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9e37aefc-fe52-44af-b5d1-838e0ecc1b34" (UID: "9e37aefc-fe52-44af-b5d1-838e0ecc1b34"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:12:00.469839 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.469827    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-dshm" (OuterVolumeSpecName: "dshm") pod "9e37aefc-fe52-44af-b5d1-838e0ecc1b34" (UID: "9e37aefc-fe52-44af-b5d1-838e0ecc1b34"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:12:00.469990 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.469846    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-kube-api-access-rt5kc" (OuterVolumeSpecName: "kube-api-access-rt5kc") pod "9e37aefc-fe52-44af-b5d1-838e0ecc1b34" (UID: "9e37aefc-fe52-44af-b5d1-838e0ecc1b34"). InnerVolumeSpecName "kube-api-access-rt5kc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:12:00.485479 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.485445    2575 generic.go:356] "Generic (PLEG): container finished" podID="9e37aefc-fe52-44af-b5d1-838e0ecc1b34" containerID="5f09f9e27d849ad57b31a646f455a5db15379f65604b0ec6996432a3b0ce61b5" exitCode=0
Sep 07 17:12:00.485612 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.485494    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"
Sep 07 17:12:00.485612 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.485535    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn" event={"ID":"9e37aefc-fe52-44af-b5d1-838e0ecc1b34","Type":"ContainerDied","Data":"5f09f9e27d849ad57b31a646f455a5db15379f65604b0ec6996432a3b0ce61b5"}
Sep 07 17:12:00.485612 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.485589    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn" event={"ID":"9e37aefc-fe52-44af-b5d1-838e0ecc1b34","Type":"ContainerDied","Data":"565869d1c6372fded1468d58ae137ffa286d86f4f3bf88dad81503106c00672e"}
Sep 07 17:12:00.485731 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.485613    2575 scope.go:117] "RemoveContainer" containerID="5f09f9e27d849ad57b31a646f455a5db15379f65604b0ec6996432a3b0ce61b5"
Sep 07 17:12:00.494934 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.494889    2575 scope.go:117] "RemoveContainer" containerID="5f09f9e27d849ad57b31a646f455a5db15379f65604b0ec6996432a3b0ce61b5"
Sep 07 17:12:00.495247 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:12:00.495228    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f09f9e27d849ad57b31a646f455a5db15379f65604b0ec6996432a3b0ce61b5\": container with ID starting with 5f09f9e27d849ad57b31a646f455a5db15379f65604b0ec6996432a3b0ce61b5 not found: ID does not exist" containerID="5f09f9e27d849ad57b31a646f455a5db15379f65604b0ec6996432a3b0ce61b5"
Sep 07 17:12:00.495305 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.495255    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f09f9e27d849ad57b31a646f455a5db15379f65604b0ec6996432a3b0ce61b5"} err="failed to get container status \"5f09f9e27d849ad57b31a646f455a5db15379f65604b0ec6996432a3b0ce61b5\": rpc error: code = NotFound desc = could not find container \"5f09f9e27d849ad57b31a646f455a5db15379f65604b0ec6996432a3b0ce61b5\": container with ID starting with 5f09f9e27d849ad57b31a646f455a5db15379f65604b0ec6996432a3b0ce61b5 not found: ID does not exist"
Sep 07 17:12:00.515961 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.513204    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"]
Sep 07 17:12:00.526107 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.526067    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-3f5660/autores-model-3f5660-kserve-79fbbb4b7-dvzvn"]
Sep 07 17:12:00.569088 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.569061    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-tmp-dir\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:12:00.569088 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.569088    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-tls-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:12:00.569294 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.569100    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-dshm\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:12:00.569294 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.569113    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rt5kc\" (UniqueName: \"kubernetes.io/projected/9e37aefc-fe52-44af-b5d1-838e0ecc1b34-kube-api-access-rt5kc\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:12:00.569994 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.569967    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:00.604841 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.604815    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c586c514-7d65c96788-slvhx"]
Sep 07 17:12:00.605797 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:12:00.605773    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40c359d9_565d_422a_864d_61a535ea9a44.slice/crio-be6c43ac4550e811d82b5ecdb8d7216cda940fdac9e9612985b25c3522d816b4 WatchSource:0}: Error finding container be6c43ac4550e811d82b5ecdb8d7216cda940fdac9e9612985b25c3522d816b4: Status 404 returned error can't find the container with id be6c43ac4550e811d82b5ecdb8d7216cda940fdac9e9612985b25c3522d816b4
Sep 07 17:12:00.667749 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.667710    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:00.696644 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.696616    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8"]
Sep 07 17:12:00.697081 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.697065    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e37aefc-fe52-44af-b5d1-838e0ecc1b34" containerName="main"
Sep 07 17:12:00.697081 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.697081    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e37aefc-fe52-44af-b5d1-838e0ecc1b34" containerName="main"
Sep 07 17:12:00.697203 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.697179    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e37aefc-fe52-44af-b5d1-838e0ecc1b34" containerName="main"
Sep 07 17:12:00.701588 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.701569    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8"
Sep 07 17:12:00.705178 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.705159    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-c586c514\""
Sep 07 17:12:00.705272 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.705262    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-c586c514-dockercfg-6kfd5\""
Sep 07 17:12:00.723623 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.723595    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e37aefc-fe52-44af-b5d1-838e0ecc1b34" path="/var/lib/kubelet/pods/9e37aefc-fe52-44af-b5d1-838e0ecc1b34/volumes"
Sep 07 17:12:00.723870 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.723857    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8"]
Sep 07 17:12:00.737943 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.737910    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j"]
Sep 07 17:12:00.741624 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.741605    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j"
Sep 07 17:12:00.752834 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.752809    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j"]
Sep 07 17:12:00.872201 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.872166    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5251a8f-05a3-420e-b9d9-b3f71c98d2f9-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j\" (UID: \"c5251a8f-05a3-420e-b9d9-b3f71c98d2f9\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j"
Sep 07 17:12:00.872377 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.872215    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjgkr\" (UniqueName: \"kubernetes.io/projected/4495b888-ffb1-44e5-bbfb-0bff1f99775c-kube-api-access-kjgkr\") pod \"payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8\" (UID: \"4495b888-ffb1-44e5-bbfb-0bff1f99775c\") " pod="openshift-ingress/payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8"
Sep 07 17:12:00.872377 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.872342    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4495b888-ffb1-44e5-bbfb-0bff1f99775c-plugins-config-volume\") pod \"payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8\" (UID: \"4495b888-ffb1-44e5-bbfb-0bff1f99775c\") " pod="openshift-ingress/payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8"
Sep 07 17:12:00.872453 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.872401    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nml5f\" (UniqueName: \"kubernetes.io/projected/c5251a8f-05a3-420e-b9d9-b3f71c98d2f9-kube-api-access-nml5f\") pod \"payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j\" (UID: \"c5251a8f-05a3-420e-b9d9-b3f71c98d2f9\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j"
Sep 07 17:12:00.973258 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.973226    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nml5f\" (UniqueName: \"kubernetes.io/projected/c5251a8f-05a3-420e-b9d9-b3f71c98d2f9-kube-api-access-nml5f\") pod \"payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j\" (UID: \"c5251a8f-05a3-420e-b9d9-b3f71c98d2f9\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j"
Sep 07 17:12:00.973454 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.973303    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5251a8f-05a3-420e-b9d9-b3f71c98d2f9-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j\" (UID: \"c5251a8f-05a3-420e-b9d9-b3f71c98d2f9\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j"
Sep 07 17:12:00.973454 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.973352    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjgkr\" (UniqueName: \"kubernetes.io/projected/4495b888-ffb1-44e5-bbfb-0bff1f99775c-kube-api-access-kjgkr\") pod \"payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8\" (UID: \"4495b888-ffb1-44e5-bbfb-0bff1f99775c\") " pod="openshift-ingress/payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8"
Sep 07 17:12:00.973454 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.973445    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4495b888-ffb1-44e5-bbfb-0bff1f99775c-plugins-config-volume\") pod \"payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8\" (UID: \"4495b888-ffb1-44e5-bbfb-0bff1f99775c\") " pod="openshift-ingress/payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8"
Sep 07 17:12:00.974155 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.974130    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4495b888-ffb1-44e5-bbfb-0bff1f99775c-plugins-config-volume\") pod \"payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8\" (UID: \"4495b888-ffb1-44e5-bbfb-0bff1f99775c\") " pod="openshift-ingress/payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8"
Sep 07 17:12:00.974266 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.974221    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5251a8f-05a3-420e-b9d9-b3f71c98d2f9-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j\" (UID: \"c5251a8f-05a3-420e-b9d9-b3f71c98d2f9\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j"
Sep 07 17:12:00.982185 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.982163    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nml5f\" (UniqueName: \"kubernetes.io/projected/c5251a8f-05a3-420e-b9d9-b3f71c98d2f9-kube-api-access-nml5f\") pod \"payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j\" (UID: \"c5251a8f-05a3-420e-b9d9-b3f71c98d2f9\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j"
Sep 07 17:12:00.982295 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:00.982211    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjgkr\" (UniqueName: \"kubernetes.io/projected/4495b888-ffb1-44e5-bbfb-0bff1f99775c-kube-api-access-kjgkr\") pod \"payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8\" (UID: \"4495b888-ffb1-44e5-bbfb-0bff1f99775c\") " pod="openshift-ingress/payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8"
Sep 07 17:12:01.012216 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:01.012184    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8"
Sep 07 17:12:01.053995 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:01.053936    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j"
Sep 07 17:12:01.288568 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:01.288541    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8"]
Sep 07 17:12:01.289994 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:12:01.289962    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4495b888_ffb1_44e5_bbfb_0bff1f99775c.slice/crio-07de4f56153fd9f05465be6a52253dad9f831acf897343550a41462a13916d04 WatchSource:0}: Error finding container 07de4f56153fd9f05465be6a52253dad9f831acf897343550a41462a13916d04: Status 404 returned error can't find the container with id 07de4f56153fd9f05465be6a52253dad9f831acf897343550a41462a13916d04
Sep 07 17:12:01.357063 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:01.357040    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j"]
Sep 07 17:12:01.358328 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:12:01.358304    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5251a8f_05a3_420e_b9d9_b3f71c98d2f9.slice/crio-09321c6e3da523d5e03c35cd0abb25b662028946631358da283b476bbe722efc WatchSource:0}: Error finding container 09321c6e3da523d5e03c35cd0abb25b662028946631358da283b476bbe722efc: Status 404 returned error can't find the container with id 09321c6e3da523d5e03c35cd0abb25b662028946631358da283b476bbe722efc
Sep 07 17:12:01.495084 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:01.495031    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j" event={"ID":"c5251a8f-05a3-420e-b9d9-b3f71c98d2f9","Type":"ContainerStarted","Data":"e63dea0aea42154a834c7cbd56526fa8dd7bd72b7e3ce9c8a83dbc13c2ca7fcd"}
Sep 07 17:12:01.495258 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:01.495118    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j" event={"ID":"c5251a8f-05a3-420e-b9d9-b3f71c98d2f9","Type":"ContainerStarted","Data":"09321c6e3da523d5e03c35cd0abb25b662028946631358da283b476bbe722efc"}
Sep 07 17:12:01.495258 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:01.495152    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j"
Sep 07 17:12:01.496866 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:01.496839    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8" event={"ID":"4495b888-ffb1-44e5-bbfb-0bff1f99775c","Type":"ContainerStarted","Data":"8c5cc10ee572ee42f3a3bb7bafd107a1ee158dd9d630e6a0fe51daeee460e29d"}
Sep 07 17:12:01.497029 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:01.496883    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8" event={"ID":"4495b888-ffb1-44e5-bbfb-0bff1f99775c","Type":"ContainerStarted","Data":"07de4f56153fd9f05465be6a52253dad9f831acf897343550a41462a13916d04"}
Sep 07 17:12:01.497029 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:01.496943    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8"
Sep 07 17:12:01.499704 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:01.499680    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c586c514-7d65c96788-slvhx" event={"ID":"40c359d9-565d-422a-864d-61a535ea9a44","Type":"ContainerStarted","Data":"8a0f150a034a52e843553d8fbf3092da182db72c6ef33b7afbef440642429c78"}
Sep 07 17:12:01.499850 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:01.499728    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c586c514-7d65c96788-slvhx" event={"ID":"40c359d9-565d-422a-864d-61a535ea9a44","Type":"ContainerStarted","Data":"be6c43ac4550e811d82b5ecdb8d7216cda940fdac9e9612985b25c3522d816b4"}
Sep 07 17:12:01.499850 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:01.499757    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c586c514-7d65c96788-slvhx"
Sep 07 17:12:01.519328 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:01.519281    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j" podStartSLOduration=1.51926596 podStartE2EDuration="1.51926596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:12:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:12:01.515878621 +0000 UTC m=+915.412725936" watchObservedRunningTime="2026-09-07 17:12:01.51926596 +0000 UTC m=+915.416113277"
Sep 07 17:12:01.534684 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:01.534643    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c586c514-7d65c96788-slvhx" podStartSLOduration=2.061513674 podStartE2EDuration="2.534630685s" totalImagesPullingTime="473.117011ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:11:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:12:01.534448025 +0000 UTC m=+915.431295340" watchObservedRunningTime="2026-09-07 17:12:01.534630685 +0000 UTC m=+915.431477994"
Sep 07 17:12:03.014386 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:03.014350    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:03.112768 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:03.112738    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:03.303772 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:03.303742    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:03.714913 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:03.714809    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:04.058809 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:04.058776    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:04.369823 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:04.369748    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:07.271501 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:07.271462    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:07.393139 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:07.393108    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:07.510639 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:07.510611    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c586c514-7d65c96788-slvhx"
Sep 07 17:12:07.529494 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:07.529396    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8" podStartSLOduration=7.529379948 podStartE2EDuration="7.529379948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:12:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:12:01.551751721 +0000 UTC m=+915.448599038" watchObservedRunningTime="2026-09-07 17:12:07.529379948 +0000 UTC m=+921.426227263"
Sep 07 17:12:08.128874 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:08.128842    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:08.472759 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:08.472666    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:08.571561 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:08.571528    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:08.671397 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:08.671364    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:09.031228 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:09.031165    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:09.126469 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:09.126426    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:12.507004 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:12.506964    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8"
Sep 07 17:12:12.507430 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:12.507042    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j"
Sep 07 17:12:21.146822 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:21.146790    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:29.516642 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:29.516606    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:30.117008 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.116976    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c586c514-7d65c96788-slvhx"]
Sep 07 17:12:30.117215 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.117176    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c586c514-7d65c96788-slvhx" podUID="40c359d9-565d-422a-864d-61a535ea9a44" containerName="maas-api" containerID="cri-o://8a0f150a034a52e843553d8fbf3092da182db72c6ef33b7afbef440642429c78" gracePeriod=30
Sep 07 17:12:30.131872 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.131837    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:30.173123 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.173088    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8"]
Sep 07 17:12:30.173394 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.173340    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8" podUID="4495b888-ffb1-44e5-bbfb-0bff1f99775c" containerName="payload-processing" containerID="cri-o://8c5cc10ee572ee42f3a3bb7bafd107a1ee158dd9d630e6a0fe51daeee460e29d" gracePeriod=30
Sep 07 17:12:30.184505 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.184345    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j"]
Sep 07 17:12:30.184656 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.184603    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j" podUID="c5251a8f-05a3-420e-b9d9-b3f71c98d2f9" containerName="payload-pre-processing" containerID="cri-o://e63dea0aea42154a834c7cbd56526fa8dd7bd72b7e3ce9c8a83dbc13c2ca7fcd" gracePeriod=30
Sep 07 17:12:30.221966 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.221933    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:30.293456 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.293432    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:30.395592 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.395540    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:30.466588 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.466559    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c586c514-7d65c96788-slvhx"
Sep 07 17:12:30.470463 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.470426    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8"
Sep 07 17:12:30.482314 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.482292    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j"
Sep 07 17:12:30.520054 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.520013    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:30.572536 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.572507    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7z66\" (UniqueName: \"kubernetes.io/projected/40c359d9-565d-422a-864d-61a535ea9a44-kube-api-access-h7z66\") pod \"40c359d9-565d-422a-864d-61a535ea9a44\" (UID: \"40c359d9-565d-422a-864d-61a535ea9a44\") "
Sep 07 17:12:30.572690 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.572547    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5251a8f-05a3-420e-b9d9-b3f71c98d2f9-plugins-config-volume\") pod \"c5251a8f-05a3-420e-b9d9-b3f71c98d2f9\" (UID: \"c5251a8f-05a3-420e-b9d9-b3f71c98d2f9\") "
Sep 07 17:12:30.572690 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.572581    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40c359d9-565d-422a-864d-61a535ea9a44-metrics-certs\") pod \"40c359d9-565d-422a-864d-61a535ea9a44\" (UID: \"40c359d9-565d-422a-864d-61a535ea9a44\") "
Sep 07 17:12:30.572765 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.572692    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40c359d9-565d-422a-864d-61a535ea9a44-openshift-service-ca\") pod \"40c359d9-565d-422a-864d-61a535ea9a44\" (UID: \"40c359d9-565d-422a-864d-61a535ea9a44\") "
Sep 07 17:12:30.572765 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.572728    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4495b888-ffb1-44e5-bbfb-0bff1f99775c-plugins-config-volume\") pod \"4495b888-ffb1-44e5-bbfb-0bff1f99775c\" (UID: \"4495b888-ffb1-44e5-bbfb-0bff1f99775c\") "
Sep 07 17:12:30.572839 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.572767    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjgkr\" (UniqueName: \"kubernetes.io/projected/4495b888-ffb1-44e5-bbfb-0bff1f99775c-kube-api-access-kjgkr\") pod \"4495b888-ffb1-44e5-bbfb-0bff1f99775c\" (UID: \"4495b888-ffb1-44e5-bbfb-0bff1f99775c\") "
Sep 07 17:12:30.572890 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.572836    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40c359d9-565d-422a-864d-61a535ea9a44-maas-api-tls\") pod \"40c359d9-565d-422a-864d-61a535ea9a44\" (UID: \"40c359d9-565d-422a-864d-61a535ea9a44\") "
Sep 07 17:12:30.572992 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.572890    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nml5f\" (UniqueName: \"kubernetes.io/projected/c5251a8f-05a3-420e-b9d9-b3f71c98d2f9-kube-api-access-nml5f\") pod \"c5251a8f-05a3-420e-b9d9-b3f71c98d2f9\" (UID: \"c5251a8f-05a3-420e-b9d9-b3f71c98d2f9\") "
Sep 07 17:12:30.573875 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.573074    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5251a8f-05a3-420e-b9d9-b3f71c98d2f9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c5251a8f-05a3-420e-b9d9-b3f71c98d2f9" (UID: "c5251a8f-05a3-420e-b9d9-b3f71c98d2f9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:12:30.573875 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.573355    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5251a8f-05a3-420e-b9d9-b3f71c98d2f9-plugins-config-volume\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:12:30.573875 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.573375    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4495b888-ffb1-44e5-bbfb-0bff1f99775c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4495b888-ffb1-44e5-bbfb-0bff1f99775c" (UID: "4495b888-ffb1-44e5-bbfb-0bff1f99775c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:12:30.575430 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.575394    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40c359d9-565d-422a-864d-61a535ea9a44-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "40c359d9-565d-422a-864d-61a535ea9a44" (UID: "40c359d9-565d-422a-864d-61a535ea9a44"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:12:30.575541 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.575458    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40c359d9-565d-422a-864d-61a535ea9a44-kube-api-access-h7z66" (OuterVolumeSpecName: "kube-api-access-h7z66") pod "40c359d9-565d-422a-864d-61a535ea9a44" (UID: "40c359d9-565d-422a-864d-61a535ea9a44"). InnerVolumeSpecName "kube-api-access-h7z66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:12:30.575653 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.575627    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40c359d9-565d-422a-864d-61a535ea9a44-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "40c359d9-565d-422a-864d-61a535ea9a44" (UID: "40c359d9-565d-422a-864d-61a535ea9a44"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:12:30.575737 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.575714    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5251a8f-05a3-420e-b9d9-b3f71c98d2f9-kube-api-access-nml5f" (OuterVolumeSpecName: "kube-api-access-nml5f") pod "c5251a8f-05a3-420e-b9d9-b3f71c98d2f9" (UID: "c5251a8f-05a3-420e-b9d9-b3f71c98d2f9"). InnerVolumeSpecName "kube-api-access-nml5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:12:30.575840 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.575767    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4495b888-ffb1-44e5-bbfb-0bff1f99775c-kube-api-access-kjgkr" (OuterVolumeSpecName: "kube-api-access-kjgkr") pod "4495b888-ffb1-44e5-bbfb-0bff1f99775c" (UID: "4495b888-ffb1-44e5-bbfb-0bff1f99775c"). InnerVolumeSpecName "kube-api-access-kjgkr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:12:30.576074 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.576050    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40c359d9-565d-422a-864d-61a535ea9a44-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "40c359d9-565d-422a-864d-61a535ea9a44" (UID: "40c359d9-565d-422a-864d-61a535ea9a44"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:12:30.665236 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.665157    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:30.669884 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.669855    2575 generic.go:356] "Generic (PLEG): container finished" podID="4495b888-ffb1-44e5-bbfb-0bff1f99775c" containerID="8c5cc10ee572ee42f3a3bb7bafd107a1ee158dd9d630e6a0fe51daeee460e29d" exitCode=0
Sep 07 17:12:30.670041 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.669915    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8"
Sep 07 17:12:30.670041 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.669991    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8" event={"ID":"4495b888-ffb1-44e5-bbfb-0bff1f99775c","Type":"ContainerDied","Data":"8c5cc10ee572ee42f3a3bb7bafd107a1ee158dd9d630e6a0fe51daeee460e29d"}
Sep 07 17:12:30.670041 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.670034    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8" event={"ID":"4495b888-ffb1-44e5-bbfb-0bff1f99775c","Type":"ContainerDied","Data":"07de4f56153fd9f05465be6a52253dad9f831acf897343550a41462a13916d04"}
Sep 07 17:12:30.670182 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.670055    2575 scope.go:117] "RemoveContainer" containerID="8c5cc10ee572ee42f3a3bb7bafd107a1ee158dd9d630e6a0fe51daeee460e29d"
Sep 07 17:12:30.671868 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.671594    2575 generic.go:356] "Generic (PLEG): container finished" podID="40c359d9-565d-422a-864d-61a535ea9a44" containerID="8a0f150a034a52e843553d8fbf3092da182db72c6ef33b7afbef440642429c78" exitCode=0
Sep 07 17:12:30.671868 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.671796    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c586c514-7d65c96788-slvhx" event={"ID":"40c359d9-565d-422a-864d-61a535ea9a44","Type":"ContainerDied","Data":"8a0f150a034a52e843553d8fbf3092da182db72c6ef33b7afbef440642429c78"}
Sep 07 17:12:30.671868 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.671836    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c586c514-7d65c96788-slvhx" event={"ID":"40c359d9-565d-422a-864d-61a535ea9a44","Type":"ContainerDied","Data":"be6c43ac4550e811d82b5ecdb8d7216cda940fdac9e9612985b25c3522d816b4"}
Sep 07 17:12:30.671868 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.671862    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c586c514-7d65c96788-slvhx"
Sep 07 17:12:30.673693 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.673669    2575 generic.go:356] "Generic (PLEG): container finished" podID="c5251a8f-05a3-420e-b9d9-b3f71c98d2f9" containerID="e63dea0aea42154a834c7cbd56526fa8dd7bd72b7e3ce9c8a83dbc13c2ca7fcd" exitCode=0
Sep 07 17:12:30.673818 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.673710    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j" event={"ID":"c5251a8f-05a3-420e-b9d9-b3f71c98d2f9","Type":"ContainerDied","Data":"e63dea0aea42154a834c7cbd56526fa8dd7bd72b7e3ce9c8a83dbc13c2ca7fcd"}
Sep 07 17:12:30.673818 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.673746    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j" event={"ID":"c5251a8f-05a3-420e-b9d9-b3f71c98d2f9","Type":"ContainerDied","Data":"09321c6e3da523d5e03c35cd0abb25b662028946631358da283b476bbe722efc"}
Sep 07 17:12:30.673818 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.673804    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j"
Sep 07 17:12:30.674052 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.674027    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4495b888-ffb1-44e5-bbfb-0bff1f99775c-plugins-config-volume\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:12:30.674132 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.674054    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjgkr\" (UniqueName: \"kubernetes.io/projected/4495b888-ffb1-44e5-bbfb-0bff1f99775c-kube-api-access-kjgkr\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:12:30.674132 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.674070    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40c359d9-565d-422a-864d-61a535ea9a44-maas-api-tls\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:12:30.674132 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.674085    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nml5f\" (UniqueName: \"kubernetes.io/projected/c5251a8f-05a3-420e-b9d9-b3f71c98d2f9-kube-api-access-nml5f\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:12:30.674132 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.674097    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7z66\" (UniqueName: \"kubernetes.io/projected/40c359d9-565d-422a-864d-61a535ea9a44-kube-api-access-h7z66\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:12:30.674132 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.674110    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40c359d9-565d-422a-864d-61a535ea9a44-metrics-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:12:30.674132 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.674122    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40c359d9-565d-422a-864d-61a535ea9a44-openshift-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:12:30.685300 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.685213    2575 scope.go:117] "RemoveContainer" containerID="8c5cc10ee572ee42f3a3bb7bafd107a1ee158dd9d630e6a0fe51daeee460e29d"
Sep 07 17:12:30.685626 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:12:30.685595    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c5cc10ee572ee42f3a3bb7bafd107a1ee158dd9d630e6a0fe51daeee460e29d\": container with ID starting with 8c5cc10ee572ee42f3a3bb7bafd107a1ee158dd9d630e6a0fe51daeee460e29d not found: ID does not exist" containerID="8c5cc10ee572ee42f3a3bb7bafd107a1ee158dd9d630e6a0fe51daeee460e29d"
Sep 07 17:12:30.685747 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.685634    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c5cc10ee572ee42f3a3bb7bafd107a1ee158dd9d630e6a0fe51daeee460e29d"} err="failed to get container status \"8c5cc10ee572ee42f3a3bb7bafd107a1ee158dd9d630e6a0fe51daeee460e29d\": rpc error: code = NotFound desc = could not find container \"8c5cc10ee572ee42f3a3bb7bafd107a1ee158dd9d630e6a0fe51daeee460e29d\": container with ID starting with 8c5cc10ee572ee42f3a3bb7bafd107a1ee158dd9d630e6a0fe51daeee460e29d not found: ID does not exist"
Sep 07 17:12:30.685747 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.685668    2575 scope.go:117] "RemoveContainer" containerID="8a0f150a034a52e843553d8fbf3092da182db72c6ef33b7afbef440642429c78"
Sep 07 17:12:30.694577 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.694559    2575 scope.go:117] "RemoveContainer" containerID="8a0f150a034a52e843553d8fbf3092da182db72c6ef33b7afbef440642429c78"
Sep 07 17:12:30.694812 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:12:30.694795    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a0f150a034a52e843553d8fbf3092da182db72c6ef33b7afbef440642429c78\": container with ID starting with 8a0f150a034a52e843553d8fbf3092da182db72c6ef33b7afbef440642429c78 not found: ID does not exist" containerID="8a0f150a034a52e843553d8fbf3092da182db72c6ef33b7afbef440642429c78"
Sep 07 17:12:30.694871 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.694816    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a0f150a034a52e843553d8fbf3092da182db72c6ef33b7afbef440642429c78"} err="failed to get container status \"8a0f150a034a52e843553d8fbf3092da182db72c6ef33b7afbef440642429c78\": rpc error: code = NotFound desc = could not find container \"8a0f150a034a52e843553d8fbf3092da182db72c6ef33b7afbef440642429c78\": container with ID starting with 8a0f150a034a52e843553d8fbf3092da182db72c6ef33b7afbef440642429c78 not found: ID does not exist"
Sep 07 17:12:30.694871 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.694831    2575 scope.go:117] "RemoveContainer" containerID="e63dea0aea42154a834c7cbd56526fa8dd7bd72b7e3ce9c8a83dbc13c2ca7fcd"
Sep 07 17:12:30.702306 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.702287    2575 scope.go:117] "RemoveContainer" containerID="e63dea0aea42154a834c7cbd56526fa8dd7bd72b7e3ce9c8a83dbc13c2ca7fcd"
Sep 07 17:12:30.702607 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:12:30.702582    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e63dea0aea42154a834c7cbd56526fa8dd7bd72b7e3ce9c8a83dbc13c2ca7fcd\": container with ID starting with e63dea0aea42154a834c7cbd56526fa8dd7bd72b7e3ce9c8a83dbc13c2ca7fcd not found: ID does not exist" containerID="e63dea0aea42154a834c7cbd56526fa8dd7bd72b7e3ce9c8a83dbc13c2ca7fcd"
Sep 07 17:12:30.702683 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.702613    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e63dea0aea42154a834c7cbd56526fa8dd7bd72b7e3ce9c8a83dbc13c2ca7fcd"} err="failed to get container status \"e63dea0aea42154a834c7cbd56526fa8dd7bd72b7e3ce9c8a83dbc13c2ca7fcd\": rpc error: code = NotFound desc = could not find container \"e63dea0aea42154a834c7cbd56526fa8dd7bd72b7e3ce9c8a83dbc13c2ca7fcd\": container with ID starting with e63dea0aea42154a834c7cbd56526fa8dd7bd72b7e3ce9c8a83dbc13c2ca7fcd not found: ID does not exist"
Sep 07 17:12:30.706224 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.706202    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j"]
Sep 07 17:12:30.710862 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.710844    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j"]
Sep 07 17:12:30.723164 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.723141    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5251a8f-05a3-420e-b9d9-b3f71c98d2f9" path="/var/lib/kubelet/pods/c5251a8f-05a3-420e-b9d9-b3f71c98d2f9/volumes"
Sep 07 17:12:30.723405 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.723393    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8"]
Sep 07 17:12:30.729545 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.729527    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8"]
Sep 07 17:12:30.741297 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.741278    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c586c514-7d65c96788-slvhx"]
Sep 07 17:12:30.745822 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:30.745804    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c586c514-7d65c96788-slvhx"]
Sep 07 17:12:31.393208 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:31.393120    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:31.486910 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:31.486862    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:32.205556 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:32.205521    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:32.722501 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:32.722465    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40c359d9-565d-422a-864d-61a535ea9a44" path="/var/lib/kubelet/pods/40c359d9-565d-422a-864d-61a535ea9a44/volumes"
Sep 07 17:12:32.722862 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:32.722848    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4495b888-ffb1-44e5-bbfb-0bff1f99775c" path="/var/lib/kubelet/pods/4495b888-ffb1-44e5-bbfb-0bff1f99775c/volumes"
Sep 07 17:12:32.893617 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:32.893584    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:33.827758 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:33.827724    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:35.209813 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.209776    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g"]
Sep 07 17:12:35.210306 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.210287    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4495b888-ffb1-44e5-bbfb-0bff1f99775c" containerName="payload-processing"
Sep 07 17:12:35.210354 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.210309    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4495b888-ffb1-44e5-bbfb-0bff1f99775c" containerName="payload-processing"
Sep 07 17:12:35.210354 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.210329    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5251a8f-05a3-420e-b9d9-b3f71c98d2f9" containerName="payload-pre-processing"
Sep 07 17:12:35.210354 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.210334    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5251a8f-05a3-420e-b9d9-b3f71c98d2f9" containerName="payload-pre-processing"
Sep 07 17:12:35.210354 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.210344    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40c359d9-565d-422a-864d-61a535ea9a44" containerName="maas-api"
Sep 07 17:12:35.210354 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.210349    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="40c359d9-565d-422a-864d-61a535ea9a44" containerName="maas-api"
Sep 07 17:12:35.210502 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.210427    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="40c359d9-565d-422a-864d-61a535ea9a44" containerName="maas-api"
Sep 07 17:12:35.210502 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.210437    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5251a8f-05a3-420e-b9d9-b3f71c98d2f9" containerName="payload-pre-processing"
Sep 07 17:12:35.210502 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.210445    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4495b888-ffb1-44e5-bbfb-0bff1f99775c" containerName="payload-processing"
Sep 07 17:12:35.215463 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.215438    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g"
Sep 07 17:12:35.219252 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.219233    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-3c1adc\"/\"explicit-model-3c1adc-kserve-self-signed-certs\""
Sep 07 17:12:35.219405 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.219379    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-3c1adc\"/\"kube-root-ca.crt\""
Sep 07 17:12:35.219463 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.219404    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-3c1adc\"/\"default-dockercfg-tlsb8\""
Sep 07 17:12:35.219506 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.219462    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-3c1adc\"/\"openshift-service-ca.crt\""
Sep 07 17:12:35.225911 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.225872    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g"]
Sep 07 17:12:35.243013 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.242985    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:35.319784 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.319747    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-tls-certs\") pod \"explicit-model-3c1adc-kserve-6f794597c9-n2p5g\" (UID: \"31414267-4fe2-485a-9c3a-ab9bff5dd2ee\") " pod="ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g"
Sep 07 17:12:35.319784 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.319786    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-model-cache\") pod \"explicit-model-3c1adc-kserve-6f794597c9-n2p5g\" (UID: \"31414267-4fe2-485a-9c3a-ab9bff5dd2ee\") " pod="ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g"
Sep 07 17:12:35.320016 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.319876    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-tmp-dir\") pod \"explicit-model-3c1adc-kserve-6f794597c9-n2p5g\" (UID: \"31414267-4fe2-485a-9c3a-ab9bff5dd2ee\") " pod="ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g"
Sep 07 17:12:35.320016 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.319952    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-home\") pod \"explicit-model-3c1adc-kserve-6f794597c9-n2p5g\" (UID: \"31414267-4fe2-485a-9c3a-ab9bff5dd2ee\") " pod="ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g"
Sep 07 17:12:35.320016 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.319976    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkbws\" (UniqueName: \"kubernetes.io/projected/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-kube-api-access-kkbws\") pod \"explicit-model-3c1adc-kserve-6f794597c9-n2p5g\" (UID: \"31414267-4fe2-485a-9c3a-ab9bff5dd2ee\") " pod="ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g"
Sep 07 17:12:35.320016 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.319999    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-dshm\") pod \"explicit-model-3c1adc-kserve-6f794597c9-n2p5g\" (UID: \"31414267-4fe2-485a-9c3a-ab9bff5dd2ee\") " pod="ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g"
Sep 07 17:12:35.420603 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.420563    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-dshm\") pod \"explicit-model-3c1adc-kserve-6f794597c9-n2p5g\" (UID: \"31414267-4fe2-485a-9c3a-ab9bff5dd2ee\") " pod="ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g"
Sep 07 17:12:35.420783 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.420669    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-tls-certs\") pod \"explicit-model-3c1adc-kserve-6f794597c9-n2p5g\" (UID: \"31414267-4fe2-485a-9c3a-ab9bff5dd2ee\") " pod="ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g"
Sep 07 17:12:35.420783 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.420698    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-model-cache\") pod \"explicit-model-3c1adc-kserve-6f794597c9-n2p5g\" (UID: \"31414267-4fe2-485a-9c3a-ab9bff5dd2ee\") " pod="ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g"
Sep 07 17:12:35.420783 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.420774    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-tmp-dir\") pod \"explicit-model-3c1adc-kserve-6f794597c9-n2p5g\" (UID: \"31414267-4fe2-485a-9c3a-ab9bff5dd2ee\") " pod="ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g"
Sep 07 17:12:35.421004 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.420811    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-home\") pod \"explicit-model-3c1adc-kserve-6f794597c9-n2p5g\" (UID: \"31414267-4fe2-485a-9c3a-ab9bff5dd2ee\") " pod="ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g"
Sep 07 17:12:35.421004 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.420842    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkbws\" (UniqueName: \"kubernetes.io/projected/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-kube-api-access-kkbws\") pod \"explicit-model-3c1adc-kserve-6f794597c9-n2p5g\" (UID: \"31414267-4fe2-485a-9c3a-ab9bff5dd2ee\") " pod="ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g"
Sep 07 17:12:35.421176 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.421150    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-model-cache\") pod \"explicit-model-3c1adc-kserve-6f794597c9-n2p5g\" (UID: \"31414267-4fe2-485a-9c3a-ab9bff5dd2ee\") " pod="ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g"
Sep 07 17:12:35.421242 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.421181    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-tmp-dir\") pod \"explicit-model-3c1adc-kserve-6f794597c9-n2p5g\" (UID: \"31414267-4fe2-485a-9c3a-ab9bff5dd2ee\") " pod="ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g"
Sep 07 17:12:35.421242 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.421212    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-home\") pod \"explicit-model-3c1adc-kserve-6f794597c9-n2p5g\" (UID: \"31414267-4fe2-485a-9c3a-ab9bff5dd2ee\") " pod="ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g"
Sep 07 17:12:35.423178 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.423147    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-tls-certs\") pod \"explicit-model-3c1adc-kserve-6f794597c9-n2p5g\" (UID: \"31414267-4fe2-485a-9c3a-ab9bff5dd2ee\") " pod="ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g"
Sep 07 17:12:35.423365 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.423343    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-dshm\") pod \"explicit-model-3c1adc-kserve-6f794597c9-n2p5g\" (UID: \"31414267-4fe2-485a-9c3a-ab9bff5dd2ee\") " pod="ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g"
Sep 07 17:12:35.470936 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.470863    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkbws\" (UniqueName: \"kubernetes.io/projected/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-kube-api-access-kkbws\") pod \"explicit-model-3c1adc-kserve-6f794597c9-n2p5g\" (UID: \"31414267-4fe2-485a-9c3a-ab9bff5dd2ee\") " pod="ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g"
Sep 07 17:12:35.525933 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.525878    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g"
Sep 07 17:12:35.801489 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:35.801456    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g"]
Sep 07 17:12:35.802383 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:12:35.802356    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31414267_4fe2_485a_9c3a_ab9bff5dd2ee.slice/crio-2b016d9d5bb553f8192704357e47df37898b5cff5c9bf5ba8f66fac0bfc46c77 WatchSource:0}: Error finding container 2b016d9d5bb553f8192704357e47df37898b5cff5c9bf5ba8f66fac0bfc46c77: Status 404 returned error can't find the container with id 2b016d9d5bb553f8192704357e47df37898b5cff5c9bf5ba8f66fac0bfc46c77
Sep 07 17:12:36.712326 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:36.712285    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g" event={"ID":"31414267-4fe2-485a-9c3a-ab9bff5dd2ee","Type":"ContainerStarted","Data":"539e75088bf1442c078be0628041cb6deec369d5177cda78899f5c137670de02"}
Sep 07 17:12:36.712766 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:36.712333    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g" event={"ID":"31414267-4fe2-485a-9c3a-ab9bff5dd2ee","Type":"ContainerStarted","Data":"2b016d9d5bb553f8192704357e47df37898b5cff5c9bf5ba8f66fac0bfc46c77"}
Sep 07 17:12:36.732032 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:36.731286    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g" podStartSLOduration=1.7312628829999999 podStartE2EDuration="1.731262883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:12:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:12:36.729258632 +0000 UTC m=+950.626105948" watchObservedRunningTime="2026-09-07 17:12:36.731262883 +0000 UTC m=+950.628110203"
Sep 07 17:12:39.486289 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:39.486253    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:39.587759 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:39.587727    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:39.691344 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:39.691298    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:39.795233 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:39.795205    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:40.175772 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:40.175690    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:45.278378 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:45.278331    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g"]
Sep 07 17:12:45.335126 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:45.335090    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:45.527005 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:45.526969    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g"
Sep 07 17:12:55.963311 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:55.963275    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:56.066322 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:56.066284    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:56.169723 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:56.169685    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:56.263332 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:56.263236    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:12:56.548213 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:12:56.548162    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:00.298191 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:00.298121    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g" podUID="31414267-4fe2-485a-9c3a-ab9bff5dd2ee" containerName="main" containerID="cri-o://539e75088bf1442c078be0628041cb6deec369d5177cda78899f5c137670de02" gracePeriod=45
Sep 07 17:13:00.547785 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:00.547761    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g"
Sep 07 17:13:00.672262 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:00.672170    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkbws\" (UniqueName: \"kubernetes.io/projected/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-kube-api-access-kkbws\") pod \"31414267-4fe2-485a-9c3a-ab9bff5dd2ee\" (UID: \"31414267-4fe2-485a-9c3a-ab9bff5dd2ee\") "
Sep 07 17:13:00.672441 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:00.672280    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-tmp-dir\") pod \"31414267-4fe2-485a-9c3a-ab9bff5dd2ee\" (UID: \"31414267-4fe2-485a-9c3a-ab9bff5dd2ee\") "
Sep 07 17:13:00.672441 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:00.672335    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-home\") pod \"31414267-4fe2-485a-9c3a-ab9bff5dd2ee\" (UID: \"31414267-4fe2-485a-9c3a-ab9bff5dd2ee\") "
Sep 07 17:13:00.672441 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:00.672373    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-dshm\") pod \"31414267-4fe2-485a-9c3a-ab9bff5dd2ee\" (UID: \"31414267-4fe2-485a-9c3a-ab9bff5dd2ee\") "
Sep 07 17:13:00.672441 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:00.672406    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-model-cache\") pod \"31414267-4fe2-485a-9c3a-ab9bff5dd2ee\" (UID: \"31414267-4fe2-485a-9c3a-ab9bff5dd2ee\") "
Sep 07 17:13:00.672641 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:00.672462    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-tls-certs\") pod \"31414267-4fe2-485a-9c3a-ab9bff5dd2ee\" (UID: \"31414267-4fe2-485a-9c3a-ab9bff5dd2ee\") "
Sep 07 17:13:00.672641 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:00.672567    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "31414267-4fe2-485a-9c3a-ab9bff5dd2ee" (UID: "31414267-4fe2-485a-9c3a-ab9bff5dd2ee"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:00.672641 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:00.672594    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-home" (OuterVolumeSpecName: "home") pod "31414267-4fe2-485a-9c3a-ab9bff5dd2ee" (UID: "31414267-4fe2-485a-9c3a-ab9bff5dd2ee"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:00.672778 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:00.672702    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-model-cache" (OuterVolumeSpecName: "model-cache") pod "31414267-4fe2-485a-9c3a-ab9bff5dd2ee" (UID: "31414267-4fe2-485a-9c3a-ab9bff5dd2ee"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:00.672876 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:00.672855    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-tmp-dir\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:13:00.672876 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:00.672875    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-home\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:13:00.673110 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:00.672884    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-model-cache\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:13:00.674633 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:00.674599    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-dshm" (OuterVolumeSpecName: "dshm") pod "31414267-4fe2-485a-9c3a-ab9bff5dd2ee" (UID: "31414267-4fe2-485a-9c3a-ab9bff5dd2ee"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:00.674633 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:00.674606    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-kube-api-access-kkbws" (OuterVolumeSpecName: "kube-api-access-kkbws") pod "31414267-4fe2-485a-9c3a-ab9bff5dd2ee" (UID: "31414267-4fe2-485a-9c3a-ab9bff5dd2ee"). InnerVolumeSpecName "kube-api-access-kkbws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:13:00.674872 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:00.674849    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "31414267-4fe2-485a-9c3a-ab9bff5dd2ee" (UID: "31414267-4fe2-485a-9c3a-ab9bff5dd2ee"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:13:00.774353 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:00.773949    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-tls-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:13:00.774353 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:00.773984    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkbws\" (UniqueName: \"kubernetes.io/projected/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-kube-api-access-kkbws\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:13:00.774353 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:00.774000    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31414267-4fe2-485a-9c3a-ab9bff5dd2ee-dshm\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:13:00.844041 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:00.843994    2575 generic.go:356] "Generic (PLEG): container finished" podID="31414267-4fe2-485a-9c3a-ab9bff5dd2ee" containerID="539e75088bf1442c078be0628041cb6deec369d5177cda78899f5c137670de02" exitCode=0
Sep 07 17:13:00.844041 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:00.844031    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g"
Sep 07 17:13:00.844396 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:00.844068    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g" event={"ID":"31414267-4fe2-485a-9c3a-ab9bff5dd2ee","Type":"ContainerDied","Data":"539e75088bf1442c078be0628041cb6deec369d5177cda78899f5c137670de02"}
Sep 07 17:13:00.844396 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:00.844125    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g" event={"ID":"31414267-4fe2-485a-9c3a-ab9bff5dd2ee","Type":"ContainerDied","Data":"2b016d9d5bb553f8192704357e47df37898b5cff5c9bf5ba8f66fac0bfc46c77"}
Sep 07 17:13:00.844396 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:00.844146    2575 scope.go:117] "RemoveContainer" containerID="539e75088bf1442c078be0628041cb6deec369d5177cda78899f5c137670de02"
Sep 07 17:13:00.853042 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:00.853017    2575 scope.go:117] "RemoveContainer" containerID="539e75088bf1442c078be0628041cb6deec369d5177cda78899f5c137670de02"
Sep 07 17:13:00.853284 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:13:00.853258    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"539e75088bf1442c078be0628041cb6deec369d5177cda78899f5c137670de02\": container with ID starting with 539e75088bf1442c078be0628041cb6deec369d5177cda78899f5c137670de02 not found: ID does not exist" containerID="539e75088bf1442c078be0628041cb6deec369d5177cda78899f5c137670de02"
Sep 07 17:13:00.853338 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:00.853291    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"539e75088bf1442c078be0628041cb6deec369d5177cda78899f5c137670de02"} err="failed to get container status \"539e75088bf1442c078be0628041cb6deec369d5177cda78899f5c137670de02\": rpc error: code = NotFound desc = could not find container \"539e75088bf1442c078be0628041cb6deec369d5177cda78899f5c137670de02\": container with ID starting with 539e75088bf1442c078be0628041cb6deec369d5177cda78899f5c137670de02 not found: ID does not exist"
Sep 07 17:13:00.870034 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:00.870008    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g"]
Sep 07 17:13:00.872698 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:00.872679    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-3c1adc/explicit-model-3c1adc-kserve-6f794597c9-n2p5g"]
Sep 07 17:13:02.722429 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:02.722397    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31414267-4fe2-485a-9c3a-ab9bff5dd2ee" path="/var/lib/kubelet/pods/31414267-4fe2-485a-9c3a-ab9bff5dd2ee/volumes"
Sep 07 17:13:03.399846 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:03.399811    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:03.500235 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:03.500197    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:03.687722 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:03.687639    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:04.105280 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:04.105231    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:04.451525 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:04.451432    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:04.692515 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:04.692478    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:06.075829 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:06.075793    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:06.169377 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:06.169345    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:06.272636 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:06.272593    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:12.424239 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:12.424153    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:12.527976 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:12.527946    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:12.624323 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:12.624287    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:13.027674 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.027637    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8"]
Sep 07 17:13:13.028124 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.028110    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31414267-4fe2-485a-9c3a-ab9bff5dd2ee" containerName="main"
Sep 07 17:13:13.028124 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.028125    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="31414267-4fe2-485a-9c3a-ab9bff5dd2ee" containerName="main"
Sep 07 17:13:13.028216 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.028192    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="31414267-4fe2-485a-9c3a-ab9bff5dd2ee" containerName="main"
Sep 07 17:13:13.035080 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.035051    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8"
Sep 07 17:13:13.043967 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.043804    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-f4bf9e\"/\"kube-root-ca.crt\""
Sep 07 17:13:13.043967 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.043824    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-f4bf9e\"/\"noten-model-f4bf9e-kserve-self-signed-certs\""
Sep 07 17:13:13.043967 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.043846    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-f4bf9e\"/\"default-dockercfg-bq28w\""
Sep 07 17:13:13.043967 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.043855    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-f4bf9e\"/\"openshift-service-ca.crt\""
Sep 07 17:13:13.047877 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.047856    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8"]
Sep 07 17:13:13.088860 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.088821    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:13.199501 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.199465    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cd7e58e-9269-4f6f-af4e-f43320089e46-home\") pod \"noten-model-f4bf9e-kserve-7b59478bdc-xcjt8\" (UID: \"7cd7e58e-9269-4f6f-af4e-f43320089e46\") " pod="ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8"
Sep 07 17:13:13.199688 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.199523    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cd7e58e-9269-4f6f-af4e-f43320089e46-model-cache\") pod \"noten-model-f4bf9e-kserve-7b59478bdc-xcjt8\" (UID: \"7cd7e58e-9269-4f6f-af4e-f43320089e46\") " pod="ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8"
Sep 07 17:13:13.199688 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.199549    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cd7e58e-9269-4f6f-af4e-f43320089e46-tmp-dir\") pod \"noten-model-f4bf9e-kserve-7b59478bdc-xcjt8\" (UID: \"7cd7e58e-9269-4f6f-af4e-f43320089e46\") " pod="ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8"
Sep 07 17:13:13.199688 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.199632    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h86p\" (UniqueName: \"kubernetes.io/projected/7cd7e58e-9269-4f6f-af4e-f43320089e46-kube-api-access-9h86p\") pod \"noten-model-f4bf9e-kserve-7b59478bdc-xcjt8\" (UID: \"7cd7e58e-9269-4f6f-af4e-f43320089e46\") " pod="ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8"
Sep 07 17:13:13.199688 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.199651    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cd7e58e-9269-4f6f-af4e-f43320089e46-dshm\") pod \"noten-model-f4bf9e-kserve-7b59478bdc-xcjt8\" (UID: \"7cd7e58e-9269-4f6f-af4e-f43320089e46\") " pod="ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8"
Sep 07 17:13:13.199688 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.199675    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cd7e58e-9269-4f6f-af4e-f43320089e46-tls-certs\") pod \"noten-model-f4bf9e-kserve-7b59478bdc-xcjt8\" (UID: \"7cd7e58e-9269-4f6f-af4e-f43320089e46\") " pod="ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8"
Sep 07 17:13:13.301246 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.301207    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cd7e58e-9269-4f6f-af4e-f43320089e46-model-cache\") pod \"noten-model-f4bf9e-kserve-7b59478bdc-xcjt8\" (UID: \"7cd7e58e-9269-4f6f-af4e-f43320089e46\") " pod="ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8"
Sep 07 17:13:13.301424 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.301249    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cd7e58e-9269-4f6f-af4e-f43320089e46-tmp-dir\") pod \"noten-model-f4bf9e-kserve-7b59478bdc-xcjt8\" (UID: \"7cd7e58e-9269-4f6f-af4e-f43320089e46\") " pod="ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8"
Sep 07 17:13:13.301424 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.301333    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h86p\" (UniqueName: \"kubernetes.io/projected/7cd7e58e-9269-4f6f-af4e-f43320089e46-kube-api-access-9h86p\") pod \"noten-model-f4bf9e-kserve-7b59478bdc-xcjt8\" (UID: \"7cd7e58e-9269-4f6f-af4e-f43320089e46\") " pod="ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8"
Sep 07 17:13:13.301424 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.301359    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cd7e58e-9269-4f6f-af4e-f43320089e46-dshm\") pod \"noten-model-f4bf9e-kserve-7b59478bdc-xcjt8\" (UID: \"7cd7e58e-9269-4f6f-af4e-f43320089e46\") " pod="ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8"
Sep 07 17:13:13.301424 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.301390    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cd7e58e-9269-4f6f-af4e-f43320089e46-tls-certs\") pod \"noten-model-f4bf9e-kserve-7b59478bdc-xcjt8\" (UID: \"7cd7e58e-9269-4f6f-af4e-f43320089e46\") " pod="ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8"
Sep 07 17:13:13.301666 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.301479    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cd7e58e-9269-4f6f-af4e-f43320089e46-home\") pod \"noten-model-f4bf9e-kserve-7b59478bdc-xcjt8\" (UID: \"7cd7e58e-9269-4f6f-af4e-f43320089e46\") " pod="ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8"
Sep 07 17:13:13.301666 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.301626    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cd7e58e-9269-4f6f-af4e-f43320089e46-model-cache\") pod \"noten-model-f4bf9e-kserve-7b59478bdc-xcjt8\" (UID: \"7cd7e58e-9269-4f6f-af4e-f43320089e46\") " pod="ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8"
Sep 07 17:13:13.301778 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.301631    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cd7e58e-9269-4f6f-af4e-f43320089e46-tmp-dir\") pod \"noten-model-f4bf9e-kserve-7b59478bdc-xcjt8\" (UID: \"7cd7e58e-9269-4f6f-af4e-f43320089e46\") " pod="ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8"
Sep 07 17:13:13.301840 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.301813    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cd7e58e-9269-4f6f-af4e-f43320089e46-home\") pod \"noten-model-f4bf9e-kserve-7b59478bdc-xcjt8\" (UID: \"7cd7e58e-9269-4f6f-af4e-f43320089e46\") " pod="ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8"
Sep 07 17:13:13.303614 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.303594    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cd7e58e-9269-4f6f-af4e-f43320089e46-dshm\") pod \"noten-model-f4bf9e-kserve-7b59478bdc-xcjt8\" (UID: \"7cd7e58e-9269-4f6f-af4e-f43320089e46\") " pod="ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8"
Sep 07 17:13:13.303889 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.303873    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cd7e58e-9269-4f6f-af4e-f43320089e46-tls-certs\") pod \"noten-model-f4bf9e-kserve-7b59478bdc-xcjt8\" (UID: \"7cd7e58e-9269-4f6f-af4e-f43320089e46\") " pod="ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8"
Sep 07 17:13:13.316012 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.315990    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h86p\" (UniqueName: \"kubernetes.io/projected/7cd7e58e-9269-4f6f-af4e-f43320089e46-kube-api-access-9h86p\") pod \"noten-model-f4bf9e-kserve-7b59478bdc-xcjt8\" (UID: \"7cd7e58e-9269-4f6f-af4e-f43320089e46\") " pod="ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8"
Sep 07 17:13:13.345935 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.345877    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8"
Sep 07 17:13:13.624710 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.624678    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8"]
Sep 07 17:13:13.625908 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:13:13.625869    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7cd7e58e_9269_4f6f_af4e_f43320089e46.slice/crio-d6a2c802fe25c93ef56f6814873d15e52f214b83113929e422dd68fa05b299c7 WatchSource:0}: Error finding container d6a2c802fe25c93ef56f6814873d15e52f214b83113929e422dd68fa05b299c7: Status 404 returned error can't find the container with id d6a2c802fe25c93ef56f6814873d15e52f214b83113929e422dd68fa05b299c7
Sep 07 17:13:13.916332 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.916244    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8" event={"ID":"7cd7e58e-9269-4f6f-af4e-f43320089e46","Type":"ContainerStarted","Data":"10134056668ffbbcad202f0b225ce1088bef931fb90afdd99c8397459a034ca3"}
Sep 07 17:13:13.916332 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.916281    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8" event={"ID":"7cd7e58e-9269-4f6f-af4e-f43320089e46","Type":"ContainerStarted","Data":"d6a2c802fe25c93ef56f6814873d15e52f214b83113929e422dd68fa05b299c7"}
Sep 07 17:13:13.947443 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:13.947388    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8" podStartSLOduration=0.947372557 podStartE2EDuration="947.372557ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:13:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:13:13.9453079 +0000 UTC m=+987.842155209" watchObservedRunningTime="2026-09-07 17:13:13.947372557 +0000 UTC m=+987.844219896"
Sep 07 17:13:19.054478 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:19.054442    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8"]
Sep 07 17:13:19.082176 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:19.082139    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:19.196827 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:19.196791    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:19.417521 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:19.417424    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:19.526730 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:19.526693    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:20.805578 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:20.805548    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"]
Sep 07 17:13:20.835388 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:20.835343    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:21.762279 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:21.762245    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:22.155185 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:22.155152    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:23.346383 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:23.346349    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8"
Sep 07 17:13:24.595931 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:24.595884    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:28.433873 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:28.433838    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:32.387476 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.387442    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5"]
Sep 07 17:13:32.387859 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.387650    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5" podUID="b28b6087-9a39-485d-821b-1c376a1c62ad" containerName="maas-api" containerID="cri-o://02942bd18a6a6bbb86ec28d94b4c8ec8793e53d94d73a6953c36672962b008a3" gracePeriod=30
Sep 07 17:13:32.411818 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.411782    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:32.447486 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.447456    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb"]
Sep 07 17:13:32.447760 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.447728    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb" podUID="18715797-afa1-44c3-8688-4112d809e7b0" containerName="payload-processing" containerID="cri-o://aa630382e4dde0e61adfab059de9a227b5f1c6b1ea2a692798fc72ff08dd0ee6" gracePeriod=30
Sep 07 17:13:32.458510 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.458483    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4"]
Sep 07 17:13:32.458739 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.458707    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4" podUID="0d2107d2-77f7-488d-9bd8-af52400ed4a2" containerName="payload-pre-processing" containerID="cri-o://0ef719eab62d5935865ccd8378730a64df6d29313c911db993c1b5ba6755c4d3" gracePeriod=30
Sep 07 17:13:32.493582 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.493550    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:32.593239 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.593180    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:32.693440 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.693296    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:32.719545 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.719513    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb"
Sep 07 17:13:32.747556 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.747528    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5"
Sep 07 17:13:32.759366 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.759342    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4"
Sep 07 17:13:32.792378 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.792348    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/18715797-afa1-44c3-8688-4112d809e7b0-plugins-config-volume\") pod \"18715797-afa1-44c3-8688-4112d809e7b0\" (UID: \"18715797-afa1-44c3-8688-4112d809e7b0\") "
Sep 07 17:13:32.792519 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.792430    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7z29\" (UniqueName: \"kubernetes.io/projected/18715797-afa1-44c3-8688-4112d809e7b0-kube-api-access-d7z29\") pod \"18715797-afa1-44c3-8688-4112d809e7b0\" (UID: \"18715797-afa1-44c3-8688-4112d809e7b0\") "
Sep 07 17:13:32.792720 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.792695    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18715797-afa1-44c3-8688-4112d809e7b0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "18715797-afa1-44c3-8688-4112d809e7b0" (UID: "18715797-afa1-44c3-8688-4112d809e7b0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:13:32.792912 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.792871    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/18715797-afa1-44c3-8688-4112d809e7b0-plugins-config-volume\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:13:32.795101 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.795075    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18715797-afa1-44c3-8688-4112d809e7b0-kube-api-access-d7z29" (OuterVolumeSpecName: "kube-api-access-d7z29") pod "18715797-afa1-44c3-8688-4112d809e7b0" (UID: "18715797-afa1-44c3-8688-4112d809e7b0"). InnerVolumeSpecName "kube-api-access-d7z29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:13:32.893612 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.893573    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b28b6087-9a39-485d-821b-1c376a1c62ad-metrics-certs\") pod \"b28b6087-9a39-485d-821b-1c376a1c62ad\" (UID: \"b28b6087-9a39-485d-821b-1c376a1c62ad\") "
Sep 07 17:13:32.893612 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.893615    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d2107d2-77f7-488d-9bd8-af52400ed4a2-plugins-config-volume\") pod \"0d2107d2-77f7-488d-9bd8-af52400ed4a2\" (UID: \"0d2107d2-77f7-488d-9bd8-af52400ed4a2\") "
Sep 07 17:13:32.893849 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.893636    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkjkx\" (UniqueName: \"kubernetes.io/projected/0d2107d2-77f7-488d-9bd8-af52400ed4a2-kube-api-access-fkjkx\") pod \"0d2107d2-77f7-488d-9bd8-af52400ed4a2\" (UID: \"0d2107d2-77f7-488d-9bd8-af52400ed4a2\") "
Sep 07 17:13:32.893849 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.893710    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b28b6087-9a39-485d-821b-1c376a1c62ad-openshift-service-ca\") pod \"b28b6087-9a39-485d-821b-1c376a1c62ad\" (UID: \"b28b6087-9a39-485d-821b-1c376a1c62ad\") "
Sep 07 17:13:32.893849 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.893730    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txlqh\" (UniqueName: \"kubernetes.io/projected/b28b6087-9a39-485d-821b-1c376a1c62ad-kube-api-access-txlqh\") pod \"b28b6087-9a39-485d-821b-1c376a1c62ad\" (UID: \"b28b6087-9a39-485d-821b-1c376a1c62ad\") "
Sep 07 17:13:32.893849 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.893778    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b28b6087-9a39-485d-821b-1c376a1c62ad-maas-api-tls\") pod \"b28b6087-9a39-485d-821b-1c376a1c62ad\" (UID: \"b28b6087-9a39-485d-821b-1c376a1c62ad\") "
Sep 07 17:13:32.894109 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.894078    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b28b6087-9a39-485d-821b-1c376a1c62ad-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b28b6087-9a39-485d-821b-1c376a1c62ad" (UID: "b28b6087-9a39-485d-821b-1c376a1c62ad"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:13:32.894187 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.894134    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d2107d2-77f7-488d-9bd8-af52400ed4a2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0d2107d2-77f7-488d-9bd8-af52400ed4a2" (UID: "0d2107d2-77f7-488d-9bd8-af52400ed4a2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:13:32.894187 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.894152    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7z29\" (UniqueName: \"kubernetes.io/projected/18715797-afa1-44c3-8688-4112d809e7b0-kube-api-access-d7z29\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:13:32.895852 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.895829    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b28b6087-9a39-485d-821b-1c376a1c62ad-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b28b6087-9a39-485d-821b-1c376a1c62ad" (UID: "b28b6087-9a39-485d-821b-1c376a1c62ad"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:13:32.895969 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.895862    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d2107d2-77f7-488d-9bd8-af52400ed4a2-kube-api-access-fkjkx" (OuterVolumeSpecName: "kube-api-access-fkjkx") pod "0d2107d2-77f7-488d-9bd8-af52400ed4a2" (UID: "0d2107d2-77f7-488d-9bd8-af52400ed4a2"). InnerVolumeSpecName "kube-api-access-fkjkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:13:32.896261 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.896239    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b28b6087-9a39-485d-821b-1c376a1c62ad-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b28b6087-9a39-485d-821b-1c376a1c62ad" (UID: "b28b6087-9a39-485d-821b-1c376a1c62ad"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:13:32.896323 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.896242    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b28b6087-9a39-485d-821b-1c376a1c62ad-kube-api-access-txlqh" (OuterVolumeSpecName: "kube-api-access-txlqh") pod "b28b6087-9a39-485d-821b-1c376a1c62ad" (UID: "b28b6087-9a39-485d-821b-1c376a1c62ad"). InnerVolumeSpecName "kube-api-access-txlqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:13:32.994880 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.994783    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkjkx\" (UniqueName: \"kubernetes.io/projected/0d2107d2-77f7-488d-9bd8-af52400ed4a2-kube-api-access-fkjkx\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:13:32.994880 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.994817    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b28b6087-9a39-485d-821b-1c376a1c62ad-openshift-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:13:32.994880 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.994827    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txlqh\" (UniqueName: \"kubernetes.io/projected/b28b6087-9a39-485d-821b-1c376a1c62ad-kube-api-access-txlqh\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:13:32.994880 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.994841    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b28b6087-9a39-485d-821b-1c376a1c62ad-maas-api-tls\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:13:32.994880 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.994853    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b28b6087-9a39-485d-821b-1c376a1c62ad-metrics-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:13:32.994880 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.994866    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d2107d2-77f7-488d-9bd8-af52400ed4a2-plugins-config-volume\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:13:32.995231 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:32.994943    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:33.020297 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:33.020262    2575 generic.go:356] "Generic (PLEG): container finished" podID="18715797-afa1-44c3-8688-4112d809e7b0" containerID="aa630382e4dde0e61adfab059de9a227b5f1c6b1ea2a692798fc72ff08dd0ee6" exitCode=0
Sep 07 17:13:33.020451 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:33.020314    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb"
Sep 07 17:13:33.020451 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:33.020351    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb" event={"ID":"18715797-afa1-44c3-8688-4112d809e7b0","Type":"ContainerDied","Data":"aa630382e4dde0e61adfab059de9a227b5f1c6b1ea2a692798fc72ff08dd0ee6"}
Sep 07 17:13:33.020451 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:33.020407    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb" event={"ID":"18715797-afa1-44c3-8688-4112d809e7b0","Type":"ContainerDied","Data":"9809a6322502e58f56014106019bb712e526ea4f02b5fd7e1f104fbf793afa12"}
Sep 07 17:13:33.020451 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:33.020432    2575 scope.go:117] "RemoveContainer" containerID="aa630382e4dde0e61adfab059de9a227b5f1c6b1ea2a692798fc72ff08dd0ee6"
Sep 07 17:13:33.021766 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:33.021742    2575 generic.go:356] "Generic (PLEG): container finished" podID="b28b6087-9a39-485d-821b-1c376a1c62ad" containerID="02942bd18a6a6bbb86ec28d94b4c8ec8793e53d94d73a6953c36672962b008a3" exitCode=0
Sep 07 17:13:33.021960 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:33.021833    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5"
Sep 07 17:13:33.022087 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:33.021831    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5" event={"ID":"b28b6087-9a39-485d-821b-1c376a1c62ad","Type":"ContainerDied","Data":"02942bd18a6a6bbb86ec28d94b4c8ec8793e53d94d73a6953c36672962b008a3"}
Sep 07 17:13:33.022253 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:33.022105    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5" event={"ID":"b28b6087-9a39-485d-821b-1c376a1c62ad","Type":"ContainerDied","Data":"44488517e37f1f5be43308d2899d51db020f7cc562a3e2023d2db584632dd6d7"}
Sep 07 17:13:33.023643 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:33.023618    2575 generic.go:356] "Generic (PLEG): container finished" podID="0d2107d2-77f7-488d-9bd8-af52400ed4a2" containerID="0ef719eab62d5935865ccd8378730a64df6d29313c911db993c1b5ba6755c4d3" exitCode=0
Sep 07 17:13:33.023769 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:33.023687    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4" event={"ID":"0d2107d2-77f7-488d-9bd8-af52400ed4a2","Type":"ContainerDied","Data":"0ef719eab62d5935865ccd8378730a64df6d29313c911db993c1b5ba6755c4d3"}
Sep 07 17:13:33.023769 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:33.023724    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4" event={"ID":"0d2107d2-77f7-488d-9bd8-af52400ed4a2","Type":"ContainerDied","Data":"830480422def2c1f89b477efcc4c537f9b262220c2e480f376ac1a8ea52d07d7"}
Sep 07 17:13:33.023943 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:33.023798    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4"
Sep 07 17:13:33.032000 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:33.031979    2575 scope.go:117] "RemoveContainer" containerID="aa630382e4dde0e61adfab059de9a227b5f1c6b1ea2a692798fc72ff08dd0ee6"
Sep 07 17:13:33.032284 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:13:33.032263    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa630382e4dde0e61adfab059de9a227b5f1c6b1ea2a692798fc72ff08dd0ee6\": container with ID starting with aa630382e4dde0e61adfab059de9a227b5f1c6b1ea2a692798fc72ff08dd0ee6 not found: ID does not exist" containerID="aa630382e4dde0e61adfab059de9a227b5f1c6b1ea2a692798fc72ff08dd0ee6"
Sep 07 17:13:33.032369 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:33.032290    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa630382e4dde0e61adfab059de9a227b5f1c6b1ea2a692798fc72ff08dd0ee6"} err="failed to get container status \"aa630382e4dde0e61adfab059de9a227b5f1c6b1ea2a692798fc72ff08dd0ee6\": rpc error: code = NotFound desc = could not find container \"aa630382e4dde0e61adfab059de9a227b5f1c6b1ea2a692798fc72ff08dd0ee6\": container with ID starting with aa630382e4dde0e61adfab059de9a227b5f1c6b1ea2a692798fc72ff08dd0ee6 not found: ID does not exist"
Sep 07 17:13:33.032369 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:33.032311    2575 scope.go:117] "RemoveContainer" containerID="02942bd18a6a6bbb86ec28d94b4c8ec8793e53d94d73a6953c36672962b008a3"
Sep 07 17:13:33.040715 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:33.040696    2575 scope.go:117] "RemoveContainer" containerID="02942bd18a6a6bbb86ec28d94b4c8ec8793e53d94d73a6953c36672962b008a3"
Sep 07 17:13:33.041002 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:13:33.040976    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02942bd18a6a6bbb86ec28d94b4c8ec8793e53d94d73a6953c36672962b008a3\": container with ID starting with 02942bd18a6a6bbb86ec28d94b4c8ec8793e53d94d73a6953c36672962b008a3 not found: ID does not exist" containerID="02942bd18a6a6bbb86ec28d94b4c8ec8793e53d94d73a6953c36672962b008a3"
Sep 07 17:13:33.041069 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:33.041008    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02942bd18a6a6bbb86ec28d94b4c8ec8793e53d94d73a6953c36672962b008a3"} err="failed to get container status \"02942bd18a6a6bbb86ec28d94b4c8ec8793e53d94d73a6953c36672962b008a3\": rpc error: code = NotFound desc = could not find container \"02942bd18a6a6bbb86ec28d94b4c8ec8793e53d94d73a6953c36672962b008a3\": container with ID starting with 02942bd18a6a6bbb86ec28d94b4c8ec8793e53d94d73a6953c36672962b008a3 not found: ID does not exist"
Sep 07 17:13:33.041069 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:33.041024    2575 scope.go:117] "RemoveContainer" containerID="0ef719eab62d5935865ccd8378730a64df6d29313c911db993c1b5ba6755c4d3"
Sep 07 17:13:33.049109 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:33.049089    2575 scope.go:117] "RemoveContainer" containerID="0ef719eab62d5935865ccd8378730a64df6d29313c911db993c1b5ba6755c4d3"
Sep 07 17:13:33.049471 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:13:33.049447    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ef719eab62d5935865ccd8378730a64df6d29313c911db993c1b5ba6755c4d3\": container with ID starting with 0ef719eab62d5935865ccd8378730a64df6d29313c911db993c1b5ba6755c4d3 not found: ID does not exist" containerID="0ef719eab62d5935865ccd8378730a64df6d29313c911db993c1b5ba6755c4d3"
Sep 07 17:13:33.049523 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:33.049482    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ef719eab62d5935865ccd8378730a64df6d29313c911db993c1b5ba6755c4d3"} err="failed to get container status \"0ef719eab62d5935865ccd8378730a64df6d29313c911db993c1b5ba6755c4d3\": rpc error: code = NotFound desc = could not find container \"0ef719eab62d5935865ccd8378730a64df6d29313c911db993c1b5ba6755c4d3\": container with ID starting with 0ef719eab62d5935865ccd8378730a64df6d29313c911db993c1b5ba6755c4d3 not found: ID does not exist"
Sep 07 17:13:33.051933 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:33.051913    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb"]
Sep 07 17:13:33.057568 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:33.057548    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb"]
Sep 07 17:13:33.071218 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:33.071194    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5"]
Sep 07 17:13:33.075395 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:33.075373    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9fa102-7c67b6847b-n58w5"]
Sep 07 17:13:33.087123 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:33.087085    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4"]
Sep 07 17:13:33.096817 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:33.096792    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4"]
Sep 07 17:13:34.074878 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:34.074842    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8" podUID="7cd7e58e-9269-4f6f-af4e-f43320089e46" containerName="main" containerID="cri-o://10134056668ffbbcad202f0b225ce1088bef931fb90afdd99c8397459a034ca3" gracePeriod=45
Sep 07 17:13:34.327548 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:34.327486    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8"
Sep 07 17:13:34.408709 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:34.408678    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cd7e58e-9269-4f6f-af4e-f43320089e46-tls-certs\") pod \"7cd7e58e-9269-4f6f-af4e-f43320089e46\" (UID: \"7cd7e58e-9269-4f6f-af4e-f43320089e46\") "
Sep 07 17:13:34.408921 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:34.408719    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cd7e58e-9269-4f6f-af4e-f43320089e46-dshm\") pod \"7cd7e58e-9269-4f6f-af4e-f43320089e46\" (UID: \"7cd7e58e-9269-4f6f-af4e-f43320089e46\") "
Sep 07 17:13:34.408921 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:34.408823    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cd7e58e-9269-4f6f-af4e-f43320089e46-model-cache\") pod \"7cd7e58e-9269-4f6f-af4e-f43320089e46\" (UID: \"7cd7e58e-9269-4f6f-af4e-f43320089e46\") "
Sep 07 17:13:34.408921 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:34.408870    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9h86p\" (UniqueName: \"kubernetes.io/projected/7cd7e58e-9269-4f6f-af4e-f43320089e46-kube-api-access-9h86p\") pod \"7cd7e58e-9269-4f6f-af4e-f43320089e46\" (UID: \"7cd7e58e-9269-4f6f-af4e-f43320089e46\") "
Sep 07 17:13:34.409092 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:34.408945    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cd7e58e-9269-4f6f-af4e-f43320089e46-tmp-dir\") pod \"7cd7e58e-9269-4f6f-af4e-f43320089e46\" (UID: \"7cd7e58e-9269-4f6f-af4e-f43320089e46\") "
Sep 07 17:13:34.409092 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:34.408999    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cd7e58e-9269-4f6f-af4e-f43320089e46-home\") pod \"7cd7e58e-9269-4f6f-af4e-f43320089e46\" (UID: \"7cd7e58e-9269-4f6f-af4e-f43320089e46\") "
Sep 07 17:13:34.409187 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:34.409117    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cd7e58e-9269-4f6f-af4e-f43320089e46-model-cache" (OuterVolumeSpecName: "model-cache") pod "7cd7e58e-9269-4f6f-af4e-f43320089e46" (UID: "7cd7e58e-9269-4f6f-af4e-f43320089e46"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:34.409249 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:34.409219    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cd7e58e-9269-4f6f-af4e-f43320089e46-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7cd7e58e-9269-4f6f-af4e-f43320089e46" (UID: "7cd7e58e-9269-4f6f-af4e-f43320089e46"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:34.409327 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:34.409304    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cd7e58e-9269-4f6f-af4e-f43320089e46-home" (OuterVolumeSpecName: "home") pod "7cd7e58e-9269-4f6f-af4e-f43320089e46" (UID: "7cd7e58e-9269-4f6f-af4e-f43320089e46"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:34.409427 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:34.409402    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cd7e58e-9269-4f6f-af4e-f43320089e46-tmp-dir\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:13:34.409427 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:34.409427    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cd7e58e-9269-4f6f-af4e-f43320089e46-home\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:13:34.409615 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:34.409440    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cd7e58e-9269-4f6f-af4e-f43320089e46-model-cache\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:13:34.411046 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:34.411021    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cd7e58e-9269-4f6f-af4e-f43320089e46-dshm" (OuterVolumeSpecName: "dshm") pod "7cd7e58e-9269-4f6f-af4e-f43320089e46" (UID: "7cd7e58e-9269-4f6f-af4e-f43320089e46"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:34.411133 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:34.411106    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cd7e58e-9269-4f6f-af4e-f43320089e46-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7cd7e58e-9269-4f6f-af4e-f43320089e46" (UID: "7cd7e58e-9269-4f6f-af4e-f43320089e46"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:13:34.411133 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:34.411120    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cd7e58e-9269-4f6f-af4e-f43320089e46-kube-api-access-9h86p" (OuterVolumeSpecName: "kube-api-access-9h86p") pod "7cd7e58e-9269-4f6f-af4e-f43320089e46" (UID: "7cd7e58e-9269-4f6f-af4e-f43320089e46"). InnerVolumeSpecName "kube-api-access-9h86p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:13:34.511085 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:34.511047    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cd7e58e-9269-4f6f-af4e-f43320089e46-tls-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:13:34.511085 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:34.511087    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cd7e58e-9269-4f6f-af4e-f43320089e46-dshm\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:13:34.511285 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:34.511101    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9h86p\" (UniqueName: \"kubernetes.io/projected/7cd7e58e-9269-4f6f-af4e-f43320089e46-kube-api-access-9h86p\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:13:34.722570 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:34.722490    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d2107d2-77f7-488d-9bd8-af52400ed4a2" path="/var/lib/kubelet/pods/0d2107d2-77f7-488d-9bd8-af52400ed4a2/volumes"
Sep 07 17:13:34.722855 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:34.722842    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18715797-afa1-44c3-8688-4112d809e7b0" path="/var/lib/kubelet/pods/18715797-afa1-44c3-8688-4112d809e7b0/volumes"
Sep 07 17:13:34.723226 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:34.723212    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b28b6087-9a39-485d-821b-1c376a1c62ad" path="/var/lib/kubelet/pods/b28b6087-9a39-485d-821b-1c376a1c62ad/volumes"
Sep 07 17:13:35.038620 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:35.038524    2575 generic.go:356] "Generic (PLEG): container finished" podID="7cd7e58e-9269-4f6f-af4e-f43320089e46" containerID="10134056668ffbbcad202f0b225ce1088bef931fb90afdd99c8397459a034ca3" exitCode=0
Sep 07 17:13:35.038620 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:35.038562    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8"
Sep 07 17:13:35.038620 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:35.038609    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8" event={"ID":"7cd7e58e-9269-4f6f-af4e-f43320089e46","Type":"ContainerDied","Data":"10134056668ffbbcad202f0b225ce1088bef931fb90afdd99c8397459a034ca3"}
Sep 07 17:13:35.038920 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:35.038654    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8" event={"ID":"7cd7e58e-9269-4f6f-af4e-f43320089e46","Type":"ContainerDied","Data":"d6a2c802fe25c93ef56f6814873d15e52f214b83113929e422dd68fa05b299c7"}
Sep 07 17:13:35.038920 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:35.038676    2575 scope.go:117] "RemoveContainer" containerID="10134056668ffbbcad202f0b225ce1088bef931fb90afdd99c8397459a034ca3"
Sep 07 17:13:35.047372 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:35.047351    2575 scope.go:117] "RemoveContainer" containerID="10134056668ffbbcad202f0b225ce1088bef931fb90afdd99c8397459a034ca3"
Sep 07 17:13:35.047620 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:13:35.047601    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10134056668ffbbcad202f0b225ce1088bef931fb90afdd99c8397459a034ca3\": container with ID starting with 10134056668ffbbcad202f0b225ce1088bef931fb90afdd99c8397459a034ca3 not found: ID does not exist" containerID="10134056668ffbbcad202f0b225ce1088bef931fb90afdd99c8397459a034ca3"
Sep 07 17:13:35.047665 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:35.047627    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10134056668ffbbcad202f0b225ce1088bef931fb90afdd99c8397459a034ca3"} err="failed to get container status \"10134056668ffbbcad202f0b225ce1088bef931fb90afdd99c8397459a034ca3\": rpc error: code = NotFound desc = could not find container \"10134056668ffbbcad202f0b225ce1088bef931fb90afdd99c8397459a034ca3\": container with ID starting with 10134056668ffbbcad202f0b225ce1088bef931fb90afdd99c8397459a034ca3 not found: ID does not exist"
Sep 07 17:13:35.057106 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:35.057084    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8"]
Sep 07 17:13:35.063919 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:35.063881    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-f4bf9e/noten-model-f4bf9e-kserve-7b59478bdc-xcjt8"]
Sep 07 17:13:35.248252 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:35.248214    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:35.362780 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:35.362726    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:35.461149 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:35.461117    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:35.825149 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:35.825113    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4" podUID="9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f" containerName="main" containerID="cri-o://6b09c8598afc468647e5f477252543720870827d6c2dc73b0d19c4212c3fd538" gracePeriod=45
Sep 07 17:13:36.047239 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:36.047205    2575 generic.go:356] "Generic (PLEG): container finished" podID="9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f" containerID="6b09c8598afc468647e5f477252543720870827d6c2dc73b0d19c4212c3fd538" exitCode=0
Sep 07 17:13:36.047386 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:36.047271    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4" event={"ID":"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f","Type":"ContainerDied","Data":"6b09c8598afc468647e5f477252543720870827d6c2dc73b0d19c4212c3fd538"}
Sep 07 17:13:36.074070 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:36.074048    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"
Sep 07 17:13:36.229177 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:36.229087    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-tmp-dir\") pod \"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f\" (UID: \"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f\") "
Sep 07 17:13:36.229177 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:36.229164    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-model-cache\") pod \"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f\" (UID: \"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f\") "
Sep 07 17:13:36.229409 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:36.229196    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dfzp\" (UniqueName: \"kubernetes.io/projected/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-kube-api-access-4dfzp\") pod \"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f\" (UID: \"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f\") "
Sep 07 17:13:36.229409 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:36.229273    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-home\") pod \"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f\" (UID: \"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f\") "
Sep 07 17:13:36.229409 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:36.229326    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-tls-certs\") pod \"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f\" (UID: \"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f\") "
Sep 07 17:13:36.229409 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:36.229369    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f" (UID: "9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:36.229627 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:36.229376    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-dshm\") pod \"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f\" (UID: \"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f\") "
Sep 07 17:13:36.229627 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:36.229449    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-model-cache" (OuterVolumeSpecName: "model-cache") pod "9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f" (UID: "9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:36.229723 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:36.229628    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-home" (OuterVolumeSpecName: "home") pod "9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f" (UID: "9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:36.229792 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:36.229735    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-home\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:13:36.229792 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:36.229748    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-tmp-dir\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:13:36.229792 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:36.229757    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-model-cache\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:13:36.231480 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:36.231455    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f" (UID: "9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:13:36.231591 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:36.231511    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-kube-api-access-4dfzp" (OuterVolumeSpecName: "kube-api-access-4dfzp") pod "9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f" (UID: "9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f"). InnerVolumeSpecName "kube-api-access-4dfzp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:13:36.231591 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:36.231512    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-dshm" (OuterVolumeSpecName: "dshm") pod "9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f" (UID: "9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:36.331049 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:36.331013    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dfzp\" (UniqueName: \"kubernetes.io/projected/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-kube-api-access-4dfzp\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:13:36.331049 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:36.331043    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-tls-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:13:36.331049 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:36.331052    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f-dshm\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:13:36.723427 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:36.723396    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cd7e58e-9269-4f6f-af4e-f43320089e46" path="/var/lib/kubelet/pods/7cd7e58e-9269-4f6f-af4e-f43320089e46/volumes"
Sep 07 17:13:37.054551 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:37.054513    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4" event={"ID":"9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f","Type":"ContainerDied","Data":"d8364ce60d3bd61b8ff4c8a7c4a80d64f9aff6ab91e66d22df94dea098d46546"}
Sep 07 17:13:37.054731 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:37.054567    2575 scope.go:117] "RemoveContainer" containerID="6b09c8598afc468647e5f477252543720870827d6c2dc73b0d19c4212c3fd538"
Sep 07 17:13:37.054731 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:37.054528    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"
Sep 07 17:13:37.078190 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:37.078164    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"]
Sep 07 17:13:37.080649 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:37.080627    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-9fa102/test-model-9fa102-kserve-7cd78f79f9-cm6w4"]
Sep 07 17:13:38.722018 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:38.721985    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f" path="/var/lib/kubelet/pods/9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f/volumes"
Sep 07 17:13:39.303852 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:39.303815    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:39.403012 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:39.402976    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:39.574922 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:39.574811    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:39.892106 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:39.892031    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3f5460-sh4jz"]
Sep 07 17:13:39.892454 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:39.892405    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cd7e58e-9269-4f6f-af4e-f43320089e46" containerName="main"
Sep 07 17:13:39.892454 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:39.892417    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cd7e58e-9269-4f6f-af4e-f43320089e46" containerName="main"
Sep 07 17:13:39.892454 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:39.892436    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d2107d2-77f7-488d-9bd8-af52400ed4a2" containerName="payload-pre-processing"
Sep 07 17:13:39.892454 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:39.892441    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d2107d2-77f7-488d-9bd8-af52400ed4a2" containerName="payload-pre-processing"
Sep 07 17:13:39.892454 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:39.892450    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18715797-afa1-44c3-8688-4112d809e7b0" containerName="payload-processing"
Sep 07 17:13:39.892454 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:39.892456    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="18715797-afa1-44c3-8688-4112d809e7b0" containerName="payload-processing"
Sep 07 17:13:39.892667 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:39.892465    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b28b6087-9a39-485d-821b-1c376a1c62ad" containerName="maas-api"
Sep 07 17:13:39.892667 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:39.892471    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b28b6087-9a39-485d-821b-1c376a1c62ad" containerName="maas-api"
Sep 07 17:13:39.892667 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:39.892483    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f" containerName="main"
Sep 07 17:13:39.892667 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:39.892488    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f" containerName="main"
Sep 07 17:13:39.892667 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:39.892544    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="18715797-afa1-44c3-8688-4112d809e7b0" containerName="payload-processing"
Sep 07 17:13:39.892667 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:39.892551    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b28b6087-9a39-485d-821b-1c376a1c62ad" containerName="maas-api"
Sep 07 17:13:39.892667 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:39.892557    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cd7e58e-9269-4f6f-af4e-f43320089e46" containerName="main"
Sep 07 17:13:39.892667 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:39.892564    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d2107d2-77f7-488d-9bd8-af52400ed4a2" containerName="payload-pre-processing"
Sep 07 17:13:39.892667 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:39.892572    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ca5b7d4-5e6e-460f-ab2a-1aaafc966e1f" containerName="main"
Sep 07 17:13:39.897198 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:39.897180    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3f5460-sh4jz"
Sep 07 17:13:39.900885 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:39.900859    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 17:13:39.901095 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:39.901048    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qphph\""
Sep 07 17:13:39.903910 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:39.903877    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3f5460-sh4jz"]
Sep 07 17:13:40.055479 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:40.055438    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:40.069725 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:40.069702    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/032af3c2-02a0-4c0e-87aa-a0ccfec44901-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-3f5460-sh4jz\" (UID: \"032af3c2-02a0-4c0e-87aa-a0ccfec44901\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3f5460-sh4jz"
Sep 07 17:13:40.171073 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:40.170984    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/032af3c2-02a0-4c0e-87aa-a0ccfec44901-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-3f5460-sh4jz\" (UID: \"032af3c2-02a0-4c0e-87aa-a0ccfec44901\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3f5460-sh4jz"
Sep 07 17:13:40.171556 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:40.171536    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/032af3c2-02a0-4c0e-87aa-a0ccfec44901-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-3f5460-sh4jz\" (UID: \"032af3c2-02a0-4c0e-87aa-a0ccfec44901\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3f5460-sh4jz"
Sep 07 17:13:40.209754 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:40.209723    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3f5460-sh4jz"
Sep 07 17:13:40.479923 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:40.479883    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3f5460-sh4jz"]
Sep 07 17:13:40.481500 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:13:40.481476    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod032af3c2_02a0_4c0e_87aa_a0ccfec44901.slice/crio-d3cb59f86b4bc31ca410fc93093e138fa8a6166948dd4e51c5245417cdee1568 WatchSource:0}: Error finding container d3cb59f86b4bc31ca410fc93093e138fa8a6166948dd4e51c5245417cdee1568: Status 404 returned error can't find the container with id d3cb59f86b4bc31ca410fc93093e138fa8a6166948dd4e51c5245417cdee1568
Sep 07 17:13:40.483391 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:40.483372    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 17:13:41.076664 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:41.076627    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3f5460-sh4jz" event={"ID":"032af3c2-02a0-4c0e-87aa-a0ccfec44901","Type":"ContainerStarted","Data":"d3cb59f86b4bc31ca410fc93093e138fa8a6166948dd4e51c5245417cdee1568"}
Sep 07 17:13:43.090396 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:43.090361    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3f5460-sh4jz" event={"ID":"032af3c2-02a0-4c0e-87aa-a0ccfec44901","Type":"ContainerStarted","Data":"46eeb26c3741073c688e00de7c833fca48624fe9378326c71b120784e8f821e0"}
Sep 07 17:13:43.108604 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:43.108551    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3f5460-sh4jz" podStartSLOduration=1.891419306 podStartE2EDuration="4.108535139s" totalImagesPullingTime="2.217115833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:13:43.105781363 +0000 UTC m=+1017.002628677" watchObservedRunningTime="2026-09-07 17:13:43.108535139 +0000 UTC m=+1017.005382453"
Sep 07 17:13:44.097547 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:44.097507    2575 generic.go:356] "Generic (PLEG): container finished" podID="032af3c2-02a0-4c0e-87aa-a0ccfec44901" containerID="46eeb26c3741073c688e00de7c833fca48624fe9378326c71b120784e8f821e0" exitCode=0
Sep 07 17:13:44.097955 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:44.097562    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3f5460-sh4jz" event={"ID":"032af3c2-02a0-4c0e-87aa-a0ccfec44901","Type":"ContainerDied","Data":"46eeb26c3741073c688e00de7c833fca48624fe9378326c71b120784e8f821e0"}
Sep 07 17:13:45.232752 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:45.232726    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3f5460-sh4jz"
Sep 07 17:13:45.321308 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:45.321265    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/032af3c2-02a0-4c0e-87aa-a0ccfec44901-maas-api-service-ca\") pod \"032af3c2-02a0-4c0e-87aa-a0ccfec44901\" (UID: \"032af3c2-02a0-4c0e-87aa-a0ccfec44901\") "
Sep 07 17:13:45.321617 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:45.321596    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/032af3c2-02a0-4c0e-87aa-a0ccfec44901-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "032af3c2-02a0-4c0e-87aa-a0ccfec44901" (UID: "032af3c2-02a0-4c0e-87aa-a0ccfec44901"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:13:45.422858 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:45.422780    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/032af3c2-02a0-4c0e-87aa-a0ccfec44901-maas-api-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:13:45.973995 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:45.973962    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:46.109856 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:46.109829    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3f5460-sh4jz"
Sep 07 17:13:46.110315 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:46.109825    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3f5460-sh4jz" event={"ID":"032af3c2-02a0-4c0e-87aa-a0ccfec44901","Type":"ContainerDied","Data":"d3cb59f86b4bc31ca410fc93093e138fa8a6166948dd4e51c5245417cdee1568"}
Sep 07 17:13:46.110315 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:46.109941    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d3cb59f86b4bc31ca410fc93093e138fa8a6166948dd4e51c5245417cdee1568"
Sep 07 17:13:46.715255 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:46.715224    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:50.410087 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:50.410043    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:50.510753 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:50.510712    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:50.612886 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:50.612845    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:50.629516 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:50.629486    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3f5460-sh4jz"]
Sep 07 17:13:50.633252 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:50.633221    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3f5460-sh4jz"]
Sep 07 17:13:50.712296 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:50.712203    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:50.721429 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:50.721397    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="032af3c2-02a0-4c0e-87aa-a0ccfec44901" path="/var/lib/kubelet/pods/032af3c2-02a0-4c0e-87aa-a0ccfec44901/volumes"
Sep 07 17:13:51.021184 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:51.021094    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:53.177679 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:53.177630    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:53.348989 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:53.348951    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:53.502582 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:53.502492    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:54.179420 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:54.179387    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:54.287321 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:54.287289    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:54.379193 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:54.379155    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:55.887180 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:55.887148    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:57.386171 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:57.386137    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:57.485886 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:57.485857    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:57.664203 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:57.664109    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:58.271405 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:58.271377    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:58.546033 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:58.545998    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:13:59.045095 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:13:59.045064    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:02.070425 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:02.070388    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:02.164825 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:02.164788    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:02.860109 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:02.860066    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:02.957294 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:02.957253    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:03.030450 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:03.030410    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:03.134028 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:03.133947    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl"]
Sep 07 17:14:03.134388 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:03.134322    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="032af3c2-02a0-4c0e-87aa-a0ccfec44901" containerName="revoke-keys"
Sep 07 17:14:03.134388 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:03.134334    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="032af3c2-02a0-4c0e-87aa-a0ccfec44901" containerName="revoke-keys"
Sep 07 17:14:03.134476 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:03.134413    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="032af3c2-02a0-4c0e-87aa-a0ccfec44901" containerName="revoke-keys"
Sep 07 17:14:03.139022 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:03.139003    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl"
Sep 07 17:14:03.143398 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:03.143369    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-1795dd-serving-cert\""
Sep 07 17:14:03.143933 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:03.143917    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rggbk\""
Sep 07 17:14:03.144724 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:03.144707    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 07 17:14:03.144828 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:03.144721    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 07 17:14:03.144828 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:03.144761    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 17:14:03.151259 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:03.151237    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl"]
Sep 07 17:14:03.177076 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:03.177042    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:03.199214 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:03.199181    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93324305-bad7-4527-aaf6-aee3d1c824e4-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl\" (UID: \"93324305-bad7-4527-aaf6-aee3d1c824e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl"
Sep 07 17:14:03.199407 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:03.199270    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93324305-bad7-4527-aaf6-aee3d1c824e4-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl\" (UID: \"93324305-bad7-4527-aaf6-aee3d1c824e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl"
Sep 07 17:14:03.199407 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:03.199299    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93324305-bad7-4527-aaf6-aee3d1c824e4-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl\" (UID: \"93324305-bad7-4527-aaf6-aee3d1c824e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl"
Sep 07 17:14:03.199407 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:03.199321    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xcr7\" (UniqueName: \"kubernetes.io/projected/93324305-bad7-4527-aaf6-aee3d1c824e4-kube-api-access-8xcr7\") pod \"maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl\" (UID: \"93324305-bad7-4527-aaf6-aee3d1c824e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl"
Sep 07 17:14:03.278329 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:03.278295    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:03.300067 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:03.300034    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93324305-bad7-4527-aaf6-aee3d1c824e4-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl\" (UID: \"93324305-bad7-4527-aaf6-aee3d1c824e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl"
Sep 07 17:14:03.300233 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:03.300099    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93324305-bad7-4527-aaf6-aee3d1c824e4-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl\" (UID: \"93324305-bad7-4527-aaf6-aee3d1c824e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl"
Sep 07 17:14:03.300233 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:03.300118    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93324305-bad7-4527-aaf6-aee3d1c824e4-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl\" (UID: \"93324305-bad7-4527-aaf6-aee3d1c824e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl"
Sep 07 17:14:03.300233 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:03.300134    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xcr7\" (UniqueName: \"kubernetes.io/projected/93324305-bad7-4527-aaf6-aee3d1c824e4-kube-api-access-8xcr7\") pod \"maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl\" (UID: \"93324305-bad7-4527-aaf6-aee3d1c824e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl"
Sep 07 17:14:03.300233 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:14:03.300193    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-serving-cert: secret "maas-api-e2e-shared-a-w3-1795dd-serving-cert" not found
Sep 07 17:14:03.300452 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:14:03.300268    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93324305-bad7-4527-aaf6-aee3d1c824e4-maas-api-tls podName:93324305-bad7-4527-aaf6-aee3d1c824e4 nodeName:}" failed. No retries permitted until 2026-09-07 17:14:03.800245982 +0000 UTC m=+1037.697093275 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/93324305-bad7-4527-aaf6-aee3d1c824e4-maas-api-tls") pod "maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl" (UID: "93324305-bad7-4527-aaf6-aee3d1c824e4") : secret "maas-api-e2e-shared-a-w3-1795dd-serving-cert" not found
Sep 07 17:14:03.300779 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:03.300761    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93324305-bad7-4527-aaf6-aee3d1c824e4-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl\" (UID: \"93324305-bad7-4527-aaf6-aee3d1c824e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl"
Sep 07 17:14:03.302456 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:03.302437    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93324305-bad7-4527-aaf6-aee3d1c824e4-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl\" (UID: \"93324305-bad7-4527-aaf6-aee3d1c824e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl"
Sep 07 17:14:03.310822 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:03.310797    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xcr7\" (UniqueName: \"kubernetes.io/projected/93324305-bad7-4527-aaf6-aee3d1c824e4-kube-api-access-8xcr7\") pod \"maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl\" (UID: \"93324305-bad7-4527-aaf6-aee3d1c824e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl"
Sep 07 17:14:03.651399 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:03.651350    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:03.804813 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:03.804773    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93324305-bad7-4527-aaf6-aee3d1c824e4-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl\" (UID: \"93324305-bad7-4527-aaf6-aee3d1c824e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl"
Sep 07 17:14:03.805006 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:14:03.804956    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-serving-cert: secret "maas-api-e2e-shared-a-w3-1795dd-serving-cert" not found
Sep 07 17:14:03.805052 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:14:03.805032    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93324305-bad7-4527-aaf6-aee3d1c824e4-maas-api-tls podName:93324305-bad7-4527-aaf6-aee3d1c824e4 nodeName:}" failed. No retries permitted until 2026-09-07 17:14:04.805016691 +0000 UTC m=+1038.701863988 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/93324305-bad7-4527-aaf6-aee3d1c824e4-maas-api-tls") pod "maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl" (UID: "93324305-bad7-4527-aaf6-aee3d1c824e4") : secret "maas-api-e2e-shared-a-w3-1795dd-serving-cert" not found
Sep 07 17:14:03.828825 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:03.828797    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:04.031841 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:04.031749    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:04.087730 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:04.087693    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4"]
Sep 07 17:14:04.091388 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:04.091368    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4"
Sep 07 17:14:04.094600 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:04.094580    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-1795dd-dockercfg-27746\""
Sep 07 17:14:04.095057 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:04.095039    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-1795dd\""
Sep 07 17:14:04.116357 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:04.114680    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4"]
Sep 07 17:14:04.192324 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:04.192276    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:04.208341 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:04.208309    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e70d804-99a0-49b0-892e-2314acab53d1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4\" (UID: \"1e70d804-99a0-49b0-892e-2314acab53d1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4"
Sep 07 17:14:04.208341 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:04.208345    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cxf8\" (UniqueName: \"kubernetes.io/projected/1e70d804-99a0-49b0-892e-2314acab53d1-kube-api-access-8cxf8\") pod \"payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4\" (UID: \"1e70d804-99a0-49b0-892e-2314acab53d1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4"
Sep 07 17:14:04.309579 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:04.309548    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e70d804-99a0-49b0-892e-2314acab53d1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4\" (UID: \"1e70d804-99a0-49b0-892e-2314acab53d1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4"
Sep 07 17:14:04.309789 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:04.309587    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cxf8\" (UniqueName: \"kubernetes.io/projected/1e70d804-99a0-49b0-892e-2314acab53d1-kube-api-access-8cxf8\") pod \"payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4\" (UID: \"1e70d804-99a0-49b0-892e-2314acab53d1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4"
Sep 07 17:14:04.310351 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:04.310332    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e70d804-99a0-49b0-892e-2314acab53d1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4\" (UID: \"1e70d804-99a0-49b0-892e-2314acab53d1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4"
Sep 07 17:14:04.318268 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:04.318238    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cxf8\" (UniqueName: \"kubernetes.io/projected/1e70d804-99a0-49b0-892e-2314acab53d1-kube-api-access-8cxf8\") pod \"payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4\" (UID: \"1e70d804-99a0-49b0-892e-2314acab53d1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4"
Sep 07 17:14:04.401710 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:04.401669    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4"
Sep 07 17:14:04.682410 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:04.682382    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4"]
Sep 07 17:14:04.682503 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:14:04.682401    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e70d804_99a0_49b0_892e_2314acab53d1.slice/crio-7d83cc8ad5bd918f3d1d451ea3187fc7d56dfb2571c80ab9952a4234cf2860c4 WatchSource:0}: Error finding container 7d83cc8ad5bd918f3d1d451ea3187fc7d56dfb2571c80ab9952a4234cf2860c4: Status 404 returned error can't find the container with id 7d83cc8ad5bd918f3d1d451ea3187fc7d56dfb2571c80ab9952a4234cf2860c4
Sep 07 17:14:04.815809 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:04.815770    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93324305-bad7-4527-aaf6-aee3d1c824e4-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl\" (UID: \"93324305-bad7-4527-aaf6-aee3d1c824e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl"
Sep 07 17:14:04.818439 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:04.818405    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93324305-bad7-4527-aaf6-aee3d1c824e4-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl\" (UID: \"93324305-bad7-4527-aaf6-aee3d1c824e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl"
Sep 07 17:14:04.902429 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:04.902396    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:04.952301 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:04.952221    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl"
Sep 07 17:14:04.974947 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:04.974889    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:05.216448 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:05.216352    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4" event={"ID":"1e70d804-99a0-49b0-892e-2314acab53d1","Type":"ContainerStarted","Data":"b3de58a61a20ab1a8c2b2309127af66535a5146f41e6f2f7ae2282675256e999"}
Sep 07 17:14:05.216448 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:05.216417    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4" event={"ID":"1e70d804-99a0-49b0-892e-2314acab53d1","Type":"ContainerStarted","Data":"7d83cc8ad5bd918f3d1d451ea3187fc7d56dfb2571c80ab9952a4234cf2860c4"}
Sep 07 17:14:05.216861 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:05.216462    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4"
Sep 07 17:14:05.229042 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:05.229019    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl"]
Sep 07 17:14:05.230049 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:14:05.230019    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93324305_bad7_4527_aaf6_aee3d1c824e4.slice/crio-954821c12a3639c5ca237dbe0202f9d897c5b31e5173ac33bae646e2714bf004 WatchSource:0}: Error finding container 954821c12a3639c5ca237dbe0202f9d897c5b31e5173ac33bae646e2714bf004: Status 404 returned error can't find the container with id 954821c12a3639c5ca237dbe0202f9d897c5b31e5173ac33bae646e2714bf004
Sep 07 17:14:05.251264 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:05.251218    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4" podStartSLOduration=1.25120351 podStartE2EDuration="1.25120351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:14:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:14:05.250138996 +0000 UTC m=+1039.146986310" watchObservedRunningTime="2026-09-07 17:14:05.25120351 +0000 UTC m=+1039.148050825"
Sep 07 17:14:06.224464 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:06.224425    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl" event={"ID":"93324305-bad7-4527-aaf6-aee3d1c824e4","Type":"ContainerStarted","Data":"3c1e110c2111a271a9deb33f458de7420a80852b5b4af3dadf6c40669cd7c766"}
Sep 07 17:14:06.224855 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:06.224484    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl" event={"ID":"93324305-bad7-4527-aaf6-aee3d1c824e4","Type":"ContainerStarted","Data":"954821c12a3639c5ca237dbe0202f9d897c5b31e5173ac33bae646e2714bf004"}
Sep 07 17:14:06.224855 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:06.224678    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl"
Sep 07 17:14:06.245026 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:06.244979    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl" podStartSLOduration=2.769891523 podStartE2EDuration="3.244962685s" totalImagesPullingTime="475.071162ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:14:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:14:06.243607805 +0000 UTC m=+1040.140455121" watchObservedRunningTime="2026-09-07 17:14:06.244962685 +0000 UTC m=+1040.141809999"
Sep 07 17:14:10.019397 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:10.019365    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:10.119505 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:10.119465    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:10.252047 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:10.252014    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:10.591097 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:10.591062    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:11.087920 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:11.087862    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:12.234998 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:12.234966    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl"
Sep 07 17:14:14.105670 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:14.105628    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:14.189584 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:14.189550    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:15.299096 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:15.299062    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw"]
Sep 07 17:14:15.302873 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:15.302851    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw"
Sep 07 17:14:15.305688 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:15.305664    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-f799c427-serving-cert\""
Sep 07 17:14:15.315558 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:15.315533    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw"]
Sep 07 17:14:15.344881 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:15.344845    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:15.419626 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:15.419588    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvxz8\" (UniqueName: \"kubernetes.io/projected/ff66e03c-e796-4252-9e4e-db107fac97bf-kube-api-access-cvxz8\") pod \"maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw\" (UID: \"ff66e03c-e796-4252-9e4e-db107fac97bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw"
Sep 07 17:14:15.419800 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:15.419664    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff66e03c-e796-4252-9e4e-db107fac97bf-maas-api-tls\") pod \"maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw\" (UID: \"ff66e03c-e796-4252-9e4e-db107fac97bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw"
Sep 07 17:14:15.419851 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:15.419825    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff66e03c-e796-4252-9e4e-db107fac97bf-metrics-certs\") pod \"maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw\" (UID: \"ff66e03c-e796-4252-9e4e-db107fac97bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw"
Sep 07 17:14:15.419908 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:15.419872    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff66e03c-e796-4252-9e4e-db107fac97bf-openshift-service-ca\") pod \"maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw\" (UID: \"ff66e03c-e796-4252-9e4e-db107fac97bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw"
Sep 07 17:14:15.444881 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:15.444848    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:15.521021 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:15.520970    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff66e03c-e796-4252-9e4e-db107fac97bf-metrics-certs\") pod \"maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw\" (UID: \"ff66e03c-e796-4252-9e4e-db107fac97bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw"
Sep 07 17:14:15.521212 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:15.521035    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff66e03c-e796-4252-9e4e-db107fac97bf-openshift-service-ca\") pod \"maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw\" (UID: \"ff66e03c-e796-4252-9e4e-db107fac97bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw"
Sep 07 17:14:15.521212 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:15.521097    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvxz8\" (UniqueName: \"kubernetes.io/projected/ff66e03c-e796-4252-9e4e-db107fac97bf-kube-api-access-cvxz8\") pod \"maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw\" (UID: \"ff66e03c-e796-4252-9e4e-db107fac97bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw"
Sep 07 17:14:15.521212 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:15.521166    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff66e03c-e796-4252-9e4e-db107fac97bf-maas-api-tls\") pod \"maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw\" (UID: \"ff66e03c-e796-4252-9e4e-db107fac97bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw"
Sep 07 17:14:15.521803 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:15.521778    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff66e03c-e796-4252-9e4e-db107fac97bf-openshift-service-ca\") pod \"maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw\" (UID: \"ff66e03c-e796-4252-9e4e-db107fac97bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw"
Sep 07 17:14:15.523548 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:15.523521    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff66e03c-e796-4252-9e4e-db107fac97bf-maas-api-tls\") pod \"maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw\" (UID: \"ff66e03c-e796-4252-9e4e-db107fac97bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw"
Sep 07 17:14:15.523638 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:15.523577    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff66e03c-e796-4252-9e4e-db107fac97bf-metrics-certs\") pod \"maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw\" (UID: \"ff66e03c-e796-4252-9e4e-db107fac97bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw"
Sep 07 17:14:15.530092 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:15.530071    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvxz8\" (UniqueName: \"kubernetes.io/projected/ff66e03c-e796-4252-9e4e-db107fac97bf-kube-api-access-cvxz8\") pod \"maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw\" (UID: \"ff66e03c-e796-4252-9e4e-db107fac97bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw"
Sep 07 17:14:15.551080 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:15.550997    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:15.614082 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:15.614044    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw"
Sep 07 17:14:15.870960 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:15.870874    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:15.894686 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:15.894653    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw"]
Sep 07 17:14:15.895847 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:14:15.895806    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff66e03c_e796_4252_9e4e_db107fac97bf.slice/crio-18507f393ed17299b472c7287259fc00a4eda37356b9c870aae2195b7fb2a0c3 WatchSource:0}: Error finding container 18507f393ed17299b472c7287259fc00a4eda37356b9c870aae2195b7fb2a0c3: Status 404 returned error can't find the container with id 18507f393ed17299b472c7287259fc00a4eda37356b9c870aae2195b7fb2a0c3
Sep 07 17:14:15.971168 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:15.971131    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:16.015807 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:16.015764    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f799c427-68d687f597-8swvr"]
Sep 07 17:14:16.020560 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:16.020534    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f799c427-68d687f597-8swvr"
Sep 07 17:14:16.024125 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:16.024032    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-f799c427-dockercfg-gfzjz\""
Sep 07 17:14:16.024318 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:16.024297    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-f799c427\""
Sep 07 17:14:16.028210 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:16.028189    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f799c427-68d687f597-8swvr"]
Sep 07 17:14:16.127103 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:16.127004    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g8bs\" (UniqueName: \"kubernetes.io/projected/16de247b-ba5c-4929-bc05-85284fd4699c-kube-api-access-4g8bs\") pod \"payload-processing-e2e-mt-f799c427-68d687f597-8swvr\" (UID: \"16de247b-ba5c-4929-bc05-85284fd4699c\") " pod="openshift-ingress/payload-processing-e2e-mt-f799c427-68d687f597-8swvr"
Sep 07 17:14:16.127103 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:16.127048    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16de247b-ba5c-4929-bc05-85284fd4699c-plugins-config-volume\") pod \"payload-processing-e2e-mt-f799c427-68d687f597-8swvr\" (UID: \"16de247b-ba5c-4929-bc05-85284fd4699c\") " pod="openshift-ingress/payload-processing-e2e-mt-f799c427-68d687f597-8swvr"
Sep 07 17:14:16.226315 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:16.226284    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4"
Sep 07 17:14:16.228113 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:16.228084    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g8bs\" (UniqueName: \"kubernetes.io/projected/16de247b-ba5c-4929-bc05-85284fd4699c-kube-api-access-4g8bs\") pod \"payload-processing-e2e-mt-f799c427-68d687f597-8swvr\" (UID: \"16de247b-ba5c-4929-bc05-85284fd4699c\") " pod="openshift-ingress/payload-processing-e2e-mt-f799c427-68d687f597-8swvr"
Sep 07 17:14:16.228257 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:16.228124    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16de247b-ba5c-4929-bc05-85284fd4699c-plugins-config-volume\") pod \"payload-processing-e2e-mt-f799c427-68d687f597-8swvr\" (UID: \"16de247b-ba5c-4929-bc05-85284fd4699c\") " pod="openshift-ingress/payload-processing-e2e-mt-f799c427-68d687f597-8swvr"
Sep 07 17:14:16.228786 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:16.228768    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16de247b-ba5c-4929-bc05-85284fd4699c-plugins-config-volume\") pod \"payload-processing-e2e-mt-f799c427-68d687f597-8swvr\" (UID: \"16de247b-ba5c-4929-bc05-85284fd4699c\") " pod="openshift-ingress/payload-processing-e2e-mt-f799c427-68d687f597-8swvr"
Sep 07 17:14:16.236441 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:16.236414    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g8bs\" (UniqueName: \"kubernetes.io/projected/16de247b-ba5c-4929-bc05-85284fd4699c-kube-api-access-4g8bs\") pod \"payload-processing-e2e-mt-f799c427-68d687f597-8swvr\" (UID: \"16de247b-ba5c-4929-bc05-85284fd4699c\") " pod="openshift-ingress/payload-processing-e2e-mt-f799c427-68d687f597-8swvr"
Sep 07 17:14:16.274882 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:16.274850    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw" event={"ID":"ff66e03c-e796-4252-9e4e-db107fac97bf","Type":"ContainerStarted","Data":"18507f393ed17299b472c7287259fc00a4eda37356b9c870aae2195b7fb2a0c3"}
Sep 07 17:14:16.333865 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:16.333835    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f799c427-68d687f597-8swvr"
Sep 07 17:14:16.634516 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:16.634493    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f799c427-68d687f597-8swvr"]
Sep 07 17:14:16.635152 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:14:16.635127    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16de247b_ba5c_4929_bc05_85284fd4699c.slice/crio-bd09a20dd83726b8ca5a9bab194377c486d56627e6715605130ab2def5faefc3 WatchSource:0}: Error finding container bd09a20dd83726b8ca5a9bab194377c486d56627e6715605130ab2def5faefc3: Status 404 returned error can't find the container with id bd09a20dd83726b8ca5a9bab194377c486d56627e6715605130ab2def5faefc3
Sep 07 17:14:17.282521 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:17.282484    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f799c427-68d687f597-8swvr" event={"ID":"16de247b-ba5c-4929-bc05-85284fd4699c","Type":"ContainerStarted","Data":"a8a9665416df250588ba2c3b371591bf57031424bbc566f23437f7493762c079"}
Sep 07 17:14:17.282719 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:17.282694    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-f799c427-68d687f597-8swvr"
Sep 07 17:14:17.282805 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:17.282737    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f799c427-68d687f597-8swvr" event={"ID":"16de247b-ba5c-4929-bc05-85284fd4699c","Type":"ContainerStarted","Data":"bd09a20dd83726b8ca5a9bab194377c486d56627e6715605130ab2def5faefc3"}
Sep 07 17:14:17.284204 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:17.284180    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw" event={"ID":"ff66e03c-e796-4252-9e4e-db107fac97bf","Type":"ContainerStarted","Data":"942ad9d8fba319302963529061d4b3395ef7980474ecf289abc5fc36dd5d0bd6"}
Sep 07 17:14:17.284324 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:17.284223    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw"
Sep 07 17:14:17.324027 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:17.323874    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-f799c427-68d687f597-8swvr" podStartSLOduration=2.323856792 podStartE2EDuration="2.323856792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:14:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:14:17.322197756 +0000 UTC m=+1051.219045072" watchObservedRunningTime="2026-09-07 17:14:17.323856792 +0000 UTC m=+1051.220704107"
Sep 07 17:14:23.294659 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:23.294626    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw"
Sep 07 17:14:23.319739 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:23.319677    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw" podStartSLOduration=7.528092929 podStartE2EDuration="8.319656439s" totalImagesPullingTime="791.56351ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:14:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:14:17.359093775 +0000 UTC m=+1051.255941101" watchObservedRunningTime="2026-09-07 17:14:23.319656439 +0000 UTC m=+1057.216503760"
Sep 07 17:14:24.453957 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:24.453919    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:26.928936 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:26.928887    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:27.279294 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:27.279211    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:27.741666 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:27.741628    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:28.292094 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:28.292059    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-f799c427-68d687f597-8swvr"
Sep 07 17:14:28.294502 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:28.294468    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:31.182808 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:31.182774    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:31.295964 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:31.295916    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:32.360882 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:32.360841    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:32.459179 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:32.459138    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:32.929811 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:32.929762    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:33.028011 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:33.027978    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:33.128700 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:33.128668    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2"]
Sep 07 17:14:33.132469 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:33.132454    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2"
Sep 07 17:14:33.136499 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:33.136480    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-3973bf\""
Sep 07 17:14:33.136615 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:33.136600    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-3973bf-dockercfg-46qzp\""
Sep 07 17:14:33.145942 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:33.145880    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2"]
Sep 07 17:14:33.186041 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:33.185957    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ef4b828-1482-48c5-bfff-76c31f326856-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2\" (UID: \"6ef4b828-1482-48c5-bfff-76c31f326856\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2"
Sep 07 17:14:33.186041 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:33.185998    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxjzg\" (UniqueName: \"kubernetes.io/projected/6ef4b828-1482-48c5-bfff-76c31f326856-kube-api-access-gxjzg\") pod \"payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2\" (UID: \"6ef4b828-1482-48c5-bfff-76c31f326856\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2"
Sep 07 17:14:33.287391 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:33.287350    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxjzg\" (UniqueName: \"kubernetes.io/projected/6ef4b828-1482-48c5-bfff-76c31f326856-kube-api-access-gxjzg\") pod \"payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2\" (UID: \"6ef4b828-1482-48c5-bfff-76c31f326856\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2"
Sep 07 17:14:33.287590 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:33.287474    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ef4b828-1482-48c5-bfff-76c31f326856-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2\" (UID: \"6ef4b828-1482-48c5-bfff-76c31f326856\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2"
Sep 07 17:14:33.288140 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:33.288118    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ef4b828-1482-48c5-bfff-76c31f326856-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2\" (UID: \"6ef4b828-1482-48c5-bfff-76c31f326856\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2"
Sep 07 17:14:33.306291 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:33.306266    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxjzg\" (UniqueName: \"kubernetes.io/projected/6ef4b828-1482-48c5-bfff-76c31f326856-kube-api-access-gxjzg\") pod \"payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2\" (UID: \"6ef4b828-1482-48c5-bfff-76c31f326856\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2"
Sep 07 17:14:33.443802 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:33.443707    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2"
Sep 07 17:14:33.727829 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:33.727783    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2"]
Sep 07 17:14:33.730132 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:14:33.730098    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ef4b828_1482_48c5_bfff_76c31f326856.slice/crio-84cfdddb16c9ec734fd8d6558f4fafeb059208411da75b96100f88673f0e182d WatchSource:0}: Error finding container 84cfdddb16c9ec734fd8d6558f4fafeb059208411da75b96100f88673f0e182d: Status 404 returned error can't find the container with id 84cfdddb16c9ec734fd8d6558f4fafeb059208411da75b96100f88673f0e182d
Sep 07 17:14:34.380604 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:34.380552    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2" event={"ID":"6ef4b828-1482-48c5-bfff-76c31f326856","Type":"ContainerStarted","Data":"cecd8b2c8006e0f0da3010517b645f474f213f8688a0cfa1fafbb092b570aef7"}
Sep 07 17:14:34.380805 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:34.380626    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2" event={"ID":"6ef4b828-1482-48c5-bfff-76c31f326856","Type":"ContainerStarted","Data":"84cfdddb16c9ec734fd8d6558f4fafeb059208411da75b96100f88673f0e182d"}
Sep 07 17:14:34.380805 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:34.380749    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2"
Sep 07 17:14:34.408266 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:34.408213    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2" podStartSLOduration=1.4081960150000001 podStartE2EDuration="1.408196015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:14:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:14:34.40616829 +0000 UTC m=+1068.303015609" watchObservedRunningTime="2026-09-07 17:14:34.408196015 +0000 UTC m=+1068.305043336"
Sep 07 17:14:36.470107 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:36.470078    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:39.006379 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:39.006291    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:39.754869 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:39.754836    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:39.872075 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:39.872040    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:40.178786 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:40.178755    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:45.389283 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:45.389242    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2"
Sep 07 17:14:46.297810 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:46.297775    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:46.401291 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:46.401253    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:54.673025 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:54.672990    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:56.095865 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:56.095826    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:56.816878 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:56.816832    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:57.443024 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:57.442988    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw"]
Sep 07 17:14:57.443485 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:57.443281    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw" podUID="ff66e03c-e796-4252-9e4e-db107fac97bf" containerName="maas-api" containerID="cri-o://942ad9d8fba319302963529061d4b3395ef7980474ecf289abc5fc36dd5d0bd6" gracePeriod=30
Sep 07 17:14:57.473688 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:57.473659    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:57.505308 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:57.505279    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f799c427-68d687f597-8swvr"]
Sep 07 17:14:57.505551 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:57.505522    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-f799c427-68d687f597-8swvr" podUID="16de247b-ba5c-4929-bc05-85284fd4699c" containerName="payload-processing" containerID="cri-o://a8a9665416df250588ba2c3b371591bf57031424bbc566f23437f7493762c079" gracePeriod=30
Sep 07 17:14:57.575126 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:57.575089    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:57.676596 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:57.676561    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:57.751867 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:57.751842    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw"
Sep 07 17:14:57.761690 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:57.761661    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:57.779524 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:57.779497    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f799c427-68d687f597-8swvr"
Sep 07 17:14:57.832937 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:57.832883    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16de247b-ba5c-4929-bc05-85284fd4699c-plugins-config-volume\") pod \"16de247b-ba5c-4929-bc05-85284fd4699c\" (UID: \"16de247b-ba5c-4929-bc05-85284fd4699c\") "
Sep 07 17:14:57.833108 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:57.832952    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff66e03c-e796-4252-9e4e-db107fac97bf-maas-api-tls\") pod \"ff66e03c-e796-4252-9e4e-db107fac97bf\" (UID: \"ff66e03c-e796-4252-9e4e-db107fac97bf\") "
Sep 07 17:14:57.833108 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:57.832990    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvxz8\" (UniqueName: \"kubernetes.io/projected/ff66e03c-e796-4252-9e4e-db107fac97bf-kube-api-access-cvxz8\") pod \"ff66e03c-e796-4252-9e4e-db107fac97bf\" (UID: \"ff66e03c-e796-4252-9e4e-db107fac97bf\") "
Sep 07 17:14:57.833108 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:57.833049    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff66e03c-e796-4252-9e4e-db107fac97bf-metrics-certs\") pod \"ff66e03c-e796-4252-9e4e-db107fac97bf\" (UID: \"ff66e03c-e796-4252-9e4e-db107fac97bf\") "
Sep 07 17:14:57.833108 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:57.833077    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4g8bs\" (UniqueName: \"kubernetes.io/projected/16de247b-ba5c-4929-bc05-85284fd4699c-kube-api-access-4g8bs\") pod \"16de247b-ba5c-4929-bc05-85284fd4699c\" (UID: \"16de247b-ba5c-4929-bc05-85284fd4699c\") "
Sep 07 17:14:57.833347 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:57.833117    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff66e03c-e796-4252-9e4e-db107fac97bf-openshift-service-ca\") pod \"ff66e03c-e796-4252-9e4e-db107fac97bf\" (UID: \"ff66e03c-e796-4252-9e4e-db107fac97bf\") "
Sep 07 17:14:57.833347 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:57.833223    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16de247b-ba5c-4929-bc05-85284fd4699c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "16de247b-ba5c-4929-bc05-85284fd4699c" (UID: "16de247b-ba5c-4929-bc05-85284fd4699c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:14:57.833569 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:57.833544    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff66e03c-e796-4252-9e4e-db107fac97bf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ff66e03c-e796-4252-9e4e-db107fac97bf" (UID: "ff66e03c-e796-4252-9e4e-db107fac97bf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:14:57.833651 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:57.833594    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16de247b-ba5c-4929-bc05-85284fd4699c-plugins-config-volume\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:14:57.835292 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:57.835261    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff66e03c-e796-4252-9e4e-db107fac97bf-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ff66e03c-e796-4252-9e4e-db107fac97bf" (UID: "ff66e03c-e796-4252-9e4e-db107fac97bf"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:14:57.835292 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:57.835282    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff66e03c-e796-4252-9e4e-db107fac97bf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ff66e03c-e796-4252-9e4e-db107fac97bf" (UID: "ff66e03c-e796-4252-9e4e-db107fac97bf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:14:57.835292 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:57.835288    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff66e03c-e796-4252-9e4e-db107fac97bf-kube-api-access-cvxz8" (OuterVolumeSpecName: "kube-api-access-cvxz8") pod "ff66e03c-e796-4252-9e4e-db107fac97bf" (UID: "ff66e03c-e796-4252-9e4e-db107fac97bf"). InnerVolumeSpecName "kube-api-access-cvxz8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:14:57.835474 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:57.835337    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16de247b-ba5c-4929-bc05-85284fd4699c-kube-api-access-4g8bs" (OuterVolumeSpecName: "kube-api-access-4g8bs") pod "16de247b-ba5c-4929-bc05-85284fd4699c" (UID: "16de247b-ba5c-4929-bc05-85284fd4699c"). InnerVolumeSpecName "kube-api-access-4g8bs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:14:57.935012 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:57.934969    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4g8bs\" (UniqueName: \"kubernetes.io/projected/16de247b-ba5c-4929-bc05-85284fd4699c-kube-api-access-4g8bs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:14:57.935012 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:57.935007    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff66e03c-e796-4252-9e4e-db107fac97bf-openshift-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:14:57.935012 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:57.935020    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff66e03c-e796-4252-9e4e-db107fac97bf-maas-api-tls\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:14:57.935256 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:57.935032    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvxz8\" (UniqueName: \"kubernetes.io/projected/ff66e03c-e796-4252-9e4e-db107fac97bf-kube-api-access-cvxz8\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:14:57.935256 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:57.935044    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff66e03c-e796-4252-9e4e-db107fac97bf-metrics-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:14:58.081911 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:58.081863    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:14:58.513911 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:58.513858    2575 generic.go:356] "Generic (PLEG): container finished" podID="16de247b-ba5c-4929-bc05-85284fd4699c" containerID="a8a9665416df250588ba2c3b371591bf57031424bbc566f23437f7493762c079" exitCode=0
Sep 07 17:14:58.514282 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:58.513919    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f799c427-68d687f597-8swvr"
Sep 07 17:14:58.514282 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:58.513947    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f799c427-68d687f597-8swvr" event={"ID":"16de247b-ba5c-4929-bc05-85284fd4699c","Type":"ContainerDied","Data":"a8a9665416df250588ba2c3b371591bf57031424bbc566f23437f7493762c079"}
Sep 07 17:14:58.514282 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:58.513995    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f799c427-68d687f597-8swvr" event={"ID":"16de247b-ba5c-4929-bc05-85284fd4699c","Type":"ContainerDied","Data":"bd09a20dd83726b8ca5a9bab194377c486d56627e6715605130ab2def5faefc3"}
Sep 07 17:14:58.514282 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:58.514022    2575 scope.go:117] "RemoveContainer" containerID="a8a9665416df250588ba2c3b371591bf57031424bbc566f23437f7493762c079"
Sep 07 17:14:58.515400 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:58.515381    2575 generic.go:356] "Generic (PLEG): container finished" podID="ff66e03c-e796-4252-9e4e-db107fac97bf" containerID="942ad9d8fba319302963529061d4b3395ef7980474ecf289abc5fc36dd5d0bd6" exitCode=0
Sep 07 17:14:58.515469 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:58.515415    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw" event={"ID":"ff66e03c-e796-4252-9e4e-db107fac97bf","Type":"ContainerDied","Data":"942ad9d8fba319302963529061d4b3395ef7980474ecf289abc5fc36dd5d0bd6"}
Sep 07 17:14:58.515469 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:58.515448    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw" event={"ID":"ff66e03c-e796-4252-9e4e-db107fac97bf","Type":"ContainerDied","Data":"18507f393ed17299b472c7287259fc00a4eda37356b9c870aae2195b7fb2a0c3"}
Sep 07 17:14:58.515469 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:58.515458    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw"
Sep 07 17:14:58.523923 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:58.523886    2575 scope.go:117] "RemoveContainer" containerID="a8a9665416df250588ba2c3b371591bf57031424bbc566f23437f7493762c079"
Sep 07 17:14:58.524195 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:14:58.524174    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8a9665416df250588ba2c3b371591bf57031424bbc566f23437f7493762c079\": container with ID starting with a8a9665416df250588ba2c3b371591bf57031424bbc566f23437f7493762c079 not found: ID does not exist" containerID="a8a9665416df250588ba2c3b371591bf57031424bbc566f23437f7493762c079"
Sep 07 17:14:58.524239 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:58.524204    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8a9665416df250588ba2c3b371591bf57031424bbc566f23437f7493762c079"} err="failed to get container status \"a8a9665416df250588ba2c3b371591bf57031424bbc566f23437f7493762c079\": rpc error: code = NotFound desc = could not find container \"a8a9665416df250588ba2c3b371591bf57031424bbc566f23437f7493762c079\": container with ID starting with a8a9665416df250588ba2c3b371591bf57031424bbc566f23437f7493762c079 not found: ID does not exist"
Sep 07 17:14:58.524239 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:58.524220    2575 scope.go:117] "RemoveContainer" containerID="942ad9d8fba319302963529061d4b3395ef7980474ecf289abc5fc36dd5d0bd6"
Sep 07 17:14:58.532563 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:58.532547    2575 scope.go:117] "RemoveContainer" containerID="942ad9d8fba319302963529061d4b3395ef7980474ecf289abc5fc36dd5d0bd6"
Sep 07 17:14:58.532815 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:14:58.532798    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"942ad9d8fba319302963529061d4b3395ef7980474ecf289abc5fc36dd5d0bd6\": container with ID starting with 942ad9d8fba319302963529061d4b3395ef7980474ecf289abc5fc36dd5d0bd6 not found: ID does not exist" containerID="942ad9d8fba319302963529061d4b3395ef7980474ecf289abc5fc36dd5d0bd6"
Sep 07 17:14:58.532872 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:58.532822    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"942ad9d8fba319302963529061d4b3395ef7980474ecf289abc5fc36dd5d0bd6"} err="failed to get container status \"942ad9d8fba319302963529061d4b3395ef7980474ecf289abc5fc36dd5d0bd6\": rpc error: code = NotFound desc = could not find container \"942ad9d8fba319302963529061d4b3395ef7980474ecf289abc5fc36dd5d0bd6\": container with ID starting with 942ad9d8fba319302963529061d4b3395ef7980474ecf289abc5fc36dd5d0bd6 not found: ID does not exist"
Sep 07 17:14:58.538522 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:58.538494    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f799c427-68d687f597-8swvr"]
Sep 07 17:14:58.543189 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:58.543169    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f799c427-68d687f597-8swvr"]
Sep 07 17:14:58.555056 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:58.555033    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw"]
Sep 07 17:14:58.559248 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:58.559228    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f799c427-7c498d4b7b-m6tsw"]
Sep 07 17:14:58.722939 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:58.722840    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16de247b-ba5c-4929-bc05-85284fd4699c" path="/var/lib/kubelet/pods/16de247b-ba5c-4929-bc05-85284fd4699c/volumes"
Sep 07 17:14:58.723414 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:14:58.723396    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff66e03c-e796-4252-9e4e-db107fac97bf" path="/var/lib/kubelet/pods/ff66e03c-e796-4252-9e4e-db107fac97bf/volumes"
Sep 07 17:15:00.140288 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:00.140253    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3973bf-29813355-67hl4"]
Sep 07 17:15:00.140706 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:00.140692    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16de247b-ba5c-4929-bc05-85284fd4699c" containerName="payload-processing"
Sep 07 17:15:00.140751 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:00.140708    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="16de247b-ba5c-4929-bc05-85284fd4699c" containerName="payload-processing"
Sep 07 17:15:00.140751 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:00.140728    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff66e03c-e796-4252-9e4e-db107fac97bf" containerName="maas-api"
Sep 07 17:15:00.140751 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:00.140735    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff66e03c-e796-4252-9e4e-db107fac97bf" containerName="maas-api"
Sep 07 17:15:00.140841 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:00.140806    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff66e03c-e796-4252-9e4e-db107fac97bf" containerName="maas-api"
Sep 07 17:15:00.140841 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:00.140814    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="16de247b-ba5c-4929-bc05-85284fd4699c" containerName="payload-processing"
Sep 07 17:15:00.145445 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:00.145425    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3973bf-29813355-67hl4"
Sep 07 17:15:00.148447 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:00.148424    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qphph\""
Sep 07 17:15:00.151919 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:00.151881    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3973bf-29813355-67hl4"]
Sep 07 17:15:00.157739 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:00.157719    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3973bf-29813355-67hl4"
Sep 07 17:15:00.435198 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:15:00.435167    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc6fb977_a988_44bc_9aca_7a21cff348cf.slice/crio-5aee2cf8e9fd0eb52397facd0955e76635955fb7d0371a2217e2e359f81e010c WatchSource:0}: Error finding container 5aee2cf8e9fd0eb52397facd0955e76635955fb7d0371a2217e2e359f81e010c: Status 404 returned error can't find the container with id 5aee2cf8e9fd0eb52397facd0955e76635955fb7d0371a2217e2e359f81e010c
Sep 07 17:15:00.436301 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:00.436269    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3973bf-29813355-67hl4"]
Sep 07 17:15:00.534655 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:00.534623    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3973bf-29813355-67hl4" event={"ID":"fc6fb977-a988-44bc-9aca-7a21cff348cf","Type":"ContainerStarted","Data":"5aee2cf8e9fd0eb52397facd0955e76635955fb7d0371a2217e2e359f81e010c"}
Sep 07 17:15:01.541216 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:01.541126    2575 generic.go:356] "Generic (PLEG): container finished" podID="fc6fb977-a988-44bc-9aca-7a21cff348cf" containerID="01d2e466a715db4062eb2361ff0d68ed863430bda94b07102e7903a0f3110d1f" exitCode=0
Sep 07 17:15:01.541216 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:01.541184    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3973bf-29813355-67hl4" event={"ID":"fc6fb977-a988-44bc-9aca-7a21cff348cf","Type":"ContainerDied","Data":"01d2e466a715db4062eb2361ff0d68ed863430bda94b07102e7903a0f3110d1f"}
Sep 07 17:15:02.694561 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:02.694532    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3973bf-29813355-67hl4"
Sep 07 17:15:03.552653 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:03.552616    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3973bf-29813355-67hl4" event={"ID":"fc6fb977-a988-44bc-9aca-7a21cff348cf","Type":"ContainerDied","Data":"5aee2cf8e9fd0eb52397facd0955e76635955fb7d0371a2217e2e359f81e010c"}
Sep 07 17:15:03.552653 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:03.552634    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3973bf-29813355-67hl4"
Sep 07 17:15:03.552874 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:03.552666    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5aee2cf8e9fd0eb52397facd0955e76635955fb7d0371a2217e2e359f81e010c"
Sep 07 17:15:04.735796 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:04.735765    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:04.810329 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:04.810292    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:05.023415 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:05.023326    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:05.376073 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:05.376040    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:05.534413 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:05.534377    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:05.679068 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:05.678972    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:11.869957 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:11.869925    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:11.966404 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:11.966366    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:12.064886 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:12.064851    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:12.209333 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:12.209247    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:14.906875 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:14.906841    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"]
Sep 07 17:15:14.907492 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:14.907473    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc6fb977-a988-44bc-9aca-7a21cff348cf" containerName="cleanup"
Sep 07 17:15:14.907586 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:14.907494    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc6fb977-a988-44bc-9aca-7a21cff348cf" containerName="cleanup"
Sep 07 17:15:14.907631 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:14.907594    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc6fb977-a988-44bc-9aca-7a21cff348cf" containerName="cleanup"
Sep 07 17:15:14.916626 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:14.916600    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"
Sep 07 17:15:14.921398 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:14.920801    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-1795dd\"/\"openshift-service-ca.crt\""
Sep 07 17:15:14.921398 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:14.921215    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-1795dd\"/\"kube-root-ca.crt\""
Sep 07 17:15:14.923219 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:14.922541    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-1795dd\"/\"default-dockercfg-9jlnk\""
Sep 07 17:15:14.923219 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:14.922809    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-1795dd\"/\"auth-test-model-1795dd-kserve-self-signed-certs\""
Sep 07 17:15:14.925384 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:14.925358    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"]
Sep 07 17:15:14.937049 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:14.937021    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:15.002287 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:15.002250    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-home\") pod \"auth-test-model-1795dd-kserve-765559b547-4dqjr\" (UID: \"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"
Sep 07 17:15:15.002454 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:15.002324    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-model-cache\") pod \"auth-test-model-1795dd-kserve-765559b547-4dqjr\" (UID: \"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"
Sep 07 17:15:15.002454 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:15.002370    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msws7\" (UniqueName: \"kubernetes.io/projected/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-kube-api-access-msws7\") pod \"auth-test-model-1795dd-kserve-765559b547-4dqjr\" (UID: \"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"
Sep 07 17:15:15.002561 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:15.002456    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-dshm\") pod \"auth-test-model-1795dd-kserve-765559b547-4dqjr\" (UID: \"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"
Sep 07 17:15:15.002561 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:15.002502    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-tls-certs\") pod \"auth-test-model-1795dd-kserve-765559b547-4dqjr\" (UID: \"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"
Sep 07 17:15:15.002652 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:15.002559    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-tmp-dir\") pod \"auth-test-model-1795dd-kserve-765559b547-4dqjr\" (UID: \"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"
Sep 07 17:15:15.103902 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:15.103860    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-model-cache\") pod \"auth-test-model-1795dd-kserve-765559b547-4dqjr\" (UID: \"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"
Sep 07 17:15:15.104080 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:15.103937    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msws7\" (UniqueName: \"kubernetes.io/projected/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-kube-api-access-msws7\") pod \"auth-test-model-1795dd-kserve-765559b547-4dqjr\" (UID: \"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"
Sep 07 17:15:15.104080 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:15.103984    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-dshm\") pod \"auth-test-model-1795dd-kserve-765559b547-4dqjr\" (UID: \"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"
Sep 07 17:15:15.104080 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:15.104023    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-tls-certs\") pod \"auth-test-model-1795dd-kserve-765559b547-4dqjr\" (UID: \"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"
Sep 07 17:15:15.104080 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:15.104068    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-tmp-dir\") pod \"auth-test-model-1795dd-kserve-765559b547-4dqjr\" (UID: \"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"
Sep 07 17:15:15.104287 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:15.104181    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-home\") pod \"auth-test-model-1795dd-kserve-765559b547-4dqjr\" (UID: \"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"
Sep 07 17:15:15.104287 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:15.104253    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-model-cache\") pod \"auth-test-model-1795dd-kserve-765559b547-4dqjr\" (UID: \"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"
Sep 07 17:15:15.104403 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:15.104383    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-tmp-dir\") pod \"auth-test-model-1795dd-kserve-765559b547-4dqjr\" (UID: \"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"
Sep 07 17:15:15.104530 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:15.104505    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-home\") pod \"auth-test-model-1795dd-kserve-765559b547-4dqjr\" (UID: \"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"
Sep 07 17:15:15.106121 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:15.106102    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-dshm\") pod \"auth-test-model-1795dd-kserve-765559b547-4dqjr\" (UID: \"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"
Sep 07 17:15:15.106454 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:15.106433    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-tls-certs\") pod \"auth-test-model-1795dd-kserve-765559b547-4dqjr\" (UID: \"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"
Sep 07 17:15:15.112452 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:15.112426    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msws7\" (UniqueName: \"kubernetes.io/projected/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-kube-api-access-msws7\") pod \"auth-test-model-1795dd-kserve-765559b547-4dqjr\" (UID: \"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"
Sep 07 17:15:15.231446 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:15.231344    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"
Sep 07 17:15:15.507333 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:15.507299    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"]
Sep 07 17:15:15.508302 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:15:15.508276    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b9dca94_36a2_4c4c_a3a6_9cc87ad28316.slice/crio-1dd4fd7407f6b30aa857d9d9a7be392e0ea8d726bb428ca9a2ecb9c714e4956f WatchSource:0}: Error finding container 1dd4fd7407f6b30aa857d9d9a7be392e0ea8d726bb428ca9a2ecb9c714e4956f: Status 404 returned error can't find the container with id 1dd4fd7407f6b30aa857d9d9a7be392e0ea8d726bb428ca9a2ecb9c714e4956f
Sep 07 17:15:15.617863 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:15.617824    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr" event={"ID":"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316","Type":"ContainerStarted","Data":"42532b755829d51b34ecc856035bba184713d5e99202a31575a66f9da7a61402"}
Sep 07 17:15:15.618043 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:15.617874    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr" event={"ID":"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316","Type":"ContainerStarted","Data":"1dd4fd7407f6b30aa857d9d9a7be392e0ea8d726bb428ca9a2ecb9c714e4956f"}
Sep 07 17:15:15.636121 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:15.636068    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr" podStartSLOduration=1.636047795 podStartE2EDuration="1.636047795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:15:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:15:15.634682318 +0000 UTC m=+1109.531529634" watchObservedRunningTime="2026-09-07 17:15:15.636047795 +0000 UTC m=+1109.532895110"
Sep 07 17:15:18.612023 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:18.611988    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:18.716280 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:18.716241    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:19.589746 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:19.589710    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:19.861134 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:19.861033    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:20.468540 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:20.468499    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:22.498775 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:22.498739    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:22.598218 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:22.598186    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:23.659728 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:23.659698    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk"]
Sep 07 17:15:23.663547 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:23.663526    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk"
Sep 07 17:15:23.666159 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:23.666133    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-202015-serving-cert\""
Sep 07 17:15:23.675199 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:23.675175    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk"]
Sep 07 17:15:23.694039 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:23.694012    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:23.796567 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:23.796531    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8459\" (UniqueName: \"kubernetes.io/projected/f38d18c5-8a88-4820-b1e7-a2dd28e1e902-kube-api-access-v8459\") pod \"maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk\" (UID: \"f38d18c5-8a88-4820-b1e7-a2dd28e1e902\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk"
Sep 07 17:15:23.796757 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:23.796666    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f38d18c5-8a88-4820-b1e7-a2dd28e1e902-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk\" (UID: \"f38d18c5-8a88-4820-b1e7-a2dd28e1e902\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk"
Sep 07 17:15:23.796829 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:23.796757    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f38d18c5-8a88-4820-b1e7-a2dd28e1e902-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk\" (UID: \"f38d18c5-8a88-4820-b1e7-a2dd28e1e902\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk"
Sep 07 17:15:23.796888 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:23.796864    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f38d18c5-8a88-4820-b1e7-a2dd28e1e902-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk\" (UID: \"f38d18c5-8a88-4820-b1e7-a2dd28e1e902\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk"
Sep 07 17:15:23.797118 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:23.797092    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:23.897526 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:23.897485    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:23.897736 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:23.897494    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f38d18c5-8a88-4820-b1e7-a2dd28e1e902-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk\" (UID: \"f38d18c5-8a88-4820-b1e7-a2dd28e1e902\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk"
Sep 07 17:15:23.898503 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:23.898107    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f38d18c5-8a88-4820-b1e7-a2dd28e1e902-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk\" (UID: \"f38d18c5-8a88-4820-b1e7-a2dd28e1e902\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk"
Sep 07 17:15:23.898503 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:23.898232    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8459\" (UniqueName: \"kubernetes.io/projected/f38d18c5-8a88-4820-b1e7-a2dd28e1e902-kube-api-access-v8459\") pod \"maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk\" (UID: \"f38d18c5-8a88-4820-b1e7-a2dd28e1e902\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk"
Sep 07 17:15:23.898503 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:23.898423    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f38d18c5-8a88-4820-b1e7-a2dd28e1e902-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk\" (UID: \"f38d18c5-8a88-4820-b1e7-a2dd28e1e902\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk"
Sep 07 17:15:23.899254 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:23.899230    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f38d18c5-8a88-4820-b1e7-a2dd28e1e902-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk\" (UID: \"f38d18c5-8a88-4820-b1e7-a2dd28e1e902\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk"
Sep 07 17:15:23.900431 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:23.900406    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f38d18c5-8a88-4820-b1e7-a2dd28e1e902-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk\" (UID: \"f38d18c5-8a88-4820-b1e7-a2dd28e1e902\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk"
Sep 07 17:15:23.900530 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:23.900496    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f38d18c5-8a88-4820-b1e7-a2dd28e1e902-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk\" (UID: \"f38d18c5-8a88-4820-b1e7-a2dd28e1e902\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk"
Sep 07 17:15:23.907324 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:23.907304    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8459\" (UniqueName: \"kubernetes.io/projected/f38d18c5-8a88-4820-b1e7-a2dd28e1e902-kube-api-access-v8459\") pod \"maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk\" (UID: \"f38d18c5-8a88-4820-b1e7-a2dd28e1e902\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk"
Sep 07 17:15:23.976530 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:23.976444    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk"
Sep 07 17:15:24.243257 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:24.243175    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:24.260691 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:15:24.260659    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf38d18c5_8a88_4820_b1e7_a2dd28e1e902.slice/crio-6c7b4c78184e90d6ebf8db56057981359d2377ff734068870d975f728d21fd78 WatchSource:0}: Error finding container 6c7b4c78184e90d6ebf8db56057981359d2377ff734068870d975f728d21fd78: Status 404 returned error can't find the container with id 6c7b4c78184e90d6ebf8db56057981359d2377ff734068870d975f728d21fd78
Sep 07 17:15:24.261335 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:24.261311    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk"]
Sep 07 17:15:24.344045 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:24.344013    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:24.354352 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:24.354325    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5"]
Sep 07 17:15:24.359056 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:24.359036    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5"
Sep 07 17:15:24.362494 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:24.362468    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-202015\""
Sep 07 17:15:24.374665 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:24.374641    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5"]
Sep 07 17:15:24.504230 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:24.504149    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x52jc\" (UniqueName: \"kubernetes.io/projected/7277260b-4d5d-43c4-874d-fd93747a8e91-kube-api-access-x52jc\") pod \"payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5\" (UID: \"7277260b-4d5d-43c4-874d-fd93747a8e91\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5"
Sep 07 17:15:24.504370 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:24.504291    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7277260b-4d5d-43c4-874d-fd93747a8e91-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5\" (UID: \"7277260b-4d5d-43c4-874d-fd93747a8e91\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5"
Sep 07 17:15:24.605104 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:24.605068    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7277260b-4d5d-43c4-874d-fd93747a8e91-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5\" (UID: \"7277260b-4d5d-43c4-874d-fd93747a8e91\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5"
Sep 07 17:15:24.605284 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:24.605165    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x52jc\" (UniqueName: \"kubernetes.io/projected/7277260b-4d5d-43c4-874d-fd93747a8e91-kube-api-access-x52jc\") pod \"payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5\" (UID: \"7277260b-4d5d-43c4-874d-fd93747a8e91\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5"
Sep 07 17:15:24.605829 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:24.605803    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7277260b-4d5d-43c4-874d-fd93747a8e91-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5\" (UID: \"7277260b-4d5d-43c4-874d-fd93747a8e91\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5"
Sep 07 17:15:24.613684 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:24.613659    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x52jc\" (UniqueName: \"kubernetes.io/projected/7277260b-4d5d-43c4-874d-fd93747a8e91-kube-api-access-x52jc\") pod \"payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5\" (UID: \"7277260b-4d5d-43c4-874d-fd93747a8e91\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5"
Sep 07 17:15:24.667937 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:24.667877    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk" event={"ID":"f38d18c5-8a88-4820-b1e7-a2dd28e1e902","Type":"ContainerStarted","Data":"6c7b4c78184e90d6ebf8db56057981359d2377ff734068870d975f728d21fd78"}
Sep 07 17:15:24.670064 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:24.670046    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5"
Sep 07 17:15:24.944430 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:24.944400    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5"]
Sep 07 17:15:24.945228 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:15:24.945197    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7277260b_4d5d_43c4_874d_fd93747a8e91.slice/crio-dd573111c5cfc0db1abe1b3bb70a80de77f56e87ff9ad2201cb20ac1cbccaa38 WatchSource:0}: Error finding container dd573111c5cfc0db1abe1b3bb70a80de77f56e87ff9ad2201cb20ac1cbccaa38: Status 404 returned error can't find the container with id dd573111c5cfc0db1abe1b3bb70a80de77f56e87ff9ad2201cb20ac1cbccaa38
Sep 07 17:15:25.232084 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:25.232050    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"
Sep 07 17:15:25.232299 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:25.232101    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"
Sep 07 17:15:25.244828 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:25.244799    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"
Sep 07 17:15:25.676761 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:25.676727    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk" event={"ID":"f38d18c5-8a88-4820-b1e7-a2dd28e1e902","Type":"ContainerStarted","Data":"b07c2e6b2f011398c1d7dc87f900a15754a606b962ffd66394f8c16db16daaba"}
Sep 07 17:15:25.677309 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:25.676797    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk"
Sep 07 17:15:25.678866 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:25.678840    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5" event={"ID":"7277260b-4d5d-43c4-874d-fd93747a8e91","Type":"ContainerStarted","Data":"0956347a7ec385365804f9f5871e8d158b486ed5d33ff2809e176fe98b423d1a"}
Sep 07 17:15:25.679019 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:25.678913    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5" event={"ID":"7277260b-4d5d-43c4-874d-fd93747a8e91","Type":"ContainerStarted","Data":"dd573111c5cfc0db1abe1b3bb70a80de77f56e87ff9ad2201cb20ac1cbccaa38"}
Sep 07 17:15:25.679019 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:25.678946    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5"
Sep 07 17:15:25.691291 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:25.691269    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"
Sep 07 17:15:25.696305 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:25.696256    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk" podStartSLOduration=2.18705692 podStartE2EDuration="2.696241662s" totalImagesPullingTime="509.184742ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:15:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:15:25.695690576 +0000 UTC m=+1119.592537890" watchObservedRunningTime="2026-09-07 17:15:25.696241662 +0000 UTC m=+1119.593088976"
Sep 07 17:15:25.713364 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:25.713318    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5" podStartSLOduration=1.713303625 podStartE2EDuration="1.713303625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:15:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:15:25.711318942 +0000 UTC m=+1119.608166257" watchObservedRunningTime="2026-09-07 17:15:25.713303625 +0000 UTC m=+1119.610150943"
Sep 07 17:15:28.186851 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:28.186811    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:28.251570 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:28.251528    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:31.690439 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:31.690412    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk"
Sep 07 17:15:34.815821 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:34.815782    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:36.686598 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:36.686565    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5"
Sep 07 17:15:44.912735 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:44.912701    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"]
Sep 07 17:15:44.916730 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:44.916706    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"
Sep 07 17:15:44.920640 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:44.920617    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-3973bf\"/\"openshift-service-ca.crt\""
Sep 07 17:15:44.920875 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:44.920674    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-3973bf\"/\"auth-test-model-3973bf-kserve-self-signed-certs\""
Sep 07 17:15:44.921029 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:44.920729    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-3973bf\"/\"default-dockercfg-8k8vf\""
Sep 07 17:15:44.921029 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:44.920774    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-3973bf\"/\"kube-root-ca.crt\""
Sep 07 17:15:44.932364 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:44.932340    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"]
Sep 07 17:15:44.954469 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:44.954433    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:45.006207 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:45.006176    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f347c46-a786-4776-876a-d76c3087b850-home\") pod \"auth-test-model-3973bf-kserve-6988cf475f-b844r\" (UID: \"2f347c46-a786-4776-876a-d76c3087b850\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"
Sep 07 17:15:45.006385 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:45.006222    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f347c46-a786-4776-876a-d76c3087b850-model-cache\") pod \"auth-test-model-3973bf-kserve-6988cf475f-b844r\" (UID: \"2f347c46-a786-4776-876a-d76c3087b850\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"
Sep 07 17:15:45.006385 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:45.006265    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f347c46-a786-4776-876a-d76c3087b850-tmp-dir\") pod \"auth-test-model-3973bf-kserve-6988cf475f-b844r\" (UID: \"2f347c46-a786-4776-876a-d76c3087b850\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"
Sep 07 17:15:45.006385 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:45.006300    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f347c46-a786-4776-876a-d76c3087b850-dshm\") pod \"auth-test-model-3973bf-kserve-6988cf475f-b844r\" (UID: \"2f347c46-a786-4776-876a-d76c3087b850\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"
Sep 07 17:15:45.006385 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:45.006345    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz8l2\" (UniqueName: \"kubernetes.io/projected/2f347c46-a786-4776-876a-d76c3087b850-kube-api-access-xz8l2\") pod \"auth-test-model-3973bf-kserve-6988cf475f-b844r\" (UID: \"2f347c46-a786-4776-876a-d76c3087b850\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"
Sep 07 17:15:45.006385 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:45.006377    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f347c46-a786-4776-876a-d76c3087b850-tls-certs\") pod \"auth-test-model-3973bf-kserve-6988cf475f-b844r\" (UID: \"2f347c46-a786-4776-876a-d76c3087b850\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"
Sep 07 17:15:45.107123 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:45.107087    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f347c46-a786-4776-876a-d76c3087b850-home\") pod \"auth-test-model-3973bf-kserve-6988cf475f-b844r\" (UID: \"2f347c46-a786-4776-876a-d76c3087b850\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"
Sep 07 17:15:45.107287 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:45.107145    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f347c46-a786-4776-876a-d76c3087b850-model-cache\") pod \"auth-test-model-3973bf-kserve-6988cf475f-b844r\" (UID: \"2f347c46-a786-4776-876a-d76c3087b850\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"
Sep 07 17:15:45.107338 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:45.107309    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f347c46-a786-4776-876a-d76c3087b850-tmp-dir\") pod \"auth-test-model-3973bf-kserve-6988cf475f-b844r\" (UID: \"2f347c46-a786-4776-876a-d76c3087b850\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"
Sep 07 17:15:45.107393 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:45.107360    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f347c46-a786-4776-876a-d76c3087b850-dshm\") pod \"auth-test-model-3973bf-kserve-6988cf475f-b844r\" (UID: \"2f347c46-a786-4776-876a-d76c3087b850\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"
Sep 07 17:15:45.107448 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:45.107396    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz8l2\" (UniqueName: \"kubernetes.io/projected/2f347c46-a786-4776-876a-d76c3087b850-kube-api-access-xz8l2\") pod \"auth-test-model-3973bf-kserve-6988cf475f-b844r\" (UID: \"2f347c46-a786-4776-876a-d76c3087b850\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"
Sep 07 17:15:45.107448 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:45.107426    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f347c46-a786-4776-876a-d76c3087b850-tls-certs\") pod \"auth-test-model-3973bf-kserve-6988cf475f-b844r\" (UID: \"2f347c46-a786-4776-876a-d76c3087b850\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"
Sep 07 17:15:45.107562 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:45.107451    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f347c46-a786-4776-876a-d76c3087b850-model-cache\") pod \"auth-test-model-3973bf-kserve-6988cf475f-b844r\" (UID: \"2f347c46-a786-4776-876a-d76c3087b850\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"
Sep 07 17:15:45.107562 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:45.107493    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f347c46-a786-4776-876a-d76c3087b850-home\") pod \"auth-test-model-3973bf-kserve-6988cf475f-b844r\" (UID: \"2f347c46-a786-4776-876a-d76c3087b850\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"
Sep 07 17:15:45.107672 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:45.107632    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f347c46-a786-4776-876a-d76c3087b850-tmp-dir\") pod \"auth-test-model-3973bf-kserve-6988cf475f-b844r\" (UID: \"2f347c46-a786-4776-876a-d76c3087b850\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"
Sep 07 17:15:45.109468 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:45.109433    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f347c46-a786-4776-876a-d76c3087b850-dshm\") pod \"auth-test-model-3973bf-kserve-6988cf475f-b844r\" (UID: \"2f347c46-a786-4776-876a-d76c3087b850\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"
Sep 07 17:15:45.109751 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:45.109733    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f347c46-a786-4776-876a-d76c3087b850-tls-certs\") pod \"auth-test-model-3973bf-kserve-6988cf475f-b844r\" (UID: \"2f347c46-a786-4776-876a-d76c3087b850\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"
Sep 07 17:15:45.115990 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:45.115965    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz8l2\" (UniqueName: \"kubernetes.io/projected/2f347c46-a786-4776-876a-d76c3087b850-kube-api-access-xz8l2\") pod \"auth-test-model-3973bf-kserve-6988cf475f-b844r\" (UID: \"2f347c46-a786-4776-876a-d76c3087b850\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"
Sep 07 17:15:45.226630 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:45.226538    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"
Sep 07 17:15:45.505143 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:45.505115    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"]
Sep 07 17:15:45.505986 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:15:45.505963    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f347c46_a786_4776_876a_d76c3087b850.slice/crio-3a96e764124295c6bf0b9c12ead0e237b30e938f1f735a40fd2f678b593aedba WatchSource:0}: Error finding container 3a96e764124295c6bf0b9c12ead0e237b30e938f1f735a40fd2f678b593aedba: Status 404 returned error can't find the container with id 3a96e764124295c6bf0b9c12ead0e237b30e938f1f735a40fd2f678b593aedba
Sep 07 17:15:45.795773 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:45.795741    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r" event={"ID":"2f347c46-a786-4776-876a-d76c3087b850","Type":"ContainerStarted","Data":"8283ab170e56bdca81f311dcf6ffbab367fc77cbbc9b728dac5fd5c73b766312"}
Sep 07 17:15:45.795954 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:45.795786    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r" event={"ID":"2f347c46-a786-4776-876a-d76c3087b850","Type":"ContainerStarted","Data":"3a96e764124295c6bf0b9c12ead0e237b30e938f1f735a40fd2f678b593aedba"}
Sep 07 17:15:45.854142 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:45.854085    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r" podStartSLOduration=1.85406764 podStartE2EDuration="1.85406764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:15:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:15:45.854012438 +0000 UTC m=+1139.750859754" watchObservedRunningTime="2026-09-07 17:15:45.85406764 +0000 UTC m=+1139.750914967"
Sep 07 17:15:47.468644 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:47.468613    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:47.815683 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:47.815658    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:48.154998 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:48.154884    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:48.631365 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:48.631325    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:51.769755 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:51.769716    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:51.907687 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:51.907648    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:53.076639 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:53.076604    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:53.179910 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:53.179864    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:53.297234 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:53.297197    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:53.771646 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:53.771605    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:53.885250 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:53.885203    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:15:53.936890 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:53.936856    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv"]
Sep 07 17:15:53.941805 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:53.941785    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv"
Sep 07 17:15:53.944533 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:53.944507    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-43ab35\""
Sep 07 17:15:53.944661 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:53.944574    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-43ab35-dockercfg-79cxw\""
Sep 07 17:15:53.953433 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:53.953410    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv"]
Sep 07 17:15:54.055063 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:54.055033    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm"]
Sep 07 17:15:54.058696 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:54.058681    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm"
Sep 07 17:15:54.071495 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:54.071472    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm"]
Sep 07 17:15:54.102663 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:54.102628    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t7kk\" (UniqueName: \"kubernetes.io/projected/f0bedc9f-8728-495a-8ff2-0b7714fe21fe-kube-api-access-8t7kk\") pod \"payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv\" (UID: \"f0bedc9f-8728-495a-8ff2-0b7714fe21fe\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv"
Sep 07 17:15:54.103049 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:54.102699    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0bedc9f-8728-495a-8ff2-0b7714fe21fe-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv\" (UID: \"f0bedc9f-8728-495a-8ff2-0b7714fe21fe\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv"
Sep 07 17:15:54.204262 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:54.204206    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0bedc9f-8728-495a-8ff2-0b7714fe21fe-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv\" (UID: \"f0bedc9f-8728-495a-8ff2-0b7714fe21fe\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv"
Sep 07 17:15:54.204452 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:54.204292    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm\" (UID: \"a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm"
Sep 07 17:15:54.204452 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:54.204312    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmrzf\" (UniqueName: \"kubernetes.io/projected/a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e-kube-api-access-mmrzf\") pod \"payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm\" (UID: \"a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm"
Sep 07 17:15:54.204452 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:54.204371    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t7kk\" (UniqueName: \"kubernetes.io/projected/f0bedc9f-8728-495a-8ff2-0b7714fe21fe-kube-api-access-8t7kk\") pod \"payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv\" (UID: \"f0bedc9f-8728-495a-8ff2-0b7714fe21fe\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv"
Sep 07 17:15:54.204948 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:54.204928    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0bedc9f-8728-495a-8ff2-0b7714fe21fe-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv\" (UID: \"f0bedc9f-8728-495a-8ff2-0b7714fe21fe\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv"
Sep 07 17:15:54.213433 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:54.213410    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t7kk\" (UniqueName: \"kubernetes.io/projected/f0bedc9f-8728-495a-8ff2-0b7714fe21fe-kube-api-access-8t7kk\") pod \"payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv\" (UID: \"f0bedc9f-8728-495a-8ff2-0b7714fe21fe\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv"
Sep 07 17:15:54.252428 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:54.252391    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv"
Sep 07 17:15:54.307501 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:54.305850    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm\" (UID: \"a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm"
Sep 07 17:15:54.307734 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:54.307444    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm\" (UID: \"a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm"
Sep 07 17:15:54.308203 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:54.308173    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmrzf\" (UniqueName: \"kubernetes.io/projected/a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e-kube-api-access-mmrzf\") pod \"payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm\" (UID: \"a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm"
Sep 07 17:15:54.319095 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:54.319068    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmrzf\" (UniqueName: \"kubernetes.io/projected/a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e-kube-api-access-mmrzf\") pod \"payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm\" (UID: \"a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm"
Sep 07 17:15:54.369162 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:54.369120    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm"
Sep 07 17:15:54.529262 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:54.529227    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv"]
Sep 07 17:15:54.529748 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:15:54.529722    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0bedc9f_8728_495a_8ff2_0b7714fe21fe.slice/crio-97b45ddcb4fa73d0388616ac0c6527c563d44fa278d1745da8f4add6b664e1e5 WatchSource:0}: Error finding container 97b45ddcb4fa73d0388616ac0c6527c563d44fa278d1745da8f4add6b664e1e5: Status 404 returned error can't find the container with id 97b45ddcb4fa73d0388616ac0c6527c563d44fa278d1745da8f4add6b664e1e5
Sep 07 17:15:54.645542 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:54.645510    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm"]
Sep 07 17:15:54.646351 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:15:54.646329    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda82e72c6_a0a4_48c7_9e90_63b2dc9dd38e.slice/crio-58c7c4de9ae1d29b457e42cffecdca247d4b3c3fa528b936c001109b24403209 WatchSource:0}: Error finding container 58c7c4de9ae1d29b457e42cffecdca247d4b3c3fa528b936c001109b24403209: Status 404 returned error can't find the container with id 58c7c4de9ae1d29b457e42cffecdca247d4b3c3fa528b936c001109b24403209
Sep 07 17:15:54.846134 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:54.846036    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv" event={"ID":"f0bedc9f-8728-495a-8ff2-0b7714fe21fe","Type":"ContainerStarted","Data":"fdb3575e22d9c9ff37e8329386e0417f6871b937af6a00df2748b89496169317"}
Sep 07 17:15:54.846134 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:54.846094    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv" event={"ID":"f0bedc9f-8728-495a-8ff2-0b7714fe21fe","Type":"ContainerStarted","Data":"97b45ddcb4fa73d0388616ac0c6527c563d44fa278d1745da8f4add6b664e1e5"}
Sep 07 17:15:54.846134 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:54.846128    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv"
Sep 07 17:15:54.847918 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:54.847869    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm" event={"ID":"a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e","Type":"ContainerStarted","Data":"52d7588b81008fc75234cff09fc4f8f1f46c3046f5721e5783127e59c73a990b"}
Sep 07 17:15:54.848051 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:54.847942    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm" event={"ID":"a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e","Type":"ContainerStarted","Data":"58c7c4de9ae1d29b457e42cffecdca247d4b3c3fa528b936c001109b24403209"}
Sep 07 17:15:54.848051 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:54.847972    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm"
Sep 07 17:15:54.865508 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:54.865449    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv" podStartSLOduration=1.865432517 podStartE2EDuration="1.865432517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:15:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:15:54.864432785 +0000 UTC m=+1148.761280105" watchObservedRunningTime="2026-09-07 17:15:54.865432517 +0000 UTC m=+1148.762279835"
Sep 07 17:15:55.226844 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:55.226758    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"
Sep 07 17:15:55.227294 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:55.226837    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"
Sep 07 17:15:55.241359 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:55.241332    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"
Sep 07 17:15:55.261200 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:55.261151    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm" podStartSLOduration=1.261135932 podStartE2EDuration="1.261135932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:15:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:15:54.883734889 +0000 UTC m=+1148.780582206" watchObservedRunningTime="2026-09-07 17:15:55.261135932 +0000 UTC m=+1149.157983294"
Sep 07 17:15:55.865529 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:15:55.865493    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"
Sep 07 17:16:05.856013 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:05.855982    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv"
Sep 07 17:16:05.856494 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:05.856053    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm"
Sep 07 17:16:16.635580 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:16.635496    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:16:30.742983 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:30.742947    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:16:31.022057 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:31.021963    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:16:31.113696 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:31.113657    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:16:34.026087 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:34.026045    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:16:34.123014 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:34.122976    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:16:34.988594 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:34.988550    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:16:35.974698 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:35.974657    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:16:36.156394 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:36.156362    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:16:36.379790 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:36.379758    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:16:36.602478 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:36.602448    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:16:36.692301 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:36.692211    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:16:36.728633 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:36.728603    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq"]
Sep 07 17:16:36.733136 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:36.733114    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq"
Sep 07 17:16:36.735776 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:36.735754    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-4170e7d8\""
Sep 07 17:16:36.735776 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:36.735775    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-4170e7d8-dockercfg-wz7q2\""
Sep 07 17:16:36.743527 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:36.743504    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq"]
Sep 07 17:16:36.838653 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:36.838616    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ss9l\" (UniqueName: \"kubernetes.io/projected/3598a5bb-ca67-4f93-816d-c6ff0e06b13b-kube-api-access-6ss9l\") pod \"payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq\" (UID: \"3598a5bb-ca67-4f93-816d-c6ff0e06b13b\") " pod="openshift-ingress/payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq"
Sep 07 17:16:36.838870 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:36.838788    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3598a5bb-ca67-4f93-816d-c6ff0e06b13b-plugins-config-volume\") pod \"payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq\" (UID: \"3598a5bb-ca67-4f93-816d-c6ff0e06b13b\") " pod="openshift-ingress/payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq"
Sep 07 17:16:36.939592 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:36.939551    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3598a5bb-ca67-4f93-816d-c6ff0e06b13b-plugins-config-volume\") pod \"payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq\" (UID: \"3598a5bb-ca67-4f93-816d-c6ff0e06b13b\") " pod="openshift-ingress/payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq"
Sep 07 17:16:36.939879 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:36.939647    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ss9l\" (UniqueName: \"kubernetes.io/projected/3598a5bb-ca67-4f93-816d-c6ff0e06b13b-kube-api-access-6ss9l\") pod \"payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq\" (UID: \"3598a5bb-ca67-4f93-816d-c6ff0e06b13b\") " pod="openshift-ingress/payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq"
Sep 07 17:16:36.940329 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:36.940308    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3598a5bb-ca67-4f93-816d-c6ff0e06b13b-plugins-config-volume\") pod \"payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq\" (UID: \"3598a5bb-ca67-4f93-816d-c6ff0e06b13b\") " pod="openshift-ingress/payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq"
Sep 07 17:16:36.947601 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:36.947544    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ss9l\" (UniqueName: \"kubernetes.io/projected/3598a5bb-ca67-4f93-816d-c6ff0e06b13b-kube-api-access-6ss9l\") pod \"payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq\" (UID: \"3598a5bb-ca67-4f93-816d-c6ff0e06b13b\") " pod="openshift-ingress/payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq"
Sep 07 17:16:37.045880 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:37.045844    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq"
Sep 07 17:16:37.322046 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:37.321966    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq"]
Sep 07 17:16:37.324538 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:16:37.324512    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3598a5bb_ca67_4f93_816d_c6ff0e06b13b.slice/crio-dc231099466ab6f3ba32ecc19aef636671c6c7238e2d6555cc795d0653a81b5f WatchSource:0}: Error finding container dc231099466ab6f3ba32ecc19aef636671c6c7238e2d6555cc795d0653a81b5f: Status 404 returned error can't find the container with id dc231099466ab6f3ba32ecc19aef636671c6c7238e2d6555cc795d0653a81b5f
Sep 07 17:16:38.090252 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:38.090214    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq" event={"ID":"3598a5bb-ca67-4f93-816d-c6ff0e06b13b","Type":"ContainerStarted","Data":"7be581dcf466c6e1142c8ecb200205e707ffcb750f64d156a080e0f65d3204f9"}
Sep 07 17:16:38.090732 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:38.090262    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq" event={"ID":"3598a5bb-ca67-4f93-816d-c6ff0e06b13b","Type":"ContainerStarted","Data":"dc231099466ab6f3ba32ecc19aef636671c6c7238e2d6555cc795d0653a81b5f"}
Sep 07 17:16:38.090732 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:38.090293    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq"
Sep 07 17:16:38.113563 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:38.113510    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq" podStartSLOduration=2.113496401 podStartE2EDuration="2.113496401s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:16:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:16:38.109758332 +0000 UTC m=+1192.006605659" watchObservedRunningTime="2026-09-07 17:16:38.113496401 +0000 UTC m=+1192.010343715"
Sep 07 17:16:46.703757 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:46.703724    2575 scope.go:117] "RemoveContainer" containerID="a2579f144720668697c6b0691b60876cd8a4be2e031f06f49727b7bd8c8c0c0b"
Sep 07 17:16:49.098284 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:49.098257    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq"
Sep 07 17:16:58.901873 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:16:58.901836    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:17:05.644360 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:05.644320    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:17:47.076366 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:47.076327    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:17:53.884137 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:53.884087    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:17:53.922335 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:53.922300    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq"]
Sep 07 17:17:53.922663 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:53.922605    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq" podUID="3598a5bb-ca67-4f93-816d-c6ff0e06b13b" containerName="payload-processing" containerID="cri-o://7be581dcf466c6e1142c8ecb200205e707ffcb750f64d156a080e0f65d3204f9" gracePeriod=30
Sep 07 17:17:53.968373 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:53.968333    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:17:54.030259 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:54.030220    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:17:54.102047 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:54.101976    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:17:54.169587 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:54.169554    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:17:54.195497 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:54.195467    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq"
Sep 07 17:17:54.227487 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:54.227459    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3598a5bb-ca67-4f93-816d-c6ff0e06b13b-plugins-config-volume\") pod \"3598a5bb-ca67-4f93-816d-c6ff0e06b13b\" (UID: \"3598a5bb-ca67-4f93-816d-c6ff0e06b13b\") "
Sep 07 17:17:54.227668 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:54.227501    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ss9l\" (UniqueName: \"kubernetes.io/projected/3598a5bb-ca67-4f93-816d-c6ff0e06b13b-kube-api-access-6ss9l\") pod \"3598a5bb-ca67-4f93-816d-c6ff0e06b13b\" (UID: \"3598a5bb-ca67-4f93-816d-c6ff0e06b13b\") "
Sep 07 17:17:54.228015 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:54.227968    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3598a5bb-ca67-4f93-816d-c6ff0e06b13b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3598a5bb-ca67-4f93-816d-c6ff0e06b13b" (UID: "3598a5bb-ca67-4f93-816d-c6ff0e06b13b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:17:54.230263 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:54.230237    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3598a5bb-ca67-4f93-816d-c6ff0e06b13b-kube-api-access-6ss9l" (OuterVolumeSpecName: "kube-api-access-6ss9l") pod "3598a5bb-ca67-4f93-816d-c6ff0e06b13b" (UID: "3598a5bb-ca67-4f93-816d-c6ff0e06b13b"). InnerVolumeSpecName "kube-api-access-6ss9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:17:54.329277 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:54.329238    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3598a5bb-ca67-4f93-816d-c6ff0e06b13b-plugins-config-volume\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:17:54.329277 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:54.329272    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ss9l\" (UniqueName: \"kubernetes.io/projected/3598a5bb-ca67-4f93-816d-c6ff0e06b13b-kube-api-access-6ss9l\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:17:54.526087 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:54.525997    2575 generic.go:356] "Generic (PLEG): container finished" podID="3598a5bb-ca67-4f93-816d-c6ff0e06b13b" containerID="7be581dcf466c6e1142c8ecb200205e707ffcb750f64d156a080e0f65d3204f9" exitCode=0
Sep 07 17:17:54.526087 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:54.526038    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq" event={"ID":"3598a5bb-ca67-4f93-816d-c6ff0e06b13b","Type":"ContainerDied","Data":"7be581dcf466c6e1142c8ecb200205e707ffcb750f64d156a080e0f65d3204f9"}
Sep 07 17:17:54.526087 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:54.526046    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq"
Sep 07 17:17:54.526351 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:54.526089    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq" event={"ID":"3598a5bb-ca67-4f93-816d-c6ff0e06b13b","Type":"ContainerDied","Data":"dc231099466ab6f3ba32ecc19aef636671c6c7238e2d6555cc795d0653a81b5f"}
Sep 07 17:17:54.526351 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:54.526119    2575 scope.go:117] "RemoveContainer" containerID="7be581dcf466c6e1142c8ecb200205e707ffcb750f64d156a080e0f65d3204f9"
Sep 07 17:17:54.535685 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:54.535663    2575 scope.go:117] "RemoveContainer" containerID="7be581dcf466c6e1142c8ecb200205e707ffcb750f64d156a080e0f65d3204f9"
Sep 07 17:17:54.536013 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:17:54.535993    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7be581dcf466c6e1142c8ecb200205e707ffcb750f64d156a080e0f65d3204f9\": container with ID starting with 7be581dcf466c6e1142c8ecb200205e707ffcb750f64d156a080e0f65d3204f9 not found: ID does not exist" containerID="7be581dcf466c6e1142c8ecb200205e707ffcb750f64d156a080e0f65d3204f9"
Sep 07 17:17:54.536099 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:54.536023    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7be581dcf466c6e1142c8ecb200205e707ffcb750f64d156a080e0f65d3204f9"} err="failed to get container status \"7be581dcf466c6e1142c8ecb200205e707ffcb750f64d156a080e0f65d3204f9\": rpc error: code = NotFound desc = could not find container \"7be581dcf466c6e1142c8ecb200205e707ffcb750f64d156a080e0f65d3204f9\": container with ID starting with 7be581dcf466c6e1142c8ecb200205e707ffcb750f64d156a080e0f65d3204f9 not found: ID does not exist"
Sep 07 17:17:54.556020 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:54.555983    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq"]
Sep 07 17:17:54.567490 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:54.567460    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq"]
Sep 07 17:17:54.722881 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:54.722841    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3598a5bb-ca67-4f93-816d-c6ff0e06b13b" path="/var/lib/kubelet/pods/3598a5bb-ca67-4f93-816d-c6ff0e06b13b/volumes"
Sep 07 17:17:57.146713 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:57.146675    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:17:58.002910 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:58.002868    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"]
Sep 07 17:17:58.025023 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:58.024990    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:17:58.998514 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:58.998477    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"]
Sep 07 17:17:59.014116 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:17:59.014083    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:18:02.202306 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:02.202272    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:18:05.722738 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:05.722702    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"]
Sep 07 17:18:05.723169 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:05.723156    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3598a5bb-ca67-4f93-816d-c6ff0e06b13b" containerName="payload-processing"
Sep 07 17:18:05.723214 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:05.723170    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3598a5bb-ca67-4f93-816d-c6ff0e06b13b" containerName="payload-processing"
Sep 07 17:18:05.723268 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:05.723259    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3598a5bb-ca67-4f93-816d-c6ff0e06b13b" containerName="payload-processing"
Sep 07 17:18:05.727941 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:05.727922    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"
Sep 07 17:18:05.730543 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:05.730521    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-1795dd\"/\"sub-test-model-1795dd-kserve-self-signed-certs\""
Sep 07 17:18:05.735340 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:05.735314    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"]
Sep 07 17:18:05.846771 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:05.846734    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1d77341-772f-409b-be48-b0b01a54ed8a-model-cache\") pod \"sub-test-model-1795dd-kserve-685984f87-bvcv8\" (UID: \"f1d77341-772f-409b-be48-b0b01a54ed8a\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"
Sep 07 17:18:05.846972 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:05.846776    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lrtv\" (UniqueName: \"kubernetes.io/projected/f1d77341-772f-409b-be48-b0b01a54ed8a-kube-api-access-2lrtv\") pod \"sub-test-model-1795dd-kserve-685984f87-bvcv8\" (UID: \"f1d77341-772f-409b-be48-b0b01a54ed8a\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"
Sep 07 17:18:05.846972 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:05.846805    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1d77341-772f-409b-be48-b0b01a54ed8a-tls-certs\") pod \"sub-test-model-1795dd-kserve-685984f87-bvcv8\" (UID: \"f1d77341-772f-409b-be48-b0b01a54ed8a\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"
Sep 07 17:18:05.846972 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:05.846878    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1d77341-772f-409b-be48-b0b01a54ed8a-dshm\") pod \"sub-test-model-1795dd-kserve-685984f87-bvcv8\" (UID: \"f1d77341-772f-409b-be48-b0b01a54ed8a\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"
Sep 07 17:18:05.846972 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:05.846935    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1d77341-772f-409b-be48-b0b01a54ed8a-home\") pod \"sub-test-model-1795dd-kserve-685984f87-bvcv8\" (UID: \"f1d77341-772f-409b-be48-b0b01a54ed8a\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"
Sep 07 17:18:05.847147 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:05.847029    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1d77341-772f-409b-be48-b0b01a54ed8a-tmp-dir\") pod \"sub-test-model-1795dd-kserve-685984f87-bvcv8\" (UID: \"f1d77341-772f-409b-be48-b0b01a54ed8a\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"
Sep 07 17:18:05.856845 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:05.856817    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:18:05.948158 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:05.948115    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1d77341-772f-409b-be48-b0b01a54ed8a-tls-certs\") pod \"sub-test-model-1795dd-kserve-685984f87-bvcv8\" (UID: \"f1d77341-772f-409b-be48-b0b01a54ed8a\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"
Sep 07 17:18:05.948354 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:05.948182    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1d77341-772f-409b-be48-b0b01a54ed8a-dshm\") pod \"sub-test-model-1795dd-kserve-685984f87-bvcv8\" (UID: \"f1d77341-772f-409b-be48-b0b01a54ed8a\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"
Sep 07 17:18:05.948354 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:05.948210    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1d77341-772f-409b-be48-b0b01a54ed8a-home\") pod \"sub-test-model-1795dd-kserve-685984f87-bvcv8\" (UID: \"f1d77341-772f-409b-be48-b0b01a54ed8a\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"
Sep 07 17:18:05.948354 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:05.948269    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1d77341-772f-409b-be48-b0b01a54ed8a-tmp-dir\") pod \"sub-test-model-1795dd-kserve-685984f87-bvcv8\" (UID: \"f1d77341-772f-409b-be48-b0b01a54ed8a\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"
Sep 07 17:18:05.948354 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:05.948352    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1d77341-772f-409b-be48-b0b01a54ed8a-model-cache\") pod \"sub-test-model-1795dd-kserve-685984f87-bvcv8\" (UID: \"f1d77341-772f-409b-be48-b0b01a54ed8a\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"
Sep 07 17:18:05.948567 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:05.948386    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lrtv\" (UniqueName: \"kubernetes.io/projected/f1d77341-772f-409b-be48-b0b01a54ed8a-kube-api-access-2lrtv\") pod \"sub-test-model-1795dd-kserve-685984f87-bvcv8\" (UID: \"f1d77341-772f-409b-be48-b0b01a54ed8a\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"
Sep 07 17:18:05.948673 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:05.948651    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1d77341-772f-409b-be48-b0b01a54ed8a-tmp-dir\") pod \"sub-test-model-1795dd-kserve-685984f87-bvcv8\" (UID: \"f1d77341-772f-409b-be48-b0b01a54ed8a\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"
Sep 07 17:18:05.948734 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:05.948651    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1d77341-772f-409b-be48-b0b01a54ed8a-home\") pod \"sub-test-model-1795dd-kserve-685984f87-bvcv8\" (UID: \"f1d77341-772f-409b-be48-b0b01a54ed8a\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"
Sep 07 17:18:05.948734 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:05.948709    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1d77341-772f-409b-be48-b0b01a54ed8a-model-cache\") pod \"sub-test-model-1795dd-kserve-685984f87-bvcv8\" (UID: \"f1d77341-772f-409b-be48-b0b01a54ed8a\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"
Sep 07 17:18:05.950542 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:05.950508    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1d77341-772f-409b-be48-b0b01a54ed8a-dshm\") pod \"sub-test-model-1795dd-kserve-685984f87-bvcv8\" (UID: \"f1d77341-772f-409b-be48-b0b01a54ed8a\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"
Sep 07 17:18:05.950749 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:05.950733    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1d77341-772f-409b-be48-b0b01a54ed8a-tls-certs\") pod \"sub-test-model-1795dd-kserve-685984f87-bvcv8\" (UID: \"f1d77341-772f-409b-be48-b0b01a54ed8a\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"
Sep 07 17:18:05.957734 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:05.957710    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lrtv\" (UniqueName: \"kubernetes.io/projected/f1d77341-772f-409b-be48-b0b01a54ed8a-kube-api-access-2lrtv\") pod \"sub-test-model-1795dd-kserve-685984f87-bvcv8\" (UID: \"f1d77341-772f-409b-be48-b0b01a54ed8a\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"
Sep 07 17:18:06.038467 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:06.038377    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"
Sep 07 17:18:06.319190 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:06.319163    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"]
Sep 07 17:18:06.320061 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:18:06.320036    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1d77341_772f_409b_be48_b0b01a54ed8a.slice/crio-67f005f3a735f76f0e3e28047a12cf2ea02e748c999ec521860b97872c70ec23 WatchSource:0}: Error finding container 67f005f3a735f76f0e3e28047a12cf2ea02e748c999ec521860b97872c70ec23: Status 404 returned error can't find the container with id 67f005f3a735f76f0e3e28047a12cf2ea02e748c999ec521860b97872c70ec23
Sep 07 17:18:06.594433 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:06.594349    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8" event={"ID":"f1d77341-772f-409b-be48-b0b01a54ed8a","Type":"ContainerStarted","Data":"ff328edaddc29dad6183d4b6392d91a3061b0221e0c73cb642ec189fd39cff80"}
Sep 07 17:18:06.594433 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:06.594401    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8" event={"ID":"f1d77341-772f-409b-be48-b0b01a54ed8a","Type":"ContainerStarted","Data":"67f005f3a735f76f0e3e28047a12cf2ea02e748c999ec521860b97872c70ec23"}
Sep 07 17:18:06.621737 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:06.621678    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8" podStartSLOduration=1.6216648679999999 podStartE2EDuration="1.621664868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:18:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:18:06.619198099 +0000 UTC m=+1280.516045415" watchObservedRunningTime="2026-09-07 17:18:06.621664868 +0000 UTC m=+1280.518512255"
Sep 07 17:18:10.913000 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:10.912959    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:18:13.022519 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:13.022458    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr" podUID="6b9dca94-36a2-4c4c-a3a6-9cc87ad28316" containerName="main" containerID="cri-o://42532b755829d51b34ecc856035bba184713d5e99202a31575a66f9da7a61402" gracePeriod=45
Sep 07 17:18:13.285809 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:13.285748    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"
Sep 07 17:18:13.423110 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:13.423074    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-tls-certs\") pod \"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316\" (UID: \"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316\") "
Sep 07 17:18:13.423304 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:13.423139    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-tmp-dir\") pod \"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316\" (UID: \"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316\") "
Sep 07 17:18:13.423304 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:13.423165    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msws7\" (UniqueName: \"kubernetes.io/projected/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-kube-api-access-msws7\") pod \"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316\" (UID: \"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316\") "
Sep 07 17:18:13.423304 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:13.423231    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-model-cache\") pod \"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316\" (UID: \"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316\") "
Sep 07 17:18:13.423304 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:13.423264    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-home\") pod \"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316\" (UID: \"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316\") "
Sep 07 17:18:13.423524 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:13.423339    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-dshm\") pod \"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316\" (UID: \"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316\") "
Sep 07 17:18:13.423524 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:13.423395    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6b9dca94-36a2-4c4c-a3a6-9cc87ad28316" (UID: "6b9dca94-36a2-4c4c-a3a6-9cc87ad28316"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:18:13.423612 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:13.423524    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-model-cache" (OuterVolumeSpecName: "model-cache") pod "6b9dca94-36a2-4c4c-a3a6-9cc87ad28316" (UID: "6b9dca94-36a2-4c4c-a3a6-9cc87ad28316"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:18:13.423612 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:13.423575    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-home" (OuterVolumeSpecName: "home") pod "6b9dca94-36a2-4c4c-a3a6-9cc87ad28316" (UID: "6b9dca94-36a2-4c4c-a3a6-9cc87ad28316"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:18:13.423731 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:13.423715    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-tmp-dir\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:18:13.423768 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:13.423733    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-model-cache\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:18:13.423768 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:13.423742    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-home\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:18:13.425464 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:13.425432    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-kube-api-access-msws7" (OuterVolumeSpecName: "kube-api-access-msws7") pod "6b9dca94-36a2-4c4c-a3a6-9cc87ad28316" (UID: "6b9dca94-36a2-4c4c-a3a6-9cc87ad28316"). InnerVolumeSpecName "kube-api-access-msws7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:18:13.425575 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:13.425465    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-dshm" (OuterVolumeSpecName: "dshm") pod "6b9dca94-36a2-4c4c-a3a6-9cc87ad28316" (UID: "6b9dca94-36a2-4c4c-a3a6-9cc87ad28316"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:18:13.425575 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:13.425471    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6b9dca94-36a2-4c4c-a3a6-9cc87ad28316" (UID: "6b9dca94-36a2-4c4c-a3a6-9cc87ad28316"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:18:13.524792 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:13.524751    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-dshm\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:18:13.524792 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:13.524785    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-tls-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:18:13.524792 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:13.524796    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msws7\" (UniqueName: \"kubernetes.io/projected/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316-kube-api-access-msws7\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:18:13.633379 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:13.633341    2575 generic.go:356] "Generic (PLEG): container finished" podID="6b9dca94-36a2-4c4c-a3a6-9cc87ad28316" containerID="42532b755829d51b34ecc856035bba184713d5e99202a31575a66f9da7a61402" exitCode=0
Sep 07 17:18:13.633379 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:13.633385    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr" event={"ID":"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316","Type":"ContainerDied","Data":"42532b755829d51b34ecc856035bba184713d5e99202a31575a66f9da7a61402"}
Sep 07 17:18:13.633637 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:13.633412    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr" event={"ID":"6b9dca94-36a2-4c4c-a3a6-9cc87ad28316","Type":"ContainerDied","Data":"1dd4fd7407f6b30aa857d9d9a7be392e0ea8d726bb428ca9a2ecb9c714e4956f"}
Sep 07 17:18:13.633637 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:13.633428    2575 scope.go:117] "RemoveContainer" containerID="42532b755829d51b34ecc856035bba184713d5e99202a31575a66f9da7a61402"
Sep 07 17:18:13.633637 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:13.633386    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"
Sep 07 17:18:13.643382 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:13.643356    2575 scope.go:117] "RemoveContainer" containerID="42532b755829d51b34ecc856035bba184713d5e99202a31575a66f9da7a61402"
Sep 07 17:18:13.643686 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:18:13.643666    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42532b755829d51b34ecc856035bba184713d5e99202a31575a66f9da7a61402\": container with ID starting with 42532b755829d51b34ecc856035bba184713d5e99202a31575a66f9da7a61402 not found: ID does not exist" containerID="42532b755829d51b34ecc856035bba184713d5e99202a31575a66f9da7a61402"
Sep 07 17:18:13.643753 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:13.643695    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42532b755829d51b34ecc856035bba184713d5e99202a31575a66f9da7a61402"} err="failed to get container status \"42532b755829d51b34ecc856035bba184713d5e99202a31575a66f9da7a61402\": rpc error: code = NotFound desc = could not find container \"42532b755829d51b34ecc856035bba184713d5e99202a31575a66f9da7a61402\": container with ID starting with 42532b755829d51b34ecc856035bba184713d5e99202a31575a66f9da7a61402 not found: ID does not exist"
Sep 07 17:18:13.663543 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:13.663515    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"]
Sep 07 17:18:13.670471 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:13.670441    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1795dd/auth-test-model-1795dd-kserve-765559b547-4dqjr"]
Sep 07 17:18:14.019204 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.019102    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r" podUID="2f347c46-a786-4776-876a-d76c3087b850" containerName="main" containerID="cri-o://8283ab170e56bdca81f311dcf6ffbab367fc77cbbc9b728dac5fd5c73b766312" gracePeriod=45
Sep 07 17:18:14.268856 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.268826    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"
Sep 07 17:18:14.433575 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.433544    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f347c46-a786-4776-876a-d76c3087b850-dshm\") pod \"2f347c46-a786-4776-876a-d76c3087b850\" (UID: \"2f347c46-a786-4776-876a-d76c3087b850\") "
Sep 07 17:18:14.433786 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.433587    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f347c46-a786-4776-876a-d76c3087b850-home\") pod \"2f347c46-a786-4776-876a-d76c3087b850\" (UID: \"2f347c46-a786-4776-876a-d76c3087b850\") "
Sep 07 17:18:14.433786 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.433607    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f347c46-a786-4776-876a-d76c3087b850-tmp-dir\") pod \"2f347c46-a786-4776-876a-d76c3087b850\" (UID: \"2f347c46-a786-4776-876a-d76c3087b850\") "
Sep 07 17:18:14.433786 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.433647    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f347c46-a786-4776-876a-d76c3087b850-model-cache\") pod \"2f347c46-a786-4776-876a-d76c3087b850\" (UID: \"2f347c46-a786-4776-876a-d76c3087b850\") "
Sep 07 17:18:14.433786 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.433778    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz8l2\" (UniqueName: \"kubernetes.io/projected/2f347c46-a786-4776-876a-d76c3087b850-kube-api-access-xz8l2\") pod \"2f347c46-a786-4776-876a-d76c3087b850\" (UID: \"2f347c46-a786-4776-876a-d76c3087b850\") "
Sep 07 17:18:14.434030 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.433829    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f347c46-a786-4776-876a-d76c3087b850-home" (OuterVolumeSpecName: "home") pod "2f347c46-a786-4776-876a-d76c3087b850" (UID: "2f347c46-a786-4776-876a-d76c3087b850"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:18:14.434030 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.433865    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f347c46-a786-4776-876a-d76c3087b850-model-cache" (OuterVolumeSpecName: "model-cache") pod "2f347c46-a786-4776-876a-d76c3087b850" (UID: "2f347c46-a786-4776-876a-d76c3087b850"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:18:14.434030 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.433877    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f347c46-a786-4776-876a-d76c3087b850-tls-certs\") pod \"2f347c46-a786-4776-876a-d76c3087b850\" (UID: \"2f347c46-a786-4776-876a-d76c3087b850\") "
Sep 07 17:18:14.434030 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.433945    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f347c46-a786-4776-876a-d76c3087b850-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2f347c46-a786-4776-876a-d76c3087b850" (UID: "2f347c46-a786-4776-876a-d76c3087b850"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:18:14.434306 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.434288    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f347c46-a786-4776-876a-d76c3087b850-home\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:18:14.434383 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.434306    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f347c46-a786-4776-876a-d76c3087b850-tmp-dir\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:18:14.434383 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.434321    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f347c46-a786-4776-876a-d76c3087b850-model-cache\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:18:14.436014 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.435989    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f347c46-a786-4776-876a-d76c3087b850-dshm" (OuterVolumeSpecName: "dshm") pod "2f347c46-a786-4776-876a-d76c3087b850" (UID: "2f347c46-a786-4776-876a-d76c3087b850"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:18:14.436130 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.436018    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f347c46-a786-4776-876a-d76c3087b850-kube-api-access-xz8l2" (OuterVolumeSpecName: "kube-api-access-xz8l2") pod "2f347c46-a786-4776-876a-d76c3087b850" (UID: "2f347c46-a786-4776-876a-d76c3087b850"). InnerVolumeSpecName "kube-api-access-xz8l2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:18:14.436130 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.436026    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f347c46-a786-4776-876a-d76c3087b850-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2f347c46-a786-4776-876a-d76c3087b850" (UID: "2f347c46-a786-4776-876a-d76c3087b850"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:18:14.534914 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.534870    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz8l2\" (UniqueName: \"kubernetes.io/projected/2f347c46-a786-4776-876a-d76c3087b850-kube-api-access-xz8l2\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:18:14.535090 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.534927    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f347c46-a786-4776-876a-d76c3087b850-tls-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:18:14.535090 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.534941    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f347c46-a786-4776-876a-d76c3087b850-dshm\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:18:14.639998 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.639966    2575 generic.go:356] "Generic (PLEG): container finished" podID="2f347c46-a786-4776-876a-d76c3087b850" containerID="8283ab170e56bdca81f311dcf6ffbab367fc77cbbc9b728dac5fd5c73b766312" exitCode=0
Sep 07 17:18:14.640176 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.640016    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"
Sep 07 17:18:14.640176 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.640052    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r" event={"ID":"2f347c46-a786-4776-876a-d76c3087b850","Type":"ContainerDied","Data":"8283ab170e56bdca81f311dcf6ffbab367fc77cbbc9b728dac5fd5c73b766312"}
Sep 07 17:18:14.640176 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.640089    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r" event={"ID":"2f347c46-a786-4776-876a-d76c3087b850","Type":"ContainerDied","Data":"3a96e764124295c6bf0b9c12ead0e237b30e938f1f735a40fd2f678b593aedba"}
Sep 07 17:18:14.640176 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.640111    2575 scope.go:117] "RemoveContainer" containerID="8283ab170e56bdca81f311dcf6ffbab367fc77cbbc9b728dac5fd5c73b766312"
Sep 07 17:18:14.649341 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.649323    2575 scope.go:117] "RemoveContainer" containerID="8283ab170e56bdca81f311dcf6ffbab367fc77cbbc9b728dac5fd5c73b766312"
Sep 07 17:18:14.649602 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:18:14.649584    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8283ab170e56bdca81f311dcf6ffbab367fc77cbbc9b728dac5fd5c73b766312\": container with ID starting with 8283ab170e56bdca81f311dcf6ffbab367fc77cbbc9b728dac5fd5c73b766312 not found: ID does not exist" containerID="8283ab170e56bdca81f311dcf6ffbab367fc77cbbc9b728dac5fd5c73b766312"
Sep 07 17:18:14.649664 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.649614    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8283ab170e56bdca81f311dcf6ffbab367fc77cbbc9b728dac5fd5c73b766312"} err="failed to get container status \"8283ab170e56bdca81f311dcf6ffbab367fc77cbbc9b728dac5fd5c73b766312\": rpc error: code = NotFound desc = could not find container \"8283ab170e56bdca81f311dcf6ffbab367fc77cbbc9b728dac5fd5c73b766312\": container with ID starting with 8283ab170e56bdca81f311dcf6ffbab367fc77cbbc9b728dac5fd5c73b766312 not found: ID does not exist"
Sep 07 17:18:14.663130 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.663096    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"]
Sep 07 17:18:14.671999 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.671975    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-3973bf/auth-test-model-3973bf-kserve-6988cf475f-b844r"]
Sep 07 17:18:14.722298 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.722225    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f347c46-a786-4776-876a-d76c3087b850" path="/var/lib/kubelet/pods/2f347c46-a786-4776-876a-d76c3087b850/volumes"
Sep 07 17:18:14.722647 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:14.722634    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b9dca94-36a2-4c4c-a3a6-9cc87ad28316" path="/var/lib/kubelet/pods/6b9dca94-36a2-4c4c-a3a6-9cc87ad28316/volumes"
Sep 07 17:18:16.039226 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:16.039186    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"
Sep 07 17:18:16.039623 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:16.039238    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"
Sep 07 17:18:16.051909 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:16.051867    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"
Sep 07 17:18:16.664573 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:16.664545    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"
Sep 07 17:18:39.694478 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:39.694434    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:18:40.066255 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:40.066218    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:18:45.949325 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:45.949279    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:18:56.818289 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:56.818255    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"]
Sep 07 17:18:56.818746 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:56.818694    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b9dca94-36a2-4c4c-a3a6-9cc87ad28316" containerName="main"
Sep 07 17:18:56.818746 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:56.818705    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b9dca94-36a2-4c4c-a3a6-9cc87ad28316" containerName="main"
Sep 07 17:18:56.818746 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:56.818725    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f347c46-a786-4776-876a-d76c3087b850" containerName="main"
Sep 07 17:18:56.818746 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:56.818730    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f347c46-a786-4776-876a-d76c3087b850" containerName="main"
Sep 07 17:18:56.819060 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:56.818802    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f347c46-a786-4776-876a-d76c3087b850" containerName="main"
Sep 07 17:18:56.819060 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:56.818811    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b9dca94-36a2-4c4c-a3a6-9cc87ad28316" containerName="main"
Sep 07 17:18:56.823783 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:56.823761    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"
Sep 07 17:18:56.827986 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:56.827954    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-3973bf\"/\"sub-test-model-3973bf-kserve-self-signed-certs\""
Sep 07 17:18:56.829384 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:56.829360    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-3973bf\"/\"kube-root-ca.crt\""
Sep 07 17:18:56.829503 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:56.829373    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-3973bf\"/\"openshift-service-ca.crt\""
Sep 07 17:18:56.831886 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:56.831858    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-3973bf\"/\"default-dockercfg-8k8vf\""
Sep 07 17:18:56.835740 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:56.835718    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"]
Sep 07 17:18:56.879944 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:56.879883    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:18:56.954917 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:56.954860    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09198f91-75ca-4aac-8b5a-aab7a6b3c665-tmp-dir\") pod \"sub-test-model-3973bf-kserve-78b64c76dc-sqprf\" (UID: \"09198f91-75ca-4aac-8b5a-aab7a6b3c665\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"
Sep 07 17:18:56.955084 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:56.954922    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09198f91-75ca-4aac-8b5a-aab7a6b3c665-tls-certs\") pod \"sub-test-model-3973bf-kserve-78b64c76dc-sqprf\" (UID: \"09198f91-75ca-4aac-8b5a-aab7a6b3c665\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"
Sep 07 17:18:56.955084 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:56.954978    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09198f91-75ca-4aac-8b5a-aab7a6b3c665-home\") pod \"sub-test-model-3973bf-kserve-78b64c76dc-sqprf\" (UID: \"09198f91-75ca-4aac-8b5a-aab7a6b3c665\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"
Sep 07 17:18:56.955084 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:56.955038    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf6jw\" (UniqueName: \"kubernetes.io/projected/09198f91-75ca-4aac-8b5a-aab7a6b3c665-kube-api-access-xf6jw\") pod \"sub-test-model-3973bf-kserve-78b64c76dc-sqprf\" (UID: \"09198f91-75ca-4aac-8b5a-aab7a6b3c665\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"
Sep 07 17:18:56.955194 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:56.955115    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09198f91-75ca-4aac-8b5a-aab7a6b3c665-model-cache\") pod \"sub-test-model-3973bf-kserve-78b64c76dc-sqprf\" (UID: \"09198f91-75ca-4aac-8b5a-aab7a6b3c665\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"
Sep 07 17:18:56.955194 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:56.955157    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09198f91-75ca-4aac-8b5a-aab7a6b3c665-dshm\") pod \"sub-test-model-3973bf-kserve-78b64c76dc-sqprf\" (UID: \"09198f91-75ca-4aac-8b5a-aab7a6b3c665\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"
Sep 07 17:18:57.055767 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:57.055734    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09198f91-75ca-4aac-8b5a-aab7a6b3c665-tmp-dir\") pod \"sub-test-model-3973bf-kserve-78b64c76dc-sqprf\" (UID: \"09198f91-75ca-4aac-8b5a-aab7a6b3c665\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"
Sep 07 17:18:57.055967 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:57.055778    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09198f91-75ca-4aac-8b5a-aab7a6b3c665-tls-certs\") pod \"sub-test-model-3973bf-kserve-78b64c76dc-sqprf\" (UID: \"09198f91-75ca-4aac-8b5a-aab7a6b3c665\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"
Sep 07 17:18:57.055967 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:57.055805    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09198f91-75ca-4aac-8b5a-aab7a6b3c665-home\") pod \"sub-test-model-3973bf-kserve-78b64c76dc-sqprf\" (UID: \"09198f91-75ca-4aac-8b5a-aab7a6b3c665\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"
Sep 07 17:18:57.055967 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:57.055878    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf6jw\" (UniqueName: \"kubernetes.io/projected/09198f91-75ca-4aac-8b5a-aab7a6b3c665-kube-api-access-xf6jw\") pod \"sub-test-model-3973bf-kserve-78b64c76dc-sqprf\" (UID: \"09198f91-75ca-4aac-8b5a-aab7a6b3c665\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"
Sep 07 17:18:57.055967 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:57.055948    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09198f91-75ca-4aac-8b5a-aab7a6b3c665-model-cache\") pod \"sub-test-model-3973bf-kserve-78b64c76dc-sqprf\" (UID: \"09198f91-75ca-4aac-8b5a-aab7a6b3c665\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"
Sep 07 17:18:57.056215 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:57.055975    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09198f91-75ca-4aac-8b5a-aab7a6b3c665-dshm\") pod \"sub-test-model-3973bf-kserve-78b64c76dc-sqprf\" (UID: \"09198f91-75ca-4aac-8b5a-aab7a6b3c665\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"
Sep 07 17:18:57.056215 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:57.056178    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09198f91-75ca-4aac-8b5a-aab7a6b3c665-tmp-dir\") pod \"sub-test-model-3973bf-kserve-78b64c76dc-sqprf\" (UID: \"09198f91-75ca-4aac-8b5a-aab7a6b3c665\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"
Sep 07 17:18:57.056332 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:57.056221    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09198f91-75ca-4aac-8b5a-aab7a6b3c665-home\") pod \"sub-test-model-3973bf-kserve-78b64c76dc-sqprf\" (UID: \"09198f91-75ca-4aac-8b5a-aab7a6b3c665\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"
Sep 07 17:18:57.056464 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:57.056430    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09198f91-75ca-4aac-8b5a-aab7a6b3c665-model-cache\") pod \"sub-test-model-3973bf-kserve-78b64c76dc-sqprf\" (UID: \"09198f91-75ca-4aac-8b5a-aab7a6b3c665\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"
Sep 07 17:18:57.058395 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:57.058372    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09198f91-75ca-4aac-8b5a-aab7a6b3c665-dshm\") pod \"sub-test-model-3973bf-kserve-78b64c76dc-sqprf\" (UID: \"09198f91-75ca-4aac-8b5a-aab7a6b3c665\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"
Sep 07 17:18:57.058514 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:57.058496    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09198f91-75ca-4aac-8b5a-aab7a6b3c665-tls-certs\") pod \"sub-test-model-3973bf-kserve-78b64c76dc-sqprf\" (UID: \"09198f91-75ca-4aac-8b5a-aab7a6b3c665\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"
Sep 07 17:18:57.076128 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:57.076060    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf6jw\" (UniqueName: \"kubernetes.io/projected/09198f91-75ca-4aac-8b5a-aab7a6b3c665-kube-api-access-xf6jw\") pod \"sub-test-model-3973bf-kserve-78b64c76dc-sqprf\" (UID: \"09198f91-75ca-4aac-8b5a-aab7a6b3c665\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"
Sep 07 17:18:57.133760 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:57.133733    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"
Sep 07 17:18:57.412201 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:57.412169    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"]
Sep 07 17:18:57.413110 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:18:57.413084    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09198f91_75ca_4aac_8b5a_aab7a6b3c665.slice/crio-8410aefeac02588158eeb6f01ef86f893c35910e4af1748672ded2341858dd6a WatchSource:0}: Error finding container 8410aefeac02588158eeb6f01ef86f893c35910e4af1748672ded2341858dd6a: Status 404 returned error can't find the container with id 8410aefeac02588158eeb6f01ef86f893c35910e4af1748672ded2341858dd6a
Sep 07 17:18:57.884069 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:57.884031    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf" event={"ID":"09198f91-75ca-4aac-8b5a-aab7a6b3c665","Type":"ContainerStarted","Data":"d89a916f1b17a4a5a3dde0eeb9cd22f1f3c9212c24fd01e9e719275819bfe250"}
Sep 07 17:18:57.884069 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:57.884073    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf" event={"ID":"09198f91-75ca-4aac-8b5a-aab7a6b3c665","Type":"ContainerStarted","Data":"8410aefeac02588158eeb6f01ef86f893c35910e4af1748672ded2341858dd6a"}
Sep 07 17:18:57.905253 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:57.905200    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf" podStartSLOduration=1.9051846220000002 podStartE2EDuration="1.905184622s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:18:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:18:57.90224956 +0000 UTC m=+1331.799096877" watchObservedRunningTime="2026-09-07 17:18:57.905184622 +0000 UTC m=+1331.802031937"
Sep 07 17:18:58.431571 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:18:58.431521    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:00.400453 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:00.400411    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:00.461451 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:00.461419    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:00.670874 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:00.670784    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:01.956667 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:01.956637    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:02.120252 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:02.120213    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:02.744928 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:02.744868    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:02.840973 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:02.840878    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:02.940920 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:02.940857    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:04.167577 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:04.167543    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:07.133959 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:07.133907    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"
Sep 07 17:19:07.133959 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:07.133970    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"
Sep 07 17:19:07.147137 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:07.147107    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"
Sep 07 17:19:07.949760 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:07.949731    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"
Sep 07 17:19:10.306552 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:10.306468    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:10.409414 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:10.409379    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:10.984240 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:10.984204    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:17.194331 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:17.194290    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:17.305180 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:17.305141    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:17.399280 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:17.399241    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:25.144435 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:25.144394    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:27.866586 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:27.866545    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:28.074144 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:28.074104    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:46.757994 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:46.753586    2575 scope.go:117] "RemoveContainer" containerID="46eeb26c3741073c688e00de7c833fca48624fe9378326c71b120784e8f821e0"
Sep 07 17:19:48.970348 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:48.970312    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:49.245069 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:49.244988    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"]
Sep 07 17:19:49.258224 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:49.258189    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:50.199017 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:50.198984    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"]
Sep 07 17:19:50.216169 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:50.216138    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:54.785109 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:54.785078    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:54.847922 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:54.847858    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:55.114117 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:55.114082    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:55.419169 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:55.419073    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:55.627074 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:55.627038    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:55.724890 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:55.724809    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:57.206653 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:57.206617    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:58.075402 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:58.075296    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:58.168880 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:58.168840    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:59.231198 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:59.231166    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:59.290171 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:59.290134    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:59.393851 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:59.393810    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:59.705874 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:59.705839    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:59.797499 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:59.797468    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:19:59.802631 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:59.802605    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj"]
Sep 07 17:19:59.807984 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:59.807964    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj"
Sep 07 17:19:59.810624 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:59.810608    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-b36e3a\""
Sep 07 17:19:59.811078 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:59.811062    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-b36e3a-dockercfg-rjl92\""
Sep 07 17:19:59.824583 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:59.824554    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj"]
Sep 07 17:19:59.903492 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:59.903462    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pllhf\" (UniqueName: \"kubernetes.io/projected/f6e56b5a-3279-4bf3-9d92-bf08a55ba22e-kube-api-access-pllhf\") pod \"payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj\" (UID: \"f6e56b5a-3279-4bf3-9d92-bf08a55ba22e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj"
Sep 07 17:19:59.903667 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:19:59.903618    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6e56b5a-3279-4bf3-9d92-bf08a55ba22e-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj\" (UID: \"f6e56b5a-3279-4bf3-9d92-bf08a55ba22e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj"
Sep 07 17:20:00.005057 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:00.004967    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pllhf\" (UniqueName: \"kubernetes.io/projected/f6e56b5a-3279-4bf3-9d92-bf08a55ba22e-kube-api-access-pllhf\") pod \"payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj\" (UID: \"f6e56b5a-3279-4bf3-9d92-bf08a55ba22e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj"
Sep 07 17:20:00.005234 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:00.005096    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6e56b5a-3279-4bf3-9d92-bf08a55ba22e-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj\" (UID: \"f6e56b5a-3279-4bf3-9d92-bf08a55ba22e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj"
Sep 07 17:20:00.005800 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:00.005779    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6e56b5a-3279-4bf3-9d92-bf08a55ba22e-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj\" (UID: \"f6e56b5a-3279-4bf3-9d92-bf08a55ba22e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj"
Sep 07 17:20:00.012242 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:00.012209    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pllhf\" (UniqueName: \"kubernetes.io/projected/f6e56b5a-3279-4bf3-9d92-bf08a55ba22e-kube-api-access-pllhf\") pod \"payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj\" (UID: \"f6e56b5a-3279-4bf3-9d92-bf08a55ba22e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj"
Sep 07 17:20:00.118576 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:00.118548    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj"
Sep 07 17:20:00.392307 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:00.392275    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj"]
Sep 07 17:20:00.393628 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:20:00.393586    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6e56b5a_3279_4bf3_9d92_bf08a55ba22e.slice/crio-584149d87caa4a73a08dd3bfeb6061d1b818418828d6c6e869286142f60b9213 WatchSource:0}: Error finding container 584149d87caa4a73a08dd3bfeb6061d1b818418828d6c6e869286142f60b9213: Status 404 returned error can't find the container with id 584149d87caa4a73a08dd3bfeb6061d1b818418828d6c6e869286142f60b9213
Sep 07 17:20:01.231862 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:01.231826    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj" event={"ID":"f6e56b5a-3279-4bf3-9d92-bf08a55ba22e","Type":"ContainerStarted","Data":"1e50233f7f9b35e64c8bff884a4cc995542a9826f21e655b1af6d71595707353"}
Sep 07 17:20:01.232070 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:01.231913    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj" event={"ID":"f6e56b5a-3279-4bf3-9d92-bf08a55ba22e","Type":"ContainerStarted","Data":"584149d87caa4a73a08dd3bfeb6061d1b818418828d6c6e869286142f60b9213"}
Sep 07 17:20:01.232070 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:01.231948    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj"
Sep 07 17:20:01.261699 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:01.261647    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj" podStartSLOduration=2.261628378 podStartE2EDuration="2.261628378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:19:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:20:01.26066156 +0000 UTC m=+1395.157508875" watchObservedRunningTime="2026-09-07 17:20:01.261628378 +0000 UTC m=+1395.158475719"
Sep 07 17:20:04.265546 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:04.265498    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8" podUID="f1d77341-772f-409b-be48-b0b01a54ed8a" containerName="main" containerID="cri-o://ff328edaddc29dad6183d4b6392d91a3061b0221e0c73cb642ec189fd39cff80" gracePeriod=45
Sep 07 17:20:04.529541 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:04.529481    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"
Sep 07 17:20:04.550431 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:04.550397    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1d77341-772f-409b-be48-b0b01a54ed8a-tmp-dir\") pod \"f1d77341-772f-409b-be48-b0b01a54ed8a\" (UID: \"f1d77341-772f-409b-be48-b0b01a54ed8a\") "
Sep 07 17:20:04.550431 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:04.550432    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1d77341-772f-409b-be48-b0b01a54ed8a-model-cache\") pod \"f1d77341-772f-409b-be48-b0b01a54ed8a\" (UID: \"f1d77341-772f-409b-be48-b0b01a54ed8a\") "
Sep 07 17:20:04.550637 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:04.550506    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1d77341-772f-409b-be48-b0b01a54ed8a-dshm\") pod \"f1d77341-772f-409b-be48-b0b01a54ed8a\" (UID: \"f1d77341-772f-409b-be48-b0b01a54ed8a\") "
Sep 07 17:20:04.550637 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:04.550536    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1d77341-772f-409b-be48-b0b01a54ed8a-tls-certs\") pod \"f1d77341-772f-409b-be48-b0b01a54ed8a\" (UID: \"f1d77341-772f-409b-be48-b0b01a54ed8a\") "
Sep 07 17:20:04.550637 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:04.550585    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lrtv\" (UniqueName: \"kubernetes.io/projected/f1d77341-772f-409b-be48-b0b01a54ed8a-kube-api-access-2lrtv\") pod \"f1d77341-772f-409b-be48-b0b01a54ed8a\" (UID: \"f1d77341-772f-409b-be48-b0b01a54ed8a\") "
Sep 07 17:20:04.550637 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:04.550609    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1d77341-772f-409b-be48-b0b01a54ed8a-home\") pod \"f1d77341-772f-409b-be48-b0b01a54ed8a\" (UID: \"f1d77341-772f-409b-be48-b0b01a54ed8a\") "
Sep 07 17:20:04.550873 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:04.550635    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1d77341-772f-409b-be48-b0b01a54ed8a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f1d77341-772f-409b-be48-b0b01a54ed8a" (UID: "f1d77341-772f-409b-be48-b0b01a54ed8a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:20:04.550873 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:04.550743    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1d77341-772f-409b-be48-b0b01a54ed8a-model-cache" (OuterVolumeSpecName: "model-cache") pod "f1d77341-772f-409b-be48-b0b01a54ed8a" (UID: "f1d77341-772f-409b-be48-b0b01a54ed8a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:20:04.550873 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:04.550822    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1d77341-772f-409b-be48-b0b01a54ed8a-home" (OuterVolumeSpecName: "home") pod "f1d77341-772f-409b-be48-b0b01a54ed8a" (UID: "f1d77341-772f-409b-be48-b0b01a54ed8a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:20:04.551147 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:04.551118    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1d77341-772f-409b-be48-b0b01a54ed8a-tmp-dir\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:20:04.551214 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:04.551152    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1d77341-772f-409b-be48-b0b01a54ed8a-model-cache\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:20:04.551214 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:04.551166    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1d77341-772f-409b-be48-b0b01a54ed8a-home\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:20:04.554209 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:04.554178    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1d77341-772f-409b-be48-b0b01a54ed8a-kube-api-access-2lrtv" (OuterVolumeSpecName: "kube-api-access-2lrtv") pod "f1d77341-772f-409b-be48-b0b01a54ed8a" (UID: "f1d77341-772f-409b-be48-b0b01a54ed8a"). InnerVolumeSpecName "kube-api-access-2lrtv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:20:04.554936 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:04.554869    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1d77341-772f-409b-be48-b0b01a54ed8a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f1d77341-772f-409b-be48-b0b01a54ed8a" (UID: "f1d77341-772f-409b-be48-b0b01a54ed8a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:20:04.555288 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:04.555265    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1d77341-772f-409b-be48-b0b01a54ed8a-dshm" (OuterVolumeSpecName: "dshm") pod "f1d77341-772f-409b-be48-b0b01a54ed8a" (UID: "f1d77341-772f-409b-be48-b0b01a54ed8a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:20:04.651840 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:04.651802    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lrtv\" (UniqueName: \"kubernetes.io/projected/f1d77341-772f-409b-be48-b0b01a54ed8a-kube-api-access-2lrtv\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:20:04.651840 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:04.651836    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1d77341-772f-409b-be48-b0b01a54ed8a-dshm\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:20:04.651840 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:04.651845    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1d77341-772f-409b-be48-b0b01a54ed8a-tls-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:20:05.220112 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:05.220067    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf" podUID="09198f91-75ca-4aac-8b5a-aab7a6b3c665" containerName="main" containerID="cri-o://d89a916f1b17a4a5a3dde0eeb9cd22f1f3c9212c24fd01e9e719275819bfe250" gracePeriod=45
Sep 07 17:20:05.260696 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:05.260664    2575 generic.go:356] "Generic (PLEG): container finished" podID="f1d77341-772f-409b-be48-b0b01a54ed8a" containerID="ff328edaddc29dad6183d4b6392d91a3061b0221e0c73cb642ec189fd39cff80" exitCode=0
Sep 07 17:20:05.260873 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:05.260703    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"
Sep 07 17:20:05.260873 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:05.260748    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8" event={"ID":"f1d77341-772f-409b-be48-b0b01a54ed8a","Type":"ContainerDied","Data":"ff328edaddc29dad6183d4b6392d91a3061b0221e0c73cb642ec189fd39cff80"}
Sep 07 17:20:05.260873 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:05.260791    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8" event={"ID":"f1d77341-772f-409b-be48-b0b01a54ed8a","Type":"ContainerDied","Data":"67f005f3a735f76f0e3e28047a12cf2ea02e748c999ec521860b97872c70ec23"}
Sep 07 17:20:05.260873 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:05.260809    2575 scope.go:117] "RemoveContainer" containerID="ff328edaddc29dad6183d4b6392d91a3061b0221e0c73cb642ec189fd39cff80"
Sep 07 17:20:05.283545 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:05.283522    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"]
Sep 07 17:20:05.287495 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:05.287471    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1795dd/sub-test-model-1795dd-kserve-685984f87-bvcv8"]
Sep 07 17:20:05.333047 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:05.332929    2575 scope.go:117] "RemoveContainer" containerID="ff328edaddc29dad6183d4b6392d91a3061b0221e0c73cb642ec189fd39cff80"
Sep 07 17:20:05.333342 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:20:05.333312    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff328edaddc29dad6183d4b6392d91a3061b0221e0c73cb642ec189fd39cff80\": container with ID starting with ff328edaddc29dad6183d4b6392d91a3061b0221e0c73cb642ec189fd39cff80 not found: ID does not exist" containerID="ff328edaddc29dad6183d4b6392d91a3061b0221e0c73cb642ec189fd39cff80"
Sep 07 17:20:05.333431 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:05.333356    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff328edaddc29dad6183d4b6392d91a3061b0221e0c73cb642ec189fd39cff80"} err="failed to get container status \"ff328edaddc29dad6183d4b6392d91a3061b0221e0c73cb642ec189fd39cff80\": rpc error: code = NotFound desc = could not find container \"ff328edaddc29dad6183d4b6392d91a3061b0221e0c73cb642ec189fd39cff80\": container with ID starting with ff328edaddc29dad6183d4b6392d91a3061b0221e0c73cb642ec189fd39cff80 not found: ID does not exist"
Sep 07 17:20:05.477608 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:05.477545    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"
Sep 07 17:20:05.560116 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:05.560085    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09198f91-75ca-4aac-8b5a-aab7a6b3c665-tmp-dir\") pod \"09198f91-75ca-4aac-8b5a-aab7a6b3c665\" (UID: \"09198f91-75ca-4aac-8b5a-aab7a6b3c665\") "
Sep 07 17:20:05.560287 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:05.560127    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09198f91-75ca-4aac-8b5a-aab7a6b3c665-tls-certs\") pod \"09198f91-75ca-4aac-8b5a-aab7a6b3c665\" (UID: \"09198f91-75ca-4aac-8b5a-aab7a6b3c665\") "
Sep 07 17:20:05.560287 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:05.560154    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xf6jw\" (UniqueName: \"kubernetes.io/projected/09198f91-75ca-4aac-8b5a-aab7a6b3c665-kube-api-access-xf6jw\") pod \"09198f91-75ca-4aac-8b5a-aab7a6b3c665\" (UID: \"09198f91-75ca-4aac-8b5a-aab7a6b3c665\") "
Sep 07 17:20:05.560287 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:05.560187    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09198f91-75ca-4aac-8b5a-aab7a6b3c665-home\") pod \"09198f91-75ca-4aac-8b5a-aab7a6b3c665\" (UID: \"09198f91-75ca-4aac-8b5a-aab7a6b3c665\") "
Sep 07 17:20:05.560287 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:05.560248    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09198f91-75ca-4aac-8b5a-aab7a6b3c665-model-cache\") pod \"09198f91-75ca-4aac-8b5a-aab7a6b3c665\" (UID: \"09198f91-75ca-4aac-8b5a-aab7a6b3c665\") "
Sep 07 17:20:05.560485 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:05.560330    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09198f91-75ca-4aac-8b5a-aab7a6b3c665-dshm\") pod \"09198f91-75ca-4aac-8b5a-aab7a6b3c665\" (UID: \"09198f91-75ca-4aac-8b5a-aab7a6b3c665\") "
Sep 07 17:20:05.560485 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:05.560389    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09198f91-75ca-4aac-8b5a-aab7a6b3c665-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "09198f91-75ca-4aac-8b5a-aab7a6b3c665" (UID: "09198f91-75ca-4aac-8b5a-aab7a6b3c665"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:20:05.560485 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:05.560469    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09198f91-75ca-4aac-8b5a-aab7a6b3c665-home" (OuterVolumeSpecName: "home") pod "09198f91-75ca-4aac-8b5a-aab7a6b3c665" (UID: "09198f91-75ca-4aac-8b5a-aab7a6b3c665"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:20:05.560650 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:05.560509    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09198f91-75ca-4aac-8b5a-aab7a6b3c665-model-cache" (OuterVolumeSpecName: "model-cache") pod "09198f91-75ca-4aac-8b5a-aab7a6b3c665" (UID: "09198f91-75ca-4aac-8b5a-aab7a6b3c665"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:20:05.560705 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:05.560684    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09198f91-75ca-4aac-8b5a-aab7a6b3c665-tmp-dir\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:20:05.560748 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:05.560710    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09198f91-75ca-4aac-8b5a-aab7a6b3c665-home\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:20:05.560748 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:05.560726    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09198f91-75ca-4aac-8b5a-aab7a6b3c665-model-cache\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:20:05.562368 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:05.562340    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09198f91-75ca-4aac-8b5a-aab7a6b3c665-kube-api-access-xf6jw" (OuterVolumeSpecName: "kube-api-access-xf6jw") pod "09198f91-75ca-4aac-8b5a-aab7a6b3c665" (UID: "09198f91-75ca-4aac-8b5a-aab7a6b3c665"). InnerVolumeSpecName "kube-api-access-xf6jw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:20:05.562471 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:05.562383    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09198f91-75ca-4aac-8b5a-aab7a6b3c665-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "09198f91-75ca-4aac-8b5a-aab7a6b3c665" (UID: "09198f91-75ca-4aac-8b5a-aab7a6b3c665"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:20:05.562471 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:05.562383    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09198f91-75ca-4aac-8b5a-aab7a6b3c665-dshm" (OuterVolumeSpecName: "dshm") pod "09198f91-75ca-4aac-8b5a-aab7a6b3c665" (UID: "09198f91-75ca-4aac-8b5a-aab7a6b3c665"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:20:05.662256 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:05.662225    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09198f91-75ca-4aac-8b5a-aab7a6b3c665-dshm\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:20:05.662256 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:05.662251    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09198f91-75ca-4aac-8b5a-aab7a6b3c665-tls-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:20:05.662256 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:05.662261    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xf6jw\" (UniqueName: \"kubernetes.io/projected/09198f91-75ca-4aac-8b5a-aab7a6b3c665-kube-api-access-xf6jw\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:20:06.267252 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:06.267213    2575 generic.go:356] "Generic (PLEG): container finished" podID="09198f91-75ca-4aac-8b5a-aab7a6b3c665" containerID="d89a916f1b17a4a5a3dde0eeb9cd22f1f3c9212c24fd01e9e719275819bfe250" exitCode=0
Sep 07 17:20:06.267450 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:06.267263    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"
Sep 07 17:20:06.267450 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:06.267298    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf" event={"ID":"09198f91-75ca-4aac-8b5a-aab7a6b3c665","Type":"ContainerDied","Data":"d89a916f1b17a4a5a3dde0eeb9cd22f1f3c9212c24fd01e9e719275819bfe250"}
Sep 07 17:20:06.267450 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:06.267348    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf" event={"ID":"09198f91-75ca-4aac-8b5a-aab7a6b3c665","Type":"ContainerDied","Data":"8410aefeac02588158eeb6f01ef86f893c35910e4af1748672ded2341858dd6a"}
Sep 07 17:20:06.267450 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:06.267370    2575 scope.go:117] "RemoveContainer" containerID="d89a916f1b17a4a5a3dde0eeb9cd22f1f3c9212c24fd01e9e719275819bfe250"
Sep 07 17:20:06.277002 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:06.276984    2575 scope.go:117] "RemoveContainer" containerID="d89a916f1b17a4a5a3dde0eeb9cd22f1f3c9212c24fd01e9e719275819bfe250"
Sep 07 17:20:06.277250 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:20:06.277232    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d89a916f1b17a4a5a3dde0eeb9cd22f1f3c9212c24fd01e9e719275819bfe250\": container with ID starting with d89a916f1b17a4a5a3dde0eeb9cd22f1f3c9212c24fd01e9e719275819bfe250 not found: ID does not exist" containerID="d89a916f1b17a4a5a3dde0eeb9cd22f1f3c9212c24fd01e9e719275819bfe250"
Sep 07 17:20:06.277299 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:06.277258    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d89a916f1b17a4a5a3dde0eeb9cd22f1f3c9212c24fd01e9e719275819bfe250"} err="failed to get container status \"d89a916f1b17a4a5a3dde0eeb9cd22f1f3c9212c24fd01e9e719275819bfe250\": rpc error: code = NotFound desc = could not find container \"d89a916f1b17a4a5a3dde0eeb9cd22f1f3c9212c24fd01e9e719275819bfe250\": container with ID starting with d89a916f1b17a4a5a3dde0eeb9cd22f1f3c9212c24fd01e9e719275819bfe250 not found: ID does not exist"
Sep 07 17:20:06.293174 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:06.293151    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"]
Sep 07 17:20:06.295844 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:06.295823    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-3973bf/sub-test-model-3973bf-kserve-78b64c76dc-sqprf"]
Sep 07 17:20:06.723636 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:06.723608    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09198f91-75ca-4aac-8b5a-aab7a6b3c665" path="/var/lib/kubelet/pods/09198f91-75ca-4aac-8b5a-aab7a6b3c665/volumes"
Sep 07 17:20:06.724048 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:06.724032    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1d77341-772f-409b-be48-b0b01a54ed8a" path="/var/lib/kubelet/pods/f1d77341-772f-409b-be48-b0b01a54ed8a/volumes"
Sep 07 17:20:12.239063 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:12.239032    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj"
Sep 07 17:20:23.068391 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:23.068348    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:20:23.539341 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:23.539244    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:20:23.961686 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:23.961645    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:20:24.133060 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:24.133025    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:20:27.070660 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:27.070629    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:20:27.164745 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:27.164706    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:20:28.414517 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:28.414485    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd"]
Sep 07 17:20:28.415179 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:28.415158    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09198f91-75ca-4aac-8b5a-aab7a6b3c665" containerName="main"
Sep 07 17:20:28.415179 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:28.415181    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="09198f91-75ca-4aac-8b5a-aab7a6b3c665" containerName="main"
Sep 07 17:20:28.415324 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:28.415218    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1d77341-772f-409b-be48-b0b01a54ed8a" containerName="main"
Sep 07 17:20:28.415324 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:28.415227    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1d77341-772f-409b-be48-b0b01a54ed8a" containerName="main"
Sep 07 17:20:28.415430 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:28.415354    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1d77341-772f-409b-be48-b0b01a54ed8a" containerName="main"
Sep 07 17:20:28.415430 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:28.415368    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="09198f91-75ca-4aac-8b5a-aab7a6b3c665" containerName="main"
Sep 07 17:20:28.418763 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:28.418741    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd"
Sep 07 17:20:28.423958 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:28.423938    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-611042-serving-cert\""
Sep 07 17:20:28.434172 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:28.434147    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd"]
Sep 07 17:20:28.468636 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:28.468605    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:20:28.477353 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:28.477326    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/159a5322-a120-457c-8e46-3e57c45f603a-openshift-service-ca\") pod \"maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd\" (UID: \"159a5322-a120-457c-8e46-3e57c45f603a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd"
Sep 07 17:20:28.477473 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:28.477369    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/159a5322-a120-457c-8e46-3e57c45f603a-metrics-certs\") pod \"maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd\" (UID: \"159a5322-a120-457c-8e46-3e57c45f603a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd"
Sep 07 17:20:28.477473 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:28.477398    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/159a5322-a120-457c-8e46-3e57c45f603a-maas-api-tls\") pod \"maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd\" (UID: \"159a5322-a120-457c-8e46-3e57c45f603a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd"
Sep 07 17:20:28.477552 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:28.477460    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcw5b\" (UniqueName: \"kubernetes.io/projected/159a5322-a120-457c-8e46-3e57c45f603a-kube-api-access-xcw5b\") pod \"maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd\" (UID: \"159a5322-a120-457c-8e46-3e57c45f603a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd"
Sep 07 17:20:28.578395 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:28.578357    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/159a5322-a120-457c-8e46-3e57c45f603a-openshift-service-ca\") pod \"maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd\" (UID: \"159a5322-a120-457c-8e46-3e57c45f603a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd"
Sep 07 17:20:28.578578 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:28.578407    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/159a5322-a120-457c-8e46-3e57c45f603a-metrics-certs\") pod \"maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd\" (UID: \"159a5322-a120-457c-8e46-3e57c45f603a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd"
Sep 07 17:20:28.578578 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:28.578530    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/159a5322-a120-457c-8e46-3e57c45f603a-maas-api-tls\") pod \"maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd\" (UID: \"159a5322-a120-457c-8e46-3e57c45f603a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd"
Sep 07 17:20:28.578578 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:28.578576    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcw5b\" (UniqueName: \"kubernetes.io/projected/159a5322-a120-457c-8e46-3e57c45f603a-kube-api-access-xcw5b\") pod \"maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd\" (UID: \"159a5322-a120-457c-8e46-3e57c45f603a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd"
Sep 07 17:20:28.578732 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:20:28.578662    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-611042-serving-cert: secret "maas-api-e2e-api-b-611042-serving-cert" not found
Sep 07 17:20:28.578784 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:20:28.578746    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/159a5322-a120-457c-8e46-3e57c45f603a-maas-api-tls podName:159a5322-a120-457c-8e46-3e57c45f603a nodeName:}" failed. No retries permitted until 2026-09-07 17:20:29.078723711 +0000 UTC m=+1422.975571017 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/159a5322-a120-457c-8e46-3e57c45f603a-maas-api-tls") pod "maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd" (UID: "159a5322-a120-457c-8e46-3e57c45f603a") : secret "maas-api-e2e-api-b-611042-serving-cert" not found
Sep 07 17:20:28.579222 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:28.579197    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/159a5322-a120-457c-8e46-3e57c45f603a-openshift-service-ca\") pod \"maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd\" (UID: \"159a5322-a120-457c-8e46-3e57c45f603a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd"
Sep 07 17:20:28.581111 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:28.581088    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/159a5322-a120-457c-8e46-3e57c45f603a-metrics-certs\") pod \"maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd\" (UID: \"159a5322-a120-457c-8e46-3e57c45f603a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd"
Sep 07 17:20:28.586826 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:28.586800    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:20:28.588471 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:28.588450    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcw5b\" (UniqueName: \"kubernetes.io/projected/159a5322-a120-457c-8e46-3e57c45f603a-kube-api-access-xcw5b\") pod \"maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd\" (UID: \"159a5322-a120-457c-8e46-3e57c45f603a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd"
Sep 07 17:20:28.682762 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:28.682670    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:20:29.028291 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.028204    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:20:29.084907 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.084860    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/159a5322-a120-457c-8e46-3e57c45f603a-maas-api-tls\") pod \"maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd\" (UID: \"159a5322-a120-457c-8e46-3e57c45f603a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd"
Sep 07 17:20:29.087306 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.087274    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/159a5322-a120-457c-8e46-3e57c45f603a-maas-api-tls\") pod \"maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd\" (UID: \"159a5322-a120-457c-8e46-3e57c45f603a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd"
Sep 07 17:20:29.157937 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.157866    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:20:29.233716 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.233682    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr"]
Sep 07 17:20:29.237621 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.237604    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr"
Sep 07 17:20:29.240162 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.240141    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-611042\""
Sep 07 17:20:29.240256 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.240238    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-611042-dockercfg-x6d85\""
Sep 07 17:20:29.248554 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.248529    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr"]
Sep 07 17:20:29.320716 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.320681    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-611042-b989f997-k6lrt"]
Sep 07 17:20:29.324475 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.324456    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-611042-b989f997-k6lrt"
Sep 07 17:20:29.333546 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.333522    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd"
Sep 07 17:20:29.337880 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.337857    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-611042-b989f997-k6lrt"]
Sep 07 17:20:29.386991 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.386790    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4b0356b-b031-4040-993a-167e2d9b930f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr\" (UID: \"f4b0356b-b031-4040-993a-167e2d9b930f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr"
Sep 07 17:20:29.386991 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.386958    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkstl\" (UniqueName: \"kubernetes.io/projected/519ae34b-3ffc-4d10-9fd5-1395bd415fc4-kube-api-access-kkstl\") pod \"payload-processing-e2e-api-b-611042-b989f997-k6lrt\" (UID: \"519ae34b-3ffc-4d10-9fd5-1395bd415fc4\") " pod="openshift-ingress/payload-processing-e2e-api-b-611042-b989f997-k6lrt"
Sep 07 17:20:29.387245 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.387130    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52cf5\" (UniqueName: \"kubernetes.io/projected/f4b0356b-b031-4040-993a-167e2d9b930f-kube-api-access-52cf5\") pod \"payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr\" (UID: \"f4b0356b-b031-4040-993a-167e2d9b930f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr"
Sep 07 17:20:29.387340 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.387268    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/519ae34b-3ffc-4d10-9fd5-1395bd415fc4-plugins-config-volume\") pod \"payload-processing-e2e-api-b-611042-b989f997-k6lrt\" (UID: \"519ae34b-3ffc-4d10-9fd5-1395bd415fc4\") " pod="openshift-ingress/payload-processing-e2e-api-b-611042-b989f997-k6lrt"
Sep 07 17:20:29.487870 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.487833    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/519ae34b-3ffc-4d10-9fd5-1395bd415fc4-plugins-config-volume\") pod \"payload-processing-e2e-api-b-611042-b989f997-k6lrt\" (UID: \"519ae34b-3ffc-4d10-9fd5-1395bd415fc4\") " pod="openshift-ingress/payload-processing-e2e-api-b-611042-b989f997-k6lrt"
Sep 07 17:20:29.488279 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.487921    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4b0356b-b031-4040-993a-167e2d9b930f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr\" (UID: \"f4b0356b-b031-4040-993a-167e2d9b930f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr"
Sep 07 17:20:29.488279 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.487964    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkstl\" (UniqueName: \"kubernetes.io/projected/519ae34b-3ffc-4d10-9fd5-1395bd415fc4-kube-api-access-kkstl\") pod \"payload-processing-e2e-api-b-611042-b989f997-k6lrt\" (UID: \"519ae34b-3ffc-4d10-9fd5-1395bd415fc4\") " pod="openshift-ingress/payload-processing-e2e-api-b-611042-b989f997-k6lrt"
Sep 07 17:20:29.488279 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.488002    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52cf5\" (UniqueName: \"kubernetes.io/projected/f4b0356b-b031-4040-993a-167e2d9b930f-kube-api-access-52cf5\") pod \"payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr\" (UID: \"f4b0356b-b031-4040-993a-167e2d9b930f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr"
Sep 07 17:20:29.488598 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.488577    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/519ae34b-3ffc-4d10-9fd5-1395bd415fc4-plugins-config-volume\") pod \"payload-processing-e2e-api-b-611042-b989f997-k6lrt\" (UID: \"519ae34b-3ffc-4d10-9fd5-1395bd415fc4\") " pod="openshift-ingress/payload-processing-e2e-api-b-611042-b989f997-k6lrt"
Sep 07 17:20:29.488639 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.488609    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4b0356b-b031-4040-993a-167e2d9b930f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr\" (UID: \"f4b0356b-b031-4040-993a-167e2d9b930f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr"
Sep 07 17:20:29.497224 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.497195    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkstl\" (UniqueName: \"kubernetes.io/projected/519ae34b-3ffc-4d10-9fd5-1395bd415fc4-kube-api-access-kkstl\") pod \"payload-processing-e2e-api-b-611042-b989f997-k6lrt\" (UID: \"519ae34b-3ffc-4d10-9fd5-1395bd415fc4\") " pod="openshift-ingress/payload-processing-e2e-api-b-611042-b989f997-k6lrt"
Sep 07 17:20:29.497348 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.497278    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52cf5\" (UniqueName: \"kubernetes.io/projected/f4b0356b-b031-4040-993a-167e2d9b930f-kube-api-access-52cf5\") pod \"payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr\" (UID: \"f4b0356b-b031-4040-993a-167e2d9b930f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr"
Sep 07 17:20:29.549429 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.549380    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr"
Sep 07 17:20:29.616375 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.616340    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd"]
Sep 07 17:20:29.618034 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:20:29.617999    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod159a5322_a120_457c_8e46_3e57c45f603a.slice/crio-f76ed61808d3799894923a40896629c555caa5182f560e93fc05e937070b0949 WatchSource:0}: Error finding container f76ed61808d3799894923a40896629c555caa5182f560e93fc05e937070b0949: Status 404 returned error can't find the container with id f76ed61808d3799894923a40896629c555caa5182f560e93fc05e937070b0949
Sep 07 17:20:29.620013 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.619992    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 17:20:29.635428 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.635266    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-611042-b989f997-k6lrt"
Sep 07 17:20:29.826438 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.826411    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr"]
Sep 07 17:20:29.827414 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:20:29.827392    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4b0356b_b031_4040_993a_167e2d9b930f.slice/crio-e946e2e83cb3a6241ce685c4f0fbd3ec692772556def6d0e031ffd12257ed0fc WatchSource:0}: Error finding container e946e2e83cb3a6241ce685c4f0fbd3ec692772556def6d0e031ffd12257ed0fc: Status 404 returned error can't find the container with id e946e2e83cb3a6241ce685c4f0fbd3ec692772556def6d0e031ffd12257ed0fc
Sep 07 17:20:29.914434 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:29.914405    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-611042-b989f997-k6lrt"]
Sep 07 17:20:29.917812 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:20:29.917784    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod519ae34b_3ffc_4d10_9fd5_1395bd415fc4.slice/crio-9a8948d9e21d8490f685f6821e51ad1aa2a2695981a0df939a24e5c618c55834 WatchSource:0}: Error finding container 9a8948d9e21d8490f685f6821e51ad1aa2a2695981a0df939a24e5c618c55834: Status 404 returned error can't find the container with id 9a8948d9e21d8490f685f6821e51ad1aa2a2695981a0df939a24e5c618c55834
Sep 07 17:20:30.403341 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:30.403304    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-611042-b989f997-k6lrt" event={"ID":"519ae34b-3ffc-4d10-9fd5-1395bd415fc4","Type":"ContainerStarted","Data":"03a7c10932d43a28c1113a7e06eb424a87cc275c764bd0aba6c9553012179d7a"}
Sep 07 17:20:30.403559 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:30.403363    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-611042-b989f997-k6lrt" event={"ID":"519ae34b-3ffc-4d10-9fd5-1395bd415fc4","Type":"ContainerStarted","Data":"9a8948d9e21d8490f685f6821e51ad1aa2a2695981a0df939a24e5c618c55834"}
Sep 07 17:20:30.403559 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:30.403416    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-611042-b989f997-k6lrt"
Sep 07 17:20:30.405191 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:30.405156    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr" event={"ID":"f4b0356b-b031-4040-993a-167e2d9b930f","Type":"ContainerStarted","Data":"a4d4714bddcc4e4dace1bfc54e3d755d336bf84116f5144650c6bc98ba2a6a96"}
Sep 07 17:20:30.405326 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:30.405213    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr" event={"ID":"f4b0356b-b031-4040-993a-167e2d9b930f","Type":"ContainerStarted","Data":"e946e2e83cb3a6241ce685c4f0fbd3ec692772556def6d0e031ffd12257ed0fc"}
Sep 07 17:20:30.405326 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:30.405240    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr"
Sep 07 17:20:30.406859 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:30.406834    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd" event={"ID":"159a5322-a120-457c-8e46-3e57c45f603a","Type":"ContainerStarted","Data":"0a6e3e29960cc497ca6dc75a1f70ed2479eab1e322aa1bb1ab76dd66b597ea63"}
Sep 07 17:20:30.407003 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:30.406878    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd" event={"ID":"159a5322-a120-457c-8e46-3e57c45f603a","Type":"ContainerStarted","Data":"f76ed61808d3799894923a40896629c555caa5182f560e93fc05e937070b0949"}
Sep 07 17:20:30.407003 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:30.406944    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd"
Sep 07 17:20:30.425211 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:30.425165    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-611042-b989f997-k6lrt" podStartSLOduration=1.425150965 podStartE2EDuration="1.425150965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:20:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:20:30.421378383 +0000 UTC m=+1424.318225700" watchObservedRunningTime="2026-09-07 17:20:30.425150965 +0000 UTC m=+1424.321998271"
Sep 07 17:20:30.441308 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:30.441251    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr" podStartSLOduration=1.441233311 podStartE2EDuration="1.441233311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:20:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:20:30.440824321 +0000 UTC m=+1424.337671646" watchObservedRunningTime="2026-09-07 17:20:30.441233311 +0000 UTC m=+1424.338080627"
Sep 07 17:20:30.460646 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:30.460591    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd" podStartSLOduration=2.1617146050000002 podStartE2EDuration="2.46057546s" totalImagesPullingTime="298.860855ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:20:30.459272623 +0000 UTC m=+1424.356119939" watchObservedRunningTime="2026-09-07 17:20:30.46057546 +0000 UTC m=+1424.357422774"
Sep 07 17:20:36.418034 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:36.418002    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd"
Sep 07 17:20:41.415004 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:41.414927    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr"
Sep 07 17:20:41.415004 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:41.414999    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-611042-b989f997-k6lrt"
Sep 07 17:20:45.287360 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:45.287316    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:20:47.524356 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:47.524318    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"]
Sep 07 17:20:47.529849 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:47.529823    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"
Sep 07 17:20:47.537004 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:47.535509    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-3973bf\"/\"kube-root-ca.crt\""
Sep 07 17:20:47.538619 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:47.538547    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-3973bf\"/\"rate-test-model-3973bf-kserve-self-signed-certs\""
Sep 07 17:20:47.541357 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:47.539538    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"]
Sep 07 17:20:47.541357 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:47.539718    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-3973bf\"/\"default-dockercfg-8k8vf\""
Sep 07 17:20:47.542761 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:47.542740    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-3973bf\"/\"openshift-service-ca.crt\""
Sep 07 17:20:47.547944 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:47.547920    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:20:47.576057 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:47.576018    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/366901cd-b3a3-411b-9ed5-ca219f483219-model-cache\") pod \"rate-test-model-3973bf-kserve-6cd76c6659-6rhmz\" (UID: \"366901cd-b3a3-411b-9ed5-ca219f483219\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"
Sep 07 17:20:47.576231 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:47.576092    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/366901cd-b3a3-411b-9ed5-ca219f483219-home\") pod \"rate-test-model-3973bf-kserve-6cd76c6659-6rhmz\" (UID: \"366901cd-b3a3-411b-9ed5-ca219f483219\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"
Sep 07 17:20:47.576231 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:47.576119    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbfzj\" (UniqueName: \"kubernetes.io/projected/366901cd-b3a3-411b-9ed5-ca219f483219-kube-api-access-tbfzj\") pod \"rate-test-model-3973bf-kserve-6cd76c6659-6rhmz\" (UID: \"366901cd-b3a3-411b-9ed5-ca219f483219\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"
Sep 07 17:20:47.576316 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:47.576239    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/366901cd-b3a3-411b-9ed5-ca219f483219-tmp-dir\") pod \"rate-test-model-3973bf-kserve-6cd76c6659-6rhmz\" (UID: \"366901cd-b3a3-411b-9ed5-ca219f483219\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"
Sep 07 17:20:47.576316 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:47.576287    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/366901cd-b3a3-411b-9ed5-ca219f483219-dshm\") pod \"rate-test-model-3973bf-kserve-6cd76c6659-6rhmz\" (UID: \"366901cd-b3a3-411b-9ed5-ca219f483219\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"
Sep 07 17:20:47.576424 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:47.576314    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/366901cd-b3a3-411b-9ed5-ca219f483219-tls-certs\") pod \"rate-test-model-3973bf-kserve-6cd76c6659-6rhmz\" (UID: \"366901cd-b3a3-411b-9ed5-ca219f483219\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"
Sep 07 17:20:47.677971 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:47.677927    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/366901cd-b3a3-411b-9ed5-ca219f483219-tmp-dir\") pod \"rate-test-model-3973bf-kserve-6cd76c6659-6rhmz\" (UID: \"366901cd-b3a3-411b-9ed5-ca219f483219\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"
Sep 07 17:20:47.678170 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:47.678003    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/366901cd-b3a3-411b-9ed5-ca219f483219-dshm\") pod \"rate-test-model-3973bf-kserve-6cd76c6659-6rhmz\" (UID: \"366901cd-b3a3-411b-9ed5-ca219f483219\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"
Sep 07 17:20:47.678170 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:47.678024    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/366901cd-b3a3-411b-9ed5-ca219f483219-tls-certs\") pod \"rate-test-model-3973bf-kserve-6cd76c6659-6rhmz\" (UID: \"366901cd-b3a3-411b-9ed5-ca219f483219\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"
Sep 07 17:20:47.678170 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:47.678064    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/366901cd-b3a3-411b-9ed5-ca219f483219-model-cache\") pod \"rate-test-model-3973bf-kserve-6cd76c6659-6rhmz\" (UID: \"366901cd-b3a3-411b-9ed5-ca219f483219\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"
Sep 07 17:20:47.678170 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:47.678104    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/366901cd-b3a3-411b-9ed5-ca219f483219-home\") pod \"rate-test-model-3973bf-kserve-6cd76c6659-6rhmz\" (UID: \"366901cd-b3a3-411b-9ed5-ca219f483219\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"
Sep 07 17:20:47.678170 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:47.678126    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbfzj\" (UniqueName: \"kubernetes.io/projected/366901cd-b3a3-411b-9ed5-ca219f483219-kube-api-access-tbfzj\") pod \"rate-test-model-3973bf-kserve-6cd76c6659-6rhmz\" (UID: \"366901cd-b3a3-411b-9ed5-ca219f483219\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"
Sep 07 17:20:47.678520 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:47.678483    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/366901cd-b3a3-411b-9ed5-ca219f483219-home\") pod \"rate-test-model-3973bf-kserve-6cd76c6659-6rhmz\" (UID: \"366901cd-b3a3-411b-9ed5-ca219f483219\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"
Sep 07 17:20:47.678643 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:47.678521    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/366901cd-b3a3-411b-9ed5-ca219f483219-model-cache\") pod \"rate-test-model-3973bf-kserve-6cd76c6659-6rhmz\" (UID: \"366901cd-b3a3-411b-9ed5-ca219f483219\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"
Sep 07 17:20:47.678722 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:47.678633    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/366901cd-b3a3-411b-9ed5-ca219f483219-tmp-dir\") pod \"rate-test-model-3973bf-kserve-6cd76c6659-6rhmz\" (UID: \"366901cd-b3a3-411b-9ed5-ca219f483219\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"
Sep 07 17:20:47.680603 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:47.680583    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/366901cd-b3a3-411b-9ed5-ca219f483219-dshm\") pod \"rate-test-model-3973bf-kserve-6cd76c6659-6rhmz\" (UID: \"366901cd-b3a3-411b-9ed5-ca219f483219\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"
Sep 07 17:20:47.680697 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:47.680679    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/366901cd-b3a3-411b-9ed5-ca219f483219-tls-certs\") pod \"rate-test-model-3973bf-kserve-6cd76c6659-6rhmz\" (UID: \"366901cd-b3a3-411b-9ed5-ca219f483219\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"
Sep 07 17:20:47.689930 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:47.689879    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbfzj\" (UniqueName: \"kubernetes.io/projected/366901cd-b3a3-411b-9ed5-ca219f483219-kube-api-access-tbfzj\") pod \"rate-test-model-3973bf-kserve-6cd76c6659-6rhmz\" (UID: \"366901cd-b3a3-411b-9ed5-ca219f483219\") " pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"
Sep 07 17:20:47.845576 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:47.845541    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"
Sep 07 17:20:48.127550 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:48.127514    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"]
Sep 07 17:20:48.127739 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:20:48.127641    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod366901cd_b3a3_411b_9ed5_ca219f483219.slice/crio-bcf14b0bd2a050aeee9645364a906e28a9e9ecae9e38107cb5cde5ba52a61754 WatchSource:0}: Error finding container bcf14b0bd2a050aeee9645364a906e28a9e9ecae9e38107cb5cde5ba52a61754: Status 404 returned error can't find the container with id bcf14b0bd2a050aeee9645364a906e28a9e9ecae9e38107cb5cde5ba52a61754
Sep 07 17:20:48.513846 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:48.513757    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz" event={"ID":"366901cd-b3a3-411b-9ed5-ca219f483219","Type":"ContainerStarted","Data":"8165173c25c0b6d1793878a8b1c3aad49a10e6d2bfc9991425e899b8b40d3784"}
Sep 07 17:20:48.513846 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:48.513799    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz" event={"ID":"366901cd-b3a3-411b-9ed5-ca219f483219","Type":"ContainerStarted","Data":"bcf14b0bd2a050aeee9645364a906e28a9e9ecae9e38107cb5cde5ba52a61754"}
Sep 07 17:20:48.534543 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:48.534495    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz" podStartSLOduration=1.534480498 podStartE2EDuration="1.534480498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:20:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:20:48.532606753 +0000 UTC m=+1442.429454068" watchObservedRunningTime="2026-09-07 17:20:48.534480498 +0000 UTC m=+1442.431327815"
Sep 07 17:20:49.642578 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:49.642543    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:20:51.986243 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:51.986204    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:20:55.159671 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:55.159640    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:20:57.845751 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:57.845705    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"
Sep 07 17:20:57.846187 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:57.845768    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"
Sep 07 17:20:57.858424 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:57.858398    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"
Sep 07 17:20:58.580070 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:20:58.580040    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"
Sep 07 17:21:10.586660 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:10.586618    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj"]
Sep 07 17:21:10.587089 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:10.586865    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj" podUID="f6e56b5a-3279-4bf3-9d92-bf08a55ba22e" containerName="payload-pre-processing" containerID="cri-o://1e50233f7f9b35e64c8bff884a4cc995542a9826f21e655b1af6d71595707353" gracePeriod=30
Sep 07 17:21:10.845220 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:10.845154    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj"
Sep 07 17:21:10.923434 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:10.923408    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pllhf\" (UniqueName: \"kubernetes.io/projected/f6e56b5a-3279-4bf3-9d92-bf08a55ba22e-kube-api-access-pllhf\") pod \"f6e56b5a-3279-4bf3-9d92-bf08a55ba22e\" (UID: \"f6e56b5a-3279-4bf3-9d92-bf08a55ba22e\") "
Sep 07 17:21:10.923603 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:10.923450    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6e56b5a-3279-4bf3-9d92-bf08a55ba22e-plugins-config-volume\") pod \"f6e56b5a-3279-4bf3-9d92-bf08a55ba22e\" (UID: \"f6e56b5a-3279-4bf3-9d92-bf08a55ba22e\") "
Sep 07 17:21:10.923836 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:10.923810    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6e56b5a-3279-4bf3-9d92-bf08a55ba22e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f6e56b5a-3279-4bf3-9d92-bf08a55ba22e" (UID: "f6e56b5a-3279-4bf3-9d92-bf08a55ba22e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:21:10.925589 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:10.925553    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6e56b5a-3279-4bf3-9d92-bf08a55ba22e-kube-api-access-pllhf" (OuterVolumeSpecName: "kube-api-access-pllhf") pod "f6e56b5a-3279-4bf3-9d92-bf08a55ba22e" (UID: "f6e56b5a-3279-4bf3-9d92-bf08a55ba22e"). InnerVolumeSpecName "kube-api-access-pllhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:21:11.024498 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:11.024463    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pllhf\" (UniqueName: \"kubernetes.io/projected/f6e56b5a-3279-4bf3-9d92-bf08a55ba22e-kube-api-access-pllhf\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:21:11.024498 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:11.024493    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6e56b5a-3279-4bf3-9d92-bf08a55ba22e-plugins-config-volume\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:21:11.306776 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:11.306740    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:11.408500 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:11.408460    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:11.643014 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:11.642917    2575 generic.go:356] "Generic (PLEG): container finished" podID="f6e56b5a-3279-4bf3-9d92-bf08a55ba22e" containerID="1e50233f7f9b35e64c8bff884a4cc995542a9826f21e655b1af6d71595707353" exitCode=0
Sep 07 17:21:11.643014 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:11.642959    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj"
Sep 07 17:21:11.643014 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:11.642990    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj" event={"ID":"f6e56b5a-3279-4bf3-9d92-bf08a55ba22e","Type":"ContainerDied","Data":"1e50233f7f9b35e64c8bff884a4cc995542a9826f21e655b1af6d71595707353"}
Sep 07 17:21:11.643522 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:11.643046    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj" event={"ID":"f6e56b5a-3279-4bf3-9d92-bf08a55ba22e","Type":"ContainerDied","Data":"584149d87caa4a73a08dd3bfeb6061d1b818418828d6c6e869286142f60b9213"}
Sep 07 17:21:11.643522 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:11.643078    2575 scope.go:117] "RemoveContainer" containerID="1e50233f7f9b35e64c8bff884a4cc995542a9826f21e655b1af6d71595707353"
Sep 07 17:21:11.652504 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:11.652485    2575 scope.go:117] "RemoveContainer" containerID="1e50233f7f9b35e64c8bff884a4cc995542a9826f21e655b1af6d71595707353"
Sep 07 17:21:11.652821 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:21:11.652802    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e50233f7f9b35e64c8bff884a4cc995542a9826f21e655b1af6d71595707353\": container with ID starting with 1e50233f7f9b35e64c8bff884a4cc995542a9826f21e655b1af6d71595707353 not found: ID does not exist" containerID="1e50233f7f9b35e64c8bff884a4cc995542a9826f21e655b1af6d71595707353"
Sep 07 17:21:11.652875 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:11.652831    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e50233f7f9b35e64c8bff884a4cc995542a9826f21e655b1af6d71595707353"} err="failed to get container status \"1e50233f7f9b35e64c8bff884a4cc995542a9826f21e655b1af6d71595707353\": rpc error: code = NotFound desc = could not find container \"1e50233f7f9b35e64c8bff884a4cc995542a9826f21e655b1af6d71595707353\": container with ID starting with 1e50233f7f9b35e64c8bff884a4cc995542a9826f21e655b1af6d71595707353 not found: ID does not exist"
Sep 07 17:21:11.666285 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:11.666263    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj"]
Sep 07 17:21:11.670559 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:11.670529    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj"]
Sep 07 17:21:12.723407 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:12.723372    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6e56b5a-3279-4bf3-9d92-bf08a55ba22e" path="/var/lib/kubelet/pods/f6e56b5a-3279-4bf3-9d92-bf08a55ba22e/volumes"
Sep 07 17:21:12.878994 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:12.878959    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:14.919276 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:14.919239    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:17.737665 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:17.737631    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:17.848812 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:17.848772    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:18.004042 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:18.003963    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:18.541392 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:18.541350    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:34.063615 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.063584    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd"]
Sep 07 17:21:34.064041 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.063774    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd" podUID="159a5322-a120-457c-8e46-3e57c45f603a" containerName="maas-api" containerID="cri-o://0a6e3e29960cc497ca6dc75a1f70ed2479eab1e322aa1bb1ab76dd66b597ea63" gracePeriod=30
Sep 07 17:21:34.087785 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.087754    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:34.130351 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.130320    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-611042-b989f997-k6lrt"]
Sep 07 17:21:34.130573 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.130549    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-611042-b989f997-k6lrt" podUID="519ae34b-3ffc-4d10-9fd5-1395bd415fc4" containerName="payload-processing" containerID="cri-o://03a7c10932d43a28c1113a7e06eb424a87cc275c764bd0aba6c9553012179d7a" gracePeriod=30
Sep 07 17:21:34.135403 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.135378    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr"]
Sep 07 17:21:34.135575 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.135556    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr" podUID="f4b0356b-b031-4040-993a-167e2d9b930f" containerName="payload-pre-processing" containerID="cri-o://a4d4714bddcc4e4dace1bfc54e3d755d336bf84116f5144650c6bc98ba2a6a96" gracePeriod=30
Sep 07 17:21:34.181090 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.181052    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:34.262937 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.262870    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:34.351347 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.351275    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:34.414003 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.413976    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd"
Sep 07 17:21:34.420685 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.420659    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-611042-b989f997-k6lrt"
Sep 07 17:21:34.428187 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.428160    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:34.430310 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.430293    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr"
Sep 07 17:21:34.551537 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.551507    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52cf5\" (UniqueName: \"kubernetes.io/projected/f4b0356b-b031-4040-993a-167e2d9b930f-kube-api-access-52cf5\") pod \"f4b0356b-b031-4040-993a-167e2d9b930f\" (UID: \"f4b0356b-b031-4040-993a-167e2d9b930f\") "
Sep 07 17:21:34.551713 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.551618    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/519ae34b-3ffc-4d10-9fd5-1395bd415fc4-plugins-config-volume\") pod \"519ae34b-3ffc-4d10-9fd5-1395bd415fc4\" (UID: \"519ae34b-3ffc-4d10-9fd5-1395bd415fc4\") "
Sep 07 17:21:34.551713 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.551642    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcw5b\" (UniqueName: \"kubernetes.io/projected/159a5322-a120-457c-8e46-3e57c45f603a-kube-api-access-xcw5b\") pod \"159a5322-a120-457c-8e46-3e57c45f603a\" (UID: \"159a5322-a120-457c-8e46-3e57c45f603a\") "
Sep 07 17:21:34.551713 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.551682    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/159a5322-a120-457c-8e46-3e57c45f603a-maas-api-tls\") pod \"159a5322-a120-457c-8e46-3e57c45f603a\" (UID: \"159a5322-a120-457c-8e46-3e57c45f603a\") "
Sep 07 17:21:34.551843 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.551722    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkstl\" (UniqueName: \"kubernetes.io/projected/519ae34b-3ffc-4d10-9fd5-1395bd415fc4-kube-api-access-kkstl\") pod \"519ae34b-3ffc-4d10-9fd5-1395bd415fc4\" (UID: \"519ae34b-3ffc-4d10-9fd5-1395bd415fc4\") "
Sep 07 17:21:34.551843 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.551754    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4b0356b-b031-4040-993a-167e2d9b930f-plugins-config-volume\") pod \"f4b0356b-b031-4040-993a-167e2d9b930f\" (UID: \"f4b0356b-b031-4040-993a-167e2d9b930f\") "
Sep 07 17:21:34.552000 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.551858    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/159a5322-a120-457c-8e46-3e57c45f603a-metrics-certs\") pod \"159a5322-a120-457c-8e46-3e57c45f603a\" (UID: \"159a5322-a120-457c-8e46-3e57c45f603a\") "
Sep 07 17:21:34.552000 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.551950    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/159a5322-a120-457c-8e46-3e57c45f603a-openshift-service-ca\") pod \"159a5322-a120-457c-8e46-3e57c45f603a\" (UID: \"159a5322-a120-457c-8e46-3e57c45f603a\") "
Sep 07 17:21:34.552128 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.552097    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/519ae34b-3ffc-4d10-9fd5-1395bd415fc4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "519ae34b-3ffc-4d10-9fd5-1395bd415fc4" (UID: "519ae34b-3ffc-4d10-9fd5-1395bd415fc4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:21:34.552203 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.552134    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4b0356b-b031-4040-993a-167e2d9b930f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f4b0356b-b031-4040-993a-167e2d9b930f" (UID: "f4b0356b-b031-4040-993a-167e2d9b930f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:21:34.552492 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.552464    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/159a5322-a120-457c-8e46-3e57c45f603a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "159a5322-a120-457c-8e46-3e57c45f603a" (UID: "159a5322-a120-457c-8e46-3e57c45f603a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:21:34.552623 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.552564    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/519ae34b-3ffc-4d10-9fd5-1395bd415fc4-plugins-config-volume\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:21:34.552623 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.552585    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4b0356b-b031-4040-993a-167e2d9b930f-plugins-config-volume\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:21:34.553939 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.553910    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/159a5322-a120-457c-8e46-3e57c45f603a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "159a5322-a120-457c-8e46-3e57c45f603a" (UID: "159a5322-a120-457c-8e46-3e57c45f603a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:21:34.554064 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.553993    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/519ae34b-3ffc-4d10-9fd5-1395bd415fc4-kube-api-access-kkstl" (OuterVolumeSpecName: "kube-api-access-kkstl") pod "519ae34b-3ffc-4d10-9fd5-1395bd415fc4" (UID: "519ae34b-3ffc-4d10-9fd5-1395bd415fc4"). InnerVolumeSpecName "kube-api-access-kkstl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:21:34.554128 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.554074    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/159a5322-a120-457c-8e46-3e57c45f603a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "159a5322-a120-457c-8e46-3e57c45f603a" (UID: "159a5322-a120-457c-8e46-3e57c45f603a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:21:34.554288 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.554269    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/159a5322-a120-457c-8e46-3e57c45f603a-kube-api-access-xcw5b" (OuterVolumeSpecName: "kube-api-access-xcw5b") pod "159a5322-a120-457c-8e46-3e57c45f603a" (UID: "159a5322-a120-457c-8e46-3e57c45f603a"). InnerVolumeSpecName "kube-api-access-xcw5b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:21:34.554288 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.554280    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4b0356b-b031-4040-993a-167e2d9b930f-kube-api-access-52cf5" (OuterVolumeSpecName: "kube-api-access-52cf5") pod "f4b0356b-b031-4040-993a-167e2d9b930f" (UID: "f4b0356b-b031-4040-993a-167e2d9b930f"). InnerVolumeSpecName "kube-api-access-52cf5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:21:34.653848 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.653761    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcw5b\" (UniqueName: \"kubernetes.io/projected/159a5322-a120-457c-8e46-3e57c45f603a-kube-api-access-xcw5b\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:21:34.653848 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.653796    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/159a5322-a120-457c-8e46-3e57c45f603a-maas-api-tls\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:21:34.653848 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.653805    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkstl\" (UniqueName: \"kubernetes.io/projected/519ae34b-3ffc-4d10-9fd5-1395bd415fc4-kube-api-access-kkstl\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:21:34.653848 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.653814    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/159a5322-a120-457c-8e46-3e57c45f603a-metrics-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:21:34.653848 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.653823    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/159a5322-a120-457c-8e46-3e57c45f603a-openshift-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:21:34.653848 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.653831    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52cf5\" (UniqueName: \"kubernetes.io/projected/f4b0356b-b031-4040-993a-167e2d9b930f-kube-api-access-52cf5\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:21:34.685173 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.685136    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:34.769466 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.769431    2575 generic.go:356] "Generic (PLEG): container finished" podID="159a5322-a120-457c-8e46-3e57c45f603a" containerID="0a6e3e29960cc497ca6dc75a1f70ed2479eab1e322aa1bb1ab76dd66b597ea63" exitCode=0
Sep 07 17:21:34.769579 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.769477    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd"
Sep 07 17:21:34.769579 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.769513    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd" event={"ID":"159a5322-a120-457c-8e46-3e57c45f603a","Type":"ContainerDied","Data":"0a6e3e29960cc497ca6dc75a1f70ed2479eab1e322aa1bb1ab76dd66b597ea63"}
Sep 07 17:21:34.769579 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.769568    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd" event={"ID":"159a5322-a120-457c-8e46-3e57c45f603a","Type":"ContainerDied","Data":"f76ed61808d3799894923a40896629c555caa5182f560e93fc05e937070b0949"}
Sep 07 17:21:34.769722 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.769597    2575 scope.go:117] "RemoveContainer" containerID="0a6e3e29960cc497ca6dc75a1f70ed2479eab1e322aa1bb1ab76dd66b597ea63"
Sep 07 17:21:34.771123 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.771098    2575 generic.go:356] "Generic (PLEG): container finished" podID="519ae34b-3ffc-4d10-9fd5-1395bd415fc4" containerID="03a7c10932d43a28c1113a7e06eb424a87cc275c764bd0aba6c9553012179d7a" exitCode=0
Sep 07 17:21:34.771255 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.771174    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-611042-b989f997-k6lrt"
Sep 07 17:21:34.771255 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.771189    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-611042-b989f997-k6lrt" event={"ID":"519ae34b-3ffc-4d10-9fd5-1395bd415fc4","Type":"ContainerDied","Data":"03a7c10932d43a28c1113a7e06eb424a87cc275c764bd0aba6c9553012179d7a"}
Sep 07 17:21:34.771255 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.771242    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-611042-b989f997-k6lrt" event={"ID":"519ae34b-3ffc-4d10-9fd5-1395bd415fc4","Type":"ContainerDied","Data":"9a8948d9e21d8490f685f6821e51ad1aa2a2695981a0df939a24e5c618c55834"}
Sep 07 17:21:34.772857 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.772757    2575 generic.go:356] "Generic (PLEG): container finished" podID="f4b0356b-b031-4040-993a-167e2d9b930f" containerID="a4d4714bddcc4e4dace1bfc54e3d755d336bf84116f5144650c6bc98ba2a6a96" exitCode=0
Sep 07 17:21:34.772857 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.772782    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr" event={"ID":"f4b0356b-b031-4040-993a-167e2d9b930f","Type":"ContainerDied","Data":"a4d4714bddcc4e4dace1bfc54e3d755d336bf84116f5144650c6bc98ba2a6a96"}
Sep 07 17:21:34.772857 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.772820    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr"
Sep 07 17:21:34.772857 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.772832    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr" event={"ID":"f4b0356b-b031-4040-993a-167e2d9b930f","Type":"ContainerDied","Data":"e946e2e83cb3a6241ce685c4f0fbd3ec692772556def6d0e031ffd12257ed0fc"}
Sep 07 17:21:34.780169 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.780156    2575 scope.go:117] "RemoveContainer" containerID="0a6e3e29960cc497ca6dc75a1f70ed2479eab1e322aa1bb1ab76dd66b597ea63"
Sep 07 17:21:34.780437 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:21:34.780417    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a6e3e29960cc497ca6dc75a1f70ed2479eab1e322aa1bb1ab76dd66b597ea63\": container with ID starting with 0a6e3e29960cc497ca6dc75a1f70ed2479eab1e322aa1bb1ab76dd66b597ea63 not found: ID does not exist" containerID="0a6e3e29960cc497ca6dc75a1f70ed2479eab1e322aa1bb1ab76dd66b597ea63"
Sep 07 17:21:34.780490 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.780445    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a6e3e29960cc497ca6dc75a1f70ed2479eab1e322aa1bb1ab76dd66b597ea63"} err="failed to get container status \"0a6e3e29960cc497ca6dc75a1f70ed2479eab1e322aa1bb1ab76dd66b597ea63\": rpc error: code = NotFound desc = could not find container \"0a6e3e29960cc497ca6dc75a1f70ed2479eab1e322aa1bb1ab76dd66b597ea63\": container with ID starting with 0a6e3e29960cc497ca6dc75a1f70ed2479eab1e322aa1bb1ab76dd66b597ea63 not found: ID does not exist"
Sep 07 17:21:34.780490 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.780460    2575 scope.go:117] "RemoveContainer" containerID="03a7c10932d43a28c1113a7e06eb424a87cc275c764bd0aba6c9553012179d7a"
Sep 07 17:21:34.788204 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.788189    2575 scope.go:117] "RemoveContainer" containerID="03a7c10932d43a28c1113a7e06eb424a87cc275c764bd0aba6c9553012179d7a"
Sep 07 17:21:34.788453 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:21:34.788435    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03a7c10932d43a28c1113a7e06eb424a87cc275c764bd0aba6c9553012179d7a\": container with ID starting with 03a7c10932d43a28c1113a7e06eb424a87cc275c764bd0aba6c9553012179d7a not found: ID does not exist" containerID="03a7c10932d43a28c1113a7e06eb424a87cc275c764bd0aba6c9553012179d7a"
Sep 07 17:21:34.788517 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.788459    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03a7c10932d43a28c1113a7e06eb424a87cc275c764bd0aba6c9553012179d7a"} err="failed to get container status \"03a7c10932d43a28c1113a7e06eb424a87cc275c764bd0aba6c9553012179d7a\": rpc error: code = NotFound desc = could not find container \"03a7c10932d43a28c1113a7e06eb424a87cc275c764bd0aba6c9553012179d7a\": container with ID starting with 03a7c10932d43a28c1113a7e06eb424a87cc275c764bd0aba6c9553012179d7a not found: ID does not exist"
Sep 07 17:21:34.788517 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.788480    2575 scope.go:117] "RemoveContainer" containerID="a4d4714bddcc4e4dace1bfc54e3d755d336bf84116f5144650c6bc98ba2a6a96"
Sep 07 17:21:34.796348 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.796330    2575 scope.go:117] "RemoveContainer" containerID="a4d4714bddcc4e4dace1bfc54e3d755d336bf84116f5144650c6bc98ba2a6a96"
Sep 07 17:21:34.796625 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:21:34.796605    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4d4714bddcc4e4dace1bfc54e3d755d336bf84116f5144650c6bc98ba2a6a96\": container with ID starting with a4d4714bddcc4e4dace1bfc54e3d755d336bf84116f5144650c6bc98ba2a6a96 not found: ID does not exist" containerID="a4d4714bddcc4e4dace1bfc54e3d755d336bf84116f5144650c6bc98ba2a6a96"
Sep 07 17:21:34.796687 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.796638    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4d4714bddcc4e4dace1bfc54e3d755d336bf84116f5144650c6bc98ba2a6a96"} err="failed to get container status \"a4d4714bddcc4e4dace1bfc54e3d755d336bf84116f5144650c6bc98ba2a6a96\": rpc error: code = NotFound desc = could not find container \"a4d4714bddcc4e4dace1bfc54e3d755d336bf84116f5144650c6bc98ba2a6a96\": container with ID starting with a4d4714bddcc4e4dace1bfc54e3d755d336bf84116f5144650c6bc98ba2a6a96 not found: ID does not exist"
Sep 07 17:21:34.798545 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.798527    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr"]
Sep 07 17:21:34.807264 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.807243    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr"]
Sep 07 17:21:34.820086 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.820063    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd"]
Sep 07 17:21:34.826505 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.826479    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-611042-5ff4c8d889-zvlmd"]
Sep 07 17:21:34.843193 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.843160    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-611042-b989f997-k6lrt"]
Sep 07 17:21:34.845844 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:34.845822    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-611042-b989f997-k6lrt"]
Sep 07 17:21:35.848315 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:35.848278    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:36.724135 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:36.724103    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="159a5322-a120-457c-8e46-3e57c45f603a" path="/var/lib/kubelet/pods/159a5322-a120-457c-8e46-3e57c45f603a/volumes"
Sep 07 17:21:36.724513 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:36.724499    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="519ae34b-3ffc-4d10-9fd5-1395bd415fc4" path="/var/lib/kubelet/pods/519ae34b-3ffc-4d10-9fd5-1395bd415fc4/volumes"
Sep 07 17:21:36.724821 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:36.724810    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4b0356b-b031-4040-993a-167e2d9b930f" path="/var/lib/kubelet/pods/f4b0356b-b031-4040-993a-167e2d9b930f/volumes"
Sep 07 17:21:41.063326 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:41.063286    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:41.161363 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:41.161322    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:41.328289 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:41.328193    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:41.953145 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:41.953113    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:45.741761 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:45.741718    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:45.838842 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:45.838807    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:52.278415 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.278372    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk"]
Sep 07 17:21:52.278882 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.278634    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk" podUID="f38d18c5-8a88-4820-b1e7-a2dd28e1e902" containerName="maas-api" containerID="cri-o://b07c2e6b2f011398c1d7dc87f900a15754a606b962ffd66394f8c16db16daaba" gracePeriod=30
Sep 07 17:21:52.307489 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.307459    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:52.339720 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.339687    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5"]
Sep 07 17:21:52.339953 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.339912    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5" podUID="7277260b-4d5d-43c4-874d-fd93747a8e91" containerName="payload-pre-processing" containerID="cri-o://0956347a7ec385365804f9f5871e8d158b486ed5d33ff2809e176fe98b423d1a" gracePeriod=30
Sep 07 17:21:52.383151 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.383110    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:52.481298 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.481259    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:52.582170 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.582134    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:52.596399 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.596377    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk"
Sep 07 17:21:52.619856 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.619832    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5"
Sep 07 17:21:52.630841 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.630817    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f38d18c5-8a88-4820-b1e7-a2dd28e1e902-maas-api-tls\") pod \"f38d18c5-8a88-4820-b1e7-a2dd28e1e902\" (UID: \"f38d18c5-8a88-4820-b1e7-a2dd28e1e902\") "
Sep 07 17:21:52.630997 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.630849    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f38d18c5-8a88-4820-b1e7-a2dd28e1e902-metrics-certs\") pod \"f38d18c5-8a88-4820-b1e7-a2dd28e1e902\" (UID: \"f38d18c5-8a88-4820-b1e7-a2dd28e1e902\") "
Sep 07 17:21:52.630997 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.630869    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8459\" (UniqueName: \"kubernetes.io/projected/f38d18c5-8a88-4820-b1e7-a2dd28e1e902-kube-api-access-v8459\") pod \"f38d18c5-8a88-4820-b1e7-a2dd28e1e902\" (UID: \"f38d18c5-8a88-4820-b1e7-a2dd28e1e902\") "
Sep 07 17:21:52.630997 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.630953    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x52jc\" (UniqueName: \"kubernetes.io/projected/7277260b-4d5d-43c4-874d-fd93747a8e91-kube-api-access-x52jc\") pod \"7277260b-4d5d-43c4-874d-fd93747a8e91\" (UID: \"7277260b-4d5d-43c4-874d-fd93747a8e91\") "
Sep 07 17:21:52.631171 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.631028    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7277260b-4d5d-43c4-874d-fd93747a8e91-plugins-config-volume\") pod \"7277260b-4d5d-43c4-874d-fd93747a8e91\" (UID: \"7277260b-4d5d-43c4-874d-fd93747a8e91\") "
Sep 07 17:21:52.631171 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.631113    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f38d18c5-8a88-4820-b1e7-a2dd28e1e902-openshift-service-ca\") pod \"f38d18c5-8a88-4820-b1e7-a2dd28e1e902\" (UID: \"f38d18c5-8a88-4820-b1e7-a2dd28e1e902\") "
Sep 07 17:21:52.631506 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.631469    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7277260b-4d5d-43c4-874d-fd93747a8e91-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7277260b-4d5d-43c4-874d-fd93747a8e91" (UID: "7277260b-4d5d-43c4-874d-fd93747a8e91"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:21:52.631754 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.631724    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f38d18c5-8a88-4820-b1e7-a2dd28e1e902-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f38d18c5-8a88-4820-b1e7-a2dd28e1e902" (UID: "f38d18c5-8a88-4820-b1e7-a2dd28e1e902"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:21:52.633138 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.633102    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f38d18c5-8a88-4820-b1e7-a2dd28e1e902-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f38d18c5-8a88-4820-b1e7-a2dd28e1e902" (UID: "f38d18c5-8a88-4820-b1e7-a2dd28e1e902"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:21:52.633250 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.633136    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f38d18c5-8a88-4820-b1e7-a2dd28e1e902-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f38d18c5-8a88-4820-b1e7-a2dd28e1e902" (UID: "f38d18c5-8a88-4820-b1e7-a2dd28e1e902"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:21:52.633250 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.633148    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f38d18c5-8a88-4820-b1e7-a2dd28e1e902-kube-api-access-v8459" (OuterVolumeSpecName: "kube-api-access-v8459") pod "f38d18c5-8a88-4820-b1e7-a2dd28e1e902" (UID: "f38d18c5-8a88-4820-b1e7-a2dd28e1e902"). InnerVolumeSpecName "kube-api-access-v8459". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:21:52.633567 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.633543    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7277260b-4d5d-43c4-874d-fd93747a8e91-kube-api-access-x52jc" (OuterVolumeSpecName: "kube-api-access-x52jc") pod "7277260b-4d5d-43c4-874d-fd93747a8e91" (UID: "7277260b-4d5d-43c4-874d-fd93747a8e91"). InnerVolumeSpecName "kube-api-access-x52jc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:21:52.732067 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.732030    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f38d18c5-8a88-4820-b1e7-a2dd28e1e902-openshift-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:21:52.732067 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.732067    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f38d18c5-8a88-4820-b1e7-a2dd28e1e902-maas-api-tls\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:21:52.732276 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.732080    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f38d18c5-8a88-4820-b1e7-a2dd28e1e902-metrics-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:21:52.732276 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.732092    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8459\" (UniqueName: \"kubernetes.io/projected/f38d18c5-8a88-4820-b1e7-a2dd28e1e902-kube-api-access-v8459\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:21:52.732276 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.732105    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x52jc\" (UniqueName: \"kubernetes.io/projected/7277260b-4d5d-43c4-874d-fd93747a8e91-kube-api-access-x52jc\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:21:52.732276 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.732117    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7277260b-4d5d-43c4-874d-fd93747a8e91-plugins-config-volume\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:21:52.865844 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.865746    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:52.875487 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.875454    2575 generic.go:356] "Generic (PLEG): container finished" podID="f38d18c5-8a88-4820-b1e7-a2dd28e1e902" containerID="b07c2e6b2f011398c1d7dc87f900a15754a606b962ffd66394f8c16db16daaba" exitCode=0
Sep 07 17:21:52.875664 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.875499    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk" event={"ID":"f38d18c5-8a88-4820-b1e7-a2dd28e1e902","Type":"ContainerDied","Data":"b07c2e6b2f011398c1d7dc87f900a15754a606b962ffd66394f8c16db16daaba"}
Sep 07 17:21:52.875664 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.875518    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk"
Sep 07 17:21:52.875664 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.875558    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk" event={"ID":"f38d18c5-8a88-4820-b1e7-a2dd28e1e902","Type":"ContainerDied","Data":"6c7b4c78184e90d6ebf8db56057981359d2377ff734068870d975f728d21fd78"}
Sep 07 17:21:52.875664 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.875583    2575 scope.go:117] "RemoveContainer" containerID="b07c2e6b2f011398c1d7dc87f900a15754a606b962ffd66394f8c16db16daaba"
Sep 07 17:21:52.877201 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.877177    2575 generic.go:356] "Generic (PLEG): container finished" podID="7277260b-4d5d-43c4-874d-fd93747a8e91" containerID="0956347a7ec385365804f9f5871e8d158b486ed5d33ff2809e176fe98b423d1a" exitCode=0
Sep 07 17:21:52.877329 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.877238    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5"
Sep 07 17:21:52.877329 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.877242    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5" event={"ID":"7277260b-4d5d-43c4-874d-fd93747a8e91","Type":"ContainerDied","Data":"0956347a7ec385365804f9f5871e8d158b486ed5d33ff2809e176fe98b423d1a"}
Sep 07 17:21:52.877329 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.877302    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5" event={"ID":"7277260b-4d5d-43c4-874d-fd93747a8e91","Type":"ContainerDied","Data":"dd573111c5cfc0db1abe1b3bb70a80de77f56e87ff9ad2201cb20ac1cbccaa38"}
Sep 07 17:21:52.887170 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.887151    2575 scope.go:117] "RemoveContainer" containerID="b07c2e6b2f011398c1d7dc87f900a15754a606b962ffd66394f8c16db16daaba"
Sep 07 17:21:52.887492 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:21:52.887467    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b07c2e6b2f011398c1d7dc87f900a15754a606b962ffd66394f8c16db16daaba\": container with ID starting with b07c2e6b2f011398c1d7dc87f900a15754a606b962ffd66394f8c16db16daaba not found: ID does not exist" containerID="b07c2e6b2f011398c1d7dc87f900a15754a606b962ffd66394f8c16db16daaba"
Sep 07 17:21:52.887545 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.887492    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b07c2e6b2f011398c1d7dc87f900a15754a606b962ffd66394f8c16db16daaba"} err="failed to get container status \"b07c2e6b2f011398c1d7dc87f900a15754a606b962ffd66394f8c16db16daaba\": rpc error: code = NotFound desc = could not find container \"b07c2e6b2f011398c1d7dc87f900a15754a606b962ffd66394f8c16db16daaba\": container with ID starting with b07c2e6b2f011398c1d7dc87f900a15754a606b962ffd66394f8c16db16daaba not found: ID does not exist"
Sep 07 17:21:52.887545 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.887508    2575 scope.go:117] "RemoveContainer" containerID="0956347a7ec385365804f9f5871e8d158b486ed5d33ff2809e176fe98b423d1a"
Sep 07 17:21:52.897371 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.897347    2575 scope.go:117] "RemoveContainer" containerID="0956347a7ec385365804f9f5871e8d158b486ed5d33ff2809e176fe98b423d1a"
Sep 07 17:21:52.897667 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:21:52.897645    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0956347a7ec385365804f9f5871e8d158b486ed5d33ff2809e176fe98b423d1a\": container with ID starting with 0956347a7ec385365804f9f5871e8d158b486ed5d33ff2809e176fe98b423d1a not found: ID does not exist" containerID="0956347a7ec385365804f9f5871e8d158b486ed5d33ff2809e176fe98b423d1a"
Sep 07 17:21:52.897731 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.897679    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0956347a7ec385365804f9f5871e8d158b486ed5d33ff2809e176fe98b423d1a"} err="failed to get container status \"0956347a7ec385365804f9f5871e8d158b486ed5d33ff2809e176fe98b423d1a\": rpc error: code = NotFound desc = could not find container \"0956347a7ec385365804f9f5871e8d158b486ed5d33ff2809e176fe98b423d1a\": container with ID starting with 0956347a7ec385365804f9f5871e8d158b486ed5d33ff2809e176fe98b423d1a not found: ID does not exist"
Sep 07 17:21:52.897984 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.897965    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5"]
Sep 07 17:21:52.903320 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.903296    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5"]
Sep 07 17:21:52.916435 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.916407    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk"]
Sep 07 17:21:52.919224 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:52.919204    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-202015-78b48ccf69-lpkrk"]
Sep 07 17:21:54.113041 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:54.113007    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:54.723182 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:54.723152    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7277260b-4d5d-43c4-874d-fd93747a8e91" path="/var/lib/kubelet/pods/7277260b-4d5d-43c4-874d-fd93747a8e91/volumes"
Sep 07 17:21:54.723568 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:54.723554    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f38d18c5-8a88-4820-b1e7-a2dd28e1e902" path="/var/lib/kubelet/pods/f38d18c5-8a88-4820-b1e7-a2dd28e1e902/volumes"
Sep 07 17:21:55.016692 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:55.016603    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"]
Sep 07 17:21:55.039113 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:55.039066    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:55.479498 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:55.479445    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:55.897160 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:55.897126    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:56.604752 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:56.604720    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:58.541560 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:58.541520    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:58.642791 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:58.642759    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:59.484179 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.484137    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:59.587955 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.587918    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:59.712837 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.712802    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p"]
Sep 07 17:21:59.713478 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.713450    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7277260b-4d5d-43c4-874d-fd93747a8e91" containerName="payload-pre-processing"
Sep 07 17:21:59.713478 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.713478    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7277260b-4d5d-43c4-874d-fd93747a8e91" containerName="payload-pre-processing"
Sep 07 17:21:59.713630 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.713490    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="159a5322-a120-457c-8e46-3e57c45f603a" containerName="maas-api"
Sep 07 17:21:59.713630 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.713496    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="159a5322-a120-457c-8e46-3e57c45f603a" containerName="maas-api"
Sep 07 17:21:59.713630 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.713506    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="519ae34b-3ffc-4d10-9fd5-1395bd415fc4" containerName="payload-processing"
Sep 07 17:21:59.713630 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.713512    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="519ae34b-3ffc-4d10-9fd5-1395bd415fc4" containerName="payload-processing"
Sep 07 17:21:59.713630 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.713524    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f38d18c5-8a88-4820-b1e7-a2dd28e1e902" containerName="maas-api"
Sep 07 17:21:59.713630 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.713529    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f38d18c5-8a88-4820-b1e7-a2dd28e1e902" containerName="maas-api"
Sep 07 17:21:59.713630 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.713535    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4b0356b-b031-4040-993a-167e2d9b930f" containerName="payload-pre-processing"
Sep 07 17:21:59.713630 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.713541    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4b0356b-b031-4040-993a-167e2d9b930f" containerName="payload-pre-processing"
Sep 07 17:21:59.713630 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.713559    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6e56b5a-3279-4bf3-9d92-bf08a55ba22e" containerName="payload-pre-processing"
Sep 07 17:21:59.713630 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.713564    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6e56b5a-3279-4bf3-9d92-bf08a55ba22e" containerName="payload-pre-processing"
Sep 07 17:21:59.713630 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.713629    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4b0356b-b031-4040-993a-167e2d9b930f" containerName="payload-pre-processing"
Sep 07 17:21:59.714000 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.713637    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f38d18c5-8a88-4820-b1e7-a2dd28e1e902" containerName="maas-api"
Sep 07 17:21:59.714000 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.713644    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="519ae34b-3ffc-4d10-9fd5-1395bd415fc4" containerName="payload-processing"
Sep 07 17:21:59.714000 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.713651    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6e56b5a-3279-4bf3-9d92-bf08a55ba22e" containerName="payload-pre-processing"
Sep 07 17:21:59.714000 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.713660    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7277260b-4d5d-43c4-874d-fd93747a8e91" containerName="payload-pre-processing"
Sep 07 17:21:59.714000 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.713665    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="159a5322-a120-457c-8e46-3e57c45f603a" containerName="maas-api"
Sep 07 17:21:59.717481 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.717455    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p"
Sep 07 17:21:59.720206 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.720184    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-9765ce-serving-cert\""
Sep 07 17:21:59.737154 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.737073    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p"]
Sep 07 17:21:59.777555 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.777520    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:59.803659 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.803629    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/564918a3-72ed-4c22-b9a2-0393dbb3b338-metrics-certs\") pod \"maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p\" (UID: \"564918a3-72ed-4c22-b9a2-0393dbb3b338\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p"
Sep 07 17:21:59.803806 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.803675    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/564918a3-72ed-4c22-b9a2-0393dbb3b338-maas-api-tls\") pod \"maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p\" (UID: \"564918a3-72ed-4c22-b9a2-0393dbb3b338\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p"
Sep 07 17:21:59.804173 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.804145    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfzfk\" (UniqueName: \"kubernetes.io/projected/564918a3-72ed-4c22-b9a2-0393dbb3b338-kube-api-access-jfzfk\") pod \"maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p\" (UID: \"564918a3-72ed-4c22-b9a2-0393dbb3b338\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p"
Sep 07 17:21:59.804295 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.804188    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/564918a3-72ed-4c22-b9a2-0393dbb3b338-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p\" (UID: \"564918a3-72ed-4c22-b9a2-0393dbb3b338\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p"
Sep 07 17:21:59.878441 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.878410    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:21:59.904933 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.904882    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfzfk\" (UniqueName: \"kubernetes.io/projected/564918a3-72ed-4c22-b9a2-0393dbb3b338-kube-api-access-jfzfk\") pod \"maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p\" (UID: \"564918a3-72ed-4c22-b9a2-0393dbb3b338\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p"
Sep 07 17:21:59.905073 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.904943    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/564918a3-72ed-4c22-b9a2-0393dbb3b338-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p\" (UID: \"564918a3-72ed-4c22-b9a2-0393dbb3b338\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p"
Sep 07 17:21:59.905073 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.904989    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/564918a3-72ed-4c22-b9a2-0393dbb3b338-metrics-certs\") pod \"maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p\" (UID: \"564918a3-72ed-4c22-b9a2-0393dbb3b338\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p"
Sep 07 17:21:59.905073 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.905011    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/564918a3-72ed-4c22-b9a2-0393dbb3b338-maas-api-tls\") pod \"maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p\" (UID: \"564918a3-72ed-4c22-b9a2-0393dbb3b338\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p"
Sep 07 17:21:59.905192 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:21:59.905148    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-serving-cert: secret "maas-api-e2e-ipp-a-9765ce-serving-cert" not found
Sep 07 17:21:59.905241 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:21:59.905199    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/564918a3-72ed-4c22-b9a2-0393dbb3b338-maas-api-tls podName:564918a3-72ed-4c22-b9a2-0393dbb3b338 nodeName:}" failed. No retries permitted until 2026-09-07 17:22:00.4051843 +0000 UTC m=+1514.302031593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/564918a3-72ed-4c22-b9a2-0393dbb3b338-maas-api-tls") pod "maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p" (UID: "564918a3-72ed-4c22-b9a2-0393dbb3b338") : secret "maas-api-e2e-ipp-a-9765ce-serving-cert" not found
Sep 07 17:21:59.905567 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.905546    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/564918a3-72ed-4c22-b9a2-0393dbb3b338-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p\" (UID: \"564918a3-72ed-4c22-b9a2-0393dbb3b338\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p"
Sep 07 17:21:59.907396 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.907375    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/564918a3-72ed-4c22-b9a2-0393dbb3b338-metrics-certs\") pod \"maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p\" (UID: \"564918a3-72ed-4c22-b9a2-0393dbb3b338\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p"
Sep 07 17:21:59.919323 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:21:59.919299    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfzfk\" (UniqueName: \"kubernetes.io/projected/564918a3-72ed-4c22-b9a2-0393dbb3b338-kube-api-access-jfzfk\") pod \"maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p\" (UID: \"564918a3-72ed-4c22-b9a2-0393dbb3b338\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p"
Sep 07 17:22:00.287196 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:00.287159    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:22:00.384929 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:00.384885    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2"]
Sep 07 17:22:00.388951 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:00.388926    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2"
Sep 07 17:22:00.392626 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:00.392602    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-9765ce\""
Sep 07 17:22:00.392763 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:00.392649    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-9765ce-dockercfg-z4qks\""
Sep 07 17:22:00.400800 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:00.400774    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2"]
Sep 07 17:22:00.409878 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:00.409749    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/564918a3-72ed-4c22-b9a2-0393dbb3b338-maas-api-tls\") pod \"maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p\" (UID: \"564918a3-72ed-4c22-b9a2-0393dbb3b338\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p"
Sep 07 17:22:00.412547 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:00.412515    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/564918a3-72ed-4c22-b9a2-0393dbb3b338-maas-api-tls\") pod \"maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p\" (UID: \"564918a3-72ed-4c22-b9a2-0393dbb3b338\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p"
Sep 07 17:22:00.416287 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:00.416265    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr"]
Sep 07 17:22:00.420416 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:00.420375    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr"
Sep 07 17:22:00.430417 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:00.430395    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr"]
Sep 07 17:22:00.510887 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:00.510852    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2\" (UID: \"ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2"
Sep 07 17:22:00.511063 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:00.510960    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtbkm\" (UniqueName: \"kubernetes.io/projected/eab3bfa9-e2fe-4750-92f8-80af5e1d2e95-kube-api-access-jtbkm\") pod \"payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr\" (UID: \"eab3bfa9-e2fe-4750-92f8-80af5e1d2e95\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr"
Sep 07 17:22:00.511063 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:00.511006    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eab3bfa9-e2fe-4750-92f8-80af5e1d2e95-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr\" (UID: \"eab3bfa9-e2fe-4750-92f8-80af5e1d2e95\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr"
Sep 07 17:22:00.511138 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:00.511084    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k5cq\" (UniqueName: \"kubernetes.io/projected/ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3-kube-api-access-9k5cq\") pod \"payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2\" (UID: \"ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2"
Sep 07 17:22:00.611730 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:00.611695    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtbkm\" (UniqueName: \"kubernetes.io/projected/eab3bfa9-e2fe-4750-92f8-80af5e1d2e95-kube-api-access-jtbkm\") pod \"payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr\" (UID: \"eab3bfa9-e2fe-4750-92f8-80af5e1d2e95\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr"
Sep 07 17:22:00.612117 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:00.611744    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eab3bfa9-e2fe-4750-92f8-80af5e1d2e95-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr\" (UID: \"eab3bfa9-e2fe-4750-92f8-80af5e1d2e95\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr"
Sep 07 17:22:00.612117 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:00.611822    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k5cq\" (UniqueName: \"kubernetes.io/projected/ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3-kube-api-access-9k5cq\") pod \"payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2\" (UID: \"ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2"
Sep 07 17:22:00.612117 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:00.611947    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2\" (UID: \"ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2"
Sep 07 17:22:00.612533 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:00.612512    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eab3bfa9-e2fe-4750-92f8-80af5e1d2e95-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr\" (UID: \"eab3bfa9-e2fe-4750-92f8-80af5e1d2e95\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr"
Sep 07 17:22:00.612596 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:00.612578    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2\" (UID: \"ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2"
Sep 07 17:22:00.620054 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:00.620031    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k5cq\" (UniqueName: \"kubernetes.io/projected/ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3-kube-api-access-9k5cq\") pod \"payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2\" (UID: \"ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2"
Sep 07 17:22:00.620216 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:00.620199    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtbkm\" (UniqueName: \"kubernetes.io/projected/eab3bfa9-e2fe-4750-92f8-80af5e1d2e95-kube-api-access-jtbkm\") pod \"payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr\" (UID: \"eab3bfa9-e2fe-4750-92f8-80af5e1d2e95\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr"
Sep 07 17:22:00.631666 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:00.631646    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p"
Sep 07 17:22:00.701632 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:00.701601    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2"
Sep 07 17:22:00.733299 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:00.733270    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr"
Sep 07 17:22:00.910539 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:00.910510    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p"]
Sep 07 17:22:00.911772 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:22:00.911745    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod564918a3_72ed_4c22_b9a2_0393dbb3b338.slice/crio-6aa49bc4e7579b5bd0a045341a0df8e571892513d774a28140d30679d0233ab7 WatchSource:0}: Error finding container 6aa49bc4e7579b5bd0a045341a0df8e571892513d774a28140d30679d0233ab7: Status 404 returned error can't find the container with id 6aa49bc4e7579b5bd0a045341a0df8e571892513d774a28140d30679d0233ab7
Sep 07 17:22:00.936657 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:00.936622    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p" event={"ID":"564918a3-72ed-4c22-b9a2-0393dbb3b338","Type":"ContainerStarted","Data":"6aa49bc4e7579b5bd0a045341a0df8e571892513d774a28140d30679d0233ab7"}
Sep 07 17:22:00.985678 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:00.985653    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2"]
Sep 07 17:22:00.986915 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:22:00.986852    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddbb5010_5aac_4ce6_b5dc_0dc8ae0fc5a3.slice/crio-e9609f52cebb3af5c4c537514e6268a9964103d34113ec43f969eca9445b335e WatchSource:0}: Error finding container e9609f52cebb3af5c4c537514e6268a9964103d34113ec43f969eca9445b335e: Status 404 returned error can't find the container with id e9609f52cebb3af5c4c537514e6268a9964103d34113ec43f969eca9445b335e
Sep 07 17:22:01.020940 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:01.020915    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr"]
Sep 07 17:22:01.031229 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:22:01.031195    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeab3bfa9_e2fe_4750_92f8_80af5e1d2e95.slice/crio-0350d0250c53f960a87defe832d0397049c4aae63557fec7ffafdefd52d96d53 WatchSource:0}: Error finding container 0350d0250c53f960a87defe832d0397049c4aae63557fec7ffafdefd52d96d53: Status 404 returned error can't find the container with id 0350d0250c53f960a87defe832d0397049c4aae63557fec7ffafdefd52d96d53
Sep 07 17:22:01.517016 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:01.516982    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:22:01.945794 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:01.945752    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr" event={"ID":"eab3bfa9-e2fe-4750-92f8-80af5e1d2e95","Type":"ContainerStarted","Data":"44c10e98ad2e60f9b6207fcb1f12e31127a3592600b3959cc2c8c9791351786d"}
Sep 07 17:22:01.946248 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:01.945815    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr" event={"ID":"eab3bfa9-e2fe-4750-92f8-80af5e1d2e95","Type":"ContainerStarted","Data":"0350d0250c53f960a87defe832d0397049c4aae63557fec7ffafdefd52d96d53"}
Sep 07 17:22:01.946248 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:01.945844    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr"
Sep 07 17:22:01.947436 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:01.947406    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2" event={"ID":"ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3","Type":"ContainerStarted","Data":"18d2667ddb0fcb911bbe21472e46b5b2a73b0133ed53871e16c9476541f98b11"}
Sep 07 17:22:01.947565 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:01.947463    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2" event={"ID":"ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3","Type":"ContainerStarted","Data":"e9609f52cebb3af5c4c537514e6268a9964103d34113ec43f969eca9445b335e"}
Sep 07 17:22:01.947565 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:01.947495    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2"
Sep 07 17:22:01.949092 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:01.949071    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p" event={"ID":"564918a3-72ed-4c22-b9a2-0393dbb3b338","Type":"ContainerStarted","Data":"38d232252637d231f0c0aa99c40d93080c07165cd9d0cb7431e15cda49f4f9b3"}
Sep 07 17:22:01.949213 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:01.949193    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p"
Sep 07 17:22:01.970561 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:01.970514    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr" podStartSLOduration=1.970498617 podStartE2EDuration="1.970498617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:22:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:22:01.9678385 +0000 UTC m=+1515.864685836" watchObservedRunningTime="2026-09-07 17:22:01.970498617 +0000 UTC m=+1515.867345931"
Sep 07 17:22:01.989714 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:01.989667    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p" podStartSLOduration=2.5473141740000003 podStartE2EDuration="2.989650605s" totalImagesPullingTime="442.336431ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:21:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:22:01.986837065 +0000 UTC m=+1515.883684394" watchObservedRunningTime="2026-09-07 17:22:01.989650605 +0000 UTC m=+1515.886497945"
Sep 07 17:22:02.017421 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:02.017368    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2" podStartSLOduration=2.017351914 podStartE2EDuration="2.017351914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:22:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:22:02.013933456 +0000 UTC m=+1515.910780769" watchObservedRunningTime="2026-09-07 17:22:02.017351914 +0000 UTC m=+1515.914199228"
Sep 07 17:22:07.959552 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:07.959520    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p"
Sep 07 17:22:10.036314 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:10.036216    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz" podUID="366901cd-b3a3-411b-9ed5-ca219f483219" containerName="main" containerID="cri-o://8165173c25c0b6d1793878a8b1c3aad49a10e6d2bfc9991425e899b8b40d3784" gracePeriod=45
Sep 07 17:22:10.252136 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:10.252085    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:22:10.293517 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:10.293494    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"
Sep 07 17:22:10.418813 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:10.418779    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/366901cd-b3a3-411b-9ed5-ca219f483219-tls-certs\") pod \"366901cd-b3a3-411b-9ed5-ca219f483219\" (UID: \"366901cd-b3a3-411b-9ed5-ca219f483219\") "
Sep 07 17:22:10.418986 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:10.418838    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/366901cd-b3a3-411b-9ed5-ca219f483219-dshm\") pod \"366901cd-b3a3-411b-9ed5-ca219f483219\" (UID: \"366901cd-b3a3-411b-9ed5-ca219f483219\") "
Sep 07 17:22:10.418986 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:10.418883    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/366901cd-b3a3-411b-9ed5-ca219f483219-home\") pod \"366901cd-b3a3-411b-9ed5-ca219f483219\" (UID: \"366901cd-b3a3-411b-9ed5-ca219f483219\") "
Sep 07 17:22:10.418986 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:10.418928    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbfzj\" (UniqueName: \"kubernetes.io/projected/366901cd-b3a3-411b-9ed5-ca219f483219-kube-api-access-tbfzj\") pod \"366901cd-b3a3-411b-9ed5-ca219f483219\" (UID: \"366901cd-b3a3-411b-9ed5-ca219f483219\") "
Sep 07 17:22:10.418986 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:10.418964    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/366901cd-b3a3-411b-9ed5-ca219f483219-model-cache\") pod \"366901cd-b3a3-411b-9ed5-ca219f483219\" (UID: \"366901cd-b3a3-411b-9ed5-ca219f483219\") "
Sep 07 17:22:10.419234 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:10.418993    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/366901cd-b3a3-411b-9ed5-ca219f483219-tmp-dir\") pod \"366901cd-b3a3-411b-9ed5-ca219f483219\" (UID: \"366901cd-b3a3-411b-9ed5-ca219f483219\") "
Sep 07 17:22:10.419289 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:10.419244    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/366901cd-b3a3-411b-9ed5-ca219f483219-model-cache" (OuterVolumeSpecName: "model-cache") pod "366901cd-b3a3-411b-9ed5-ca219f483219" (UID: "366901cd-b3a3-411b-9ed5-ca219f483219"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:22:10.419289 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:10.419256    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/366901cd-b3a3-411b-9ed5-ca219f483219-home" (OuterVolumeSpecName: "home") pod "366901cd-b3a3-411b-9ed5-ca219f483219" (UID: "366901cd-b3a3-411b-9ed5-ca219f483219"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:22:10.419289 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:10.419271    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/366901cd-b3a3-411b-9ed5-ca219f483219-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "366901cd-b3a3-411b-9ed5-ca219f483219" (UID: "366901cd-b3a3-411b-9ed5-ca219f483219"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:22:10.419445 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:10.419396    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/366901cd-b3a3-411b-9ed5-ca219f483219-home\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:22:10.419445 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:10.419415    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/366901cd-b3a3-411b-9ed5-ca219f483219-model-cache\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:22:10.419445 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:10.419431    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/366901cd-b3a3-411b-9ed5-ca219f483219-tmp-dir\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:22:10.421032 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:10.421009    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/366901cd-b3a3-411b-9ed5-ca219f483219-kube-api-access-tbfzj" (OuterVolumeSpecName: "kube-api-access-tbfzj") pod "366901cd-b3a3-411b-9ed5-ca219f483219" (UID: "366901cd-b3a3-411b-9ed5-ca219f483219"). InnerVolumeSpecName "kube-api-access-tbfzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:22:10.421443 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:10.421421    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/366901cd-b3a3-411b-9ed5-ca219f483219-dshm" (OuterVolumeSpecName: "dshm") pod "366901cd-b3a3-411b-9ed5-ca219f483219" (UID: "366901cd-b3a3-411b-9ed5-ca219f483219"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:22:10.421524 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:10.421423    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/366901cd-b3a3-411b-9ed5-ca219f483219-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "366901cd-b3a3-411b-9ed5-ca219f483219" (UID: "366901cd-b3a3-411b-9ed5-ca219f483219"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:22:10.520129 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:10.520098    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/366901cd-b3a3-411b-9ed5-ca219f483219-tls-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:22:10.520129 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:10.520124    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/366901cd-b3a3-411b-9ed5-ca219f483219-dshm\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:22:10.520129 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:10.520133    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbfzj\" (UniqueName: \"kubernetes.io/projected/366901cd-b3a3-411b-9ed5-ca219f483219-kube-api-access-tbfzj\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:22:10.959660 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:10.959614    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:22:11.011932 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.009609    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm"]
Sep 07 17:22:11.011932 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.010052    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm" podUID="a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e" containerName="payload-processing" containerID="cri-o://52d7588b81008fc75234cff09fc4f8f1f46c3046f5721e5783127e59c73a990b" gracePeriod=30
Sep 07 17:22:11.016009 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.013176    2575 generic.go:356] "Generic (PLEG): container finished" podID="366901cd-b3a3-411b-9ed5-ca219f483219" containerID="8165173c25c0b6d1793878a8b1c3aad49a10e6d2bfc9991425e899b8b40d3784" exitCode=0
Sep 07 17:22:11.016009 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.013330    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz" event={"ID":"366901cd-b3a3-411b-9ed5-ca219f483219","Type":"ContainerDied","Data":"8165173c25c0b6d1793878a8b1c3aad49a10e6d2bfc9991425e899b8b40d3784"}
Sep 07 17:22:11.016009 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.013382    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz" event={"ID":"366901cd-b3a3-411b-9ed5-ca219f483219","Type":"ContainerDied","Data":"bcf14b0bd2a050aeee9645364a906e28a9e9ecae9e38107cb5cde5ba52a61754"}
Sep 07 17:22:11.016009 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.013509    2575 scope.go:117] "RemoveContainer" containerID="8165173c25c0b6d1793878a8b1c3aad49a10e6d2bfc9991425e899b8b40d3784"
Sep 07 17:22:11.016009 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.014089    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"
Sep 07 17:22:11.019962 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.018959    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv"]
Sep 07 17:22:11.020370 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.020252    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv" podUID="f0bedc9f-8728-495a-8ff2-0b7714fe21fe" containerName="payload-pre-processing" containerID="cri-o://fdb3575e22d9c9ff37e8329386e0417f6871b937af6a00df2748b89496169317" gracePeriod=30
Sep 07 17:22:11.037532 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.037325    2575 scope.go:117] "RemoveContainer" containerID="8165173c25c0b6d1793878a8b1c3aad49a10e6d2bfc9991425e899b8b40d3784"
Sep 07 17:22:11.038398 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:22:11.038326    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8165173c25c0b6d1793878a8b1c3aad49a10e6d2bfc9991425e899b8b40d3784\": container with ID starting with 8165173c25c0b6d1793878a8b1c3aad49a10e6d2bfc9991425e899b8b40d3784 not found: ID does not exist" containerID="8165173c25c0b6d1793878a8b1c3aad49a10e6d2bfc9991425e899b8b40d3784"
Sep 07 17:22:11.038398 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.038372    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8165173c25c0b6d1793878a8b1c3aad49a10e6d2bfc9991425e899b8b40d3784"} err="failed to get container status \"8165173c25c0b6d1793878a8b1c3aad49a10e6d2bfc9991425e899b8b40d3784\": rpc error: code = NotFound desc = could not find container \"8165173c25c0b6d1793878a8b1c3aad49a10e6d2bfc9991425e899b8b40d3784\": container with ID starting with 8165173c25c0b6d1793878a8b1c3aad49a10e6d2bfc9991425e899b8b40d3784 not found: ID does not exist"
Sep 07 17:22:11.069341 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.069312    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:22:11.078715 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.078683    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"]
Sep 07 17:22:11.083100 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.083077    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-3973bf/rate-test-model-3973bf-kserve-6cd76c6659-6rhmz"]
Sep 07 17:22:11.172406 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.172369    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:22:11.282768 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.282739    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:22:11.309628 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.309607    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm"
Sep 07 17:22:11.312641 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.312622    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv"
Sep 07 17:22:11.388440 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.388406    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:22:11.429332 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.429296    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8t7kk\" (UniqueName: \"kubernetes.io/projected/f0bedc9f-8728-495a-8ff2-0b7714fe21fe-kube-api-access-8t7kk\") pod \"f0bedc9f-8728-495a-8ff2-0b7714fe21fe\" (UID: \"f0bedc9f-8728-495a-8ff2-0b7714fe21fe\") "
Sep 07 17:22:11.429589 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.429347    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0bedc9f-8728-495a-8ff2-0b7714fe21fe-plugins-config-volume\") pod \"f0bedc9f-8728-495a-8ff2-0b7714fe21fe\" (UID: \"f0bedc9f-8728-495a-8ff2-0b7714fe21fe\") "
Sep 07 17:22:11.429589 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.429384    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e-plugins-config-volume\") pod \"a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e\" (UID: \"a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e\") "
Sep 07 17:22:11.429589 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.429462    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmrzf\" (UniqueName: \"kubernetes.io/projected/a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e-kube-api-access-mmrzf\") pod \"a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e\" (UID: \"a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e\") "
Sep 07 17:22:11.429751 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.429701    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0bedc9f-8728-495a-8ff2-0b7714fe21fe-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f0bedc9f-8728-495a-8ff2-0b7714fe21fe" (UID: "f0bedc9f-8728-495a-8ff2-0b7714fe21fe"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:22:11.429813 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.429798    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0bedc9f-8728-495a-8ff2-0b7714fe21fe-plugins-config-volume\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:22:11.429866 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.429850    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e" (UID: "a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:22:11.431448 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.431424    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0bedc9f-8728-495a-8ff2-0b7714fe21fe-kube-api-access-8t7kk" (OuterVolumeSpecName: "kube-api-access-8t7kk") pod "f0bedc9f-8728-495a-8ff2-0b7714fe21fe" (UID: "f0bedc9f-8728-495a-8ff2-0b7714fe21fe"). InnerVolumeSpecName "kube-api-access-8t7kk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:22:11.431555 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.431516    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e-kube-api-access-mmrzf" (OuterVolumeSpecName: "kube-api-access-mmrzf") pod "a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e" (UID: "a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e"). InnerVolumeSpecName "kube-api-access-mmrzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:22:11.531129 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.531043    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8t7kk\" (UniqueName: \"kubernetes.io/projected/f0bedc9f-8728-495a-8ff2-0b7714fe21fe-kube-api-access-8t7kk\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:22:11.531129 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.531076    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e-plugins-config-volume\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:22:11.531129 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.531087    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmrzf\" (UniqueName: \"kubernetes.io/projected/a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e-kube-api-access-mmrzf\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:22:11.730065 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:11.730017    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:22:12.020398 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:12.020362    2575 generic.go:356] "Generic (PLEG): container finished" podID="a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e" containerID="52d7588b81008fc75234cff09fc4f8f1f46c3046f5721e5783127e59c73a990b" exitCode=0
Sep 07 17:22:12.020557 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:12.020407    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm"
Sep 07 17:22:12.020557 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:12.020441    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm" event={"ID":"a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e","Type":"ContainerDied","Data":"52d7588b81008fc75234cff09fc4f8f1f46c3046f5721e5783127e59c73a990b"}
Sep 07 17:22:12.020557 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:12.020493    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm" event={"ID":"a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e","Type":"ContainerDied","Data":"58c7c4de9ae1d29b457e42cffecdca247d4b3c3fa528b936c001109b24403209"}
Sep 07 17:22:12.020557 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:12.020515    2575 scope.go:117] "RemoveContainer" containerID="52d7588b81008fc75234cff09fc4f8f1f46c3046f5721e5783127e59c73a990b"
Sep 07 17:22:12.022946 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:12.022922    2575 generic.go:356] "Generic (PLEG): container finished" podID="f0bedc9f-8728-495a-8ff2-0b7714fe21fe" containerID="fdb3575e22d9c9ff37e8329386e0417f6871b937af6a00df2748b89496169317" exitCode=0
Sep 07 17:22:12.023037 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:12.022968    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv"
Sep 07 17:22:12.023079 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:12.022971    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv" event={"ID":"f0bedc9f-8728-495a-8ff2-0b7714fe21fe","Type":"ContainerDied","Data":"fdb3575e22d9c9ff37e8329386e0417f6871b937af6a00df2748b89496169317"}
Sep 07 17:22:12.023131 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:12.023112    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv" event={"ID":"f0bedc9f-8728-495a-8ff2-0b7714fe21fe","Type":"ContainerDied","Data":"97b45ddcb4fa73d0388616ac0c6527c563d44fa278d1745da8f4add6b664e1e5"}
Sep 07 17:22:12.030746 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:12.030728    2575 scope.go:117] "RemoveContainer" containerID="52d7588b81008fc75234cff09fc4f8f1f46c3046f5721e5783127e59c73a990b"
Sep 07 17:22:12.031059 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:22:12.031037    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52d7588b81008fc75234cff09fc4f8f1f46c3046f5721e5783127e59c73a990b\": container with ID starting with 52d7588b81008fc75234cff09fc4f8f1f46c3046f5721e5783127e59c73a990b not found: ID does not exist" containerID="52d7588b81008fc75234cff09fc4f8f1f46c3046f5721e5783127e59c73a990b"
Sep 07 17:22:12.031174 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:12.031063    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52d7588b81008fc75234cff09fc4f8f1f46c3046f5721e5783127e59c73a990b"} err="failed to get container status \"52d7588b81008fc75234cff09fc4f8f1f46c3046f5721e5783127e59c73a990b\": rpc error: code = NotFound desc = could not find container \"52d7588b81008fc75234cff09fc4f8f1f46c3046f5721e5783127e59c73a990b\": container with ID starting with 52d7588b81008fc75234cff09fc4f8f1f46c3046f5721e5783127e59c73a990b not found: ID does not exist"
Sep 07 17:22:12.031174 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:12.031080    2575 scope.go:117] "RemoveContainer" containerID="fdb3575e22d9c9ff37e8329386e0417f6871b937af6a00df2748b89496169317"
Sep 07 17:22:12.039456 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:12.039287    2575 scope.go:117] "RemoveContainer" containerID="fdb3575e22d9c9ff37e8329386e0417f6871b937af6a00df2748b89496169317"
Sep 07 17:22:12.039663 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:22:12.039558    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdb3575e22d9c9ff37e8329386e0417f6871b937af6a00df2748b89496169317\": container with ID starting with fdb3575e22d9c9ff37e8329386e0417f6871b937af6a00df2748b89496169317 not found: ID does not exist" containerID="fdb3575e22d9c9ff37e8329386e0417f6871b937af6a00df2748b89496169317"
Sep 07 17:22:12.039663 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:12.039580    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdb3575e22d9c9ff37e8329386e0417f6871b937af6a00df2748b89496169317"} err="failed to get container status \"fdb3575e22d9c9ff37e8329386e0417f6871b937af6a00df2748b89496169317\": rpc error: code = NotFound desc = could not find container \"fdb3575e22d9c9ff37e8329386e0417f6871b937af6a00df2748b89496169317\": container with ID starting with fdb3575e22d9c9ff37e8329386e0417f6871b937af6a00df2748b89496169317 not found: ID does not exist"
Sep 07 17:22:12.067120 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:12.067096    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm"]
Sep 07 17:22:12.077567 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:12.077542    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm"]
Sep 07 17:22:12.100839 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:12.100812    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv"]
Sep 07 17:22:12.106789 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:12.106768    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv"]
Sep 07 17:22:12.722439 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:12.722395    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="366901cd-b3a3-411b-9ed5-ca219f483219" path="/var/lib/kubelet/pods/366901cd-b3a3-411b-9ed5-ca219f483219/volumes"
Sep 07 17:22:12.722881 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:12.722859    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e" path="/var/lib/kubelet/pods/a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e/volumes"
Sep 07 17:22:12.723290 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:12.723269    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0bedc9f-8728-495a-8ff2-0b7714fe21fe" path="/var/lib/kubelet/pods/f0bedc9f-8728-495a-8ff2-0b7714fe21fe/volumes"
Sep 07 17:22:12.956615 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:12.956585    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2"
Sep 07 17:22:12.956763 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:12.956744    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr"
Sep 07 17:22:18.013255 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:18.013214    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:22:18.119675 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:18.119640    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:22:18.286014 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:18.285924    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:22:20.854133 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:20.854101    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:22:23.506042 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:23.505998    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:22:24.171292 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:24.171253    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:22:24.483539 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:24.483450    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:22:24.754866 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:24.754773    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:22:27.993428 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:27.993393    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:22:28.086211 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:28.086169    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:22:29.157761 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:29.157722    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:22:29.257685 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:29.257645    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:22:29.378578 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:29.378539    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:22:29.647146 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:29.647110    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:22:29.744348 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:29.744307    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:22:29.782623 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:29.782593    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb"]
Sep 07 17:22:29.783079 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:29.783065    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e" containerName="payload-processing"
Sep 07 17:22:29.783129 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:29.783081    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e" containerName="payload-processing"
Sep 07 17:22:29.783129 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:29.783098    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0bedc9f-8728-495a-8ff2-0b7714fe21fe" containerName="payload-pre-processing"
Sep 07 17:22:29.783129 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:29.783104    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0bedc9f-8728-495a-8ff2-0b7714fe21fe" containerName="payload-pre-processing"
Sep 07 17:22:29.783129 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:29.783119    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="366901cd-b3a3-411b-9ed5-ca219f483219" containerName="main"
Sep 07 17:22:29.783129 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:29.783125    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="366901cd-b3a3-411b-9ed5-ca219f483219" containerName="main"
Sep 07 17:22:29.783285 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:29.783208    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a82e72c6-a0a4-48c7-9e90-63b2dc9dd38e" containerName="payload-processing"
Sep 07 17:22:29.783285 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:29.783218    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="366901cd-b3a3-411b-9ed5-ca219f483219" containerName="main"
Sep 07 17:22:29.783285 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:29.783228    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0bedc9f-8728-495a-8ff2-0b7714fe21fe" containerName="payload-pre-processing"
Sep 07 17:22:29.786193 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:29.786175    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb"
Sep 07 17:22:29.788734 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:29.788717    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-fac82d-dockercfg-74wlt\""
Sep 07 17:22:29.788907 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:29.788877    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-fac82d\""
Sep 07 17:22:29.797599 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:29.797575    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb"]
Sep 07 17:22:29.806388 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:29.806355    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc0f7fa0-eab8-48a6-ad40-054f84919b2f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb\" (UID: \"fc0f7fa0-eab8-48a6-ad40-054f84919b2f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb"
Sep 07 17:22:29.806545 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:29.806494    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwrhh\" (UniqueName: \"kubernetes.io/projected/fc0f7fa0-eab8-48a6-ad40-054f84919b2f-kube-api-access-pwrhh\") pod \"payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb\" (UID: \"fc0f7fa0-eab8-48a6-ad40-054f84919b2f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb"
Sep 07 17:22:29.908198 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:29.908118    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc0f7fa0-eab8-48a6-ad40-054f84919b2f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb\" (UID: \"fc0f7fa0-eab8-48a6-ad40-054f84919b2f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb"
Sep 07 17:22:29.908198 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:29.908171    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwrhh\" (UniqueName: \"kubernetes.io/projected/fc0f7fa0-eab8-48a6-ad40-054f84919b2f-kube-api-access-pwrhh\") pod \"payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb\" (UID: \"fc0f7fa0-eab8-48a6-ad40-054f84919b2f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb"
Sep 07 17:22:29.908835 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:29.908816    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc0f7fa0-eab8-48a6-ad40-054f84919b2f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb\" (UID: \"fc0f7fa0-eab8-48a6-ad40-054f84919b2f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb"
Sep 07 17:22:29.916519 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:29.916498    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwrhh\" (UniqueName: \"kubernetes.io/projected/fc0f7fa0-eab8-48a6-ad40-054f84919b2f-kube-api-access-pwrhh\") pod \"payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb\" (UID: \"fc0f7fa0-eab8-48a6-ad40-054f84919b2f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb"
Sep 07 17:22:30.097702 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:30.097669    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb"
Sep 07 17:22:30.377385 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:30.377344    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb"]
Sep 07 17:22:30.378351 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:22:30.378327    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc0f7fa0_eab8_48a6_ad40_054f84919b2f.slice/crio-d18b291522dc6de79689c68f200111060b9a958aa728c2c8d7d275f6174b3573 WatchSource:0}: Error finding container d18b291522dc6de79689c68f200111060b9a958aa728c2c8d7d275f6174b3573: Status 404 returned error can't find the container with id d18b291522dc6de79689c68f200111060b9a958aa728c2c8d7d275f6174b3573
Sep 07 17:22:31.131094 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:31.131056    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb" event={"ID":"fc0f7fa0-eab8-48a6-ad40-054f84919b2f","Type":"ContainerStarted","Data":"0564d7785da165240483a869d9718250377dc9ba869f1fd65a433c8d9a51c57c"}
Sep 07 17:22:31.131311 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:31.131113    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb" event={"ID":"fc0f7fa0-eab8-48a6-ad40-054f84919b2f","Type":"ContainerStarted","Data":"d18b291522dc6de79689c68f200111060b9a958aa728c2c8d7d275f6174b3573"}
Sep 07 17:22:31.131311 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:31.131162    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb"
Sep 07 17:22:31.150636 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:31.150585    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb" podStartSLOduration=2.150571101 podStartE2EDuration="2.150571101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:22:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:22:31.149039184 +0000 UTC m=+1545.045886523" watchObservedRunningTime="2026-09-07 17:22:31.150571101 +0000 UTC m=+1545.047418415"
Sep 07 17:22:42.139365 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:42.139331    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb"
Sep 07 17:22:53.008592 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:53.008548    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:22:58.137505 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:22:58.137470    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb_fc0f7fa0-eab8-48a6-ad40-054f84919b2f/payload-processing/0.log"
Sep 07 17:23:10.668399 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:10.668366    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:23:38.902504 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:38.902436    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr_eab3bfa9-e2fe-4750-92f8-80af5e1d2e95/payload-processing/0.log"
Sep 07 17:23:39.136533 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:39.136503    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb_fc0f7fa0-eab8-48a6-ad40-054f84919b2f/payload-processing/0.log"
Sep 07 17:23:39.414439 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:39.414397    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:23:39.767325 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:39.767245    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:23:39.979927 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:39.979873    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:23:42.504175 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:42.504138    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:23:42.601008 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:42.600967    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:23:43.746579 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:43.746544    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz"]
Sep 07 17:23:43.750429 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:43.750408    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz"
Sep 07 17:23:43.755094 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:43.755074    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-dad805-serving-cert\""
Sep 07 17:23:43.774352 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:43.774320    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz"]
Sep 07 17:23:43.788531 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:43.788489    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:23:43.852138 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:43.852103    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxmn8\" (UniqueName: \"kubernetes.io/projected/b183d202-7d4f-4827-b052-c9d343dee6b9-kube-api-access-pxmn8\") pod \"maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz\" (UID: \"b183d202-7d4f-4827-b052-c9d343dee6b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz"
Sep 07 17:23:43.852348 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:43.852169    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b183d202-7d4f-4827-b052-c9d343dee6b9-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz\" (UID: \"b183d202-7d4f-4827-b052-c9d343dee6b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz"
Sep 07 17:23:43.852348 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:43.852194    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b183d202-7d4f-4827-b052-c9d343dee6b9-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz\" (UID: \"b183d202-7d4f-4827-b052-c9d343dee6b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz"
Sep 07 17:23:43.852348 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:43.852334    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b183d202-7d4f-4827-b052-c9d343dee6b9-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz\" (UID: \"b183d202-7d4f-4827-b052-c9d343dee6b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz"
Sep 07 17:23:43.896770 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:43.896734    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:23:43.953314 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:43.953250    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxmn8\" (UniqueName: \"kubernetes.io/projected/b183d202-7d4f-4827-b052-c9d343dee6b9-kube-api-access-pxmn8\") pod \"maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz\" (UID: \"b183d202-7d4f-4827-b052-c9d343dee6b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz"
Sep 07 17:23:43.953314 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:43.953303    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b183d202-7d4f-4827-b052-c9d343dee6b9-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz\" (UID: \"b183d202-7d4f-4827-b052-c9d343dee6b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz"
Sep 07 17:23:43.953314 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:43.953322    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b183d202-7d4f-4827-b052-c9d343dee6b9-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz\" (UID: \"b183d202-7d4f-4827-b052-c9d343dee6b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz"
Sep 07 17:23:43.953796 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:43.953395    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b183d202-7d4f-4827-b052-c9d343dee6b9-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz\" (UID: \"b183d202-7d4f-4827-b052-c9d343dee6b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz"
Sep 07 17:23:43.954456 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:43.954419    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b183d202-7d4f-4827-b052-c9d343dee6b9-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz\" (UID: \"b183d202-7d4f-4827-b052-c9d343dee6b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz"
Sep 07 17:23:43.956102 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:43.956065    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b183d202-7d4f-4827-b052-c9d343dee6b9-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz\" (UID: \"b183d202-7d4f-4827-b052-c9d343dee6b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz"
Sep 07 17:23:43.956194 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:43.956124    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b183d202-7d4f-4827-b052-c9d343dee6b9-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz\" (UID: \"b183d202-7d4f-4827-b052-c9d343dee6b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz"
Sep 07 17:23:43.962296 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:43.962278    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxmn8\" (UniqueName: \"kubernetes.io/projected/b183d202-7d4f-4827-b052-c9d343dee6b9-kube-api-access-pxmn8\") pod \"maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz\" (UID: \"b183d202-7d4f-4827-b052-c9d343dee6b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz"
Sep 07 17:23:43.996673 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:43.996573    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:23:44.060322 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:44.060286    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz"
Sep 07 17:23:44.337171 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:44.337137    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz"]
Sep 07 17:23:44.337520 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:44.337493    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:23:44.338049 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:23:44.338029    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb183d202_7d4f_4827_b052_c9d343dee6b9.slice/crio-f783effdd81c835c289551da1519e998c738d7004f5750f46c903f46edba84df WatchSource:0}: Error finding container f783effdd81c835c289551da1519e998c738d7004f5750f46c903f46edba84df: Status 404 returned error can't find the container with id f783effdd81c835c289551da1519e998c738d7004f5750f46c903f46edba84df
Sep 07 17:23:44.436094 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:44.436060    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:23:44.476422 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:44.476376    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr"]
Sep 07 17:23:44.481679 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:44.481652    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr"
Sep 07 17:23:44.484733 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:44.484700    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-dad805\""
Sep 07 17:23:44.484913 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:44.484794    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-dad805-dockercfg-5dzxk\""
Sep 07 17:23:44.496448 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:44.496413    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr"]
Sep 07 17:23:44.529743 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:44.529707    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz" event={"ID":"b183d202-7d4f-4827-b052-c9d343dee6b9","Type":"ContainerStarted","Data":"f783effdd81c835c289551da1519e998c738d7004f5750f46c903f46edba84df"}
Sep 07 17:23:44.562034 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:44.561583    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr\" (UID: \"68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr"
Sep 07 17:23:44.562441 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:44.562413    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h8kj\" (UniqueName: \"kubernetes.io/projected/68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339-kube-api-access-9h8kj\") pod \"payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr\" (UID: \"68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr"
Sep 07 17:23:44.663412 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:44.663322    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr\" (UID: \"68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr"
Sep 07 17:23:44.663571 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:44.663469    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h8kj\" (UniqueName: \"kubernetes.io/projected/68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339-kube-api-access-9h8kj\") pod \"payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr\" (UID: \"68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr"
Sep 07 17:23:44.664179 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:44.664152    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr\" (UID: \"68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr"
Sep 07 17:23:44.673054 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:44.673025    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h8kj\" (UniqueName: \"kubernetes.io/projected/68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339-kube-api-access-9h8kj\") pod \"payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr\" (UID: \"68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr"
Sep 07 17:23:44.793852 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:44.793830    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr"
Sep 07 17:23:45.075604 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:45.075575    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr"]
Sep 07 17:23:45.076758 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:23:45.076733    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68a8ad2c_f7fa_48b2_8e49_d2a1b56a3339.slice/crio-1cec275d65b9f6b291b49f418f43e9ef7ba130239a2e62aa1628c04f8d0b047f WatchSource:0}: Error finding container 1cec275d65b9f6b291b49f418f43e9ef7ba130239a2e62aa1628c04f8d0b047f: Status 404 returned error can't find the container with id 1cec275d65b9f6b291b49f418f43e9ef7ba130239a2e62aa1628c04f8d0b047f
Sep 07 17:23:45.536843 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:45.536746    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz" event={"ID":"b183d202-7d4f-4827-b052-c9d343dee6b9","Type":"ContainerStarted","Data":"bdad63865e7881a6231ccc5594c971097f30e5314b39b560ff1ac01f58c468f4"}
Sep 07 17:23:45.537033 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:45.536936    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz"
Sep 07 17:23:45.538344 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:45.538320    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr" event={"ID":"68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339","Type":"ContainerStarted","Data":"71bb27af77834d0ea10861687a0a2f346d9ac7aacf99ab29df41bd8c0d978ac7"}
Sep 07 17:23:45.538452 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:45.538363    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr" event={"ID":"68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339","Type":"ContainerStarted","Data":"1cec275d65b9f6b291b49f418f43e9ef7ba130239a2e62aa1628c04f8d0b047f"}
Sep 07 17:23:45.538452 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:45.538400    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr"
Sep 07 17:23:45.556353 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:45.556309    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz" podStartSLOduration=2.150102815 podStartE2EDuration="2.556296354s" totalImagesPullingTime="406.193539ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:23:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:23:45.555417164 +0000 UTC m=+1619.452264480" watchObservedRunningTime="2026-09-07 17:23:45.556296354 +0000 UTC m=+1619.453143666"
Sep 07 17:23:45.575599 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:45.575557    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr" podStartSLOduration=1.575545391 podStartE2EDuration="1.575545391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:23:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:23:45.572422791 +0000 UTC m=+1619.469270106" watchObservedRunningTime="2026-09-07 17:23:45.575545391 +0000 UTC m=+1619.472392763"
Sep 07 17:23:51.550195 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:51.550164    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz"
Sep 07 17:23:55.446853 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:55.446815    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:23:56.547567 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:23:56.547537    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr"
Sep 07 17:24:07.499436 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:07.499391    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:24:12.807194 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:12.807161    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:24:14.188290 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.188256    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz"]
Sep 07 17:24:14.188750 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.188483    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz" podUID="b183d202-7d4f-4827-b052-c9d343dee6b9" containerName="maas-api" containerID="cri-o://bdad63865e7881a6231ccc5594c971097f30e5314b39b560ff1ac01f58c468f4" gracePeriod=30
Sep 07 17:24:14.217329 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.217294    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:24:14.248809 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.248775    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr"]
Sep 07 17:24:14.249087 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.249053    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr" podUID="68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339" containerName="payload-processing" containerID="cri-o://71bb27af77834d0ea10861687a0a2f346d9ac7aacf99ab29df41bd8c0d978ac7" gracePeriod=30
Sep 07 17:24:14.318534 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.318491    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:24:14.421456 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.421413    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:24:14.514459 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.514434    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz"
Sep 07 17:24:14.525183 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.525153    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:24:14.539706 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.539672    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr"
Sep 07 17:24:14.564817 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.564788    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxmn8\" (UniqueName: \"kubernetes.io/projected/b183d202-7d4f-4827-b052-c9d343dee6b9-kube-api-access-pxmn8\") pod \"b183d202-7d4f-4827-b052-c9d343dee6b9\" (UID: \"b183d202-7d4f-4827-b052-c9d343dee6b9\") "
Sep 07 17:24:14.565037 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.564881    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b183d202-7d4f-4827-b052-c9d343dee6b9-openshift-service-ca\") pod \"b183d202-7d4f-4827-b052-c9d343dee6b9\" (UID: \"b183d202-7d4f-4827-b052-c9d343dee6b9\") "
Sep 07 17:24:14.565037 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.564986    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9h8kj\" (UniqueName: \"kubernetes.io/projected/68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339-kube-api-access-9h8kj\") pod \"68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339\" (UID: \"68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339\") "
Sep 07 17:24:14.565159 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.565056    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339-plugins-config-volume\") pod \"68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339\" (UID: \"68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339\") "
Sep 07 17:24:14.565159 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.565090    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b183d202-7d4f-4827-b052-c9d343dee6b9-metrics-certs\") pod \"b183d202-7d4f-4827-b052-c9d343dee6b9\" (UID: \"b183d202-7d4f-4827-b052-c9d343dee6b9\") "
Sep 07 17:24:14.565274 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.565161    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b183d202-7d4f-4827-b052-c9d343dee6b9-maas-api-tls\") pod \"b183d202-7d4f-4827-b052-c9d343dee6b9\" (UID: \"b183d202-7d4f-4827-b052-c9d343dee6b9\") "
Sep 07 17:24:14.565420 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.565392    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b183d202-7d4f-4827-b052-c9d343dee6b9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b183d202-7d4f-4827-b052-c9d343dee6b9" (UID: "b183d202-7d4f-4827-b052-c9d343dee6b9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:24:14.565528 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.565501    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339" (UID: "68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:24:14.565598 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.565534    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b183d202-7d4f-4827-b052-c9d343dee6b9-openshift-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:24:14.567730 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.567688    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b183d202-7d4f-4827-b052-c9d343dee6b9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b183d202-7d4f-4827-b052-c9d343dee6b9" (UID: "b183d202-7d4f-4827-b052-c9d343dee6b9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:24:14.567860 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.567743    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b183d202-7d4f-4827-b052-c9d343dee6b9-kube-api-access-pxmn8" (OuterVolumeSpecName: "kube-api-access-pxmn8") pod "b183d202-7d4f-4827-b052-c9d343dee6b9" (UID: "b183d202-7d4f-4827-b052-c9d343dee6b9"). InnerVolumeSpecName "kube-api-access-pxmn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:24:14.568517 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.568491    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b183d202-7d4f-4827-b052-c9d343dee6b9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b183d202-7d4f-4827-b052-c9d343dee6b9" (UID: "b183d202-7d4f-4827-b052-c9d343dee6b9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:24:14.569336 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.569304    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339-kube-api-access-9h8kj" (OuterVolumeSpecName: "kube-api-access-9h8kj") pod "68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339" (UID: "68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339"). InnerVolumeSpecName "kube-api-access-9h8kj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:24:14.666832 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.666788    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9h8kj\" (UniqueName: \"kubernetes.io/projected/68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339-kube-api-access-9h8kj\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:24:14.666832 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.666828    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339-plugins-config-volume\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:24:14.666832 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.666839    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b183d202-7d4f-4827-b052-c9d343dee6b9-metrics-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:24:14.666832 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.666848    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b183d202-7d4f-4827-b052-c9d343dee6b9-maas-api-tls\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:24:14.667146 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.666856    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxmn8\" (UniqueName: \"kubernetes.io/projected/b183d202-7d4f-4827-b052-c9d343dee6b9-kube-api-access-pxmn8\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:24:14.704307 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.704274    2575 generic.go:356] "Generic (PLEG): container finished" podID="b183d202-7d4f-4827-b052-c9d343dee6b9" containerID="bdad63865e7881a6231ccc5594c971097f30e5314b39b560ff1ac01f58c468f4" exitCode=0
Sep 07 17:24:14.704487 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.704333    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz"
Sep 07 17:24:14.704487 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.704353    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz" event={"ID":"b183d202-7d4f-4827-b052-c9d343dee6b9","Type":"ContainerDied","Data":"bdad63865e7881a6231ccc5594c971097f30e5314b39b560ff1ac01f58c468f4"}
Sep 07 17:24:14.704487 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.704412    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz" event={"ID":"b183d202-7d4f-4827-b052-c9d343dee6b9","Type":"ContainerDied","Data":"f783effdd81c835c289551da1519e998c738d7004f5750f46c903f46edba84df"}
Sep 07 17:24:14.704487 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.704441    2575 scope.go:117] "RemoveContainer" containerID="bdad63865e7881a6231ccc5594c971097f30e5314b39b560ff1ac01f58c468f4"
Sep 07 17:24:14.705880 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.705855    2575 generic.go:356] "Generic (PLEG): container finished" podID="68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339" containerID="71bb27af77834d0ea10861687a0a2f346d9ac7aacf99ab29df41bd8c0d978ac7" exitCode=0
Sep 07 17:24:14.706011 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.705919    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr"
Sep 07 17:24:14.706011 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.705950    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr" event={"ID":"68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339","Type":"ContainerDied","Data":"71bb27af77834d0ea10861687a0a2f346d9ac7aacf99ab29df41bd8c0d978ac7"}
Sep 07 17:24:14.706011 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.705999    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr" event={"ID":"68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339","Type":"ContainerDied","Data":"1cec275d65b9f6b291b49f418f43e9ef7ba130239a2e62aa1628c04f8d0b047f"}
Sep 07 17:24:14.716302 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.716285    2575 scope.go:117] "RemoveContainer" containerID="bdad63865e7881a6231ccc5594c971097f30e5314b39b560ff1ac01f58c468f4"
Sep 07 17:24:14.716638 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:24:14.716610    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdad63865e7881a6231ccc5594c971097f30e5314b39b560ff1ac01f58c468f4\": container with ID starting with bdad63865e7881a6231ccc5594c971097f30e5314b39b560ff1ac01f58c468f4 not found: ID does not exist" containerID="bdad63865e7881a6231ccc5594c971097f30e5314b39b560ff1ac01f58c468f4"
Sep 07 17:24:14.716829 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.716651    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdad63865e7881a6231ccc5594c971097f30e5314b39b560ff1ac01f58c468f4"} err="failed to get container status \"bdad63865e7881a6231ccc5594c971097f30e5314b39b560ff1ac01f58c468f4\": rpc error: code = NotFound desc = could not find container \"bdad63865e7881a6231ccc5594c971097f30e5314b39b560ff1ac01f58c468f4\": container with ID starting with bdad63865e7881a6231ccc5594c971097f30e5314b39b560ff1ac01f58c468f4 not found: ID does not exist"
Sep 07 17:24:14.716829 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.716679    2575 scope.go:117] "RemoveContainer" containerID="71bb27af77834d0ea10861687a0a2f346d9ac7aacf99ab29df41bd8c0d978ac7"
Sep 07 17:24:14.726084 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.726055    2575 scope.go:117] "RemoveContainer" containerID="71bb27af77834d0ea10861687a0a2f346d9ac7aacf99ab29df41bd8c0d978ac7"
Sep 07 17:24:14.726715 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:24:14.726690    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71bb27af77834d0ea10861687a0a2f346d9ac7aacf99ab29df41bd8c0d978ac7\": container with ID starting with 71bb27af77834d0ea10861687a0a2f346d9ac7aacf99ab29df41bd8c0d978ac7 not found: ID does not exist" containerID="71bb27af77834d0ea10861687a0a2f346d9ac7aacf99ab29df41bd8c0d978ac7"
Sep 07 17:24:14.726801 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.726723    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71bb27af77834d0ea10861687a0a2f346d9ac7aacf99ab29df41bd8c0d978ac7"} err="failed to get container status \"71bb27af77834d0ea10861687a0a2f346d9ac7aacf99ab29df41bd8c0d978ac7\": rpc error: code = NotFound desc = could not find container \"71bb27af77834d0ea10861687a0a2f346d9ac7aacf99ab29df41bd8c0d978ac7\": container with ID starting with 71bb27af77834d0ea10861687a0a2f346d9ac7aacf99ab29df41bd8c0d978ac7 not found: ID does not exist"
Sep 07 17:24:14.729961 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.729940    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz"]
Sep 07 17:24:14.733722 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.733703    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dad805-6647c64cf4-ts6dz"]
Sep 07 17:24:14.744262 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.744239    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr"]
Sep 07 17:24:14.748879 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.748857    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr"]
Sep 07 17:24:14.822758 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:14.822723    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:24:16.723654 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:16.723594    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339" path="/var/lib/kubelet/pods/68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339/volumes"
Sep 07 17:24:16.724307 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:16.724284    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b183d202-7d4f-4827-b052-c9d343dee6b9" path="/var/lib/kubelet/pods/b183d202-7d4f-4827-b052-c9d343dee6b9/volumes"
Sep 07 17:24:21.228413 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:21.228375    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:24:21.330647 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:21.330610    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:24:21.510564 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:21.510478    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:24:25.338321 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:25.338282    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:24:26.249843 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:26.249814    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:24:26.963232 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:26.963196    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:24:40.629926 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:40.629876    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p"]
Sep 07 17:24:40.630384 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:40.630131    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p" podUID="564918a3-72ed-4c22-b9a2-0393dbb3b338" containerName="maas-api" containerID="cri-o://38d232252637d231f0c0aa99c40d93080c07165cd9d0cb7431e15cda49f4f9b3" gracePeriod=30
Sep 07 17:24:40.662598 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:40.662551    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:24:40.696073 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:40.696040    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr"]
Sep 07 17:24:40.696357 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:40.696331    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr" podUID="eab3bfa9-e2fe-4750-92f8-80af5e1d2e95" containerName="payload-processing" containerID="cri-o://44c10e98ad2e60f9b6207fcb1f12e31127a3592600b3959cc2c8c9791351786d" gracePeriod=30
Sep 07 17:24:40.703718 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:40.703688    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2"]
Sep 07 17:24:40.704022 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:40.703983    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2" podUID="ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3" containerName="payload-pre-processing" containerID="cri-o://18d2667ddb0fcb911bbe21472e46b5b2a73b0133ed53871e16c9476541f98b11" gracePeriod=30
Sep 07 17:24:40.742969 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:40.742932    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:24:40.824022 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:40.823880    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:24:40.855884 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:40.855849    2575 generic.go:356] "Generic (PLEG): container finished" podID="eab3bfa9-e2fe-4750-92f8-80af5e1d2e95" containerID="44c10e98ad2e60f9b6207fcb1f12e31127a3592600b3959cc2c8c9791351786d" exitCode=0
Sep 07 17:24:40.856093 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:40.855980    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr" event={"ID":"eab3bfa9-e2fe-4750-92f8-80af5e1d2e95","Type":"ContainerDied","Data":"44c10e98ad2e60f9b6207fcb1f12e31127a3592600b3959cc2c8c9791351786d"}
Sep 07 17:24:40.858851 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:40.858816    2575 generic.go:356] "Generic (PLEG): container finished" podID="ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3" containerID="18d2667ddb0fcb911bbe21472e46b5b2a73b0133ed53871e16c9476541f98b11" exitCode=0
Sep 07 17:24:40.859043 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:40.858971    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2" event={"ID":"ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3","Type":"ContainerDied","Data":"18d2667ddb0fcb911bbe21472e46b5b2a73b0133ed53871e16c9476541f98b11"}
Sep 07 17:24:40.861342 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:40.861168    2575 generic.go:356] "Generic (PLEG): container finished" podID="564918a3-72ed-4c22-b9a2-0393dbb3b338" containerID="38d232252637d231f0c0aa99c40d93080c07165cd9d0cb7431e15cda49f4f9b3" exitCode=0
Sep 07 17:24:40.861342 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:40.861239    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p" event={"ID":"564918a3-72ed-4c22-b9a2-0393dbb3b338","Type":"ContainerDied","Data":"38d232252637d231f0c0aa99c40d93080c07165cd9d0cb7431e15cda49f4f9b3"}
Sep 07 17:24:40.904693 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:40.904567    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:24:40.976000 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:40.975776    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:24:40.996570 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:40.996447    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr"
Sep 07 17:24:40.999801 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:40.999775    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p"
Sep 07 17:24:41.003741 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.003721    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2"
Sep 07 17:24:41.136643 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.136607    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/564918a3-72ed-4c22-b9a2-0393dbb3b338-maas-api-tls\") pod \"564918a3-72ed-4c22-b9a2-0393dbb3b338\" (UID: \"564918a3-72ed-4c22-b9a2-0393dbb3b338\") "
Sep 07 17:24:41.136823 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.136660    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/564918a3-72ed-4c22-b9a2-0393dbb3b338-metrics-certs\") pod \"564918a3-72ed-4c22-b9a2-0393dbb3b338\" (UID: \"564918a3-72ed-4c22-b9a2-0393dbb3b338\") "
Sep 07 17:24:41.136823 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.136683    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/564918a3-72ed-4c22-b9a2-0393dbb3b338-openshift-service-ca\") pod \"564918a3-72ed-4c22-b9a2-0393dbb3b338\" (UID: \"564918a3-72ed-4c22-b9a2-0393dbb3b338\") "
Sep 07 17:24:41.136823 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.136705    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtbkm\" (UniqueName: \"kubernetes.io/projected/eab3bfa9-e2fe-4750-92f8-80af5e1d2e95-kube-api-access-jtbkm\") pod \"eab3bfa9-e2fe-4750-92f8-80af5e1d2e95\" (UID: \"eab3bfa9-e2fe-4750-92f8-80af5e1d2e95\") "
Sep 07 17:24:41.136823 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.136721    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eab3bfa9-e2fe-4750-92f8-80af5e1d2e95-plugins-config-volume\") pod \"eab3bfa9-e2fe-4750-92f8-80af5e1d2e95\" (UID: \"eab3bfa9-e2fe-4750-92f8-80af5e1d2e95\") "
Sep 07 17:24:41.136823 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.136777    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9k5cq\" (UniqueName: \"kubernetes.io/projected/ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3-kube-api-access-9k5cq\") pod \"ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3\" (UID: \"ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3\") "
Sep 07 17:24:41.137140 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.136871    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3-plugins-config-volume\") pod \"ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3\" (UID: \"ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3\") "
Sep 07 17:24:41.137140 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.136956    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfzfk\" (UniqueName: \"kubernetes.io/projected/564918a3-72ed-4c22-b9a2-0393dbb3b338-kube-api-access-jfzfk\") pod \"564918a3-72ed-4c22-b9a2-0393dbb3b338\" (UID: \"564918a3-72ed-4c22-b9a2-0393dbb3b338\") "
Sep 07 17:24:41.137140 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.137101    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/564918a3-72ed-4c22-b9a2-0393dbb3b338-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "564918a3-72ed-4c22-b9a2-0393dbb3b338" (UID: "564918a3-72ed-4c22-b9a2-0393dbb3b338"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:24:41.137481 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.137421    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3" (UID: "ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:24:41.137481 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.137432    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/564918a3-72ed-4c22-b9a2-0393dbb3b338-openshift-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:24:41.137613 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.137478    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eab3bfa9-e2fe-4750-92f8-80af5e1d2e95-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "eab3bfa9-e2fe-4750-92f8-80af5e1d2e95" (UID: "eab3bfa9-e2fe-4750-92f8-80af5e1d2e95"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:24:41.139021 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.138997    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/564918a3-72ed-4c22-b9a2-0393dbb3b338-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "564918a3-72ed-4c22-b9a2-0393dbb3b338" (UID: "564918a3-72ed-4c22-b9a2-0393dbb3b338"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:24:41.139532 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.139506    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/564918a3-72ed-4c22-b9a2-0393dbb3b338-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "564918a3-72ed-4c22-b9a2-0393dbb3b338" (UID: "564918a3-72ed-4c22-b9a2-0393dbb3b338"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:24:41.139599 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.139540    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eab3bfa9-e2fe-4750-92f8-80af5e1d2e95-kube-api-access-jtbkm" (OuterVolumeSpecName: "kube-api-access-jtbkm") pod "eab3bfa9-e2fe-4750-92f8-80af5e1d2e95" (UID: "eab3bfa9-e2fe-4750-92f8-80af5e1d2e95"). InnerVolumeSpecName "kube-api-access-jtbkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:24:41.139599 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.139549    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/564918a3-72ed-4c22-b9a2-0393dbb3b338-kube-api-access-jfzfk" (OuterVolumeSpecName: "kube-api-access-jfzfk") pod "564918a3-72ed-4c22-b9a2-0393dbb3b338" (UID: "564918a3-72ed-4c22-b9a2-0393dbb3b338"). InnerVolumeSpecName "kube-api-access-jfzfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:24:41.139599 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.139548    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3-kube-api-access-9k5cq" (OuterVolumeSpecName: "kube-api-access-9k5cq") pod "ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3" (UID: "ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3"). InnerVolumeSpecName "kube-api-access-9k5cq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:24:41.238263 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.238182    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9k5cq\" (UniqueName: \"kubernetes.io/projected/ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3-kube-api-access-9k5cq\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:24:41.238263 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.238213    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3-plugins-config-volume\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:24:41.238263 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.238223    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfzfk\" (UniqueName: \"kubernetes.io/projected/564918a3-72ed-4c22-b9a2-0393dbb3b338-kube-api-access-jfzfk\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:24:41.238263 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.238232    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/564918a3-72ed-4c22-b9a2-0393dbb3b338-maas-api-tls\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:24:41.238263 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.238241    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/564918a3-72ed-4c22-b9a2-0393dbb3b338-metrics-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:24:41.238263 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.238249    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtbkm\" (UniqueName: \"kubernetes.io/projected/eab3bfa9-e2fe-4750-92f8-80af5e1d2e95-kube-api-access-jtbkm\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:24:41.238263 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.238257    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eab3bfa9-e2fe-4750-92f8-80af5e1d2e95-plugins-config-volume\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:24:41.277110 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.277076    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:24:41.868408 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.868319    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr"
Sep 07 17:24:41.868408 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.868350    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr" event={"ID":"eab3bfa9-e2fe-4750-92f8-80af5e1d2e95","Type":"ContainerDied","Data":"0350d0250c53f960a87defe832d0397049c4aae63557fec7ffafdefd52d96d53"}
Sep 07 17:24:41.868408 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.868410    2575 scope.go:117] "RemoveContainer" containerID="44c10e98ad2e60f9b6207fcb1f12e31127a3592600b3959cc2c8c9791351786d"
Sep 07 17:24:41.869853 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.869839    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2"
Sep 07 17:24:41.869945 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.869858    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2" event={"ID":"ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3","Type":"ContainerDied","Data":"e9609f52cebb3af5c4c537514e6268a9964103d34113ec43f969eca9445b335e"}
Sep 07 17:24:41.871309 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.871280    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p"
Sep 07 17:24:41.871478 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.871334    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p" event={"ID":"564918a3-72ed-4c22-b9a2-0393dbb3b338","Type":"ContainerDied","Data":"6aa49bc4e7579b5bd0a045341a0df8e571892513d774a28140d30679d0233ab7"}
Sep 07 17:24:41.880605 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.880580    2575 scope.go:117] "RemoveContainer" containerID="18d2667ddb0fcb911bbe21472e46b5b2a73b0133ed53871e16c9476541f98b11"
Sep 07 17:24:41.889768 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.889748    2575 scope.go:117] "RemoveContainer" containerID="38d232252637d231f0c0aa99c40d93080c07165cd9d0cb7431e15cda49f4f9b3"
Sep 07 17:24:41.905298 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.905274    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2"]
Sep 07 17:24:41.912387 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.912364    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2"]
Sep 07 17:24:41.927519 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.927489    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr"]
Sep 07 17:24:41.930596 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.930577    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr"]
Sep 07 17:24:41.949103 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.949067    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p"]
Sep 07 17:24:41.953263 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:41.953236    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-9765ce-74b97ccb78-xn79p"]
Sep 07 17:24:42.723096 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:42.723063    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="564918a3-72ed-4c22-b9a2-0393dbb3b338" path="/var/lib/kubelet/pods/564918a3-72ed-4c22-b9a2-0393dbb3b338/volumes"
Sep 07 17:24:42.723433 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:42.723420    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3" path="/var/lib/kubelet/pods/ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3/volumes"
Sep 07 17:24:42.723738 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:42.723726    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eab3bfa9-e2fe-4750-92f8-80af5e1d2e95" path="/var/lib/kubelet/pods/eab3bfa9-e2fe-4750-92f8-80af5e1d2e95/volumes"
Sep 07 17:24:46.348264 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:46.348221    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:24:56.415522 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:24:56.415482    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:25:23.264273 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:23.264183    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:25:23.679784 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:23.679738    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:25:29.435967 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:29.435926    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:25:29.535381 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:29.535347    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:25:29.707403 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:29.707316    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:25:30.048460 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:30.048421    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fac82d-5cwh5"]
Sep 07 17:25:30.048976 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:30.048958    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eab3bfa9-e2fe-4750-92f8-80af5e1d2e95" containerName="payload-processing"
Sep 07 17:25:30.049085 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:30.048977    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="eab3bfa9-e2fe-4750-92f8-80af5e1d2e95" containerName="payload-processing"
Sep 07 17:25:30.049085 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:30.049003    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="564918a3-72ed-4c22-b9a2-0393dbb3b338" containerName="maas-api"
Sep 07 17:25:30.049085 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:30.049012    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="564918a3-72ed-4c22-b9a2-0393dbb3b338" containerName="maas-api"
Sep 07 17:25:30.049085 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:30.049023    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3" containerName="payload-pre-processing"
Sep 07 17:25:30.049085 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:30.049032    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3" containerName="payload-pre-processing"
Sep 07 17:25:30.049085 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:30.049046    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339" containerName="payload-processing"
Sep 07 17:25:30.049085 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:30.049054    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339" containerName="payload-processing"
Sep 07 17:25:30.049085 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:30.049082    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b183d202-7d4f-4827-b052-c9d343dee6b9" containerName="maas-api"
Sep 07 17:25:30.049481 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:30.049090    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b183d202-7d4f-4827-b052-c9d343dee6b9" containerName="maas-api"
Sep 07 17:25:30.049481 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:30.049188    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="eab3bfa9-e2fe-4750-92f8-80af5e1d2e95" containerName="payload-processing"
Sep 07 17:25:30.049481 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:30.049201    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="68a8ad2c-f7fa-48b2-8e49-d2a1b56a3339" containerName="payload-processing"
Sep 07 17:25:30.049481 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:30.049211    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="564918a3-72ed-4c22-b9a2-0393dbb3b338" containerName="maas-api"
Sep 07 17:25:30.049481 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:30.049223    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddbb5010-5aac-4ce6-b5dc-0dc8ae0fc5a3" containerName="payload-pre-processing"
Sep 07 17:25:30.049481 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:30.049233    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b183d202-7d4f-4827-b052-c9d343dee6b9" containerName="maas-api"
Sep 07 17:25:30.052700 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:30.052682    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fac82d-5cwh5"
Sep 07 17:25:30.055232 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:30.055213    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qphph\""
Sep 07 17:25:30.060398 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:30.060376    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fac82d-5cwh5"]
Sep 07 17:25:30.101978 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:30.101948    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c56753e6-5b82-4b6c-a517-1320b4d89e46-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-fac82d-5cwh5\" (UID: \"c56753e6-5b82-4b6c-a517-1320b4d89e46\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fac82d-5cwh5"
Sep 07 17:25:30.154472 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:30.154423    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:25:30.202666 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:30.202633    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c56753e6-5b82-4b6c-a517-1320b4d89e46-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-fac82d-5cwh5\" (UID: \"c56753e6-5b82-4b6c-a517-1320b4d89e46\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fac82d-5cwh5"
Sep 07 17:25:30.203264 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:30.203246    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c56753e6-5b82-4b6c-a517-1320b4d89e46-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-fac82d-5cwh5\" (UID: \"c56753e6-5b82-4b6c-a517-1320b4d89e46\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fac82d-5cwh5"
Sep 07 17:25:30.364405 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:30.364327    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fac82d-5cwh5"
Sep 07 17:25:30.635721 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:30.635696    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fac82d-5cwh5"]
Sep 07 17:25:30.637020 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:25:30.636992    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc56753e6_5b82_4b6c_a517_1320b4d89e46.slice/crio-b2bd0db090c3cb5f83da353708ee4c85eff6f4c968f99cf16fff44a2c40badd4 WatchSource:0}: Error finding container b2bd0db090c3cb5f83da353708ee4c85eff6f4c968f99cf16fff44a2c40badd4: Status 404 returned error can't find the container with id b2bd0db090c3cb5f83da353708ee4c85eff6f4c968f99cf16fff44a2c40badd4
Sep 07 17:25:31.138312 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:31.138213    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fac82d-5cwh5" event={"ID":"c56753e6-5b82-4b6c-a517-1320b4d89e46","Type":"ContainerStarted","Data":"7c1f584461bbb3fe25ba107d51a5ca72258fadf6658e3c668e03615d6141369c"}
Sep 07 17:25:31.138312 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:31.138279    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fac82d-5cwh5" event={"ID":"c56753e6-5b82-4b6c-a517-1320b4d89e46","Type":"ContainerStarted","Data":"b2bd0db090c3cb5f83da353708ee4c85eff6f4c968f99cf16fff44a2c40badd4"}
Sep 07 17:25:31.156968 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:31.156915    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fac82d-5cwh5" podStartSLOduration=1.15688716 podStartE2EDuration="1.15688716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:25:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:25:31.154419766 +0000 UTC m=+1725.051267081" watchObservedRunningTime="2026-09-07 17:25:31.15688716 +0000 UTC m=+1725.053734527"
Sep 07 17:25:32.144486 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:32.144450    2575 generic.go:356] "Generic (PLEG): container finished" podID="c56753e6-5b82-4b6c-a517-1320b4d89e46" containerID="7c1f584461bbb3fe25ba107d51a5ca72258fadf6658e3c668e03615d6141369c" exitCode=0
Sep 07 17:25:32.144848 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:32.144510    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fac82d-5cwh5" event={"ID":"c56753e6-5b82-4b6c-a517-1320b4d89e46","Type":"ContainerDied","Data":"7c1f584461bbb3fe25ba107d51a5ca72258fadf6658e3c668e03615d6141369c"}
Sep 07 17:25:33.287241 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:33.287206    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fac82d-5cwh5"
Sep 07 17:25:33.330568 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:33.330533    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c56753e6-5b82-4b6c-a517-1320b4d89e46-maas-api-service-ca\") pod \"c56753e6-5b82-4b6c-a517-1320b4d89e46\" (UID: \"c56753e6-5b82-4b6c-a517-1320b4d89e46\") "
Sep 07 17:25:33.330886 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:33.330860    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c56753e6-5b82-4b6c-a517-1320b4d89e46-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c56753e6-5b82-4b6c-a517-1320b4d89e46" (UID: "c56753e6-5b82-4b6c-a517-1320b4d89e46"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:25:33.431966 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:33.431863    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c56753e6-5b82-4b6c-a517-1320b4d89e46-maas-api-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:25:34.155835 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:34.155797    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fac82d-5cwh5" event={"ID":"c56753e6-5b82-4b6c-a517-1320b4d89e46","Type":"ContainerDied","Data":"b2bd0db090c3cb5f83da353708ee4c85eff6f4c968f99cf16fff44a2c40badd4"}
Sep 07 17:25:34.156063 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:34.155853    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2bd0db090c3cb5f83da353708ee4c85eff6f4c968f99cf16fff44a2c40badd4"
Sep 07 17:25:34.156063 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:34.155809    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fac82d-5cwh5"
Sep 07 17:25:40.757586 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:40.757544    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:25:40.797312 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:40.797278    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb"]
Sep 07 17:25:40.797571 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:40.797544    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb" podUID="fc0f7fa0-eab8-48a6-ad40-054f84919b2f" containerName="payload-processing" containerID="cri-o://0564d7785da165240483a869d9718250377dc9ba869f1fd65a433c8d9a51c57c" gracePeriod=30
Sep 07 17:25:40.856466 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:40.856433    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:25:40.956361 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:40.956328    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:25:41.018164 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:41.018086    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fac82d-5cwh5"]
Sep 07 17:25:41.022657 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:41.022635    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fac82d-5cwh5"]
Sep 07 17:25:41.033716 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:41.033690    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:25:41.054538 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:41.054516    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb"
Sep 07 17:25:41.106007 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:41.105971    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc0f7fa0-eab8-48a6-ad40-054f84919b2f-plugins-config-volume\") pod \"fc0f7fa0-eab8-48a6-ad40-054f84919b2f\" (UID: \"fc0f7fa0-eab8-48a6-ad40-054f84919b2f\") "
Sep 07 17:25:41.106007 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:41.106009    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwrhh\" (UniqueName: \"kubernetes.io/projected/fc0f7fa0-eab8-48a6-ad40-054f84919b2f-kube-api-access-pwrhh\") pod \"fc0f7fa0-eab8-48a6-ad40-054f84919b2f\" (UID: \"fc0f7fa0-eab8-48a6-ad40-054f84919b2f\") "
Sep 07 17:25:41.106366 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:41.106338    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc0f7fa0-eab8-48a6-ad40-054f84919b2f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fc0f7fa0-eab8-48a6-ad40-054f84919b2f" (UID: "fc0f7fa0-eab8-48a6-ad40-054f84919b2f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:25:41.108148 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:41.108126    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc0f7fa0-eab8-48a6-ad40-054f84919b2f-kube-api-access-pwrhh" (OuterVolumeSpecName: "kube-api-access-pwrhh") pod "fc0f7fa0-eab8-48a6-ad40-054f84919b2f" (UID: "fc0f7fa0-eab8-48a6-ad40-054f84919b2f"). InnerVolumeSpecName "kube-api-access-pwrhh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:25:41.193080 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:41.193043    2575 generic.go:356] "Generic (PLEG): container finished" podID="fc0f7fa0-eab8-48a6-ad40-054f84919b2f" containerID="0564d7785da165240483a869d9718250377dc9ba869f1fd65a433c8d9a51c57c" exitCode=0
Sep 07 17:25:41.193250 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:41.193092    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb" event={"ID":"fc0f7fa0-eab8-48a6-ad40-054f84919b2f","Type":"ContainerDied","Data":"0564d7785da165240483a869d9718250377dc9ba869f1fd65a433c8d9a51c57c"}
Sep 07 17:25:41.193250 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:41.193130    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb" event={"ID":"fc0f7fa0-eab8-48a6-ad40-054f84919b2f","Type":"ContainerDied","Data":"d18b291522dc6de79689c68f200111060b9a958aa728c2c8d7d275f6174b3573"}
Sep 07 17:25:41.193250 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:41.193150    2575 scope.go:117] "RemoveContainer" containerID="0564d7785da165240483a869d9718250377dc9ba869f1fd65a433c8d9a51c57c"
Sep 07 17:25:41.193250 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:41.193093    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb"
Sep 07 17:25:41.202255 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:41.202236    2575 scope.go:117] "RemoveContainer" containerID="0564d7785da165240483a869d9718250377dc9ba869f1fd65a433c8d9a51c57c"
Sep 07 17:25:41.202485 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:25:41.202469    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0564d7785da165240483a869d9718250377dc9ba869f1fd65a433c8d9a51c57c\": container with ID starting with 0564d7785da165240483a869d9718250377dc9ba869f1fd65a433c8d9a51c57c not found: ID does not exist" containerID="0564d7785da165240483a869d9718250377dc9ba869f1fd65a433c8d9a51c57c"
Sep 07 17:25:41.202532 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:41.202493    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0564d7785da165240483a869d9718250377dc9ba869f1fd65a433c8d9a51c57c"} err="failed to get container status \"0564d7785da165240483a869d9718250377dc9ba869f1fd65a433c8d9a51c57c\": rpc error: code = NotFound desc = could not find container \"0564d7785da165240483a869d9718250377dc9ba869f1fd65a433c8d9a51c57c\": container with ID starting with 0564d7785da165240483a869d9718250377dc9ba869f1fd65a433c8d9a51c57c not found: ID does not exist"
Sep 07 17:25:41.207073 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:41.207055    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc0f7fa0-eab8-48a6-ad40-054f84919b2f-plugins-config-volume\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:25:41.207141 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:41.207075    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwrhh\" (UniqueName: \"kubernetes.io/projected/fc0f7fa0-eab8-48a6-ad40-054f84919b2f-kube-api-access-pwrhh\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:25:41.224122 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:41.224098    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb"]
Sep 07 17:25:41.236070 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:41.236051    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb"]
Sep 07 17:25:41.418373 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:41.418334    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:25:42.722611 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:42.722576    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c56753e6-5b82-4b6c-a517-1320b4d89e46" path="/var/lib/kubelet/pods/c56753e6-5b82-4b6c-a517-1320b4d89e46/volumes"
Sep 07 17:25:42.723019 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:42.723003    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc0f7fa0-eab8-48a6-ad40-054f84919b2f" path="/var/lib/kubelet/pods/fc0f7fa0-eab8-48a6-ad40-054f84919b2f/volumes"
Sep 07 17:25:47.569142 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:47.569105    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:25:47.670619 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:47.670575    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:25:47.870376 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:47.870289    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:25:48.193174 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:48.193090    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1795dd-5vczg"]
Sep 07 17:25:48.193527 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:48.193514    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc0f7fa0-eab8-48a6-ad40-054f84919b2f" containerName="payload-processing"
Sep 07 17:25:48.193569 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:48.193529    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc0f7fa0-eab8-48a6-ad40-054f84919b2f" containerName="payload-processing"
Sep 07 17:25:48.193569 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:48.193554    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c56753e6-5b82-4b6c-a517-1320b4d89e46" containerName="revoke-keys"
Sep 07 17:25:48.193569 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:48.193560    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c56753e6-5b82-4b6c-a517-1320b4d89e46" containerName="revoke-keys"
Sep 07 17:25:48.193664 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:48.193618    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc0f7fa0-eab8-48a6-ad40-054f84919b2f" containerName="payload-processing"
Sep 07 17:25:48.193664 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:48.193630    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c56753e6-5b82-4b6c-a517-1320b4d89e46" containerName="revoke-keys"
Sep 07 17:25:48.198174 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:48.198158    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1795dd-5vczg"
Sep 07 17:25:48.201598 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:48.201580    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qphph\""
Sep 07 17:25:48.221878 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:48.221845    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1795dd-5vczg"]
Sep 07 17:25:48.283142 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:48.283109    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/53f714f9-1c24-4f82-a7c9-84ceafadcbf5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-1795dd-5vczg\" (UID: \"53f714f9-1c24-4f82-a7c9-84ceafadcbf5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1795dd-5vczg"
Sep 07 17:25:48.382210 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:48.382161    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:25:48.384334 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:48.384303    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/53f714f9-1c24-4f82-a7c9-84ceafadcbf5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-1795dd-5vczg\" (UID: \"53f714f9-1c24-4f82-a7c9-84ceafadcbf5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1795dd-5vczg"
Sep 07 17:25:48.384920 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:48.384887    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/53f714f9-1c24-4f82-a7c9-84ceafadcbf5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-1795dd-5vczg\" (UID: \"53f714f9-1c24-4f82-a7c9-84ceafadcbf5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1795dd-5vczg"
Sep 07 17:25:48.507780 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:48.507677    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1795dd-5vczg"
Sep 07 17:25:48.782167 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:48.782143    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1795dd-5vczg"]
Sep 07 17:25:48.783933 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:25:48.783880    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53f714f9_1c24_4f82_a7c9_84ceafadcbf5.slice/crio-f229fc9cbe204b3299669c47a180c4d5c1005ded62971967b5ca40e09ebb8a61 WatchSource:0}: Error finding container f229fc9cbe204b3299669c47a180c4d5c1005ded62971967b5ca40e09ebb8a61: Status 404 returned error can't find the container with id f229fc9cbe204b3299669c47a180c4d5c1005ded62971967b5ca40e09ebb8a61
Sep 07 17:25:49.235883 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:49.235849    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1795dd-5vczg" event={"ID":"53f714f9-1c24-4f82-a7c9-84ceafadcbf5","Type":"ContainerStarted","Data":"bac0a26e06d27efd2ff60b5418c25bf9d8609c3dd93cab02ec451f831b95acb1"}
Sep 07 17:25:49.236074 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:49.235924    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1795dd-5vczg" event={"ID":"53f714f9-1c24-4f82-a7c9-84ceafadcbf5","Type":"ContainerStarted","Data":"f229fc9cbe204b3299669c47a180c4d5c1005ded62971967b5ca40e09ebb8a61"}
Sep 07 17:25:49.252901 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:49.252855    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1795dd-5vczg" podStartSLOduration=1.2528394440000001 podStartE2EDuration="1.252839444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:25:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:25:49.251850879 +0000 UTC m=+1743.148698195" watchObservedRunningTime="2026-09-07 17:25:49.252839444 +0000 UTC m=+1743.149686791"
Sep 07 17:25:50.242723 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:50.242686    2575 generic.go:356] "Generic (PLEG): container finished" podID="53f714f9-1c24-4f82-a7c9-84ceafadcbf5" containerID="bac0a26e06d27efd2ff60b5418c25bf9d8609c3dd93cab02ec451f831b95acb1" exitCode=0
Sep 07 17:25:50.243138 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:50.242779    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1795dd-5vczg" event={"ID":"53f714f9-1c24-4f82-a7c9-84ceafadcbf5","Type":"ContainerDied","Data":"bac0a26e06d27efd2ff60b5418c25bf9d8609c3dd93cab02ec451f831b95acb1"}
Sep 07 17:25:51.382857 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:51.382827    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1795dd-5vczg"
Sep 07 17:25:51.521121 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:51.521024    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/53f714f9-1c24-4f82-a7c9-84ceafadcbf5-maas-api-service-ca\") pod \"53f714f9-1c24-4f82-a7c9-84ceafadcbf5\" (UID: \"53f714f9-1c24-4f82-a7c9-84ceafadcbf5\") "
Sep 07 17:25:51.521419 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:51.521392    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53f714f9-1c24-4f82-a7c9-84ceafadcbf5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "53f714f9-1c24-4f82-a7c9-84ceafadcbf5" (UID: "53f714f9-1c24-4f82-a7c9-84ceafadcbf5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:25:51.622316 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:51.622280    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/53f714f9-1c24-4f82-a7c9-84ceafadcbf5-maas-api-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:25:52.255146 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:52.255114    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1795dd-5vczg"
Sep 07 17:25:52.255347 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:52.255156    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1795dd-5vczg" event={"ID":"53f714f9-1c24-4f82-a7c9-84ceafadcbf5","Type":"ContainerDied","Data":"f229fc9cbe204b3299669c47a180c4d5c1005ded62971967b5ca40e09ebb8a61"}
Sep 07 17:25:52.255347 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:52.255211    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f229fc9cbe204b3299669c47a180c4d5c1005ded62971967b5ca40e09ebb8a61"
Sep 07 17:25:58.668857 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:58.668821    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl"]
Sep 07 17:25:58.669443 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:58.669106    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl" podUID="93324305-bad7-4527-aaf6-aee3d1c824e4" containerName="maas-api" containerID="cri-o://3c1e110c2111a271a9deb33f458de7420a80852b5b4af3dadf6c40669cd7c766" gracePeriod=30
Sep 07 17:25:58.706401 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:58.706369    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:25:58.743725 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:58.743688    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4"]
Sep 07 17:25:58.743960 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:58.743920    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4" podUID="1e70d804-99a0-49b0-892e-2314acab53d1" containerName="payload-pre-processing" containerID="cri-o://b3de58a61a20ab1a8c2b2309127af66535a5146f41e6f2f7ae2282675256e999" gracePeriod=30
Sep 07 17:25:58.808010 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:58.807978    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:25:58.906568 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:58.906489    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:25:58.923296 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:58.923220    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1795dd-5vczg"]
Sep 07 17:25:58.925834 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:58.925808    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1795dd-5vczg"]
Sep 07 17:25:58.973591 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:58.973561    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:25:58.987697 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:58.987670    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl"
Sep 07 17:25:59.027422 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.027392    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4"
Sep 07 17:25:59.096928 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.096869    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93324305-bad7-4527-aaf6-aee3d1c824e4-openshift-service-ca\") pod \"93324305-bad7-4527-aaf6-aee3d1c824e4\" (UID: \"93324305-bad7-4527-aaf6-aee3d1c824e4\") "
Sep 07 17:25:59.097111 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.096952    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93324305-bad7-4527-aaf6-aee3d1c824e4-maas-api-tls\") pod \"93324305-bad7-4527-aaf6-aee3d1c824e4\" (UID: \"93324305-bad7-4527-aaf6-aee3d1c824e4\") "
Sep 07 17:25:59.097111 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.096980    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xcr7\" (UniqueName: \"kubernetes.io/projected/93324305-bad7-4527-aaf6-aee3d1c824e4-kube-api-access-8xcr7\") pod \"93324305-bad7-4527-aaf6-aee3d1c824e4\" (UID: \"93324305-bad7-4527-aaf6-aee3d1c824e4\") "
Sep 07 17:25:59.097111 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.097053    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93324305-bad7-4527-aaf6-aee3d1c824e4-metrics-certs\") pod \"93324305-bad7-4527-aaf6-aee3d1c824e4\" (UID: \"93324305-bad7-4527-aaf6-aee3d1c824e4\") "
Sep 07 17:25:59.097290 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.097272    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93324305-bad7-4527-aaf6-aee3d1c824e4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "93324305-bad7-4527-aaf6-aee3d1c824e4" (UID: "93324305-bad7-4527-aaf6-aee3d1c824e4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:25:59.097468 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.097439    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93324305-bad7-4527-aaf6-aee3d1c824e4-openshift-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:25:59.099140 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.099108    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93324305-bad7-4527-aaf6-aee3d1c824e4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "93324305-bad7-4527-aaf6-aee3d1c824e4" (UID: "93324305-bad7-4527-aaf6-aee3d1c824e4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:25:59.099477 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.099445    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93324305-bad7-4527-aaf6-aee3d1c824e4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "93324305-bad7-4527-aaf6-aee3d1c824e4" (UID: "93324305-bad7-4527-aaf6-aee3d1c824e4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:25:59.099601 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.099583    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93324305-bad7-4527-aaf6-aee3d1c824e4-kube-api-access-8xcr7" (OuterVolumeSpecName: "kube-api-access-8xcr7") pod "93324305-bad7-4527-aaf6-aee3d1c824e4" (UID: "93324305-bad7-4527-aaf6-aee3d1c824e4"). InnerVolumeSpecName "kube-api-access-8xcr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:25:59.198663 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.198581    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e70d804-99a0-49b0-892e-2314acab53d1-plugins-config-volume\") pod \"1e70d804-99a0-49b0-892e-2314acab53d1\" (UID: \"1e70d804-99a0-49b0-892e-2314acab53d1\") "
Sep 07 17:25:59.198815 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.198670    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cxf8\" (UniqueName: \"kubernetes.io/projected/1e70d804-99a0-49b0-892e-2314acab53d1-kube-api-access-8cxf8\") pod \"1e70d804-99a0-49b0-892e-2314acab53d1\" (UID: \"1e70d804-99a0-49b0-892e-2314acab53d1\") "
Sep 07 17:25:59.199035 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.199009    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e70d804-99a0-49b0-892e-2314acab53d1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1e70d804-99a0-49b0-892e-2314acab53d1" (UID: "1e70d804-99a0-49b0-892e-2314acab53d1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:25:59.199092 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.199080    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e70d804-99a0-49b0-892e-2314acab53d1-plugins-config-volume\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:25:59.199130 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.199098    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93324305-bad7-4527-aaf6-aee3d1c824e4-metrics-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:25:59.199130 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.199110    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93324305-bad7-4527-aaf6-aee3d1c824e4-maas-api-tls\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:25:59.199130 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.199117    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xcr7\" (UniqueName: \"kubernetes.io/projected/93324305-bad7-4527-aaf6-aee3d1c824e4-kube-api-access-8xcr7\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:25:59.200562 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.200539    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e70d804-99a0-49b0-892e-2314acab53d1-kube-api-access-8cxf8" (OuterVolumeSpecName: "kube-api-access-8cxf8") pod "1e70d804-99a0-49b0-892e-2314acab53d1" (UID: "1e70d804-99a0-49b0-892e-2314acab53d1"). InnerVolumeSpecName "kube-api-access-8cxf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:25:59.292738 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.292703    2575 generic.go:356] "Generic (PLEG): container finished" podID="1e70d804-99a0-49b0-892e-2314acab53d1" containerID="b3de58a61a20ab1a8c2b2309127af66535a5146f41e6f2f7ae2282675256e999" exitCode=0
Sep 07 17:25:59.292959 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.292748    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4"
Sep 07 17:25:59.292959 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.292788    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4" event={"ID":"1e70d804-99a0-49b0-892e-2314acab53d1","Type":"ContainerDied","Data":"b3de58a61a20ab1a8c2b2309127af66535a5146f41e6f2f7ae2282675256e999"}
Sep 07 17:25:59.292959 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.292861    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4" event={"ID":"1e70d804-99a0-49b0-892e-2314acab53d1","Type":"ContainerDied","Data":"7d83cc8ad5bd918f3d1d451ea3187fc7d56dfb2571c80ab9952a4234cf2860c4"}
Sep 07 17:25:59.292959 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.292883    2575 scope.go:117] "RemoveContainer" containerID="b3de58a61a20ab1a8c2b2309127af66535a5146f41e6f2f7ae2282675256e999"
Sep 07 17:25:59.294320 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.294296    2575 generic.go:356] "Generic (PLEG): container finished" podID="93324305-bad7-4527-aaf6-aee3d1c824e4" containerID="3c1e110c2111a271a9deb33f458de7420a80852b5b4af3dadf6c40669cd7c766" exitCode=0
Sep 07 17:25:59.294430 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.294354    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl"
Sep 07 17:25:59.294430 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.294373    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl" event={"ID":"93324305-bad7-4527-aaf6-aee3d1c824e4","Type":"ContainerDied","Data":"3c1e110c2111a271a9deb33f458de7420a80852b5b4af3dadf6c40669cd7c766"}
Sep 07 17:25:59.294430 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.294425    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl" event={"ID":"93324305-bad7-4527-aaf6-aee3d1c824e4","Type":"ContainerDied","Data":"954821c12a3639c5ca237dbe0202f9d897c5b31e5173ac33bae646e2714bf004"}
Sep 07 17:25:59.299730 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.299678    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cxf8\" (UniqueName: \"kubernetes.io/projected/1e70d804-99a0-49b0-892e-2314acab53d1-kube-api-access-8cxf8\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:25:59.304416 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.304388    2575 scope.go:117] "RemoveContainer" containerID="b3de58a61a20ab1a8c2b2309127af66535a5146f41e6f2f7ae2282675256e999"
Sep 07 17:25:59.304734 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:25:59.304714    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3de58a61a20ab1a8c2b2309127af66535a5146f41e6f2f7ae2282675256e999\": container with ID starting with b3de58a61a20ab1a8c2b2309127af66535a5146f41e6f2f7ae2282675256e999 not found: ID does not exist" containerID="b3de58a61a20ab1a8c2b2309127af66535a5146f41e6f2f7ae2282675256e999"
Sep 07 17:25:59.304827 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.304745    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3de58a61a20ab1a8c2b2309127af66535a5146f41e6f2f7ae2282675256e999"} err="failed to get container status \"b3de58a61a20ab1a8c2b2309127af66535a5146f41e6f2f7ae2282675256e999\": rpc error: code = NotFound desc = could not find container \"b3de58a61a20ab1a8c2b2309127af66535a5146f41e6f2f7ae2282675256e999\": container with ID starting with b3de58a61a20ab1a8c2b2309127af66535a5146f41e6f2f7ae2282675256e999 not found: ID does not exist"
Sep 07 17:25:59.304827 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.304769    2575 scope.go:117] "RemoveContainer" containerID="3c1e110c2111a271a9deb33f458de7420a80852b5b4af3dadf6c40669cd7c766"
Sep 07 17:25:59.307996 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.307974    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:25:59.312727 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.312711    2575 scope.go:117] "RemoveContainer" containerID="3c1e110c2111a271a9deb33f458de7420a80852b5b4af3dadf6c40669cd7c766"
Sep 07 17:25:59.313001 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:25:59.312982    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c1e110c2111a271a9deb33f458de7420a80852b5b4af3dadf6c40669cd7c766\": container with ID starting with 3c1e110c2111a271a9deb33f458de7420a80852b5b4af3dadf6c40669cd7c766 not found: ID does not exist" containerID="3c1e110c2111a271a9deb33f458de7420a80852b5b4af3dadf6c40669cd7c766"
Sep 07 17:25:59.313072 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.313006    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c1e110c2111a271a9deb33f458de7420a80852b5b4af3dadf6c40669cd7c766"} err="failed to get container status \"3c1e110c2111a271a9deb33f458de7420a80852b5b4af3dadf6c40669cd7c766\": rpc error: code = NotFound desc = could not find container \"3c1e110c2111a271a9deb33f458de7420a80852b5b4af3dadf6c40669cd7c766\": container with ID starting with 3c1e110c2111a271a9deb33f458de7420a80852b5b4af3dadf6c40669cd7c766 not found: ID does not exist"
Sep 07 17:25:59.319247 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.319226    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4"]
Sep 07 17:25:59.325477 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.325455    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4"]
Sep 07 17:25:59.337294 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.337270    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl"]
Sep 07 17:25:59.346448 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:25:59.346426    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1795dd-75dbdbb4b-hdjkl"]
Sep 07 17:26:00.722278 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:00.722244    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e70d804-99a0-49b0-892e-2314acab53d1" path="/var/lib/kubelet/pods/1e70d804-99a0-49b0-892e-2314acab53d1/volumes"
Sep 07 17:26:00.722659 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:00.722641    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53f714f9-1c24-4f82-a7c9-84ceafadcbf5" path="/var/lib/kubelet/pods/53f714f9-1c24-4f82-a7c9-84ceafadcbf5/volumes"
Sep 07 17:26:00.723079 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:00.723063    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93324305-bad7-4527-aaf6-aee3d1c824e4" path="/var/lib/kubelet/pods/93324305-bad7-4527-aaf6-aee3d1c824e4/volumes"
Sep 07 17:26:05.830943 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:05.830886    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:26:05.931102 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:05.931057    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:26:06.098289 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:06.098197    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:26:06.443754 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:06.443676    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3973bf-vdjbh"]
Sep 07 17:26:06.444093 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:06.444075    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93324305-bad7-4527-aaf6-aee3d1c824e4" containerName="maas-api"
Sep 07 17:26:06.444093 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:06.444093    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="93324305-bad7-4527-aaf6-aee3d1c824e4" containerName="maas-api"
Sep 07 17:26:06.444170 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:06.444100    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53f714f9-1c24-4f82-a7c9-84ceafadcbf5" containerName="revoke-keys"
Sep 07 17:26:06.444170 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:06.444106    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="53f714f9-1c24-4f82-a7c9-84ceafadcbf5" containerName="revoke-keys"
Sep 07 17:26:06.444170 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:06.444128    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e70d804-99a0-49b0-892e-2314acab53d1" containerName="payload-pre-processing"
Sep 07 17:26:06.444170 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:06.444133    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e70d804-99a0-49b0-892e-2314acab53d1" containerName="payload-pre-processing"
Sep 07 17:26:06.444293 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:06.444193    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="53f714f9-1c24-4f82-a7c9-84ceafadcbf5" containerName="revoke-keys"
Sep 07 17:26:06.444293 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:06.444202    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="93324305-bad7-4527-aaf6-aee3d1c824e4" containerName="maas-api"
Sep 07 17:26:06.444293 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:06.444210    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e70d804-99a0-49b0-892e-2314acab53d1" containerName="payload-pre-processing"
Sep 07 17:26:06.448634 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:06.448619    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3973bf-vdjbh"
Sep 07 17:26:06.451496 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:06.451229    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 17:26:06.452282 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:06.452255    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qphph\""
Sep 07 17:26:06.455230 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:06.455201    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3973bf-vdjbh"]
Sep 07 17:26:06.466298 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:06.466274    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67a9f5c9-b8ba-487d-99b1-21aa66bce691-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-3973bf-vdjbh\" (UID: \"67a9f5c9-b8ba-487d-99b1-21aa66bce691\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3973bf-vdjbh"
Sep 07 17:26:06.548787 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:06.548758    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:26:06.567591 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:06.567558    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67a9f5c9-b8ba-487d-99b1-21aa66bce691-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-3973bf-vdjbh\" (UID: \"67a9f5c9-b8ba-487d-99b1-21aa66bce691\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3973bf-vdjbh"
Sep 07 17:26:06.568185 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:06.568166    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67a9f5c9-b8ba-487d-99b1-21aa66bce691-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-3973bf-vdjbh\" (UID: \"67a9f5c9-b8ba-487d-99b1-21aa66bce691\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3973bf-vdjbh"
Sep 07 17:26:06.761281 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:06.761198    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3973bf-vdjbh"
Sep 07 17:26:07.033523 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:07.033495    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3973bf-vdjbh"]
Sep 07 17:26:07.034790 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:26:07.034764    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67a9f5c9_b8ba_487d_99b1_21aa66bce691.slice/crio-44abec2d1b2d3ae90e118703fd0d0c57e524c1800450eebe623d6249ebc9c51a WatchSource:0}: Error finding container 44abec2d1b2d3ae90e118703fd0d0c57e524c1800450eebe623d6249ebc9c51a: Status 404 returned error can't find the container with id 44abec2d1b2d3ae90e118703fd0d0c57e524c1800450eebe623d6249ebc9c51a
Sep 07 17:26:07.338459 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:07.338421    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3973bf-vdjbh" event={"ID":"67a9f5c9-b8ba-487d-99b1-21aa66bce691","Type":"ContainerStarted","Data":"44abec2d1b2d3ae90e118703fd0d0c57e524c1800450eebe623d6249ebc9c51a"}
Sep 07 17:26:08.344630 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:08.344594    2575 generic.go:356] "Generic (PLEG): container finished" podID="67a9f5c9-b8ba-487d-99b1-21aa66bce691" containerID="bf7fe1b0f7d8611911e713271940f444acab1ff36b9fca4239d79cd1856de881" exitCode=0
Sep 07 17:26:08.345033 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:08.344638    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3973bf-vdjbh" event={"ID":"67a9f5c9-b8ba-487d-99b1-21aa66bce691","Type":"ContainerDied","Data":"bf7fe1b0f7d8611911e713271940f444acab1ff36b9fca4239d79cd1856de881"}
Sep 07 17:26:09.485495 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:09.485470    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3973bf-vdjbh"
Sep 07 17:26:09.597192 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:09.597160    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67a9f5c9-b8ba-487d-99b1-21aa66bce691-maas-api-service-ca\") pod \"67a9f5c9-b8ba-487d-99b1-21aa66bce691\" (UID: \"67a9f5c9-b8ba-487d-99b1-21aa66bce691\") "
Sep 07 17:26:09.597512 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:09.597490    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67a9f5c9-b8ba-487d-99b1-21aa66bce691-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "67a9f5c9-b8ba-487d-99b1-21aa66bce691" (UID: "67a9f5c9-b8ba-487d-99b1-21aa66bce691"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:26:09.698637 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:09.698552    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67a9f5c9-b8ba-487d-99b1-21aa66bce691-maas-api-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:26:10.357011 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:10.356969    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3973bf-vdjbh" event={"ID":"67a9f5c9-b8ba-487d-99b1-21aa66bce691","Type":"ContainerDied","Data":"44abec2d1b2d3ae90e118703fd0d0c57e524c1800450eebe623d6249ebc9c51a"}
Sep 07 17:26:10.357011 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:10.356996    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3973bf-vdjbh"
Sep 07 17:26:10.357227 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:10.357031    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="44abec2d1b2d3ae90e118703fd0d0c57e524c1800450eebe623d6249ebc9c51a"
Sep 07 17:26:15.164768 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:15.164727    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:26:16.972709 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:16.972678    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3973bf-29813355-67hl4"]
Sep 07 17:26:16.973816 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:16.973776    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:26:16.975628 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:16.975604    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3973bf-29813355-67hl4"]
Sep 07 17:26:17.008224 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:17.008183    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2"]
Sep 07 17:26:17.008478 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:17.008431    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2" podUID="6ef4b828-1482-48c5-bfff-76c31f326856" containerName="payload-pre-processing" containerID="cri-o://cecd8b2c8006e0f0da3010517b645f474f213f8688a0cfa1fafbb092b570aef7" gracePeriod=30
Sep 07 17:26:17.073862 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:17.073811    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:26:17.178870 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:17.178801    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:26:17.253273 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:17.253246    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2"
Sep 07 17:26:17.269123 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:17.269098    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3973bf-vdjbh"]
Sep 07 17:26:17.274765 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:17.274723    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3973bf-vdjbh"]
Sep 07 17:26:17.279346 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:17.279316    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:26:17.367196 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:17.367161    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxjzg\" (UniqueName: \"kubernetes.io/projected/6ef4b828-1482-48c5-bfff-76c31f326856-kube-api-access-gxjzg\") pod \"6ef4b828-1482-48c5-bfff-76c31f326856\" (UID: \"6ef4b828-1482-48c5-bfff-76c31f326856\") "
Sep 07 17:26:17.367372 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:17.367213    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ef4b828-1482-48c5-bfff-76c31f326856-plugins-config-volume\") pod \"6ef4b828-1482-48c5-bfff-76c31f326856\" (UID: \"6ef4b828-1482-48c5-bfff-76c31f326856\") "
Sep 07 17:26:17.367602 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:17.367571    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ef4b828-1482-48c5-bfff-76c31f326856-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6ef4b828-1482-48c5-bfff-76c31f326856" (UID: "6ef4b828-1482-48c5-bfff-76c31f326856"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:26:17.369252 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:17.369215    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ef4b828-1482-48c5-bfff-76c31f326856-kube-api-access-gxjzg" (OuterVolumeSpecName: "kube-api-access-gxjzg") pod "6ef4b828-1482-48c5-bfff-76c31f326856" (UID: "6ef4b828-1482-48c5-bfff-76c31f326856"). InnerVolumeSpecName "kube-api-access-gxjzg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:26:17.373424 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:17.373396    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:26:17.395614 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:17.395586    2575 generic.go:356] "Generic (PLEG): container finished" podID="6ef4b828-1482-48c5-bfff-76c31f326856" containerID="cecd8b2c8006e0f0da3010517b645f474f213f8688a0cfa1fafbb092b570aef7" exitCode=0
Sep 07 17:26:17.395727 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:17.395633    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2"
Sep 07 17:26:17.395727 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:17.395664    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2" event={"ID":"6ef4b828-1482-48c5-bfff-76c31f326856","Type":"ContainerDied","Data":"cecd8b2c8006e0f0da3010517b645f474f213f8688a0cfa1fafbb092b570aef7"}
Sep 07 17:26:17.395807 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:17.395734    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2" event={"ID":"6ef4b828-1482-48c5-bfff-76c31f326856","Type":"ContainerDied","Data":"84cfdddb16c9ec734fd8d6558f4fafeb059208411da75b96100f88673f0e182d"}
Sep 07 17:26:17.395807 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:17.395757    2575 scope.go:117] "RemoveContainer" containerID="cecd8b2c8006e0f0da3010517b645f474f213f8688a0cfa1fafbb092b570aef7"
Sep 07 17:26:17.404598 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:17.404582    2575 scope.go:117] "RemoveContainer" containerID="cecd8b2c8006e0f0da3010517b645f474f213f8688a0cfa1fafbb092b570aef7"
Sep 07 17:26:17.404877 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:26:17.404855    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cecd8b2c8006e0f0da3010517b645f474f213f8688a0cfa1fafbb092b570aef7\": container with ID starting with cecd8b2c8006e0f0da3010517b645f474f213f8688a0cfa1fafbb092b570aef7 not found: ID does not exist" containerID="cecd8b2c8006e0f0da3010517b645f474f213f8688a0cfa1fafbb092b570aef7"
Sep 07 17:26:17.404962 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:17.404889    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cecd8b2c8006e0f0da3010517b645f474f213f8688a0cfa1fafbb092b570aef7"} err="failed to get container status \"cecd8b2c8006e0f0da3010517b645f474f213f8688a0cfa1fafbb092b570aef7\": rpc error: code = NotFound desc = could not find container \"cecd8b2c8006e0f0da3010517b645f474f213f8688a0cfa1fafbb092b570aef7\": container with ID starting with cecd8b2c8006e0f0da3010517b645f474f213f8688a0cfa1fafbb092b570aef7 not found: ID does not exist"
Sep 07 17:26:17.420306 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:17.420285    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2"]
Sep 07 17:26:17.424551 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:17.424530    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2"]
Sep 07 17:26:17.468016 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:17.467987    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxjzg\" (UniqueName: \"kubernetes.io/projected/6ef4b828-1482-48c5-bfff-76c31f326856-kube-api-access-gxjzg\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:26:17.468016 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:17.468013    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ef4b828-1482-48c5-bfff-76c31f326856-plugins-config-volume\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:26:17.675842 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:17.675800    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:26:18.721564 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:18.721531    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67a9f5c9-b8ba-487d-99b1-21aa66bce691" path="/var/lib/kubelet/pods/67a9f5c9-b8ba-487d-99b1-21aa66bce691/volumes"
Sep 07 17:26:18.721955 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:18.721928    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ef4b828-1482-48c5-bfff-76c31f326856" path="/var/lib/kubelet/pods/6ef4b828-1482-48c5-bfff-76c31f326856/volumes"
Sep 07 17:26:18.722182 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:18.722169    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc6fb977-a988-44bc-9aca-7a21cff348cf" path="/var/lib/kubelet/pods/fc6fb977-a988-44bc-9aca-7a21cff348cf/volumes"
Sep 07 17:26:23.821480 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:23.821443    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:26:23.914780 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:23.914726    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:26:24.091313 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:24.091196    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:26:46.902662 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:26:46.902627    2575 scope.go:117] "RemoveContainer" containerID="01d2e466a715db4062eb2361ff0d68ed863430bda94b07102e7903a0f3110d1f"
Sep 07 17:27:07.646365 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:27:07.646322    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:27:17.791384 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:27:17.791341    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:27:47.468663 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:27:47.468618    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:27:49.698588 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:27:49.698554    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:27:51.279789 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:27:51.279732    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:29:13.281000 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:29:13.280963    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-87dh2"]
Sep 07 17:29:13.281570 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:29:13.281167    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-87dh2" podUID="23f7abad-ab7c-42cc-a446-4c8bf166158d" containerName="manager" containerID="cri-o://baf14a3421e9df9cca2492ea43fe46a00e5a46b4120b442c6b5e93a36fa0e201" gracePeriod=10
Sep 07 17:29:13.524326 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:29:13.524301    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-87dh2"
Sep 07 17:29:13.593967 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:29:13.593890    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mphj\" (UniqueName: \"kubernetes.io/projected/23f7abad-ab7c-42cc-a446-4c8bf166158d-kube-api-access-4mphj\") pod \"23f7abad-ab7c-42cc-a446-4c8bf166158d\" (UID: \"23f7abad-ab7c-42cc-a446-4c8bf166158d\") "
Sep 07 17:29:13.593967 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:29:13.593967    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/23f7abad-ab7c-42cc-a446-4c8bf166158d-extensions-socket-volume\") pod \"23f7abad-ab7c-42cc-a446-4c8bf166158d\" (UID: \"23f7abad-ab7c-42cc-a446-4c8bf166158d\") "
Sep 07 17:29:13.594380 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:29:13.594355    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23f7abad-ab7c-42cc-a446-4c8bf166158d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "23f7abad-ab7c-42cc-a446-4c8bf166158d" (UID: "23f7abad-ab7c-42cc-a446-4c8bf166158d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:29:13.596075 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:29:13.596049    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23f7abad-ab7c-42cc-a446-4c8bf166158d-kube-api-access-4mphj" (OuterVolumeSpecName: "kube-api-access-4mphj") pod "23f7abad-ab7c-42cc-a446-4c8bf166158d" (UID: "23f7abad-ab7c-42cc-a446-4c8bf166158d"). InnerVolumeSpecName "kube-api-access-4mphj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:29:13.695009 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:29:13.694974    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mphj\" (UniqueName: \"kubernetes.io/projected/23f7abad-ab7c-42cc-a446-4c8bf166158d-kube-api-access-4mphj\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:29:13.695009 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:29:13.695003    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/23f7abad-ab7c-42cc-a446-4c8bf166158d-extensions-socket-volume\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:29:14.276064 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:29:14.276023    2575 generic.go:356] "Generic (PLEG): container finished" podID="23f7abad-ab7c-42cc-a446-4c8bf166158d" containerID="baf14a3421e9df9cca2492ea43fe46a00e5a46b4120b442c6b5e93a36fa0e201" exitCode=0
Sep 07 17:29:14.276246 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:29:14.276075    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-87dh2"
Sep 07 17:29:14.276246 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:29:14.276106    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-87dh2" event={"ID":"23f7abad-ab7c-42cc-a446-4c8bf166158d","Type":"ContainerDied","Data":"baf14a3421e9df9cca2492ea43fe46a00e5a46b4120b442c6b5e93a36fa0e201"}
Sep 07 17:29:14.276246 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:29:14.276158    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-87dh2" event={"ID":"23f7abad-ab7c-42cc-a446-4c8bf166158d","Type":"ContainerDied","Data":"e1cd124b1e8b0fa2314759d7409f8067db0dd2952aafc965859fd6ecba9506a0"}
Sep 07 17:29:14.276246 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:29:14.276182    2575 scope.go:117] "RemoveContainer" containerID="baf14a3421e9df9cca2492ea43fe46a00e5a46b4120b442c6b5e93a36fa0e201"
Sep 07 17:29:14.288144 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:29:14.288120    2575 scope.go:117] "RemoveContainer" containerID="baf14a3421e9df9cca2492ea43fe46a00e5a46b4120b442c6b5e93a36fa0e201"
Sep 07 17:29:14.288677 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:29:14.288657    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"baf14a3421e9df9cca2492ea43fe46a00e5a46b4120b442c6b5e93a36fa0e201\": container with ID starting with baf14a3421e9df9cca2492ea43fe46a00e5a46b4120b442c6b5e93a36fa0e201 not found: ID does not exist" containerID="baf14a3421e9df9cca2492ea43fe46a00e5a46b4120b442c6b5e93a36fa0e201"
Sep 07 17:29:14.288739 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:29:14.288686    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baf14a3421e9df9cca2492ea43fe46a00e5a46b4120b442c6b5e93a36fa0e201"} err="failed to get container status \"baf14a3421e9df9cca2492ea43fe46a00e5a46b4120b442c6b5e93a36fa0e201\": rpc error: code = NotFound desc = could not find container \"baf14a3421e9df9cca2492ea43fe46a00e5a46b4120b442c6b5e93a36fa0e201\": container with ID starting with baf14a3421e9df9cca2492ea43fe46a00e5a46b4120b442c6b5e93a36fa0e201 not found: ID does not exist"
Sep 07 17:29:14.303814 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:29:14.303789    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-87dh2"]
Sep 07 17:29:14.316566 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:29:14.316538    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-87dh2"]
Sep 07 17:29:14.722068 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:29:14.722035    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23f7abad-ab7c-42cc-a446-4c8bf166158d" path="/var/lib/kubelet/pods/23f7abad-ab7c-42cc-a446-4c8bf166158d/volumes"
Sep 07 17:30:00.150938 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:00.150879    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813370-cbgbr"]
Sep 07 17:30:00.151414 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:00.151396    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67a9f5c9-b8ba-487d-99b1-21aa66bce691" containerName="revoke-keys"
Sep 07 17:30:00.151466 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:00.151416    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="67a9f5c9-b8ba-487d-99b1-21aa66bce691" containerName="revoke-keys"
Sep 07 17:30:00.151466 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:00.151431    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23f7abad-ab7c-42cc-a446-4c8bf166158d" containerName="manager"
Sep 07 17:30:00.151466 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:00.151436    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="23f7abad-ab7c-42cc-a446-4c8bf166158d" containerName="manager"
Sep 07 17:30:00.151466 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:00.151455    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ef4b828-1482-48c5-bfff-76c31f326856" containerName="payload-pre-processing"
Sep 07 17:30:00.151466 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:00.151462    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ef4b828-1482-48c5-bfff-76c31f326856" containerName="payload-pre-processing"
Sep 07 17:30:00.151631 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:00.151516    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ef4b828-1482-48c5-bfff-76c31f326856" containerName="payload-pre-processing"
Sep 07 17:30:00.151631 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:00.151529    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="67a9f5c9-b8ba-487d-99b1-21aa66bce691" containerName="revoke-keys"
Sep 07 17:30:00.151631 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:00.151536    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="23f7abad-ab7c-42cc-a446-4c8bf166158d" containerName="manager"
Sep 07 17:30:00.154586 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:00.154570    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813370-cbgbr"
Sep 07 17:30:00.157191 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:00.157170    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qphph\""
Sep 07 17:30:00.164755 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:00.164728    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813370-cbgbr"]
Sep 07 17:30:00.165386 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:00.165367    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813370-cbgbr"
Sep 07 17:30:00.435787 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:00.435758    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813370-cbgbr"]
Sep 07 17:30:00.436821 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:30:00.436794    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1baa104b_f330_453e_93bc_45e3eeca426d.slice/crio-cfd431f752e6c2165ba8ad67742b9124bd54b4336ef978c4c6f4256be3b7d6c5 WatchSource:0}: Error finding container cfd431f752e6c2165ba8ad67742b9124bd54b4336ef978c4c6f4256be3b7d6c5: Status 404 returned error can't find the container with id cfd431f752e6c2165ba8ad67742b9124bd54b4336ef978c4c6f4256be3b7d6c5
Sep 07 17:30:00.513155 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:00.513122    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813370-cbgbr" event={"ID":"1baa104b-f330-453e-93bc-45e3eeca426d","Type":"ContainerStarted","Data":"cfd431f752e6c2165ba8ad67742b9124bd54b4336ef978c4c6f4256be3b7d6c5"}
Sep 07 17:30:01.519577 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:01.519489    2575 generic.go:356] "Generic (PLEG): container finished" podID="1baa104b-f330-453e-93bc-45e3eeca426d" containerID="42402b7ff1ce86d0fbaeaf43f6b0e7cac56ed434ab5719ce88ff9d76be31c01c" exitCode=0
Sep 07 17:30:01.519969 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:01.519570    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813370-cbgbr" event={"ID":"1baa104b-f330-453e-93bc-45e3eeca426d","Type":"ContainerDied","Data":"42402b7ff1ce86d0fbaeaf43f6b0e7cac56ed434ab5719ce88ff9d76be31c01c"}
Sep 07 17:30:02.658798 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:02.658772    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813370-cbgbr"
Sep 07 17:30:03.536741 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:03.536712    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813370-cbgbr"
Sep 07 17:30:03.536948 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:03.536711    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813370-cbgbr" event={"ID":"1baa104b-f330-453e-93bc-45e3eeca426d","Type":"ContainerDied","Data":"cfd431f752e6c2165ba8ad67742b9124bd54b4336ef978c4c6f4256be3b7d6c5"}
Sep 07 17:30:03.536948 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:03.536835    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cfd431f752e6c2165ba8ad67742b9124bd54b4336ef978c4c6f4256be3b7d6c5"
Sep 07 17:30:13.951374 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:13.951314    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbzdp"]
Sep 07 17:30:13.951769 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:13.951755    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1baa104b-f330-453e-93bc-45e3eeca426d" containerName="cleanup"
Sep 07 17:30:13.951814 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:13.951770    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1baa104b-f330-453e-93bc-45e3eeca426d" containerName="cleanup"
Sep 07 17:30:13.951850 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:13.951845    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1baa104b-f330-453e-93bc-45e3eeca426d" containerName="cleanup"
Sep 07 17:30:13.954883 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:13.954866    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbzdp"
Sep 07 17:30:13.958420 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:13.958401    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 07 17:30:13.959258 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:13.959243    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-clssw\""
Sep 07 17:30:13.959341 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:13.959324    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 07 17:30:13.973781 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:13.973742    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbzdp"]
Sep 07 17:30:14.059652 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:14.059610    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n72gh\" (UniqueName: \"kubernetes.io/projected/3f41c71b-f06e-4ede-b022-e3abd118d18d-kube-api-access-n72gh\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-cbzdp\" (UID: \"3f41c71b-f06e-4ede-b022-e3abd118d18d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbzdp"
Sep 07 17:30:14.059652 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:14.059654    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f41c71b-f06e-4ede-b022-e3abd118d18d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-cbzdp\" (UID: \"3f41c71b-f06e-4ede-b022-e3abd118d18d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbzdp"
Sep 07 17:30:14.161083 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:14.161040    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n72gh\" (UniqueName: \"kubernetes.io/projected/3f41c71b-f06e-4ede-b022-e3abd118d18d-kube-api-access-n72gh\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-cbzdp\" (UID: \"3f41c71b-f06e-4ede-b022-e3abd118d18d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbzdp"
Sep 07 17:30:14.161255 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:14.161091    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f41c71b-f06e-4ede-b022-e3abd118d18d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-cbzdp\" (UID: \"3f41c71b-f06e-4ede-b022-e3abd118d18d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbzdp"
Sep 07 17:30:14.161560 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:14.161540    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f41c71b-f06e-4ede-b022-e3abd118d18d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-cbzdp\" (UID: \"3f41c71b-f06e-4ede-b022-e3abd118d18d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbzdp"
Sep 07 17:30:14.173744 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:14.173720    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n72gh\" (UniqueName: \"kubernetes.io/projected/3f41c71b-f06e-4ede-b022-e3abd118d18d-kube-api-access-n72gh\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-cbzdp\" (UID: \"3f41c71b-f06e-4ede-b022-e3abd118d18d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbzdp"
Sep 07 17:30:14.265960 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:14.265841    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbzdp"
Sep 07 17:30:14.548303 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:14.548274    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbzdp"]
Sep 07 17:30:14.548973 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:30:14.548942    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f41c71b_f06e_4ede_b022_e3abd118d18d.slice/crio-d653cb7f784aa3b74a785a07b257c206b0cf1c8328f5f2254f0bc8772d653c80 WatchSource:0}: Error finding container d653cb7f784aa3b74a785a07b257c206b0cf1c8328f5f2254f0bc8772d653c80: Status 404 returned error can't find the container with id d653cb7f784aa3b74a785a07b257c206b0cf1c8328f5f2254f0bc8772d653c80
Sep 07 17:30:14.591152 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:14.591120    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbzdp" event={"ID":"3f41c71b-f06e-4ede-b022-e3abd118d18d","Type":"ContainerStarted","Data":"d653cb7f784aa3b74a785a07b257c206b0cf1c8328f5f2254f0bc8772d653c80"}
Sep 07 17:30:15.598427 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:15.598394    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbzdp" event={"ID":"3f41c71b-f06e-4ede-b022-e3abd118d18d","Type":"ContainerStarted","Data":"c937cb227597b10ab06e2511e98388bc4d161965c09a94b6b334a3ac64bc8882"}
Sep 07 17:30:15.598814 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:15.598455    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbzdp"
Sep 07 17:30:15.625731 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:15.625682    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbzdp" podStartSLOduration=2.625665396 podStartE2EDuration="2.625665396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:30:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:30:15.622059878 +0000 UTC m=+2009.518907192" watchObservedRunningTime="2026-09-07 17:30:15.625665396 +0000 UTC m=+2009.522512711"
Sep 07 17:30:26.606432 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:30:26.606399    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbzdp"
Sep 07 17:31:05.033622 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:05.033587    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"]
Sep 07 17:31:05.037232 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:05.037206    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"
Sep 07 17:31:05.040317 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:05.040297    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-267c53da-kserve-self-signed-certs\""
Sep 07 17:31:05.047748 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:05.047725    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"]
Sep 07 17:31:05.108378 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:05.108342    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:31:05.137279 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:05.137247    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cf73872-60dc-454d-853c-9dc4680c0cd0-tmp-dir\") pod \"e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z\" (UID: \"1cf73872-60dc-454d-853c-9dc4680c0cd0\") " pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"
Sep 07 17:31:05.137279 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:05.137279    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1cf73872-60dc-454d-853c-9dc4680c0cd0-tls-certs\") pod \"e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z\" (UID: \"1cf73872-60dc-454d-853c-9dc4680c0cd0\") " pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"
Sep 07 17:31:05.137483 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:05.137304    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1cf73872-60dc-454d-853c-9dc4680c0cd0-dshm\") pod \"e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z\" (UID: \"1cf73872-60dc-454d-853c-9dc4680c0cd0\") " pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"
Sep 07 17:31:05.137483 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:05.137322    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7wzd\" (UniqueName: \"kubernetes.io/projected/1cf73872-60dc-454d-853c-9dc4680c0cd0-kube-api-access-t7wzd\") pod \"e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z\" (UID: \"1cf73872-60dc-454d-853c-9dc4680c0cd0\") " pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"
Sep 07 17:31:05.137483 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:05.137419    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1cf73872-60dc-454d-853c-9dc4680c0cd0-model-cache\") pod \"e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z\" (UID: \"1cf73872-60dc-454d-853c-9dc4680c0cd0\") " pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"
Sep 07 17:31:05.137483 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:05.137466    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1cf73872-60dc-454d-853c-9dc4680c0cd0-home\") pod \"e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z\" (UID: \"1cf73872-60dc-454d-853c-9dc4680c0cd0\") " pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"
Sep 07 17:31:05.238007 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:05.237968    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1cf73872-60dc-454d-853c-9dc4680c0cd0-model-cache\") pod \"e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z\" (UID: \"1cf73872-60dc-454d-853c-9dc4680c0cd0\") " pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"
Sep 07 17:31:05.238190 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:05.238026    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1cf73872-60dc-454d-853c-9dc4680c0cd0-home\") pod \"e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z\" (UID: \"1cf73872-60dc-454d-853c-9dc4680c0cd0\") " pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"
Sep 07 17:31:05.238190 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:05.238070    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cf73872-60dc-454d-853c-9dc4680c0cd0-tmp-dir\") pod \"e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z\" (UID: \"1cf73872-60dc-454d-853c-9dc4680c0cd0\") " pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"
Sep 07 17:31:05.238190 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:05.238086    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1cf73872-60dc-454d-853c-9dc4680c0cd0-tls-certs\") pod \"e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z\" (UID: \"1cf73872-60dc-454d-853c-9dc4680c0cd0\") " pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"
Sep 07 17:31:05.238190 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:05.238122    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1cf73872-60dc-454d-853c-9dc4680c0cd0-dshm\") pod \"e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z\" (UID: \"1cf73872-60dc-454d-853c-9dc4680c0cd0\") " pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"
Sep 07 17:31:05.238190 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:05.238147    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7wzd\" (UniqueName: \"kubernetes.io/projected/1cf73872-60dc-454d-853c-9dc4680c0cd0-kube-api-access-t7wzd\") pod \"e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z\" (UID: \"1cf73872-60dc-454d-853c-9dc4680c0cd0\") " pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"
Sep 07 17:31:05.238480 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:05.238378    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1cf73872-60dc-454d-853c-9dc4680c0cd0-model-cache\") pod \"e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z\" (UID: \"1cf73872-60dc-454d-853c-9dc4680c0cd0\") " pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"
Sep 07 17:31:05.238480 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:05.238427    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1cf73872-60dc-454d-853c-9dc4680c0cd0-home\") pod \"e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z\" (UID: \"1cf73872-60dc-454d-853c-9dc4680c0cd0\") " pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"
Sep 07 17:31:05.238572 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:05.238519    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cf73872-60dc-454d-853c-9dc4680c0cd0-tmp-dir\") pod \"e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z\" (UID: \"1cf73872-60dc-454d-853c-9dc4680c0cd0\") " pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"
Sep 07 17:31:05.240329 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:05.240309    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1cf73872-60dc-454d-853c-9dc4680c0cd0-dshm\") pod \"e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z\" (UID: \"1cf73872-60dc-454d-853c-9dc4680c0cd0\") " pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"
Sep 07 17:31:05.240605 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:05.240585    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1cf73872-60dc-454d-853c-9dc4680c0cd0-tls-certs\") pod \"e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z\" (UID: \"1cf73872-60dc-454d-853c-9dc4680c0cd0\") " pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"
Sep 07 17:31:05.247250 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:05.247226    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7wzd\" (UniqueName: \"kubernetes.io/projected/1cf73872-60dc-454d-853c-9dc4680c0cd0-kube-api-access-t7wzd\") pod \"e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z\" (UID: \"1cf73872-60dc-454d-853c-9dc4680c0cd0\") " pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"
Sep 07 17:31:05.347061 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:05.347022    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"
Sep 07 17:31:05.621537 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:05.621513    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"]
Sep 07 17:31:05.623524 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:31:05.623501    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1cf73872_60dc_454d_853c_9dc4680c0cd0.slice/crio-262de469b4928b63e2c051b028602d25dfc1a670c9e3e56f1c8fbada2a1ad852 WatchSource:0}: Error finding container 262de469b4928b63e2c051b028602d25dfc1a670c9e3e56f1c8fbada2a1ad852: Status 404 returned error can't find the container with id 262de469b4928b63e2c051b028602d25dfc1a670c9e3e56f1c8fbada2a1ad852
Sep 07 17:31:05.862627 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:05.862588    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z" event={"ID":"1cf73872-60dc-454d-853c-9dc4680c0cd0","Type":"ContainerStarted","Data":"9d14546a4f176d3abfbf925f29eb508975579113b66fd5295e539533fac0371d"}
Sep 07 17:31:05.862627 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:05.862634    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z" event={"ID":"1cf73872-60dc-454d-853c-9dc4680c0cd0","Type":"ContainerStarted","Data":"262de469b4928b63e2c051b028602d25dfc1a670c9e3e56f1c8fbada2a1ad852"}
Sep 07 17:31:05.883717 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:05.883609    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z" podStartSLOduration=0.88359469 podStartE2EDuration="883.59469ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:31:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:31:05.881552885 +0000 UTC m=+2059.778400201" watchObservedRunningTime="2026-09-07 17:31:05.88359469 +0000 UTC m=+2059.780442047"
Sep 07 17:31:11.320529 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:11.320445    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:31:11.392945 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:11.392884    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:31:15.348155 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:15.348106    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"
Sep 07 17:31:15.348155 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:15.348160    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"
Sep 07 17:31:15.361037 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:15.361012    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"
Sep 07 17:31:15.923070 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:15.923039    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"
Sep 07 17:31:18.555507 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:18.555470    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:31:29.198404 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:29.198361    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:31:46.967333 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:46.967298    2575 scope.go:117] "RemoveContainer" containerID="7c1f584461bbb3fe25ba107d51a5ca72258fadf6658e3c668e03615d6141369c"
Sep 07 17:31:58.091402 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:58.091369    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"]
Sep 07 17:31:58.114607 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:31:58.114578    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:32:00.128178 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:00.128149    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:32:13.111171 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:13.111131    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z" podUID="1cf73872-60dc-454d-853c-9dc4680c0cd0" containerName="main" containerID="cri-o://9d14546a4f176d3abfbf925f29eb508975579113b66fd5295e539533fac0371d" gracePeriod=45
Sep 07 17:32:13.355660 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:13.355635    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"
Sep 07 17:32:13.496832 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:13.496735    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1cf73872-60dc-454d-853c-9dc4680c0cd0-dshm\") pod \"1cf73872-60dc-454d-853c-9dc4680c0cd0\" (UID: \"1cf73872-60dc-454d-853c-9dc4680c0cd0\") "
Sep 07 17:32:13.496832 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:13.496781    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1cf73872-60dc-454d-853c-9dc4680c0cd0-model-cache\") pod \"1cf73872-60dc-454d-853c-9dc4680c0cd0\" (UID: \"1cf73872-60dc-454d-853c-9dc4680c0cd0\") "
Sep 07 17:32:13.496832 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:13.496812    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cf73872-60dc-454d-853c-9dc4680c0cd0-tmp-dir\") pod \"1cf73872-60dc-454d-853c-9dc4680c0cd0\" (UID: \"1cf73872-60dc-454d-853c-9dc4680c0cd0\") "
Sep 07 17:32:13.497148 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:13.496865    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1cf73872-60dc-454d-853c-9dc4680c0cd0-tls-certs\") pod \"1cf73872-60dc-454d-853c-9dc4680c0cd0\" (UID: \"1cf73872-60dc-454d-853c-9dc4680c0cd0\") "
Sep 07 17:32:13.497148 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:13.496944    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7wzd\" (UniqueName: \"kubernetes.io/projected/1cf73872-60dc-454d-853c-9dc4680c0cd0-kube-api-access-t7wzd\") pod \"1cf73872-60dc-454d-853c-9dc4680c0cd0\" (UID: \"1cf73872-60dc-454d-853c-9dc4680c0cd0\") "
Sep 07 17:32:13.497148 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:13.496995    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1cf73872-60dc-454d-853c-9dc4680c0cd0-home\") pod \"1cf73872-60dc-454d-853c-9dc4680c0cd0\" (UID: \"1cf73872-60dc-454d-853c-9dc4680c0cd0\") "
Sep 07 17:32:13.497148 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:13.497091    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cf73872-60dc-454d-853c-9dc4680c0cd0-model-cache" (OuterVolumeSpecName: "model-cache") pod "1cf73872-60dc-454d-853c-9dc4680c0cd0" (UID: "1cf73872-60dc-454d-853c-9dc4680c0cd0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:32:13.497148 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:13.497140    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cf73872-60dc-454d-853c-9dc4680c0cd0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1cf73872-60dc-454d-853c-9dc4680c0cd0" (UID: "1cf73872-60dc-454d-853c-9dc4680c0cd0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:32:13.497417 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:13.497340    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1cf73872-60dc-454d-853c-9dc4680c0cd0-model-cache\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:32:13.497417 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:13.497402    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cf73872-60dc-454d-853c-9dc4680c0cd0-tmp-dir\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:32:13.497417 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:13.497338    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cf73872-60dc-454d-853c-9dc4680c0cd0-home" (OuterVolumeSpecName: "home") pod "1cf73872-60dc-454d-853c-9dc4680c0cd0" (UID: "1cf73872-60dc-454d-853c-9dc4680c0cd0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:32:13.499229 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:13.499197    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cf73872-60dc-454d-853c-9dc4680c0cd0-kube-api-access-t7wzd" (OuterVolumeSpecName: "kube-api-access-t7wzd") pod "1cf73872-60dc-454d-853c-9dc4680c0cd0" (UID: "1cf73872-60dc-454d-853c-9dc4680c0cd0"). InnerVolumeSpecName "kube-api-access-t7wzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:32:13.499324 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:13.499228    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cf73872-60dc-454d-853c-9dc4680c0cd0-dshm" (OuterVolumeSpecName: "dshm") pod "1cf73872-60dc-454d-853c-9dc4680c0cd0" (UID: "1cf73872-60dc-454d-853c-9dc4680c0cd0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:32:13.499324 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:13.499236    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cf73872-60dc-454d-853c-9dc4680c0cd0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1cf73872-60dc-454d-853c-9dc4680c0cd0" (UID: "1cf73872-60dc-454d-853c-9dc4680c0cd0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:32:13.598096 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:13.598057    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1cf73872-60dc-454d-853c-9dc4680c0cd0-home\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:32:13.598096 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:13.598087    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1cf73872-60dc-454d-853c-9dc4680c0cd0-dshm\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:32:13.598096 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:13.598098    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1cf73872-60dc-454d-853c-9dc4680c0cd0-tls-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:32:13.598327 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:13.598109    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7wzd\" (UniqueName: \"kubernetes.io/projected/1cf73872-60dc-454d-853c-9dc4680c0cd0-kube-api-access-t7wzd\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Sep 07 17:32:14.210599 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:14.210562    2575 generic.go:356] "Generic (PLEG): container finished" podID="1cf73872-60dc-454d-853c-9dc4680c0cd0" containerID="9d14546a4f176d3abfbf925f29eb508975579113b66fd5295e539533fac0371d" exitCode=0
Sep 07 17:32:14.211032 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:14.210609    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"
Sep 07 17:32:14.211032 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:14.210639    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z" event={"ID":"1cf73872-60dc-454d-853c-9dc4680c0cd0","Type":"ContainerDied","Data":"9d14546a4f176d3abfbf925f29eb508975579113b66fd5295e539533fac0371d"}
Sep 07 17:32:14.211032 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:14.210680    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z" event={"ID":"1cf73872-60dc-454d-853c-9dc4680c0cd0","Type":"ContainerDied","Data":"262de469b4928b63e2c051b028602d25dfc1a670c9e3e56f1c8fbada2a1ad852"}
Sep 07 17:32:14.211032 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:14.210696    2575 scope.go:117] "RemoveContainer" containerID="9d14546a4f176d3abfbf925f29eb508975579113b66fd5295e539533fac0371d"
Sep 07 17:32:14.222506 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:14.222486    2575 scope.go:117] "RemoveContainer" containerID="9d14546a4f176d3abfbf925f29eb508975579113b66fd5295e539533fac0371d"
Sep 07 17:32:14.222814 ip-10-0-136-3 kubenswrapper[2575]: E0907 17:32:14.222785    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d14546a4f176d3abfbf925f29eb508975579113b66fd5295e539533fac0371d\": container with ID starting with 9d14546a4f176d3abfbf925f29eb508975579113b66fd5295e539533fac0371d not found: ID does not exist" containerID="9d14546a4f176d3abfbf925f29eb508975579113b66fd5295e539533fac0371d"
Sep 07 17:32:14.222936 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:14.222823    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d14546a4f176d3abfbf925f29eb508975579113b66fd5295e539533fac0371d"} err="failed to get container status \"9d14546a4f176d3abfbf925f29eb508975579113b66fd5295e539533fac0371d\": rpc error: code = NotFound desc = could not find container \"9d14546a4f176d3abfbf925f29eb508975579113b66fd5295e539533fac0371d\": container with ID starting with 9d14546a4f176d3abfbf925f29eb508975579113b66fd5295e539533fac0371d not found: ID does not exist"
Sep 07 17:32:14.234599 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:14.234576    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"]
Sep 07 17:32:14.238723 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:14.238702    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-267c53da-kserve-69658f7c6c-fbn6z"]
Sep 07 17:32:14.722115 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:14.722080    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cf73872-60dc-454d-853c-9dc4680c0cd0" path="/var/lib/kubelet/pods/1cf73872-60dc-454d-853c-9dc4680c0cd0/volumes"
Sep 07 17:32:16.876023 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:16.875992    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-79b64964bc-hqm68"]
Sep 07 17:32:16.876485 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:16.876398    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cf73872-60dc-454d-853c-9dc4680c0cd0" containerName="main"
Sep 07 17:32:16.876485 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:16.876411    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cf73872-60dc-454d-853c-9dc4680c0cd0" containerName="main"
Sep 07 17:32:16.876607 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:16.876494    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cf73872-60dc-454d-853c-9dc4680c0cd0" containerName="main"
Sep 07 17:32:16.881133 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:16.881111    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79b64964bc-hqm68"
Sep 07 17:32:16.884862 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:16.884830    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 07 17:32:16.884862 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:16.884832    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 17:32:16.885088 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:16.884832    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rggbk\""
Sep 07 17:32:16.885088 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:16.884880    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 07 17:32:16.885088 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:16.884884    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 07 17:32:16.906510 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:16.906480    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-79b64964bc-hqm68"]
Sep 07 17:32:17.031352 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:17.031319    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63be495b-314f-4d8b-8411-b491b530d074-openshift-service-ca\") pod \"maas-api-79b64964bc-hqm68\" (UID: \"63be495b-314f-4d8b-8411-b491b530d074\") " pod="odh-ai-gateway-infra/maas-api-79b64964bc-hqm68"
Sep 07 17:32:17.031524 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:17.031357    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63be495b-314f-4d8b-8411-b491b530d074-metrics-certs\") pod \"maas-api-79b64964bc-hqm68\" (UID: \"63be495b-314f-4d8b-8411-b491b530d074\") " pod="odh-ai-gateway-infra/maas-api-79b64964bc-hqm68"
Sep 07 17:32:17.031524 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:17.031393    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w859j\" (UniqueName: \"kubernetes.io/projected/63be495b-314f-4d8b-8411-b491b530d074-kube-api-access-w859j\") pod \"maas-api-79b64964bc-hqm68\" (UID: \"63be495b-314f-4d8b-8411-b491b530d074\") " pod="odh-ai-gateway-infra/maas-api-79b64964bc-hqm68"
Sep 07 17:32:17.031524 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:17.031464    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63be495b-314f-4d8b-8411-b491b530d074-maas-api-tls\") pod \"maas-api-79b64964bc-hqm68\" (UID: \"63be495b-314f-4d8b-8411-b491b530d074\") " pod="odh-ai-gateway-infra/maas-api-79b64964bc-hqm68"
Sep 07 17:32:17.133011 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:17.132916    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w859j\" (UniqueName: \"kubernetes.io/projected/63be495b-314f-4d8b-8411-b491b530d074-kube-api-access-w859j\") pod \"maas-api-79b64964bc-hqm68\" (UID: \"63be495b-314f-4d8b-8411-b491b530d074\") " pod="odh-ai-gateway-infra/maas-api-79b64964bc-hqm68"
Sep 07 17:32:17.133011 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:17.132972    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63be495b-314f-4d8b-8411-b491b530d074-maas-api-tls\") pod \"maas-api-79b64964bc-hqm68\" (UID: \"63be495b-314f-4d8b-8411-b491b530d074\") " pod="odh-ai-gateway-infra/maas-api-79b64964bc-hqm68"
Sep 07 17:32:17.133250 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:17.133076    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63be495b-314f-4d8b-8411-b491b530d074-openshift-service-ca\") pod \"maas-api-79b64964bc-hqm68\" (UID: \"63be495b-314f-4d8b-8411-b491b530d074\") " pod="odh-ai-gateway-infra/maas-api-79b64964bc-hqm68"
Sep 07 17:32:17.133250 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:17.133093    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63be495b-314f-4d8b-8411-b491b530d074-metrics-certs\") pod \"maas-api-79b64964bc-hqm68\" (UID: \"63be495b-314f-4d8b-8411-b491b530d074\") " pod="odh-ai-gateway-infra/maas-api-79b64964bc-hqm68"
Sep 07 17:32:17.133747 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:17.133723    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63be495b-314f-4d8b-8411-b491b530d074-openshift-service-ca\") pod \"maas-api-79b64964bc-hqm68\" (UID: \"63be495b-314f-4d8b-8411-b491b530d074\") " pod="odh-ai-gateway-infra/maas-api-79b64964bc-hqm68"
Sep 07 17:32:17.135552 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:17.135520    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63be495b-314f-4d8b-8411-b491b530d074-metrics-certs\") pod \"maas-api-79b64964bc-hqm68\" (UID: \"63be495b-314f-4d8b-8411-b491b530d074\") " pod="odh-ai-gateway-infra/maas-api-79b64964bc-hqm68"
Sep 07 17:32:17.135646 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:17.135601    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63be495b-314f-4d8b-8411-b491b530d074-maas-api-tls\") pod \"maas-api-79b64964bc-hqm68\" (UID: \"63be495b-314f-4d8b-8411-b491b530d074\") " pod="odh-ai-gateway-infra/maas-api-79b64964bc-hqm68"
Sep 07 17:32:17.144220 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:17.144196    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w859j\" (UniqueName: \"kubernetes.io/projected/63be495b-314f-4d8b-8411-b491b530d074-kube-api-access-w859j\") pod \"maas-api-79b64964bc-hqm68\" (UID: \"63be495b-314f-4d8b-8411-b491b530d074\") " pod="odh-ai-gateway-infra/maas-api-79b64964bc-hqm68"
Sep 07 17:32:17.192692 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:17.192661    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79b64964bc-hqm68"
Sep 07 17:32:17.471465 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:17.471434    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-79b64964bc-hqm68"]
Sep 07 17:32:17.472593 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:32:17.472553    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63be495b_314f_4d8b_8411_b491b530d074.slice/crio-d9305bf1269747227cf907258cf8d0d421ec6bb0c4c6f9fd4b3b7dceec55cf10 WatchSource:0}: Error finding container d9305bf1269747227cf907258cf8d0d421ec6bb0c4c6f9fd4b3b7dceec55cf10: Status 404 returned error can't find the container with id d9305bf1269747227cf907258cf8d0d421ec6bb0c4c6f9fd4b3b7dceec55cf10
Sep 07 17:32:17.474191 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:17.474170    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 17:32:18.232559 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:18.232463    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79b64964bc-hqm68" event={"ID":"63be495b-314f-4d8b-8411-b491b530d074","Type":"ContainerStarted","Data":"4ed234ee8153924d3eb398d074d8338d5b0420eadd6611224518af6d1bed00ee"}
Sep 07 17:32:18.232559 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:18.232518    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79b64964bc-hqm68" event={"ID":"63be495b-314f-4d8b-8411-b491b530d074","Type":"ContainerStarted","Data":"d9305bf1269747227cf907258cf8d0d421ec6bb0c4c6f9fd4b3b7dceec55cf10"}
Sep 07 17:32:18.232986 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:18.232650    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-79b64964bc-hqm68"
Sep 07 17:32:18.252674 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:18.252621    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-79b64964bc-hqm68" podStartSLOduration=1.802294887 podStartE2EDuration="2.252606036s" totalImagesPullingTime="450.311149ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:32:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:32:18.251241537 +0000 UTC m=+2132.148088852" watchObservedRunningTime="2026-09-07 17:32:18.252606036 +0000 UTC m=+2132.149453350"
Sep 07 17:32:23.793479 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:23.793440    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:32:24.242836 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:24.242757    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-79b64964bc-hqm68"
Sep 07 17:32:46.987212 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:46.987177    2575 scope.go:117] "RemoveContainer" containerID="bac0a26e06d27efd2ff60b5418c25bf9d8609c3dd93cab02ec451f831b95acb1"
Sep 07 17:32:46.995714 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:46.995691    2575 scope.go:117] "RemoveContainer" containerID="bf7fe1b0f7d8611911e713271940f444acab1ff36b9fca4239d79cd1856de881"
Sep 07 17:32:54.627412 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:54.627380    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f6f7795c7-49td6_e1a5075b-6756-47de-b470-1e12271e53da/copy-manifests/0.log"
Sep 07 17:32:54.634422 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:54.634396    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f6f7795c7-49td6_e1a5075b-6756-47de-b470-1e12271e53da/manager/0.log"
Sep 07 17:32:55.312470 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:55.312440    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-79b64964bc-hqm68_63be495b-314f-4d8b-8411-b491b530d074/maas-api/0.log"
Sep 07 17:32:55.533732 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:55.533703    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29813370-cbgbr_1baa104b-f330-453e-93bc-45e3eeca426d/cleanup/0.log"
Sep 07 17:32:56.860427 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:56.860397    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-cbzdp_3f41c71b-f06e-4ede-b022-e3abd118d18d/manager/0.log"
Sep 07 17:32:57.663376 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:57.663345    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b977b55fb-krqn2_db0b8389-c068-4235-887d-a190f72b93eb/kube-auth-proxy/0.log"
Sep 07 17:32:58.001451 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:58.001371    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-kr5xx_782e4901-4c16-448e-87b9-b5de59e6e152/payload-pre-processing/0.log"
Sep 07 17:32:58.796822 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:58.796791    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-w2pvd_5b2ab3b8-6f0c-4862-8f92-365968c679f1/main/0.log"
Sep 07 17:32:59.013729 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:59.013701    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvn2q4_87c132b9-55a3-4365-a875-fcffc61cb2cc/main/0.log"
Sep 07 17:32:59.240705 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:32:59.240635    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-mln9w_f7c12ead-c1c3-4352-8100-1207bdcfb82e/main/0.log"
Sep 07 17:33:04.588961 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:04.588925    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:33:04.688653 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:04.688619    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log" limit=1024
Sep 07 17:33:07.761508 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:07.761479    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-g54wv_f6ab0a94-0f1c-496c-9072-1c50fcbcfadc/global-pull-secret-syncer/0.log"
Sep 07 17:33:07.965686 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:07.965659    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6l488_d92ac6a3-1ea8-4de3-ac1a-45583a6139d9/konnectivity-agent/0.log"
Sep 07 17:33:08.126123 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:08.126075    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-3.ec2.internal_1f6bdbab6cf05f88305dbbed7f882a37/haproxy/0.log"
Sep 07 17:33:13.302281 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:13.302250    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-cbzdp_3f41c71b-f06e-4ede-b022-e3abd118d18d/manager/0.log"
Sep 07 17:33:14.738142 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:14.738056    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8daa49bc-25cf-4cf4-8369-6db2fb1b5b11/alertmanager/0.log"
Sep 07 17:33:14.769402 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:14.769373    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8daa49bc-25cf-4cf4-8369-6db2fb1b5b11/config-reloader/0.log"
Sep 07 17:33:14.798488 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:14.798455    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8daa49bc-25cf-4cf4-8369-6db2fb1b5b11/kube-rbac-proxy-web/0.log"
Sep 07 17:33:14.831084 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:14.831059    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8daa49bc-25cf-4cf4-8369-6db2fb1b5b11/kube-rbac-proxy/0.log"
Sep 07 17:33:14.906111 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:14.906081    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8daa49bc-25cf-4cf4-8369-6db2fb1b5b11/kube-rbac-proxy-metric/0.log"
Sep 07 17:33:14.932489 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:14.932461    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8daa49bc-25cf-4cf4-8369-6db2fb1b5b11/prom-label-proxy/0.log"
Sep 07 17:33:14.971328 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:14.971308    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8daa49bc-25cf-4cf4-8369-6db2fb1b5b11/init-config-reloader/0.log"
Sep 07 17:33:15.082680 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:15.082654    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-f8tld_768b449d-d44e-4a85-8b5f-7e8b571faed3/kube-state-metrics/0.log"
Sep 07 17:33:15.129687 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:15.129662    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-f8tld_768b449d-d44e-4a85-8b5f-7e8b571faed3/kube-rbac-proxy-main/0.log"
Sep 07 17:33:15.154717 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:15.154692    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-f8tld_768b449d-d44e-4a85-8b5f-7e8b571faed3/kube-rbac-proxy-self/0.log"
Sep 07 17:33:15.185462 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:15.185436    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7c658bfc5c-jlrd9_cdb8d674-3d7f-449c-bedc-770791095e6d/metrics-server/0.log"
Sep 07 17:33:15.211691 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:15.211669    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-jl479_580463c2-35f7-4985-bfc6-c6d68d5d396a/monitoring-plugin/0.log"
Sep 07 17:33:15.363206 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:15.363130    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hqmt2_ff018cdc-ce65-469a-af7e-67b7d8ad594b/node-exporter/0.log"
Sep 07 17:33:15.397142 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:15.397113    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hqmt2_ff018cdc-ce65-469a-af7e-67b7d8ad594b/kube-rbac-proxy/0.log"
Sep 07 17:33:15.425331 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:15.425309    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hqmt2_ff018cdc-ce65-469a-af7e-67b7d8ad594b/init-textfile/0.log"
Sep 07 17:33:15.575518 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:15.575487    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-hmmgj_27653d59-ca6e-4a9f-a3ca-660a338bad78/kube-rbac-proxy-main/0.log"
Sep 07 17:33:15.607384 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:15.607356    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-hmmgj_27653d59-ca6e-4a9f-a3ca-660a338bad78/kube-rbac-proxy-self/0.log"
Sep 07 17:33:15.634559 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:15.634498    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-hmmgj_27653d59-ca6e-4a9f-a3ca-660a338bad78/openshift-state-metrics/0.log"
Sep 07 17:33:15.673944 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:15.673922    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11978911-17b6-4bcd-9b8a-f5e78dd4ab79/prometheus/0.log"
Sep 07 17:33:15.698499 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:15.698477    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11978911-17b6-4bcd-9b8a-f5e78dd4ab79/config-reloader/0.log"
Sep 07 17:33:15.726730 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:15.726706    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11978911-17b6-4bcd-9b8a-f5e78dd4ab79/thanos-sidecar/0.log"
Sep 07 17:33:15.754650 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:15.754610    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11978911-17b6-4bcd-9b8a-f5e78dd4ab79/kube-rbac-proxy-web/0.log"
Sep 07 17:33:15.788101 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:15.788080    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11978911-17b6-4bcd-9b8a-f5e78dd4ab79/kube-rbac-proxy/0.log"
Sep 07 17:33:15.819671 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:15.819647    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11978911-17b6-4bcd-9b8a-f5e78dd4ab79/kube-rbac-proxy-thanos/0.log"
Sep 07 17:33:15.844228 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:15.844205    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11978911-17b6-4bcd-9b8a-f5e78dd4ab79/init-config-reloader/0.log"
Sep 07 17:33:15.881937 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:15.881909    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-m928w_efdb8c9b-af4f-44fe-a2c6-fa66e7e7bc42/prometheus-operator/0.log"
Sep 07 17:33:15.911707 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:15.911641    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-m928w_efdb8c9b-af4f-44fe-a2c6-fa66e7e7bc42/kube-rbac-proxy/0.log"
Sep 07 17:33:15.937977 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:15.937953    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-rpb2w_a5202dd8-27cf-466b-a27f-f222cbba7676/prometheus-operator-admission-webhook/0.log"
Sep 07 17:33:15.970552 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:15.970529    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6d655bf9cf-gh59t_18b09bfe-8ae6-4937-91d6-9a4536d43330/telemeter-client/0.log"
Sep 07 17:33:15.993446 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:15.993422    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6d655bf9cf-gh59t_18b09bfe-8ae6-4937-91d6-9a4536d43330/reload/0.log"
Sep 07 17:33:16.022036 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:16.022011    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6d655bf9cf-gh59t_18b09bfe-8ae6-4937-91d6-9a4536d43330/kube-rbac-proxy/0.log"
Sep 07 17:33:16.064303 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:16.064278    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-97975b55c-p8s7b_15fb9da0-89c7-459e-9c49-84110269cc31/thanos-query/0.log"
Sep 07 17:33:16.089314 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:16.089291    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-97975b55c-p8s7b_15fb9da0-89c7-459e-9c49-84110269cc31/kube-rbac-proxy-web/0.log"
Sep 07 17:33:16.118194 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:16.118171    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-97975b55c-p8s7b_15fb9da0-89c7-459e-9c49-84110269cc31/kube-rbac-proxy/0.log"
Sep 07 17:33:16.141825 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:16.141802    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-97975b55c-p8s7b_15fb9da0-89c7-459e-9c49-84110269cc31/prom-label-proxy/0.log"
Sep 07 17:33:16.163689 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:16.163626    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-97975b55c-p8s7b_15fb9da0-89c7-459e-9c49-84110269cc31/kube-rbac-proxy-rules/0.log"
Sep 07 17:33:16.188962 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:16.188929    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-97975b55c-p8s7b_15fb9da0-89c7-459e-9c49-84110269cc31/kube-rbac-proxy-metrics/0.log"
Sep 07 17:33:17.284868 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:17.284831    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-brnxc/perf-node-gather-daemonset-rf74b"]
Sep 07 17:33:17.288602 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:17.288579    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-rf74b"
Sep 07 17:33:17.291360 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:17.291339    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-brnxc\"/\"kube-root-ca.crt\""
Sep 07 17:33:17.291476 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:17.291387    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-brnxc\"/\"openshift-service-ca.crt\""
Sep 07 17:33:17.292511 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:17.292496    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-brnxc\"/\"default-dockercfg-6bd8x\""
Sep 07 17:33:17.299667 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:17.299647    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-brnxc/perf-node-gather-daemonset-rf74b"]
Sep 07 17:33:17.435925 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:17.435875    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d861b79-904c-4fa3-8c31-02dbc39c57cb-lib-modules\") pod \"perf-node-gather-daemonset-rf74b\" (UID: \"8d861b79-904c-4fa3-8c31-02dbc39c57cb\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-rf74b"
Sep 07 17:33:17.436107 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:17.435946    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d861b79-904c-4fa3-8c31-02dbc39c57cb-sys\") pod \"perf-node-gather-daemonset-rf74b\" (UID: \"8d861b79-904c-4fa3-8c31-02dbc39c57cb\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-rf74b"
Sep 07 17:33:17.436107 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:17.436041    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jnhs\" (UniqueName: \"kubernetes.io/projected/8d861b79-904c-4fa3-8c31-02dbc39c57cb-kube-api-access-4jnhs\") pod \"perf-node-gather-daemonset-rf74b\" (UID: \"8d861b79-904c-4fa3-8c31-02dbc39c57cb\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-rf74b"
Sep 07 17:33:17.436107 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:17.436081    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8d861b79-904c-4fa3-8c31-02dbc39c57cb-proc\") pod \"perf-node-gather-daemonset-rf74b\" (UID: \"8d861b79-904c-4fa3-8c31-02dbc39c57cb\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-rf74b"
Sep 07 17:33:17.436107 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:17.436098    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8d861b79-904c-4fa3-8c31-02dbc39c57cb-podres\") pod \"perf-node-gather-daemonset-rf74b\" (UID: \"8d861b79-904c-4fa3-8c31-02dbc39c57cb\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-rf74b"
Sep 07 17:33:17.537364 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:17.537272    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d861b79-904c-4fa3-8c31-02dbc39c57cb-lib-modules\") pod \"perf-node-gather-daemonset-rf74b\" (UID: \"8d861b79-904c-4fa3-8c31-02dbc39c57cb\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-rf74b"
Sep 07 17:33:17.537364 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:17.537324    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d861b79-904c-4fa3-8c31-02dbc39c57cb-sys\") pod \"perf-node-gather-daemonset-rf74b\" (UID: \"8d861b79-904c-4fa3-8c31-02dbc39c57cb\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-rf74b"
Sep 07 17:33:17.537611 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:17.537409    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jnhs\" (UniqueName: \"kubernetes.io/projected/8d861b79-904c-4fa3-8c31-02dbc39c57cb-kube-api-access-4jnhs\") pod \"perf-node-gather-daemonset-rf74b\" (UID: \"8d861b79-904c-4fa3-8c31-02dbc39c57cb\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-rf74b"
Sep 07 17:33:17.537611 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:17.537459    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8d861b79-904c-4fa3-8c31-02dbc39c57cb-proc\") pod \"perf-node-gather-daemonset-rf74b\" (UID: \"8d861b79-904c-4fa3-8c31-02dbc39c57cb\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-rf74b"
Sep 07 17:33:17.537611 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:17.537466    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d861b79-904c-4fa3-8c31-02dbc39c57cb-sys\") pod \"perf-node-gather-daemonset-rf74b\" (UID: \"8d861b79-904c-4fa3-8c31-02dbc39c57cb\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-rf74b"
Sep 07 17:33:17.537611 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:17.537483    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8d861b79-904c-4fa3-8c31-02dbc39c57cb-podres\") pod \"perf-node-gather-daemonset-rf74b\" (UID: \"8d861b79-904c-4fa3-8c31-02dbc39c57cb\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-rf74b"
Sep 07 17:33:17.537611 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:17.537482    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d861b79-904c-4fa3-8c31-02dbc39c57cb-lib-modules\") pod \"perf-node-gather-daemonset-rf74b\" (UID: \"8d861b79-904c-4fa3-8c31-02dbc39c57cb\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-rf74b"
Sep 07 17:33:17.537611 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:17.537569    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8d861b79-904c-4fa3-8c31-02dbc39c57cb-proc\") pod \"perf-node-gather-daemonset-rf74b\" (UID: \"8d861b79-904c-4fa3-8c31-02dbc39c57cb\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-rf74b"
Sep 07 17:33:17.537819 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:17.537615    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8d861b79-904c-4fa3-8c31-02dbc39c57cb-podres\") pod \"perf-node-gather-daemonset-rf74b\" (UID: \"8d861b79-904c-4fa3-8c31-02dbc39c57cb\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-rf74b"
Sep 07 17:33:17.548239 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:17.548211    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jnhs\" (UniqueName: \"kubernetes.io/projected/8d861b79-904c-4fa3-8c31-02dbc39c57cb-kube-api-access-4jnhs\") pod \"perf-node-gather-daemonset-rf74b\" (UID: \"8d861b79-904c-4fa3-8c31-02dbc39c57cb\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-rf74b"
Sep 07 17:33:17.599287 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:17.599260    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-rf74b"
Sep 07 17:33:17.882197 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:17.882164    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-brnxc/perf-node-gather-daemonset-rf74b"]
Sep 07 17:33:17.882621 ip-10-0-136-3 kubenswrapper[2575]: W0907 17:33:17.882594    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8d861b79_904c_4fa3_8c31_02dbc39c57cb.slice/crio-fe15f9c85dd8315a56d5097e1a61e8c2b5c18e97fd86304e8b9555246f2b6ca2 WatchSource:0}: Error finding container fe15f9c85dd8315a56d5097e1a61e8c2b5c18e97fd86304e8b9555246f2b6ca2: Status 404 returned error can't find the container with id fe15f9c85dd8315a56d5097e1a61e8c2b5c18e97fd86304e8b9555246f2b6ca2
Sep 07 17:33:18.533170 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:18.533134    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-rf74b" event={"ID":"8d861b79-904c-4fa3-8c31-02dbc39c57cb","Type":"ContainerStarted","Data":"940c63d366ac7aa125c85efd150e837370f33f4dbf93aff209eeafae7a8ab800"}
Sep 07 17:33:18.533669 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:18.533224    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-rf74b" event={"ID":"8d861b79-904c-4fa3-8c31-02dbc39c57cb","Type":"ContainerStarted","Data":"fe15f9c85dd8315a56d5097e1a61e8c2b5c18e97fd86304e8b9555246f2b6ca2"}
Sep 07 17:33:18.533669 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:18.533273    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-rf74b"
Sep 07 17:33:18.552811 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:18.552763    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-rf74b" podStartSLOduration=1.552749895 podStartE2EDuration="1.552749895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 17:33:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:33:18.551314373 +0000 UTC m=+2192.448161687" watchObservedRunningTime="2026-09-07 17:33:18.552749895 +0000 UTC m=+2192.449597210"
Sep 07 17:33:18.616235 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:18.616199    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-759b7bd587-sq6cf_380bc4a5-4a82-4ea4-94c4-14314c8f06ef/console/0.log"
Sep 07 17:33:18.653814 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:18.653784    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-2jwgt_22fa9fc6-fec4-4134-8bfe-e3550ce544e4/download-server/0.log"
Sep 07 17:33:20.444169 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:20.444143    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g6dvf_529d1b0f-2d6d-440e-8e89-6c6cd5c0178c/dns/0.log"
Sep 07 17:33:20.469852 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:20.469829    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g6dvf_529d1b0f-2d6d-440e-8e89-6c6cd5c0178c/kube-rbac-proxy/0.log"
Sep 07 17:33:20.572641 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:20.572614    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dpb4t_490233b3-f4ff-4a5c-818b-6f1f6069f818/dns-node-resolver/0.log"
Sep 07 17:33:21.167711 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:21.167683    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8ljh2_c5e9c92f-1d92-4194-a20a-59963361fc54/node-ca/0.log"
Sep 07 17:33:22.522980 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:22.522951    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b977b55fb-krqn2_db0b8389-c068-4235-887d-a190f72b93eb/kube-auth-proxy/0.log"
Sep 07 17:33:22.633843 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:22.633807    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-kr5xx_782e4901-4c16-448e-87b9-b5de59e6e152/payload-pre-processing/0.log"
Sep 07 17:33:23.640536 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:23.640508    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-shggg_0fc4edc2-3945-42e0-90f7-87b0688f7e6f/serve-healthcheck-canary/0.log"
Sep 07 17:33:24.244593 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:24.244563    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w6xqw_1a345a05-e4aa-4e97-b085-b5c333e2e731/kube-rbac-proxy/0.log"
Sep 07 17:33:24.267800 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:24.267770    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w6xqw_1a345a05-e4aa-4e97-b085-b5c333e2e731/exporter/0.log"
Sep 07 17:33:24.291166 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:24.291137    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w6xqw_1a345a05-e4aa-4e97-b085-b5c333e2e731/extractor/0.log"
Sep 07 17:33:24.548100 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:24.548075    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-rf74b"
Sep 07 17:33:27.074585 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:27.074554    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f6f7795c7-49td6_e1a5075b-6756-47de-b470-1e12271e53da/manager/0.log"
Sep 07 17:33:27.095362 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:27.095338    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f6f7795c7-49td6_e1a5075b-6756-47de-b470-1e12271e53da/copy-manifests/0.log"
Sep 07 17:33:28.403885 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:28.403807    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b977b55fb-krqn2_db0b8389-c068-4235-887d-a190f72b93eb/kube-auth-proxy/0.log"
Sep 07 17:33:28.482126 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:28.482081    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-kr5xx_782e4901-4c16-448e-87b9-b5de59e6e152/payload-pre-processing/0.log"
Sep 07 17:33:28.761546 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:28.761464    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-74c754dcfc-tt9k5_f13be0ff-dc07-40f1-87a6-2f17dffc4ed9/manager/0.log"
Sep 07 17:33:30.320143 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:30.320114    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b977b55fb-krqn2_db0b8389-c068-4235-887d-a190f72b93eb/kube-auth-proxy/0.log"
Sep 07 17:33:30.435255 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:30.435155    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-kr5xx_782e4901-4c16-448e-87b9-b5de59e6e152/payload-pre-processing/0.log"
Sep 07 17:33:35.865872 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:35.865841    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dsqc5_9cfc15e5-2d9e-4cae-8db0-90217597de62/kube-multus-additional-cni-plugins/0.log"
Sep 07 17:33:35.891064 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:35.891037    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dsqc5_9cfc15e5-2d9e-4cae-8db0-90217597de62/egress-router-binary-copy/0.log"
Sep 07 17:33:35.918745 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:35.918721    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dsqc5_9cfc15e5-2d9e-4cae-8db0-90217597de62/cni-plugins/0.log"
Sep 07 17:33:35.941413 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:35.941390    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dsqc5_9cfc15e5-2d9e-4cae-8db0-90217597de62/bond-cni-plugin/0.log"
Sep 07 17:33:35.965754 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:35.965722    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dsqc5_9cfc15e5-2d9e-4cae-8db0-90217597de62/routeoverride-cni/0.log"
Sep 07 17:33:35.989402 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:35.989377    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dsqc5_9cfc15e5-2d9e-4cae-8db0-90217597de62/whereabouts-cni-bincopy/0.log"
Sep 07 17:33:36.010409 ip-10-0-136-3 kubenswrapper[2575]: I0907 17:33:36.010383    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dsqc5_9cfc15e5-2d9e-4cae-8db0-90217597de62/whereabouts-cni/0.log"